Google Search Console: There is a problem with your site! This page <URL> got indexed even though it is blocked via robots.txt. Fix it!
How tf is this my problem?
Google Search Console: There is a problem with your site! This page <URL> got indexed even though it is blocked via robots.txt. Fix it! How tf is this my problem? 1 comment
|
From Google's documentation:
If you *do* want to block this page from Google Search, robots.txt is not the correct mechanism to avoid being indexed. To avoid being indexed, remove the robots.txt block and use `noindex`.
If you *do not* want to block this page, update your robots.txt file to unblock your page.
Ah yes, let's just ignore robots.txt altogether, good idea!