Gregory's Server|
2 comments
@darius thanks, interesting in a geeky way... TIL Using robots.txt to block the crawler can prevent it from reading this noindex tag paradoxically exposing it in search results ... Due to links? Somehow... |
|
2 comments
@darius thanks, interesting in a geeky way... TIL Using robots.txt to block the crawler can prevent it from reading this noindex tag paradoxically exposing it in search results ... Due to links? Somehow... |
@msokolov it is "noindex" https://developers.google.com/search/docs/crawling-indexing/block-indexing