Gregory's Server@atomicpoet
Keep in mind this is only a "suggestion" to the search engines and it is up to them to honor it or not. In general the more well known crawlers (google, msn, bing) will honor this, but others will index your content anyways
|
Top-level
3 comments
@nus @atomicpoet This is why I tend to just accept that whatever I post will likely be indexed, and to allow indexing. The info is out there, and discouraging it being indexed just seems futile |
@90sCraig @atomicpoet which is true for all publicly facing web pages.
In addition, worth remembering that other servers can do whatever the hell they want to with your publicly accessible content