Email or username:

Password:

Forgot your password?
Top-level
Siderea, Sibylla Bostoniensis

@liztai

I am a techie, and a writer, and a robots.txt does not prevent rss. I have a robots.txt on my blog and it has perfectly working rss.

What a robots.txt does do, though, is exclude your site from Google Search.

What I don't know, because that article made no sense and I haven't investigated further, is whether this change in policy at Google means they are no longer respecting robot.txts. I have no idea why their privacy policy would have anything to do with that issue, as their privpol is for their users and definitionally people with robots.txts are declining to be their users.

@SeaFury

1 comment
Elizabeth Tai | 戴秀铃 🇲🇾

@siderea @SeaFury Yeah that's the problem - a lot of people are wondering if they'll just ignore the robots.txt

Go Up