Gregory's Server@iamdtms @nixCraft @chriscoyier @beep
Here's a maintained and updated robots.txt from the author of that blog:
https://github.com/ai-robots-txt/ai.robots.txt/blob/main/robots.txt
|
Top-level
@iamdtms @nixCraft @chriscoyier @beep Here's a maintained and updated robots.txt from the author of that blog: https://github.com/ai-robots-txt/ai.robots.txt/blob/main/robots.txt 1 comment
|
@pixelriot @iamdtms @nixCraft @chriscoyier @beep If I were an AI company I would never use any user agent in this list.