@rcombs from my earlier post:

>

the problems this tries to solve is hard! unfortunately, some things simply should not be built, regardless of how much easier it makes things for Google

and consider this: Google maintains one of the world’s biggest web scrapers. because Google is dominant in search, people will allowlist the Google scraper attestation (if it exists) no matter what. guess what individual users won’t be able to do?