@simon Hi Simon, I don't want AI using my site, and I block the user agents of many AI crawlers. Unfortunately, Jina
1. Does not acknowledge robots.txt
2. Uses a user-agent header designed to obscure its identity
3. Uses puppeteer with custom plugins to obscure itself.
This ain't it.