Good crawlers identify themselves, like on https://fedidb.org/crawler.html

Recently someone reported an issue with submitting their instance and after some investigation it was determined they or their hosting provider is blocking our user agent.

After I wrap up a few things, I will jump back to FediDB and add robots.txt support for easier exclusion.