our new mastodon server is so we can use it for communications -- which personally I am just learning about.

I realize that is not answering your question about crawling, but this step for us is independent of crawling.

I am looking forward to learning the overall culture of mastodon'ers (?) (mastodon's? masters? tooters? ? 😀 )