I think the best way to handle blogs and followers is to have your blog support RSS and ActivityPub so people on the Fediverse can easily follow it. And non-fedi followers can comment by making an account on your blog that's secretly also a fediverse account.
The only downside is that now you're not just hosting a blog but also a fediverse server.
It would surprise me if the system for this didn't already exist.