@darius This is why I never follow hashtags in my Home feed and just pin them as a separate column in the Mastodon interface instead. Easy browsing, no confusion.
Though I have accidentally followed tags a few times by pressing on the + icon (since removed in 4.2) next to the column settings button.