Agree.
I also think it's a downside of there not being an algorithm. (I'm here for the upside)
Some people like being absolutist. Some are exaggerating it to get engagement.
I've been getting very annoyed too especially when I want to read a cycling post and I get an anti fascist post in the same message.
I support your appeal to get people to tone it down from time to time and remind myself that I have to constantly refine filters based on other people's changes.