@neil honestly, Fedi isn't built for E2EE and that's fine. "do one thing and do it well" has some truth, and here it is very true.
Fedi DMs are for subtle nudges, for things that may be unlisted posts but you don't want to spam people, stuff like that. if you don't want people to read your messages, move to an actual messaging service.