I spent an entire week on this shit initially, and created this slow and terrible library that probably isn't secure: https://gitlab.com/soapbox-pub/seeded-rsa

Doing it the easy way instead takes 1 hour and you don't have to deal with any of this shit. I wish I had thought of it before.