I started using Linux in 2005. I had a printed book back then. It covered readline, emacs and vi modes, so I was aware of these shortcuts and how to find them. But it wasn’t until few years ago that I made a conscious effort to list few that seemed most useful and try to use them every day. There are 5 or 6 that stuck in my muscle memory.
You are not alone.