@kentborg Walking those data structures for every access is going to be slow whether it's done in hardware or software. Caching would have helped.
There's a detailed paper on why the 432 processor was so slow:
https://archive.org/details/432_complexity_paper/mode/2up
@kenshirriff Someone like TLBs are pretty necessary for performance.