Time to go back to scraping the parts of the Web myself that matter to me, and using Xapian to roll my own search engine - https://xapian.org/
Rollin' like its the early 2000's again...
Local disk storage is cheaper now. CPU flex and bandwidth is waaay better too.