@eniko This hits the nail on the head IMO. Too many people think of LLMs as "limited artificial intelligence" (mostly due to marketing, including how everyone calls them "AI"), not enough think about them as "plausible text generators"... there *is* no internal state which reflects whether or not it "knows" a particular fact
@eniko See also: the scam artist who has been telling everyone that "full self driving" is one year away every year since 2016 but whose engineers hasn't been able to, and will never be able to, "iron out the kinks" which make fully autonomous vehicles death machines in everything but the most ideal conditions