@eniko Perhaps you'll appreciate this exchange I just had with ChatGPT on a whim. (I went there inspired by your post.)
https://chatgpt.com/share/67288b89-303c-8000-b714-e4a05125caff
It's a series of blind stabs in the dark, delivered with full confidence, but with no guidance from reality.
@karadoc And yet a regular Google search easily found this line. LLMs do not search for information.