@dingodog19 Logic puzzles as a test for what?
Apple already recently concluded (in a report that got some media coverage, at least in the tech/IT press) that LLMs *cannot* reason logically. Plenty of additional anecdotal examples illustrating that exist. There exist arguments for the same lack of logical reasoning capability which are based in how LLMs function. There should be little need to repeat that unless you have reason to believe that you'll get a significantly different result.
@mkj @eniko
Oh I agree with all that.
I am suggesting that because of that, they will never be able to do grocery store logic puzzles, which is a good indication to non-experts that AI is not all-knowing.
And if they *did* get good at them, it would be an indication that I should not carry on dismissing AI and should see what the heck was going on.