87 comments
@kkolakowski @devopscats People are going to be mocking copy-and-pasted 2023 LLM output for the next ten years. Itโs easy engagement numbers @jamiemccarthy Yeah I know, but I still don't like such things ๐ And in this case, I would even say it was faked ๐ @kkolakowski oh I donโt doubt it could be real, thatโs typical from last year I think Hereโs a current example ๐คฃ https://researchbuzz.masto.host/@danlyke/112447350575764027 @kkolakowski @jamiemccarthy A human corrected the model manually. It's literally the mechanical turk. @starkraving666 @devopscats i just tried it and got the same thing, but the guy and the goat ended up on opposite sides of the river? when i asked about it, it basically repeats itself and says you sure there's not a wolf or some cabbage? @devopscats@toot.cat tried that with google gemini, it somehow managed to clone a goat ("the man leaves the goat behind and crosses the river for the last time, reuniting with the goat") โ:neocat_laugh:โ @PocketEleri @devopscats I was just reading this thread to find this comment. thank you. @devopscats@toot.cat why does this solution sound like a videogame glitch setup that already involves using another glitch @devopscats Proof #467198245 that LLMs don't actually understand anything, they're just fancy phrase generators. @quantumg @devopscats What I mean is, they don't understand that there's a boat and a goat. It is not translated into concepts the way a human mind would. @quantumg @arina @devopscats this model is trained on more data than a human brain could ever possibly absorb within a human lifetime, and yet it still can't solve an incredibly simple logic puzzle. if your solution is to throw more data at the problem, which up to this point has clearly not worked, then you fundamentally misunderstand what this type of tool is useful for. @spinach @arina @devopscats I don't know why you feel the need to dunk, but I suspect it's because you've been trained to behave that way. I'd argue that the average human being experiences an Internet worth of data every few minutes. It's also in a social context which is constructed for us and evaluated by other people who are trained in the same context. @quantumg @arina @devopscats you can't really measure sensory inputs in terms of data. the brain discards most of its sensory input, and it's not something you can represent in terms of a digital signal because everything is analog. the important takeaway is, humans are infinitely better at parsing language than a language model ever will be, for a fraction of the energy cost. full stop. the power of the human mind is in its ability to discard irrelevant information. LLMs can't do that, period. @spinach @arina @devopscats I don't think anyone on Earth is qualified to make the statements you're making right now. @quantumg @arina @devopscats oh, so my argument is irrelevant because you haven't deemed me qualified? sorry Mr. Official Knowledge Certification Board. i know that truth and facts inconvenience you so. keep believing you can train the LLM out of its fundamental design issues and see how far it takes you. @spinach @arina @devopscats again. You're dunking. Why are you like this? No-one knows enough about these systems or the human brain to be as certain as your statements indicate. I would say the same thing if you were talking in absolutes about cosmology. We just don't know yet. The origin of the cabbage, as usual cheeky foxes involved... @devopscats At least it figured out there was no cabbage in the original question. @wcbdata @devopscats @xvf17 @devopscats @SRDas the real danger is people that believe these things can replace peopleโฆ @xvf17 @devopscats @SRDas It would be wonderful if they would stop being delusional liars. Even a child can solve this one correctly, but AI cannot? That's not a great advertisement for AI. The only AI I recognize is in ChAI. Adrak and Ilaichi. @devopscats Small variation: โA cabbage and a river have a goat. How can they go across?โ Steps 1 and 5 are the same, and steps 2 and 4 too. ๐ Using bing.com / Copilot. @devopscats OMG, look at this: โA man have a boat. How can they go across the cabbage?โ โThe scenario youโve described seems quite whimsical! ๐ฃโโ๏ธ Letโs explore a playful solution: [โฆ] Note: This whimsical story is purely fictional and meant for entertainment. Please do not attempt to sail on actual cabbages. ๐โ This is gorgeous-Hollywood-level! ๐ @devopscats And for those who wants to know what happens to Barnaby on the Sauerkraut Islandโฆ โNote: This fanciful story is purely fictional and meant for entertainment. Please do not attempt to sail on actual cabbages or visit imaginary pickle islands. ๐โ @meduz @devopscats You're all working on making each of these worse than the last, aren't you? ๐ณ ๐ @devopscats I predict that within five years ChatGPT will be able to drive a car fasterโ and more safelyโ than a human driver @AmyZenunim @devopscats Row, row, row the goat... ๐ต @AmyZenunim @devopscats I thought the version I heard, involving a man, a goat, a boat, and crops, was the worst. I see I was wrong. This is def the worst. @AmyZenunim @devopscats Now ask "following the directions above, would the man and goat be on the same side of the river?" Or maybe just "how did the goat get across the river?" @StarkRG @devopscats i'm not doing free labour for this abomination. it can wallow in its own filth @devopscats This is a relatively simple river crossing puzzle. Here's how the man and the goat can cross the river: The man takes the goat on the boat to the other side. (He can safely bring the goat with him). @devopscats Me and my UNO reverse card can't wait till all those corporate chatbots get upgraded with a vision model. @noodle @devopscats Of course, it doesn't tell us doodly-squat about how the man got across the river with the goat, but not the boat. This is, without a doubt, the stupidest response to the question that I've ever heard. @devopscats Did anyone ask the AI where the cabbage came from? I'd really love to hear one try to defend its insane answers. Could they be any better than my baby sister's, who, when asked, why are pumpkins, said so ladies can eat them and have a baby. @devopscats I should note that the only similarity between my river-crossing puzzle and the nine-dots puzzle is... [Spinning wheel icon appears, as solution processes.] ...they may be used to test the puzzle-solving capability of applicants in bullshit employment interviews. Apparently, there's a Mobius riverbank and a full self-driving boat, or something. @devopscats 3.5 responds like this for me too. 4 does not. For anyone wondering what the hell is going on: https://en.wikipedia.org/wiki/Wolf,_goat_and_cabbage_problem @devopscats @ckape And all I'm thinking is, "Wait, it never specified the boat is on the same side of the river..." I'm glad we have AI to think _around_ produce... I mean, problems. |
@devopscats thatโs beautiful