Gregory's ServerHopefully this gets through to at least the maths crowd about how utterly crap and lacking in awareness of basic facts AI/LLM is.
This isn't a fake screenshot, it really does give this as the answer.
|
9 comments
@moirearty @FediThing @nixCraft First, it’s just fun. This isn’t an academic paper. And ChatGPT is a product, it’s ok to dunk on products that were launched to the public in shitty form. This particular thing has been “fixed”in ChatGPT 4. The open question is, “What hasn’t been fixed, because it’s not popular enough for people to have discovered the error yet?”  @raganwald @moirearty @nixCraft So no, the commentary is not at all wrongheaded. The commentary is totally apt. ChatGPT literally does not know what it is talking about, and we need to stop treating it like it has any value beyond entertainment or niche studies of linguistics. @FediThing @raganwald @nixCraft I agree from one point of view on this, Generative AI should not be getting the insane funding and roll-out / shoved down everyone’s throat it is exactly because of what you’re saying. I’m not a proponent of this technology overall and think it’s a useful tool in limited circumstances alone, and that any march toward “AGI” using similar technology is absolutely a lie and they’re more or less hopping they figure something out. @FediThing @raganwald @nixCraft However, people also think a manual correction was made which I’m reasonably sure is not true. The tech, as oversold as it is, did get better. There are limited but useful reasoning capabilities, it is not just a “stochastic parrot” as the early versions absolutely were etc. IMO some technologists won’t keep up with this field because they wrote it off (for good reason) and am not arguing in favor of a business case, but we will be dealing with it for years. @FediThing @raganwald @nixCraft from a product standpoint I am in full agreement and think these companies should be rightly criticized. From a Computer Science point of view, I believe some of the smartest folks are falling into the trap of “the thing I looked at previously was horrible so I’ve written it of entirely” and will be dogmatic about it to the detriment of their own field. There is an area between “AGI” (which is bs until breakthroughs tbd) and where we are now that will be useful. @moirearty @FediThing @nixCraft Tons of useful applications for ANI today, just as Newton and Macintosh 128K had use cases. @moirearty @FediThing @nixCraft What we know is that there is a way to report errors, and they do use the error reports to guide workers who train the model. There is also the possibility that the model itself has improved in a way that corrects this error without needing humans to focus training on it. Either way, this seems like a product from a company that is asking the world to beta-test it in production, and simultaneously, it’s a product where we cannot have a “complete test suite.” |
@FediThing @nixCraft version? There are a lot of people using old / garbage versions of these LLMs for laughs.
Claude:
“The last 5 digits of pi are not known, as pi is an irrational number with an infinite number of non-repeating digits after the decimal point. Pi has been calculated to over 100 trillion digits, but there is no "end" to the sequence of digits. The idea of there being "last" digits of pi is a misconception.”
I’m not a strong AI proponent but the commentary is wrongheaded.