Note that in this incoherent reporting of the "test" that was carried out, there is no description of what the experimental settings were. What was the input? What was the output? (And, as always, what was the training data?) 9/
"Research" in scare quotes, because OpenAI isn't bothering with peer review, just posting things on their website. For a longer take-down of the GPT-4 system card, see Episode 11 of Mystery AI Hype Theater 3000 (w/ @alex ). 10/
https://www.buzzsprout.com/2126417/13460873-episode-11-a-gpt-4-fanfiction-novella-april-7-2023
Back to the Reuters article. What's worse than reporting on non-peer-reviewed, poorly written, "research" papers posted to the web? Reporting on vague descriptions of a "discovery" attributed only unnamed sources. 11/
What's their evidence that there's a big breakthrough? Something that has "vast computing resources" can do grade-school level math. You know what else can do grade-school level math? A fucking calculator that can run on a tiny solar cell. Way more reliably, too, undoubtedly. 12/