@baldur "A University of Michigan researcher conducting...

@baldur
"A University of Michigan researcher conducting a study of public meetings, for example, said he found hallucinations in 8 out of every 10 audio transcriptions he inspected, before he started trying to improve the model."
That sentence has a link but it just points to https://umich.edu/ - not helpful AP

(Edit, btw I say AP because the website is ABC News but the authors are two journalists from the Associated Press)

Like 26 October at 13:43 | Wall-to-wall | Open on social.esmarconf.org

4 comments

Kate Nyhan

@baldur
"A recent study by computer scientists uncovered 187 hallucinations in more than 13,000 clear audio snippets they examined."
That is the academic library equivalent of the reference question "Please help me find a book I read once about goats with a blue cover."

26 October at 13:45 | Open on social.esmarconf.org

Kate Nyhan

@baldur
(Ok, *maybe* I could find news coverage or a full-text searchable article indexed somewhere that mentions 187 hallucinations. But come on, why does the reader have to go searching?)

26 October at 13:46 | Open on social.esmarconf.org

Kate Nyhan

@baldur
"Professors Allison Koenecke of Cornell University and Mona Sloane of the University of Virginia examined thousands of short snippets they obtained from TalkBank, a research repository hosted at Carnegie Mellon University." Again, the sentence has links, but they don't go to the study under discussion

26 October at 13:47 | Open on social.esmarconf.org

Kate Nyhan

@baldur
Most frustrating of all:
"This story was produced in partnership with the Pulitzer Center’s AI Accountability Network, which also partially supported the academic Whisper study."

WHICH ACADEMIC WHISPER STUDY?
YOU PAID FOR IT BUT YOU DON'T WANT ME TO READ IT?

26 October at 13:49 | Open on social.esmarconf.org