|
Top-level
 AI chatbots don't lie on purpose. They're programmed to respond to any query, drawing on patterns of word association in their data (and search results, for Bing) to generate plausible answers. They have no idea if what they're saying is true. Yet they say it so definitively, even making up nonexistent but realistic-sounding sources when needed to back up their claims. @Katecrawford dubs these bogus sources "hallucitations." https://www.washingtonpost.com/technology/2023/04/05/chatgpt-lies/ 7 comments
I'm generally not that big on "hey look, I made the AI say something bad!" stories. It's programmed to please, so if you really want to make it say bad stuff, you probably can. But with tons of folks now using AI chatbots as research tools, it seems not great if they're freely mixing facts with equally plausible-sounding lies backed up by bogus citations. And if tech firms' solution to AI's Pinocchio problem is to plug their chatbots into the internet, look stuff up, and then confidently misinterpret what they find, this isn't going to be the last time we see a misinfo ourobouros in which one AI's false claim becomes another's documented fact. @willoremus I don’t disagree but will offer a little color. First, chat bots have no notion of truth. In fact, they have no notions at all. They need to work with other systems that are designed to at least represent knowledge. Second, because they’re complex and probabilistic, making these LLM chat bots work with systems that are designed for representing knowledge is hard. And third, a wide open text box is a particularly terrible UI for a system with these limitations.  @willoremus I think "Ourobouros" is a fine name for our chatbot overlord. Much friendlier than "Skynet," still scary enough to get DARPA funding, and allegorically correct. |
Gregory's Server
It isn't just one law professor. It appears ChatGPT routinely fills in the gaps with falsehoods when prompted to talk about specific individuals about whom it may have limited credible data. An Australian mayor is threatening to sue OpenAI with defamation after ChatGPT told a constituent he'd been imprisoned for bribery, and the rumor spread. https://arstechnica.com/tech-policy/2023/04/openai-may-be-sued-after-chatgpt-falsely-says-aussie-mayor-is-an-ex-con/