Email or username:

Password:

Forgot your password?
Emily M. Bender (she/her)'s posts Post Back to profile
Emily M. Bender (she/her)

Facebook (sorry: Meta) AI: Check out our "AI" that lets you access all of humanity's knowledge.

Also Facebook AI: Be careful though, it just makes shit up.

This isn't even "they were so busy asking if they could" --- but rather they failed to spend 5 minutes asking if they could.

#AL #ML #MathyMath #Bullshit #NLP #NLProc #AIhype

Screencap from https://galactica.org/ reading "Get Started Galactica is an AI trained on humanity's scientific knowledge. You can use it as a new interface to access and manipulate what we know about the universe."
Screencap from https://galactica.org/mission/ reading "Limitations You should be aware of the following limitations when using the model (including the demo on this website): Language Models can Hallucinate.There are no guarantees for truthful or reliable output from language models, even large ones trained on high-quality data like Galactica. NEVER FOLLOW ADVICE FROM A LANGUAGE MODEL WITHOUT VERIFICATION. Language Models are Frequency-Biased. Galactica is good for generating content about well-cited concepts, but does less well for less-cited concepts and ideas, where hallucination is more likely. Language Models are often Confident But Wrong. Some of Galactica's generated text may appear very authentic and highly-confident, but might be subtly wrong in important ways. This is particularly the case for highly technical content."
16 Nov 2022 at 21:01 | Open on dair-community.social
2 comments
Emily M. Bender (she/her)

Using a large language model as a search engine was a bad idea when it was proposed by a search company. It's still a bad idea now that it's being proposed by a social media company. Fortunately, Chirag Shah and I already wrote the paper laying out all the ways in which this is a bad idea.

dl.acm.org/doi/10.1145/3498366

#AL #ML #MathyMath #Bullshit #NLP #NLProc #AIhype

16 Nov 2022 at 21:04 | Open on dair-community.social
Go Up