Email or username:

Password:

Forgot your password?
Top-level
mcc

@tess As a minor quibble, I do want to suggest an alternate scenario (to an LLM getting the nuclear codes) which may be more likely: What if a contractor uses an LLM to fill in code they're writing on some random-ass military contract, and this code gets incorporated into the UI for the humans-with-the-nuclear-codes to launch nukes or the radar system those humans use to decide whether to launch, and the LLM introduces catastrophic bugs because it's a random number generator with a human accent

5 comments
mcc

@tess Like, I do think the probability*cost = for those OTHER things you mentioned is significantly *greater* than the "doomsday via incompetence" scenario I outline, but

Neia

@mcc@mastodon.social @tess@mastodon.social for people who are more swayed by major, low-probability disasters rather than small, frequent, high-probability disasters, like with plane vs car risk levels, yeah

Ryan Castellucci :nonbinary_flag:

@mcc @tess "random number generator with a human accent" is my new favorite term to describe LLMs

sabik

@mcc @tess
Like that time the system conflated information from three different aircraft and then they shot down a civilian airliner?

(Flight 655)

Paul Shryock

@mcc @tess this seems pretty much guaranteed to happen at some point with how often "engineers" would rather copy/paste slop than do engineering, and with how little "engineers" are willing to test their code (do actual engineering).

Go Up