Email or username:

Password:

Forgot your password?
Paris Marx

When we warn the real threat of AI is how it’s used against people in the present, not the fantasies that some day computers might think for themselves, this is exactly the kind of thing we’re talking about: health insurers using AI to deny care.

arstechnica.com/health/2023/11

#tech #ai #health #healthcare

UnitedHealth uses AI model with 90% error rate to deny care, lawsuit alleges
For the largest health insurer in the US, AI's error rate is like a feature, not a bug.
84 comments
Samhain Night 4 Harris

@parismarx Funny how the errors aren’t in the customer’s favor…

anubis2814
@parismarx "Bank error in your favor" One of the greatest lies the game of monopoly ever told me.
Jeff ♨️ Darcy

@parismarx From a business perspective, the biggest thing about LLMs is not what they can actually do but how they can wash away responsibility. That's a *huge* deal to the rentier class, and "AI" proponents are well aware of it.

Jargoggles

@Obdurodon @parismarx
Companies have been pretending like nobody is personally responsible for shitty behavior for a long time by saying "it's just policy." However, people have always known that, at some level, people wrote those policies.

Much more recently, it's gotten worse when they can say "it's just the algorithm." Sure, people wrote the algorithms, but they're much more arcane than a written document.

LLMs are going to escalate this even further.

@Obdurodon @parismarx
Companies have been pretending like nobody is personally responsible for shitty behavior for a long time by saying "it's just policy." However, people have always known that, at some level, people wrote those policies.

Much more recently, it's gotten worse when they can say "it's just the algorithm." Sure, people wrote the algorithms, but they're much more arcane than a written document.

alex ₍^. ̫.^₎ฅ⋆˚✿˖°

@jargoggles @Obdurodon @parismarx this this this.

AI will be yet another scapegoat for companies to continue to make worse and worse decisions. there is ALWAYS someone behind the machine, enacting the decisions and/or allowing the AI's rulings to be honored. therefore, it is still ultimately a decision made by humans. sickening that our most powerful technology to date is already being used to continually reinforce rotten power structures and systems...

Doug Grinbergs

@parismarx re: slimy #UnitedHealth automated AI healthcare denials, people need to know that #MedicareAdvantage <> #Medicare! #MedicareDisadvantage

P.S. Mastodon should have quote toots

Julian Invictus

@parismarx it's like corporations are bad and every tool they use is used in the worst way possibly because they're inherently corrupt.

San Wu

@parismarx Correct. Skynet is never going to happen. But humans using AI nefariously against each other, that's the threat.

anubis2814
@sanwu @parismarx Pay no attention to the soulless entity behind the techno gibberish curtain.
Shonin

@parismarx And that is the insurer I'm stuck with, for reasons.

Securopean

@parismarx The EU is putting together some good legislation on this in the AI Act - along the lines of GDPR, so you can't be subject to arbitrary automated decision making.

Bill Lamb

@parismarx

Stay with regular Medicare. AVOID health insurance companies whenever possible.

Zilla

@parismarx solution, don't give them your money in the first place.

DELETED

@parismarx I know, it's a nightmare. Me and my coworkers spend half of our time battling insurance companies.

The Tired Horizon

@parismarx both are still risks, just one is years off and the other starting to happen now.

Acausal Robot God

@parismarx I was assured that the only issue with AI was that it would simulate copies of people and torture them for not working sufficiently hard to bring the AI into being.

Maddie (NEW! FUNKY MODE!) :verifiedtrans:
@AcausalRobotGod @parismarx somehow reality has managed to be even more fucked up than fiction yet again
The Gray Witch

@parismarx Request the reason and signature from the doctor advising the insurer deny care.

Shane Kerr

@gray_witch @parismarx From the fine article:

"His family appealed the denial, twice, overturning it on the second appeal after NaviHealth doctors reviewed Tetzloff's medical records. But, after 40 days at the skilled nursing home, UnitedHealth denied coverage again and refused to provide a reason. The family continued trying to appeal the denial, but were unsuccessful."

So you can ask for whatever documentation you want, but that doesn't mean that you will get it.

The Gray Witch

@shane_kerr @parismarx A doctor's signature on the denial gives much greater grounds for a lawsuit later on malpractice.

Shane Kerr

@gray_witch @parismarx I have no idea about the legal implications, so you are probably correct about those. But according to the article the insurance company did not provide any justification for denying the claim. Presumably they were asked.

I find it shocking that this would even be possible, but the article seems credible, and health care in the USA is crazy, so I am inclined to believe it.

Nicole Parsons

@parismarx

Worry more about AI becoming part of business models of funded malign influence campaigns
Like the GOP lies that let 1.18 million Americans die of preventable disease
theatlantic.com/health/archive
Imagine if Texas's Dan Patrick's donors had been able to buy an AI-assisted covid disinfo campaign, instead of relying on Fox News?
It wouldn't have just been granny targeted for callous & neglectful social murder. It would have been POC, non-Christians, & immigrants too
vanityfair.com/news/2020/03/da

@parismarx

Worry more about AI becoming part of business models of funded malign influence campaigns
Like the GOP lies that let 1.18 million Americans die of preventable disease
theatlantic.com/health/archive
Imagine if Texas's Dan Patrick's donors had been able to buy an AI-assisted covid disinfo campaign, instead of relying on Fox News?
It wouldn't have just been granny targeted for callous & neglectful social murder. It would...

Squiggle
@Npars01 @parismarx We are looking at Augmented Idiocy.

The failing public education leaves is building. At least here in Australia basic literacy, numeracy and critical thinking is on the decline.
Jim Vernon

@parismarx That's more like just plain fraud than it is "AI".

OpenDNA⚙️

@jimvernon @parismarx Fraud is what UnitedHealthcare does best.

Not even clever, sophisticated fraud either. They'll just take your money every month and then tell your doctor that they've never heard of you.

RanaldClouston

@parismarx i feel like we could have seen this exact headline 10 years ago, but it would have said 'algorithm' rather than 'AI model', probably to describe the exact same software

Paul 💙

@parismarx AI decisions aren't really decisions ..they are averaged guesses weighted in the companies favour.

Ben Harris-Roxas

@parismarx Thanks for the link.

I know you're very familiar with it, but I think everyone in your replies with "capitalism is to blame" or "what about misinformation" comments needs to study the Robodebt case in some detail.


@parismarx but they don't need AI for that. It's just something to hide behind, to pretend that denying care isn't simply their profitability model.

Shane Kerr

@Qbitzerre @parismarx You are correct, although in the case of AI normally we see not being able to explain results as a problem. But for scammy insurance companies, it is a feature.

Antiroo 🔞

@parismarx well the company was going to do the same. Soon they will have AI that tries to guilt trip you into going to work when you are sick, AI that fires you for being queer and AI that drops bombs on villages

Rye

@parismarx Imagine if they used it to optimize and streamline appointments, care, and employees were facilitating access. It's like we're so close to getting it right but a few people in suits say that we have to do it their way.

Inkican

@parismarx "We don't need to pay - we just need to prove legally why we aren't required to pay."

Frances Larina

@parismarx

It doesn't matter how accurate it is, so long as it gives the answer that's more profitable. And because it's a black box to everyone who doesn't understand AI, it's a very useful tool for profiting.

Lothus Marque

@parismarx I hesitate to call this stuff "AI" but algorithmic denials have been an issue for a while. In particular I remember reading something a while back that one (about drug seeking, IIRC SAID it was "for advisory use only" or something like that, but people were taking this potential flag and running with it as if it was gospel... unfortunately I think part of it has to do with liability. "This says there's a chance, so if I disregard this, I could be liable" ...which is shitty as hell.

Sabella

@parismarx now I have two things I hate: people calling it AI, and people using machine learning to make life all the more hellish.

Maria

@parismarx I'm surprised AI is being used for serious cases already when we still lack understanding of many things about it. Assuming this is by design is highly disturbing also.
At the same time, I wonder what is the error rate for handling such cases by a human being.

Abbie 🏳️‍⚧️

@parismarx @gwynnion

My old insurer has a human setup to deny you care 100% of the time.

Alkaris 🏳️‍⚧️ :verified:

@parismarx Obviously these companies are using AI for nefarious reasons, but this doesn't inherently mean all AI is bad. What we have here is a bad actor abusing AI with a model that's been specifically designed to be biased and deny any and all claims, all to penny pinch those who signed up to their insurance policy and to avoid having to pay out any claims to their clients. It's just fraud.

Sunday_lunar

@parismarx that is in the nature of health insurers. They will misuse any tool in the book to deny people their rightful payments. Nothing has changed.

Thibault Molleman🇧🇪 🌈🐝

@parismarx tbf.... United healthcare was already denying a shit ton of claims without AI. That's a horrible company

Token Sane Person

@parismarx This was almost certainly not "AI" in any real sense. The company is just using the word as a barrier to stop people asking questions. What data was this model based on? Who decided the rules it should follow?

My guess is it was a simple linear regression based on previous insurance decisions, which of course are not biased in any way at all.

Philip C James

@parismarx

You mean that in 9 out of 10 cases the UnitedHealth AI awards funding the patient doesn't actually merit?

...

Thought not.

Chris Laprun

@parismarx @elecharny to be fair, though, they don’t really need AI to deny claims, though, perhaps they think using an algorithm somehow absolves them?

Anisse

@parismarx @ljs AI isn't the issue here. Having a for-profit medical insurer is. Using the worst tool for the job that increases profits is only a byproduct of that.

Lorenzo Stoakes
@Aissen @parismarx you can have more than one problem at once. 'AI' is absolutely a problem, this is hardly the only example.
Voron

@parismarx if corporations are people this is basically theft and probably some bodily harm in there, why isn’t this corporation in jail, you know since it’s a person

DELETED

@parismarx
I wish it wasn't called AI, there's nothing intelligent about it.

arnicas

@parismarx but ML models have already been doing this for years.

Veranderwens

@parismarx
Wat #Rutte, #Kamp en trawanten deden/doen met #algoritmes, doen ze nu met #AI ook.

Weet wat je kiest

#verkiezingen2023

TAI

@parismarx looking at some of these responses, people are buying the flawed excuse right out of the gate. Any excuse to deny is the intent, in the design. How about AI being used to successfully prosecute the PEOPLE implementing this. What is wrong with us!!! to accept this for a minute, pay for a service you'll never get. This is more than never getting a meal you paid for or cable that never works. The consequences of this embezzlement are lethal for some; others suffer afflictions with no

MugsysRapSheet 🔩🐑🐘

@parismarx
"Health" Insurance companies use an AI model with 90% error rate to deny care.

Meanwhile, the big insurance companies are running an ad on TV featuring @BernieSanders fearmongering over a "government takeover of your healthcare!"

I WISH the gov't would take over my healthcare! washingtonexaminer.com/news/se

Huntn00

@parismarx Bad vibes for UHC. AI, such promise, such danger. 🤨

Michal Bryxí 🌱

@parismarx While 100% fcked up, I would think that the crux of the message here should be that in 2023 it's still possible to deny needed healthcare.

Cappy Ishihara

@parismarx I think the 10% rate is enough for them. saves money

All masks must fall [Imani/Dax]

@parismarx to the insurance company the errors are a feature not a bug.

l'empathie mécanique

@parismarx The problem with the “fantasies” is that when their feasibility will become evident to a non-specialist it would be waaaaaay too late to do anything.

Meanwhile, enjoy fighting your corporate overlords. There’s no real need to dunk on other people working on other problems.

ClaraBlackInk

@parismarx I think anyone who thinks AI will ever be used for good has never worked retail and had their schedule dictated by a computer system forcing them to clopen regularly but still giving them not quite enough hours to qualify for insurance.

Brian

@parismarx “our policy is for human oversight on AI decisions. Our training clearly states that it is the reviewer’s responsibility to validate the #ai findings. We have taken corrective action against the delinquent employees and added a new training program.” -company responding to these criticisms that expects same employees to review 1000s of cases a day.

Hojjat :ferris:

@parismarx 90% error rate? That doesn't make sense. Did they forget to add a "!" before the last boolean?

Ercan Erdem Ardal

@parismarx

That's why people need free government public service
For basic human health care which covers everybody.

There is no need to deal with technology / #Ai details where the main structure is obsolete.
if there is budgeting problem government can hire me as a consultant i will show them where to get it 🤐😉
Private insurance should be for jewelry etc. 😀
#HealhtCare

TAI

@parismarx Now look at the "error rate" for congress members need treatment. Do you think it's 90%? Not coincidence or happen stance they get better than us

Louis Ingenthron

@parismarx This doesn't even make sense. It's just bound to make the lawyers rich.

John (he/him) :vbike:

@parismarx 😮‍💨 Here we go again. This just sucks.

JennH

@parismarx wow. That is insane. Corporate greed plummeting health is terrible.

Reggie Huizinga :35mmil1:

@parismarx Healthcare is a free market but people can't opt out of it or they will literally die.

sxpert
@parismarx solution: get rid of the privatized healthcare insurance industry...
Steven Pigeon

@parismarx Strange problems that don't happen when there's Universal Health Care.

Griz, Some Guy on Mastodon

@parismarx Now we'll have to find new jobs for all those folks on the Death Panels...

Go Up