Email or username:

Password:

Forgot your password?
All posts Simon's posts Post Back to profile
Simon Elvery

Your regular reminder that #MachineLearning models (or #AI, if you insist on ignoring the meaning of 'intelligence') will repeat and reinforce any #bias that already exists in society.
10 Dec 2022 at 22:28 | Open on bne.social
15 comments
Simon Elvery

Can you find any other biases like this in #GoogleTranslate?

10 Dec 2022 at 22:34 | Open on bne.social
Chris Lienert

@simon I did some research into language biases for a talk and it can get insanely complicated or… not

10 Dec 2022 at 22:47 | Open on mastodon.social
Simon Elvery

@cliener Yeah, I'm sure it's very complicated. This looks like a pretty clear case of the model just repeating a bias from the training data though.

10 Dec 2022 at 22:48 | Open on bne.social
Chris Lienert

@simon in this case definitely. “You’re wearing your bias on your sleeve”

10 Dec 2022 at 22:50 | Open on mastodon.social
Elias Mårtenson

@simon It's unsurprising, but still depressing.

11 Dec 2022 at 10:22 | Open on functional.cafe
forteller
Midnight Starr

@simon That’s the same with the ATS systems that each business has in hiring people. I just talked to a Career Coach about it and he calls that software being lazy. You can't hire someone because the words on a resume matches yours. And that software does discriminate against women and minorities because of some keywords.

10 Dec 2022 at 22:51 | Open on witches.live
Simon Elvery

@goddessvault Hiring software is one place personal harms from algorithmic decision making can be most readily demonstrated. If I were running a recruitment company I'd be very nervous about using software that might lead to inadvertent proxy discrimination against protected categories.

(p.s. if you know about a specific instance of this happening my DMs are open)

10 Dec 2022 at 23:05 | Open on bne.social
Midnight Starr

@simon I did Google ATS and discrimination, and Amazon popped up. And reading further into it, their back to the drawing board figuring it out how to usebit without it discriminating again certain groups.

10 Dec 2022 at 23:44 | Open on witches.live
Ketil Froyn

@simon tried the same in Norwegian, and added one. Can confirm some bias.
10 Dec 2022 at 23:04 | Open on mas.to
Ketil Froyn
Ketil Froyn

@simon Interesting. Things get difficult for Google translate when it has multiple opposing sexist biases in a single sentence.

"kjæreste" is gender neutral, meaning girlfriend or boyfriend.
"hjemmeværende" is gender neutral, meaning staying at home.
(There's no mention of kids in the original sentence.)
The translation flips from girlfriend to boyfriend when writing "politi" (police).
11 Dec 2022 at 10:22 | Open on mas.to
Kaonashi Eli

@simon wow. That's crazy. Could it be that they interchanged "boyfriend" and "girlfriend" just to make it interesting and by chance it came out that way?

11 Dec 2022 at 10:43 | Open on universeodon.com
Nikke Lindqvist

@simon But also: Google's grasp of Danish, is in my experience, really low. What there is, seems to be inherited from the various Swedish language projects.

11 Dec 2022 at 10:47 | Open on seo.chat
aciimoruj
Go Up