Email or username:

Password:

Forgot your password?
Top-level
Natanael ⚠️

@berkes @i0null If the computer misbehaves you can't punish it. And most of the time it misbehaves because somebody designed a component (or many) wrong.

Therefore you shouldn't rely on the computer to make decisions that can't be reversed or appealed by humans, because there needs to be a human higher in the hierarchy than the computer who can fix things.

7 comments
Bèr Kessels 🐝 🚐 🏄 🌱

@Natanael_L @i0null seriously: why can you not "punish the computer"?

We can punish a car manufacturer when they forgot to put in brakes. We can punish an app developer when their app is harming us. We can punish a cloud provider when they leak data. And so on.

I feel it's far more involved than you state. What if I don't use "a computer" but instead a lambda on AWS? It would make sense the software developer is responsible when it makes a Wong decision?

Natanael ⚠️

@berkes @i0null you have the whole chain from collecting requirements to implementation to the operator of the system, the responsibility lies with whoever has contributed to the misbehavior (or opted not to fix it).

Whoever made the decision that software or hardware which they should have known wasn't ready should be put into production.

Bèr Kessels 🐝 🚐 🏄 🌱

@Natanael_L @i0null In that case "the computer" being a system, can be held responsible, no?

Natanael ⚠️

@berkes @i0null what will you do to hold it responsible? Yell at it? Power it down? Reprogram it?

And who will do so? And if you look closer, isn't whoever human that will enact this the actual person responsible for the machine's operation as they can override it?

mystixa 🎶🎧

@berkes @Natanael_L @i0null One can't 'punish a car manufacturer'.. one can add to the expense of manufacturing but that is just another of many that businesses deal with in every transaction.

llywrch

@Natanael_L @berkes @i0null Only humans higher in the hierarchy refuse to oversee the decisions algorithms make.

See almost any ban appeal in social media. Or complaint about bank handling charges.

Bèr Kessels 🐝 🚐 🏄 🌱

@llywrch @Natanael_L @i0null Certainly. But a counterexample were software developers and managers that went to jail in the VW scandal. So there is accountability for those writing software. Not much and not always. But not "never" either.

Go Up