@berkes @i0null If the computer misbehaves you can't punish it. And most of the time it misbehaves because somebody designed a component (or many) wrong.
Therefore you shouldn't rely on the computer to make decisions that can't be reversed or appealed by humans, because there needs to be a human higher in the hierarchy than the computer who can fix things.
@Natanael_L @i0null seriously: why can you not "punish the computer"?
We can punish a car manufacturer when they forgot to put in brakes. We can punish an app developer when their app is harming us. We can punish a cloud provider when they leak data. And so on.
I feel it's far more involved than you state. What if I don't use "a computer" but instead a lambda on AWS? It would make sense the software developer is responsible when it makes a Wong decision?