Gregory's Server
@trigrax Capitalism.
Most of the problems people have with AI come not from AI itself, but from the system that employs it.
People talk about the AI misalignment problem without realizing that precisely this kind of misalignment didn't come from nowhere, it's there because we've already built the system with misaligned incentives, and it's been hard at work for over two centuries, maximizing profit at the expense of everything else - politics, ecology, education, you name it. We're already living inside the giant paperclip fucking maximizer. And it was not built yesterday.
This is the real problem, not the machine learning technology in and of itself.
@drq The real alignment problem — the one that doomers are talking about (any doomer worth their salt, at least) — is not “there” yet. It will arrive with a superintelligence, one that will not give a damn about profits or their beneficiaries, in about the same way as you don’t give a damn about foraging ants whose anthill you inadvertently tread on.