@tofu @starsider And even training is kind of ok. According to this article GPT3 took 1287 MWh to train or the "annual driving emissions of 112 cars". One is a really helpful tool that can be used by millions, the other is Gary driving to wafflehouse. And to give a little bit of context: Those 500 tons are the CO2 emissions a single cruise ship is spilling out every 2 days. So not great, would be great to train on clean energy, but this critique here is not correct
https://centralnews.com.au/2024/05/10/ais-ridiculously-massive-carbon-footprint-just-how-big-is-it/
@mschfr @tofu @starsider None of this would even matter if we could just get our collective shit together as a society and make a big push for green(er) energy infrastructure. Who cares how much energy training and inference takes if it's coming from solar, wind, or nuclear power?
We fight over the wrong things, imo.