@danilo re: your energy critique, I was eagerly reading to see if you had gotten better stats than I had previously found, but I didn't see any. I don't know if it's worth editing to update, but I was saying exactly this last month: https://mastodon.social/@glyph/111251549055579334
@glyph that's super interesting context! four fucking orders of magnitude…
yeah, I'll drop a link in, do you have a citation on the GPT-3 training energy costs?