Mastodawn

RE: https://cosocial.ca/@evan/115580076628853324

This was posted 4 months ago, i.e. forever in LLM time. I would really like to see a fully-worked through analysis of the actual GHG cost of #GenAI in general and for coding applications specifically. Including, obviously, training, data centre infrastructure, silicon fabrication, etc.

The reason: I have trouble reconciling these numbers with the insane volumes of investment capital going into the space.

Show thread

Bynkii

@timbray @evan @timbray @evan yes, and if only one person was using LLMs for 30 minutes here and there, the usage wouldn’t be a problem. But that’s not the scale, it’s tens of millions 24x7.

And even if no one used them, the datacenters consume that power and water constantly. The servers don’t sleep sans queries. They are always running. They require massive amounts of energy and water simply to exist.