Tim BrayMar 13

RE: https://cosocial.ca/@evan/115580076628853324

This was posted 4 months ago, i.e. forever in LLM time. I would really like to see a fully-worked through analysis of the actual GHG cost of #GenAI in general and for coding applications specifically. Including, obviously, training, data centre infrastructure, silicon fabrication, etc.

The reason: I have trouble reconciling these numbers with the insane volumes of investment capital going into the space.

Show threadJohn Ripley
@timbray That number for LLM energy is bullshit, and the source in that thread appears to be something Sam Altman blogged, who as we know is someone who never just makes stuff up. (His post reads like ChatGPT voice, which of course it is) There is some severe weaseling be off by at least an order of magnitude—maybe the average query is "What day is it". Non-trivial queries light up 5-10kW of rack and that runs for significantly longer than seconds. This is roughly the same as a moving EV car.
Mar 13 at 5:06pmWeb