return2ozmaHeatwave is no joke...
merari42I call bullshit. Stable Diffusion XL has energy footprint of about 0.29 watt hours per image while generating. That is roughly equivalent to running a 0.5 Watt energy LED light bulb for slightly less than 35 minutes. Even for training the costs are not that extreme. Stable Diffusion needed 150,000 GPU hours. At 300 Watt for an A100 at full load that would 45,000 kWh. This roughly the energy neeed to drive an electric car for 180,000 miles, which is a lot, but still on a reasonable scale.
MarcbmannYou are kinda missing the point.
It’s not about how energy efficient or inefficient a single ChatGPT prompt is.
It’s that A/C is arguably more important to an individual than your ability to use AI. But while the government asking people to reduce AC usage is not new, AI is.
So we’re introducing new and unnecessary ways to draw power while asking people to tolerate higher temperatures within their homes.
My personal take is that we should be investing in nuclear power so we continue evolving as a society. But I guess we can hold back progress in the name of puttering along with other technology as the world slowly burns and people cook inside their homes