Every time someone talks to ChatGPT for 20 exchanges or so ...

... Microsoft's servers use a half-liter of freshwater to cool down

AI is *thirsty*

My essay on some implications of this: https://clivethompson.medium.com/ai-is-thirsty-37f99f24a26e

A "friend" link, in case you don't subscribe to Medium: https://clivethompson.medium.com/ai-is-thirsty-37f99f24a26e?sk=f5b2ea10c649a34236577139fecfd86a

@clive That estimate says your queries are using .3 kWh of electricity or so, so it is about 2 cents of power and the water that gets boiled by that (since effectively all energy consumed by computers ends up as heat).

But I don't believe it, assuming 10s of runtime, that means your query used 180 servers for that 10 seconds. LLMs are hungry but not THAT hungry.

@ncweaver @clive @clive This is good work. Another issue, besides power usage, is water usage, and I'm not sure if it's with the article or the underlying research: seems a little overly simplistic to assume all water is fresh water, doesn't it? There's a lot of room for optimization there, and it seems like they'd have incentives to optimize.

@jwatt @clive
It depends. Data centers on a river or ocean will direct heat-exchange. Other than that you use evaporation to dump heat, all AC type systems on any scale do ("cooling towers").

However, the water use is in the noise compared to say agricultural use for alfalfa. A single acre of alfalfa will use 4 acre-feet/year, so 5 MILLION liters of water to grow cattle feed (that is commonly shipped to Saudi Arabia where growing it is banned).

@jwatt @clive
To get a sense of scale, the Imperial Valley in CA (which is absolute desert) has 130,000 acres of alfalfa planted! If you care about water use, care about agriculture, and if you care about agricultural use, alfalfa is a god-damned ecological crime.

@ncweaver @jwatt

Yep — and almonds are right up there too