"Typical Chat-GPT query uses about 10 times more energy than Google search That’s just for a basic generative AI function. More advanced queries require substantially more power that have to go through an AI Cluster Farm to process large-scale computing between multiple machines."
"AI is typically deployed in 20-30 cabinet clusters at or above 40 KW per cabinet. This represents a fourfold increase in KW/ cabinet with the deployment of AI. The difference is staggering."
"ChatGPT query 10x as much as a Google search." is roughly 3 Wh per prompt and equivalent to
- leaving 11W led light light on for 16 minutes,
- streaming video in MacBook Air for about 30 minutes.
- 600W microwave for 20 seconds.
- 230W refrigerator running 46 seconds.
- driving 190 Wh/km EV vehicle 330 meters.
The cost of 100 queries per day is similar to leaving a lights on in a room for a day.
Not just interesting, but essential.
It's important to put thing into proportion so that we can make wise policy, business and consumer choices. Depending on what kind of activity those data centers replace or enable, they can save or waste energy.
For example, does a help center with AI consume more or less energy per call than a humans sitting in air conditioned rooms in the front of computer? How much?
Datacenter using 1 GWh of energy is equal to 333 million individual 3 Wh uses. Just because lots of energy is used in one place does not make it inherently worse.
Instead of "country sized" we should think in per worker, per consumer, per hour of work or play, and see where it fits in energy use.
Gerry McGovern
ma𝕏pool