I just had "the talk" with my 9yo. He came to me asking "Dad, why does AI use so much water just for generating one answer?"
So I explained to him how LLM works, how GenAI came out of that and why AI is a marketing term and absolutely wrong in that context.
Then I loaded GPT4All on my laptop and asked the thing what the result of 9+7 is. It took my poor laptop cpu 12 seconds to come up with an answer and another 12 seconds to generate the sentence with the answer. I showed him how fast kcalc (using the CPUs ALU functions) comes up with the answer for that specific question.
And then I asked a followup question, which almost take 2 minutes to compute. I showed him how the previous question and its answer became part of the prompt which made the calculation longer more complicated just to emulate a dialoge.
He noticed that my laptops CPU fan stepped up and started to roar to get rid of the core heat. Then I explained to him how AI datacenters solve all this ineffitiency by running millions of servers in parallel and how this generates so much heat that it "uses" cooling water by just boiling it until it vapourizes.
I then explained the current business model and how the companies currently burn through their cash to be the last one standing on the market when everyone else dropped out or became bankrupt. What we user pay for using this and what we actually would have to (and in the future probably will) pay for this service.
Needless to say, my kid is not a big fan now.






