l1nAnthropic expands partnership w Google and Broadcom for multiple GW of compute
https://www.anthropic.com/news/google-broadcom-partnership-compute
There's no limit to the algorithms. People dont understand yet. They can learn the whole universe with a big enough compute cluster. We built a generalizable learning machine
Because that’s the limiting factor
Somehow we must be doing this wrong.
"Do you realize that the human brain has been liken to an electronic brain? Someone said and I don't know whether he is right or not, but he said, if the human brain were put together on the basis of an IBM electronic brain, it would take 7 buildings the size of the Empire State Building to house it, it would take all the water of the Niagara River to cool it, and all of the power generated by the Niagara River to operate it." (Sermon by Paris Reidhead, circa 1950s.[1])
We're there on size and power.
Is there some more efficient way to do this?
[1] https://www.sermonindex.net/speakers/paris-reidhead/the-trag...
The Tragedy of Third Generation Religion by Paris Reidhead | SermonIndex
Paris Reidhead preaches on the tragedy of third-generation religion, using Judges chapter 2 to illustrate how the Israelites turned to idols despite witnessing God's miracles. He emphasizes the importance of true repentance, turning from idols to serve the living God, and the danger of compromising for worldly desires. Reidhead highlights the need for a genuine encounter with the cross, symbolizing death to self and resurrection in Christ, to avoid falling into the worship of Baal, Ashtoreth, and Moloch.
[dead]
I'd imagine one day there will be a limiting factor of cash to burn as well.
pretty sure evolution spent more time and energy getting there then we ultimately will
It's more meaningful to most people than FLOPS/other measures of actual computing power.
I guess gigawatts is how we roughly measure computing capacity at the datacenter scale? Also saw something similar here:
> Costs and pricing are expressed per “token”, but the published data immediately seems to admit that this is a bad choice of unit because it costs a lot more to output a token than input one. It seems to me that the actual marginal quantity being produced and consumed is “processing power”, which is apparently measured in gigawatt hours these days. In any case, I think more than anything this vindicates my original decision not to get too precise. [...]
https://backofmind.substack.com/p/new-new-rules-for-the-new-...
Is it priced that way, though? I assume next-gen TPU's will be more efficient?
