ℒӱḏɩę 💾☮∞🎶♲☀🔋Mar 14

SRAM. Static RAM. The stuff used for CPU caches, including AMD's 3D chips.

There have been mumbles of CPU prices spiking like DRAM....this may be part of why.

"Companies like Cerebras, Groq, and d-Matrix are designing AI inference chips that use massive amounts of on-chip SRAM instead of relying on external DRAM (HBM), which significantly reduces latency and power consumption."

nVidia bought Groq. Amazon and Cerebras just signed a deal. Cerebras’ WSE-3 chip includes 900,000 cores and 44 gigabytes of on-chip SRAM.

Wait for it...............

#ai #dram #memory #sram #datacenters #gpu #cerebras #groq #amazon #nvidia

Show threadF4GRX SébastienMar 14
@Lydie wow thats a lot of sram
Show threadNazoMar 14

@f4grx @Lydie Probably going to end up costing like $100,000 per unit for those... This is literal insanity.

They can benefit a lot from on-chip RAM, but not THAT much...

Show threadPete Alex Harris🦡🕸️🌲/∞🪐∫Mar 14

@nazokiyoubinbou @f4grx @Lydie
And when the CPU fries from running non-stop as a space heater/slop factory, the on-chip RAM is gone too, whereas off-chip general purpose DRAM would be re-usable.

It's almost like accelerated resource waste is the point.

Show threadNazoMar 14

@petealexharris @f4grx @Lydie It's not the point — they just literally don't think that far ahead. All they can think of is what will be most profitable in the shortest possible period of time.

But, we have to remember that this is a field where everyone assumes that just by getting into it early it guarantees someday they'll be so rich that they'll have space yachts that launch yacht ships down to the oceans for yacht parties on their other yachts. None of them even considers how any of it would actually produce those profits. They just assume it will... So they spend spend spend money they don't have.

That produces the accelerated waste, but not by intent. By sheer inability to process reality.

Sad thing is, us normal people will ultimately be the ones who pay for it probably.

Show threadPete Alex Harris🦡🕸️🌲/∞🪐∫
@nazokiyoubinbou @f4grx @Lydie
I have heard a theory that by monopolising or even destroying as much investment capital or other resources as possible, the very richest can eliminate competition, like large trees surviving a forest fire that burns off all the undergrowth.
If they're left with a bigger slice of what's left, they don't care if half the pie is on the floor. There's nothing material they want that they can't have already, so it's all about winning the game, or others losing it.
Mar 14 at 11:04amWeb
Show threadNazoMar 14

@petealexharris @f4grx @Lydie You give them too much credit in that. I understand. I used to think that way too. They're in the best position to leverage their money for long term benefits since they can afford to eat the short term costs.

But they don't do that. They can't remember further back than lunch yesterday and they can't plan ahead further than lunch tomorrow.

All they care about is maximizing profit margins today no matter even if it destroys everything tomorrow evening because they just don't think that far and all they care about is that money they can spend right now.

(And yeah, I get the irony of the whole "trying to get in early" thing with a thought process of "the day after tomorrow doesn't exist, so give me everything now.")

Show threadPete Alex Harris🦡🕸️🌲/∞🪐∫Mar 14
@nazokiyoubinbou @f4grx @Lydie
Not really giving them any credit. Some are very clever and think forward to what they want, it's just that what they want is profoundly amoral and antihuman. Some are stupefied by privilege and easily persuaded to lend money to a plan in nobody's interests if they get to visit paedo islands with their not-really-friends. None of them do the same ethical calculation we would, because we care about other people.