RegularJoeFeb 26

Nvidia delivers first Vera Rubin AI GPU samples to customers — 88-core Vera CPU paired with Rubin GPUs with 288 GB of HBM4 memory apiece

https://lemmy.world/post/43583117

Nvidia delivers first Vera Rubin AI GPU samples to customers — 88-core Vera CPU paired with Rubin GPUs with 288 GB of HBM4 memory apiece - Lemmy.World

Lemmy

Show threadPhoenixz

And none of us will be allowed to have them

Only datacenters and only fortune 500 companies will be able to use anything Nvidia

Feb 26 at 4:05pmWeb
Show threadCorkyskogFeb 27

I mean if you have the 3 million to spend on a rack of them, I am sure they would allow you to have them.

I do wonder what happens a few years down the road when everyone are replacing their gpus with latest and greatest variants what happens to the old racks? Do they get sold for pennies on the dollar because everyone else doing AI wants cutting edge?

Show threadeleitlFeb 27
The failure rate is high for ML GPUs. The hardware is effectively consumables.
Show threadeleitlFeb 27
You can’t do much with them, unless you’re into deep leaning. And the power bill would bankrupt you. I wish I had a Cerebras box, but even the smallest one is 20 kW, liquid cooled.