what if ram buyout is part of a greater attack on personal computing

any other indicators?

#mann_vs_machine

@lritter IMHO this 'war on personal computing' had been going on in the background for decades with varying intensity, similar to how DDOS attacks happen all the time without bringing the whole internet down (mostly at least). Personal computing might go back to be the niche/hobbyist activity it was in the 70s to 90s, but it won't entirely disappear. I guess it might become an expensive hobby again though :/
@floooh it begs the question what we wrote all this infrastructure for. certainly not so a bunch of locusts can run their datacenters on it, and nothing else.

@lritter hmm yeah... AFAIK the home computer revolution was mostly feeding on an overcapacity of slightly outdated 8-bit chips which suddenly became very cheap at the start of the 80s, and hobbyists and enthusiasts started to build all sorts of awesome things with this 'junk'.

Maybe we'll see a similar Cambrian Explosion after the AI bubble pops and suddenly there's a shitton of just slightly outdated GPUs and memory flooding the market waiting to be used for actually interesting stuff :)

@floooh @lritter the problem is that it's not going to be general-purpose memory; it's going to be soldered chips in these GPUs.

And that these GPUs are completely impractical to run at home scale, with them having TDP measured in kilowatts.

At least these 8-bit chips were general purpose afaik?

@IngaLovinde @floooh @lritter It is possible to make custom drivers that would expose the memory as swap block devices and to downclock or shutdown as much of the other features of the GPU as possible.

In all likelihood that would still end-up as inordinately power-hungry memory though.
@lispi314 @floooh @lritter and not even a lot of memory; extremely expensive B300 only have 144GB of it, many servers sold on used goods market have more than that.
@IngaLovinde @floooh @lritter It would make for a good memory expansion card in desktops that have considerably fewer memory slots and/or no compatibility with other ECC memory.

For servers it indeed doesn't look amazing compared to the standard.
@lispi314 @floooh @lritter yeah I was saying this in the context of that "Cambrian explosion" post.
Like, if tens of thousands of enthusiasts having access to 144GB RAM could cause any Cambrian explosion, such an explosion would already be here, because enthusiasts already have access to more than tens of thousands of used servers with more than 144GB of RAM.
@IngaLovinde @floooh @lritter I think it'll depend on just how bad the bubble eventually pops and how low the prices go (those servers still aren't exactly available at pocket-money kind of prices).

But you have a point.
@lispi314 @floooh @lritter even if they give them away for free, it will still not result in any qualitative difference with the current situation where everybody who wants a lot of RAM and can afford an iphone already has a lot of RAM.
It's not like Nvidia is making these GPUs in the billions.
@IngaLovinde @floooh @lritter > It's not like Nvidia is making these GPUs in the billions.

I was kind of expecting a large production, given the whole "filling up datacenters" thing.

@lispi314 @floooh @lritter it's large in terms of money, not in terms of the numbers of these GPUs.

Apparently the latest generation costs six digit amount per GPU; selling just a million of them would already make Nvidia one of the largest companies in the world by revenue and not just by valuation.

@IngaLovinde @floooh @lritter Yikes, those are some awfully expensive GPUs.

@lispi314 @floooh @lritter
> those servers still aren't exactly available at pocket-money kind of prices

But they literally are?
Just a random example from ebay: https://www.ebay.com/itm/226945580797 ("HP ProLiant DL360p Gen8 Xeon E5-2630 v2 2.60GHz 192GB RAM 8x 2.5 SFF P420i iLo4" for 180€); another example from another seller: https://www.ebay.com/itm/376838993431 ("Dell PowerEdge R610 Rack Server 2x Xeon X5560 4-Core 2.8GHz 192GB RAM IDRAC" for 150€).
Or https://www.ebay.com/itm/297919718270 ("HP ProLiant DL380p G8 GEN8 Server Motherboard 662530-001 622217-001 + 384GB RAM" for 300€).

HP ProLiant DL360p Gen8 Xeon E5-2630 v2 2.60GHz 192GB RAM 8x 2,5 SFF P420i iLo4 | eBay

Technical data / Technische Daten HP ProLiant DL360p Gen8. Slots for drives / Einbauplätze für Laufwerke Frontseitig: 8 x 2.5 SFF. Das können kleinere Kratzer am Gehäuse sein. RAID support yes / ja. 1 x HP Ethernet 1Gb 4-port 331FLR Adapter.

eBay
@IngaLovinde @floooh @lritter That's kind of like... 10~15x what qualifies as pocket money here.

@lispi314 @floooh @lritter okay, I can agree that if Nvidia actually makes hundreds of millions of these GPUs priced at $200k each (for multiple tens of trillions in revenue), and then after the bubble bursts all these hundreds of millions of GPUs will be sold on ebay for 0.01% of their original price, $20 a piece (or given away for free which is basically the same in that perspective), then yes, a lot of people are going to get ready access to a lot of RAM.

I don't think any of this is realistically going to happen though.