"LLMs are here to stay," is like saying that the modem-based internet of the 90s was forever. It was a largely unusable piece-of-shit tech that was manifestly incapable of delivering beyond a fraction of what the dot-com bubble promised, but it prompted investment in fixing the one thing that prevented that promise: bandwidth.
I can't emphasise strongly enough how this ISN'T happening with LLMs. They are throwing all their money into building ON the broken tech and next to nothing in developing a replacement that has an actual chance at fulfilling the promise LLMs hint at, because there genuinely aren't any plausible pathways to get there from here
The modern AI Bubble is 100% a "modem speeds were good enough and the dot-com companies only failed because they didn't have enough funding to get them over the hump created by the government's regulatory fight with Microsoft" delusion.
Modem speeds are very much not enough and if broadband had proven to be infeasible for some unexpected technical reason, then the web would definitely have faded away into a hobbyist-oriented subculture in the style of ham radio.
And if you think LLMs are "good enough" as they are, then the only thing I can say is I hope you're right because at the moment it looks like the tech industry is trying to bake a broken toy into every aspect of our society in the belief that the only thing that actually "breaks" tech is regulatory interference
Addendum: even if we were on the path towards developing an “actually works” replacement to current era LLMs—which all suffer from the same problems—that hypothetical future tech is not what’s being baked into everything. Even if they did manage to magically come up with an LLM that “works” nobody’d be using it because broken shit will be what’s built into everything.
Responding to “modem speeds are unworkable and if we don’t fix that the internet is a dead end fad” with “the internet is still extremely useful” isn’t a counterargument, it’s self-identifying as a member of the subculture that will remain after the fad peters out

The difference between thinking about how any given tech impacts you individually—harm versus utility—and thinking about how it impacts society if adopted at scale is effectively the difference between concluding that:

“Cars are fine, actually, the bigger the better. So helpful.”

Versus…

“We’re destroying ourselves and our planet because public transport is less profitable than the car industry.”

@baldur I don't know if I phrased it succinctly enough, but I think there are different and more incentives at play in business adoption than the oft discussed "it need not be able to replace you, just convincing enough for your boss to fire you over the promise of capabilities" and overleveraged data center investments. There is a landgrabbing rush for interface control going on that very much aligns with business tenets of controlling distribution channels.
@jakob Ah, that’s a good point
@baldur Same vibe as responses to technical and social problems with fediverse... 🤦

@baldur

I suspect there is an unspoken motive for sticking LLM into everything.

I think they're trying to get us to pay for another tool of oppression. LLMs are effective at manipulating people and automating surveillance so they need fewer secret police to prevent us from overthrowing them as the climate crisis get to be unlivable

@baldur Well, at least Packet Radio was a lot of fun to play with.
My first web page was on Packet Radio.
@baldur modem speeds very much were enough until the enshittification of the web.

@fedops

Ahem.

I remember downloading stuff on a 2400bps modem, way before there was an internet.

I also remember connecting to BBS and CompuServe on a 9600bps modem (9600 8n1).

Allow me to say: you will have to pry my (slow) ADSL, 4G access point and 5G phone from my cold dead fingers. 🤓

@baldur

@ParadeGrotesque ahem. My first modem was also 2400 bps, and while it was way before the web there very much was an Internet. I remember configuring uucp for mail and inn for netnews in 1991, having blagged access to the modem bank at my student helper job at the time.
@baldur

@fedops @ParadeGrotesque @baldur

I was reading ASCII text as it came across at 110 baud and was printed on a teletype. 300 baud is faster than you can read text.

I did a fair amount of programming work at 1200 baud. Like all of my college work. Mostly remote.

9600 baud is annoyingly slow for images. But I eventually paid for higher bandwidth in order to download large software packages.

@fedops @ParadeGrotesque @baldur

I curse at our local water company for subjecting me (and everyone else) to full screen full motion video when I just want to login and pay my water bill. Even their own public relations people criticize it for not being very accessible, and for being irrelevant and misleading.

There's a lot of waste — bandwidth, memory, CPU time, disk space.

But high resolution streaming video is really nice to have!

@fedops @baldur they were emphatically not. I remember trying to use the web in those days and the experience was very much one of clicking something and then coming back in a few minutes to read it.

That doesn't mean what is happening now is ok though, but in most cases it's not transfer time but rather the time parsing and executing wild amounts of JavaScript that makes it slow.

@baldur

subtopic

Did you just return home or something? ;)

https://fedibird.com/@masahiromiura/114531410906570411

#hamvention

Masahiro Miura (@[email protected])

#Dayton #Hamvention 2025 #ハムベンション #アマチュア無線 https://youtube.com/watch?v=0KVvuK6lqvc&si=_gM1GjV5huVz52NA

Fedibird
@baldur I was with you up until this point, but I disagree here. We have largely used up the bandwidth increase with much larger assets on the web unnecessarily. Sure, maybe webapps will render a spinner and progressbar instead of looking at the browser load everything, but it's still not loading that fast. Everything did not get as fast as the difference between the 56 kbps connections of modems, compared to 1-2 GBit fiber connections today (and their improvements in latency). The user expectation is still that you have to wait a bit for websites to load, even though we could do much better. Similarly, if connections remained as slow as they were then, we could still have achieved many of the advancements that make the web what it is today, except we would still have a lot of pressure to deliver small file sizes. Many of the advancements in that area are flat out ignored because we have a lot of bandwidth.
@tamas I think you've forgotten just how incredibly slow the modem internet was. It barely did images, period. Let alone streaming video or audio. Also screen resolutions needed to improve match the experience of print to remain competitive and that meant that images had to follow. Images sizes are not the biggest issue with the web today. The modem experience was much slower than you remember.
@baldur My point is that we have ignored many software advancements that could make better use of the low bandwidth. For example, real-time voice chat was not possible back then, and yet, speex was developed in the early 2000s that made this possible in as narrow as 8kbps bandwidth. Similarly, we were limited in our use of graphics, but image compression codecs also vastly improved since then. All I'm saying is, I don't think the web would have faded away to a hobbyist subculture even without the bandwidth developments.

@tamas @baldur

And it's not as if high speed internet did not exist at the time: The backbone and well connected sites had high bandwidth. It's just that most homes did not.

And it's not as if no homes had high bandwidth feeds: Many people did have "cable TV," which is high speed distribution to homes. And some had satellite (with high latency issues).

It was practically always an issue of cost and building out infrastructure.

@tamas @baldur

Heck; this conversation would work just fine over even the slower and cheaper modems of the early 1980s.

(Drop the image icons, loads of JavaScript, and other such "frills." Usenet actually worked reasonably well, for most things.)

@tamas @baldur

With LLMs, on the other hand, even the best and most well-resourced and costly of them still produce disappointing results. There's no "higher levels" where people are getting substantially better results for a roughly similar multiple of money.

@baldur @becomethewaifu While something of a detail, I'd be relatively satisfied with the speeds DOCSIS 3.1 is supposed to be capable of giving me symmetrically or even VDSL2+ asymmetrically. Of course literally no one offers either of those properly, the only (barely) adequately maintained & provisioned network infra is fiber.

90s-tier modems sucked though.