It's demotivating to think that:

- LLMs aren't good at producing original / novel work
- You still need experts to advance that stuff
- It will always be slower to move without using LLMs
- Once an innovation is done though, an innovation can always be scooped up by the LLM users
- "Bro why are you doing all this manually, I just vibe coded that in a weekend"

Will it always be this way? It's depressing in the meanwhile, at least.

In a sense, the decision is somewhat made for us in that we're developing next-generation stuff that LLMs don't know how to auto-code at @spritely. We are working on core infrastructure that needs to be carefully thought about and written. LLMs introduce a lot of errors and aren't good at doing this kind of work on their own.

And the goal was always that our work is there to be lifted from, to spread outward, the way people have long drawn from the well of the MIT / Stanford research labs in CS for decades, but for decentralized networking today

But doing it now, in this way, in this environment, it's just really depressing and demotivating.

@cwebber @spritely I had the near identical thought earlier - that someone needs to be doing the novel stuff, but we've created an environment that is, broadly speaking, uniquely demotivating to the sort of people that tend to do that sort of thing.
@swift @cwebber @spritely the two sides of llms being fundamentally conservative—they entrench the past while making a different future more difficult
@aparrish @swift @cwebber @spritely they also appeal to the most mediocre of white men who've never had a creative impulse in their whole entire lives
@pikesley @aparrish @swift @cwebber @spritely what does white have to do with it. Next you want me to feel bad for being german.
@cwebber Agreed. It’s making free and open source software development feel less rewarding. Less meaningful.

@cwebber @spritely We need you guys.

The thing that scares me the most is that in 10 years time there'll be no new people able to code new stuff, to innovate.

And *that* is the main reason why we absolutely need you guys. Regardless of how demotivating it may seem right now.

@jorgecandeias @cwebber @spritely

It's not demotivation that comes first, but rather a simple survival of those who are out of money, out of funding for the choice of doing things that last and that bridges to the future.

@jorgecandeias @cwebber @spritely I think it's incredibly alarmist to suggest that people won't take an interest in learning programming even the old "untainted" way. We already had this kind of fear mongering even before LLM's but with high level programming languages and is untrue.
@cwebber It's difficult to not think of Anathem. Communities of theorists living an ascetic life away from the rest of society.
@cwebber @spritely I mean the problem as I see it is: The people who primarily benefit from the work aren't paying for it, and there's no way to get them to contribute back ("licenses" no longer exist). So the art can only be extended by individual humans expending their savings or going into personal debt. (In theory basic research could additionally be funded by corporations, but since people who care about the art exist as a resource to be exploited, there is no reason for them to do so.)
@cwebber @spritely This is similar to the problem I have making video games: Some portion of my audience will pirate my work. Technically that doesn't harm me, *but* if *everyone* pirates the game then I don't get any money and I don't get to keep making games. I decide I don't care because not everyone pirates games and *some* of the people playing the game will pay for it. LLMs, for code, sets up the possibility the entire audience will be pirating the work. Which is wild since my code is MIT

@cwebber @spritely This said, I want to give you the flipside to the process you're describing: I am currently creating a small programming language which exists for no purpose except for me to make games for the Game Boy and NES. When I look at my language, I think: *An LLM user could not use this language, because there is not a sufficient corpus to generate code from¹*. And this sparks joy in me

¹ And a significant portion of the corpus is testcases designed to fail

@mcc @cwebber @spritely a painstakingly pre-poisoned dataset 🥰

@dvandal @cwebber @spritely I think it is important to write test cases and I think it is important your test cases test your failure modes!

:3

@mcc @cwebber @spritely I work in QA, so my job is to test those failure modes. (Automatically and at scale to boot!)

And you are right! It is important to test those cases

@mcc @dvandal @cwebber @spritely suddenly i feel an unprecedented desire to write any tests at all

@cwebber @spritely once the honeymoon period is over and the folks who keep getting rm'ed get louder and more often complain than the success stories gush, the scale will tip.

people have realised cloud was way riskier and more expensive and have started brining stuff in house again, the same will happen with llms.

itll just take a critical mass, like anything else.

and the llm horror stories are piling up

@cwebber @spritely I guess, a valuable motivator in the current LLM mire could be examples from history where clearly articulated technology—developed by small teams has had *huge* impact.

There are so many examples, but say, Sophie Wilson and colleagues and a need for low-cost educational computers resulting in ARM.

And now Sam Battle/LMNC imagining how musical tech can be constructed from scrap—likely about to re-invigorate UK’s entry to Eurovision! ‘Future history’ makers, if you will.

@cwebber

“Code/Software has no value since it can be duplicated at no cost”

The first time I heard this was 20 years ago and this has always been true.

@DevWouter But it has tons of value! It's a non-rivalrous good. And that's GREAT in many ways. I am all for code being a non-rivalrous good.

But I don't feel the situation here is the same as it's been for the last 20 years. I don't feel the same way I've felt about it for the last 20 years.

@cwebber

Economic value which is indeed not the best way to measure value 😁

Personally I have yet to see a product where the value is increased by LLM.

@DevWouter
It has reduced exchange value due to the absence of scarcity, but it retains its use value.

@cwebber

@cwebber
I just hope the bubble bursts while it's still practical to resist.
Once the unlimited investment dries up, most or all of the cloud LLM services will disappear, but if that happens after complete industry capture we are 100% boned. We'll end up with unlimited government subsidy like we have with brown energy.
@cwebber im still resisting the belief that 'moving fast' is at all good or useful. sprinting is shitting out bad software to abandon next year, but most of us know that real value lies in the marathon of maintenance and careful conscious choices

@alice @cwebber agreed. We’ve been doing a technical migration at my workplace and we keep finding more and more issues caused by people moving fast and hurrying in the previous migration years ago + in the updates and changes made during the use of the tool in question.

Time was supposedly saved back then, but it was actually just passed down the line for us to deal with now. And this wasn’t even with LLMs, just general tech and coding laziness around a big enterprise org.

@mariyadelano @alice @cwebber Most software is terrible. We build the same things over and over again, mostly poorly, and most people don't know any better. Even if you can see it, the tide is against you in most organizations. Is your NodeJS Kubernetes MongoDB Redis Temporal monstrosity 95% induced complexity and 99.9% wasted compute cycles and RAM? Sure. Can you practically change that? Not at most companies. Is this actually worse than writing it in vertically scaled Java on MySQL etc? Yes.
@mirth @mariyadelano @alice so wise let's not try doing better
@cwebber @mariyadelano @alice We absolutely should try to do better, and I appreciate everyone doing it. Every bit helps. My main point is the issues leading to slop proliferation are mostly structural and not new.
@mirth @cwebber @alice yep, what’s new with slop proliferation now, I think, is mostly the speed and scale of it.
@mariyadelano @cwebber @alice The speed is breathtaking. In the hands of very skilled engineers the coding tools can enable amazing technical feats but that raises more ethical and power concentration concerns. I've started following the development pretty closely and I think most people underestimate the danger. Not of the "paperclip factory" narrative but a much more mundane structural reduction in white collar jobs, followed by 100%+ accrual of the savings to the investor class.
@mariyadelano @cwebber @alice (And, to explain the math, when companies figure out they can do without a bunch of people, they both fire those people and use the leverage to push down pay for the rest).
@mirth @mariyadelano can you do that out of my mentions please
@cwebber Well… 9Gag was built entirely on that fast-scooping-of-slow-effort loop, wasn't it?
@jkb wow are vibe coders the 9gag of code
@cwebber I'm not sure, but both can get fucked.

@cwebber For what it’s worth I think that we are eventually going to recognize “needing to throw massive computation at things” as a symptom of language and discoverability shortcomings that we’ll find better ways to address. We already package utility up in libraries and deterministic generators, but finding and learning what resources do what remains difficult.

I think there’s still a better future out there where solving new problems is still a non-captured contribution to the common good.

@cwebber I mean: we can imagine a world where the boilerplate falls away. We can imagine a world where we can describe problem to a computer that lets it say "these are the parts of this problem that seem new, but the rest looks like this thing you already have, that you can use". We can imagine communal systems where solving that new problem becomes a contribution to a common understanding rather than just value to be captured and re-sold as a subscription.
@cwebber yeah but programming was always about solving problems anyways. If we take what you say about LLMs here as like the reality of how they are used and worked or whatever. Then the thing to think here is that what is unravelled is that for the most part of the last 20 years these guys were just solving problems other people already solved over and over.
@cwebber and if that is true then that isn't good either.
@cwebber LLM users are the same people who walk through modern art galleries saying "my kid could do that"

@andrewt
funny bit,
-to me anyway-

is

given just a bit of license & encouragement

they likely in fact, could

&
some may do it well, given time & practice.

as
they may not have morphed into pretentious, know nothing, jerks yet

@cwebber

@cwebber Relatedly, the mental health of writers, translators, editors, and language workers in general outside of computer science is just... completely wrecked. I don't know anyone who feels optimistic about this stuff OR the future of the fields of publishing, literature, knowledge production, etc. who isn't a manager trying to justify layoffs.
@gersande @cwebber FWIW, it's not much better within computer science either. It seems like everyone's mental health is falling off. The only people who seem to be doing well right now are those who drank the coolaid and genuinely believe we're on the cusp of an LLM-based Eutopia or something.
@cwebber slop machines might let you move 2 times faster but it’s at the cost of 5x the technical debt and rapid cognitive decline. any code that comes out of an LLM is a toy/liability at best
@cwebber idk, i'm ignoring it as best i can and it is making me quite happy
@cwebber Yes, it just makes it faster to produce the unoriginal/mediocre. Sad in many ways but not as much of a threat as is being made out
@cwebber This was always the case to some extent. One person spends days solving an engineering problem
Everyone afterwards copies and pastes from stack overflow. In a four year math degree you learn many centuries of work.

@cwebber LLM is the past, written in stone. You'll never get a picasso or an andy warhol out of LLM, because it's a blender for existing data.

Your post reminded me of something else. For a time I thought that ML could be good for turning video into 3D skeleton animation. But that only work if I want realist animation. If I want waluigi doing a 100m sprint, I need an animator. Which need to train. Like picasso did train in classical art.

No art under AI, unless it's more of the same.

@cwebber I've been thinking recently about how people are shown to lose skill at a task when automation is introduced to aid that, because they quickly come to rely on the tool rather than trust their own judgment. There was a study, for example, at how the introduction of AI detection models for cancer screenings actually lowered the overall accuracy rate, because no one was checking the machine's output.

Anecdotally, I've seen the same thing with programming, where people will defer to Claude when a problem is encountered rather than thinking critically about it themselves. And so I suspect we'll reach a point where actual skill at this job will be in demand, because people who rely on vibe coding won't be able to reliably fix the issues that they've introduced.

On a more personal level though... the reason I do this is because I enjoy the craft. Solving problems elegantly with code is deeply rewarding to me. And so I very much don't understand why someone would vibe code to begin with. Do they not like the work? And if not, why did they choose this career path? But yeah I agree that the whole situation is super discouraging.

@cwebber yes, it will be slower to move without genai and i also find that depressing. Even more so because one feels rushed and less engaged. It is both more stressful and more boring.

But, one will hopefully not always have to use the latest frontier models. I don't expect to see super human AGI so at some point older commodity models should be good enough.

At that point I can start crafting again by providing a scaffolding/spec for the LLM to implement.

A prompt like "Write an operating system" is not a spec nor is an unstructured back and forth dialogue. I expect to write specs in a formal language - not unlike a programming language, which is then pre-processed by some standard LLM on a low temperature setting ...

I wonder what that language will look like...

By that time, of course, LLMs will have tought me emough about running a non-software business that my lifelihood no longer depends on coding.

@cwebber on the other hand, considering how much time free software has spent chasing taillights
@cwebber dont even think its that way right now, to be fair