@steve @cross @krismicinski @shriramk @jfdm @csgordon @lindsey @jeremysiek As a professional programmer now almost 20 years out from defending a thesis that was about code generation, I can't upvote this enough.
LLMs are an incredibly inefficient way to do code reuse.
@gwozniak @steve @krismicinski @shriramk @jfdm @csgordon @lindsey @jeremysiek yeah, I was going to comment that you had said something similar a few days or a week ago.
It's wild to me that we keep writing the same program over and over again and calling it "progress."
@shriramk @cross @steve @krismicinski @jfdm @csgordon @lindsey @jeremysiek At a certain level I am on board for the "coding assistant" kind of approach that LLMs allow for, especially for throwaway code or prototypes in research. Hell, that's the kind of thing I was into when I was doing research. I wanted this sort of thing!
Leaving aside the major externality problems with the current tools (but please, don't ignore them), I firmly believe LLMs are deeply inefficient. To me there is an interesting research area here: what is a more efficient version that works? And why did all the "no code" approaches before not work? Is it because they tried to be formal? Or is it not a technical problem?
I guess I lied a bit because I find the inefficiency of them to be at the heart of the externality problems that come with them.
And from an industry standpoint, massive code generation is a very sharp double-edged sword. That stuff has to be maintained. So when there is a problem and you have reams of generated code to debug, do you debug it or just generate it all again? But if you do that, will it be the same as it was before? Because latent bugs often become vital features.
@gwozniak @cross @steve @[email protected] @jfdm @csgordon @lindsey @jeremysiek
Come on, we've been doing this for ages!
I use this as a slide from my GenAI + edu talk:
@shriramk @gwozniak @cross @steve @krismicinski @jfdm @csgordon @lindsey @jeremysiek
Wasn't COBOL invented so that non-programmers could specify programs?
Saying that "AI" will take away the need for programming is like saying that there's no need for lawyers because laws and contracts are written in English, and that's all that's needed to understand laws or write contracts.
PS: I noticed that everyone so far has skipped over the need for system-level tests to ensure that the specifications are implemented correctly. (And unit tests for the edge cases)
@PeterLudemann @gwozniak @cross @steve @[email protected] @jfdm @csgordon @lindsey @jeremysiek
Yes, and that's why Grace Hopper was ahead of us this whole time.
Nobody has "skipped" anything, my whole class on agentic coding is centered around writing lots of unit and then system tests.
@gwozniak @cross @steve @[email protected] @jfdm @csgordon @lindsey @jeremysiek
I viewed most of them as abstracting over a CRUD pattern, and they nailed that abstraction. Plus funded by lots of ZIRP, which is why we had so many of them. I have been meaning to go back and check exactly how many are still alive, but several are (and may have pivoted to AI).
So it wasn't that they "couldn't break past the barrier", they never intended to.