Kevlin HenneyApr 3, 2023

Code generated from LLMs is going to need more testing than code written by developers. This seems self-evident to me, but I suspect a lot of people are going to learn it (or ignore it) the hard way.

Given that most existing codebases are not well tested, and most developers don't test, this does not bode well.

Show threadKevlin HenneyApr 3, 2023
The practical consequence of using LLMs to generate code is that many developers will find they have unwittingly moved themselves into a role they were probably trying to avoid: they have automated the creation of legacy code and have redefined their job role as debugging and fixing such code.
Show threadMartin EscardoApr 17, 2024

@kevlin

Indeed. LLMs can do, if at all, what has already been done.

Who is going to do the new things to keep training the LLMs, if everybody is out of a job because of LLMs?

Show threadKevlin Henney
@MartinEscardo Indeed. Model collapse is a genuine issue.
Apr 17, 2024 at 8:25pmWeb