Kevlin HenneyApr 3, 2023

Code generated from LLMs is going to need more testing than code written by developers. This seems self-evident to me, but I suspect a lot of people are going to learn it (or ignore it) the hard way.

Given that most existing codebases are not well tested, and most developers don't test, this does not bode well.

Show threadKevlin HenneyApr 3, 2023
The practical consequence of using LLMs to generate code is that many developers will find they have unwittingly moved themselves into a role they were probably trying to avoid: they have automated the creation of legacy code and have redefined their job role as debugging and fixing such code.
Show threadAI6YR BenApr 4, 2023
@kevlin It's going to be a hoot if the LLMs are propagating old buggy code around, because there is so much posted publicly, ha ha. More than half of the code posted publicly is "THIS CODE DOESN'T WORK, HELP ME!" -- not sure the LLMs are advanced enough to recognize they ingested broken code.
Show threadÖlbaum
@kevlin @ai6yr That’s my new favourite argument, thank you.
Apr 11, 2023 at 9:51pmWeb