Somebody please invent a programming language that can’t be generated by LLMs

@thomasfuchs I’m pretty sure this already exists:

https://brainfuck.org

some brainfuck fluff

Includes a complete language reference, plus my many brainfuck programs and some implementations and commentary.

@JensHannemann @thomasfuchs My first thought and there you are, first response.

@thomasfuchs https://www.dangermouse.net/esoteric/chef.html

The LLM would probably fail at "Program recipes should not only generate valid output, but be easy to prepare and delicious."

DM's Esoteric Programming Languages - Chef

@thomasfuchs I don't think any novel programming language can be generated by LLMs
@thomasfuchs Unreal Engine’s Blueprint visual scripting language seems to be immune to LLMs, partly because it’s stored in binary blobs and its text-based form is hard for LLMs to generate without breaking the syntax, and partly because the documentation is so bad that there’s no good data to train LLMs on.
@thomasfuchs this should be the new Turing test - the Fuchs test, as it were.
@thomasfuchs I read/heard somewhere not too long ago that it's absolutely shitacular at Lisp; most especially by almost never getting the parentheses balanced correctly
@thomasfuchs I should try to dust off my #Forth skills and see how LLMs do with that. It’s esoteric enough that not much training data will exist and RPN should throw them a nice curve ball.
@thomasfuchs I don't want to go back to check if things have improved, but when I was looking into whether LLMs could be useful at all, I tried to generate some Smalltalk. The syntax ended up being a mix of Smalltalk, Python, and Java. The program itself relied on nonexistent stuff, which got "implemented" as wrappers around other nonexistent stuff when pointed out.
@thomasfuchs brainf*ck might finally have its day....