RE: https://neuromatch.social/@jonny/116325123136895805

lmao oh my god of _course_ it was just going to be the hackiest hack that ever hacked
i'm just cackling, while also feeling vindicated

what does it do? it does some god-awful special-case hacks to make it look like they made LLMs do a good job at code when in fact it just keeps trying and trying and trying until it makes something that compiles. haaahahahahahahahaha
@pikhq When I run models on my own I usually do it in a harness that uses BPF grammar to make it impossible for the model to generate ungrammatical tokens, you can use this trick to load up a JSON schema and force the model to obey. It's kinda neat and is the basis of how tool calling works everywhere but with Anthropic lol
@cadey i would have _assumed_ they would have done something like that, to at least make the _effort_ to work right, but i guess not in their case