Lot of LLM users out here thinking they're built different.
CI, unit tests, linters, formatters, code review are imperfect but effective safety and productivity tools because they do not require a state of constant hypervigilance.
@dreid One might go so far as to argue they're effective tools _because_ they let you outsource the hypervigillance to the tool ... at least so sayeth my 91st "git commit -m formatting" command...
@meejah @dreid one of the key features is determinism. We have a static analysis tool that were mandated to use at work that is not fully deterministic (it was deterministic if you considered a whole set of inputs and the amount of RAM you fed it, but if you added more code to analyze it might drop some issues that it found previously from the union of the two sets). Everyone hates that tool.

@c0dec0dec0de @meejah @dreid when I worked on GCC (upwards of 20 years ago now) we went to so much trouble to make sure that turning debug info on or off would not change the generated machine code whatsoever

another lesson lost, i suppose

@dreid Model checking & other formal verification can also be helpful, particularly for stuff that's hard to wrap one's head around.