@DJGummikuh @jpmens when I think about whether I can trust "vibe coding" (aka LLMs rolling the dice) I think about the many times I asked Gemini to tell me the current headlines on CNN.com, and it proceeded to say a few ones that sounded plausible, plus one where they said President Biden planned to spend the upcoming weekend preparing for his next debate with GOP nominee Trump. I asked it this question in May 2025.

I asked it to read aloud to me the 1st chapter of a specific Sherlock Holmes book that is well known to me. It began with a scene of Sherlock injecting himself with heroin. Which was interesting because he does do that at one point in one of his books. But he def didnt in the opening of that book. I know because I had it open before me and was staring at it. Just like CNN.

I've asked an LLM if it was raining in my town currently. It replied with utter confidence, no, and that in fact it was impossible. The chance for rain is 0. Which was weird because right then I was looking out my front door at a torrential downpour.

But yeah... we're supposed to trust the "experts" who build those things with software, which is much easier to fuck up in subtle ways harder to see at first glance. Nein! ha