"By now Cluely had been listening in on our conversation for a while, and I suggested that we open it up and see what it thought I should say next. I clicked the button marked what should i say next? Cluely suggested that I say, “Yeah, let’s open up Cluely and see what it’s doing right now—can you share your screen or walk me through what you’re seeing?” I’d already said pretty much exactly this, but since it had shown up onscreen I read it out loud. Cluely helpfully transcribed my repeating its suggestion, and then suggested that I say, “Alright, I’ve got Cluely open—here’s what I’m looking at right now.” I’m not sure who exactly I was supposed to be saying this to—possibly myself. Somehow our conversation seemed to have gotten stuck on the process of opening Cluely, despite the fact that Cluely was, in fact, already open. But I said it anyway, since I was now just repeating everything that came up on the screen. Cluely then told me to respond—to either it or myself; it was getting hard to tell at this point—by saying, “Great, I’m ready—just let me know what you want Cluely to check or help with next.” I started to worry that I would be trapped in this conversation forever, constantly repeating the machine’s words back to it as it pretended to be me. I told Roy that I wasn’t sure this was particularly useful. This seemed to confuse him. He asked, “I mean, what would you have wanted it to say?”
Ifound it strange that Roy couldn’t see the glaring contradiction in his own project. Here was someone who reacted very violently to anyone who tried to tell him what to do. At the same time, his grand contribution to the world was a piece of software that told people what to do."
https://harpers.org/archive/2026/03/childs-play-sam-kriss-ai-startup-roy-lee/
#AI #GenerativeAI #AIAgents #AGI #SanFrancisco #Startups #Cluely