Mike Chowla ✅1/ I asked ChatGPT to create a career ladder with competencies for Product Managers. At first glance, it looks pretty good but then I looked at it closer and it reads like a generic job descriptions for different levels of Product Managers.
2/ And then hits me, most of the text freely available on the Internet for what different levels of Product Managers do is job descriptions used for recruiting. And thus what ChatGPT spits back is a basically job description.
3/ This is good example of how the output of LLMs will be heavily influenced by what it most common type of text available on a subject.
Matthew Martin@mchowla All summaries of books from chatgpt sound like a quip to sell you a book. Actually that's kind of true of any topic, it sounds like it is trying to sell you on it. Accidental opinions, since if you ask it for an opinion directly, it will disclaim having any opinions.