No, You Shouldn't Let Your Kids Use ChatGPT. A thread. 🧵

1/16

We pretend that because the interface is clean and there’s no nicotine, no violence, no nudity, that it’s safe. It looks like a homework helper. A science fair assistant. A miracle of modern education.

That’s just marketing.

2/16

You wouldn’t let your child hang out unsupervised with a stranger - especially one who lies confidently, speaks with artificial authority, and occasionally invents facts.

3/16

But that’s what we’re doing when we let them talk to generative AI with no guardrails and no context. It looks smart. It feels friendly. It sounds right. That’s exactly what makes it dangerous.

4/16

We underestimate how deeply plastic the young mind is.

Kids don’t use tools; they internalize them.

5/16

Kids learn how to think by watching thinking happen. When you train on a language model, it doesn’t learn truth, it learns patterns. When a kid trains on a language model, the same thing happens. They start seeing speech as performance.

6/16

They start believing fluency equals wisdom. They mimic the mimicry.

7/16

We don’t give a five-year-old a credit card and say, “Good luck budgeting.” We don’t drop a 10-year-old into Times Square at midnight and call it a field trip.

8/16

We create buffers. We wait until they’ve got context, maturity, the ability to weigh signal from noise.

And even then, we supervise.

9/16

ChatGPT etc are powerful - and fundamentally misaligned with how kids learn to trust, reason, and discern.

10/16

These models shape the questions you ask next. They don’t reflect your thinking. They nudge it. Relentlessly.

11/16

I'm not trying to create a panic. This is a boundary. If you wouldn’t let your kid join Twitter, if you wouldn’t let them Google health symptoms unsupervised, don’t let them outsource cognition to a system you don’t understand.

12/16

Curiosity needs friction. Learning needs surprise. Wisdom needs mistakes. Models don’t offer that. They offer something faster, smoother, and emptier.

13/16

We can teach kids to use these tools with judgment, with context, with skepticism. But that starts with a pause. With an adult in the room. With a conversation about what these models are and what they’re not. It starts with treating intelligence as more than output.

14/16

Once you flatten knowledge into prediction, once you replace the actual road of learning with a shortcut that feels smarter than you are, you’ve done more harm than you know.

15/16

You’ve reshaped the map your kid is using to navigate the world.

You’ve said: here’s something that sounds like thinking.

Something easier than thinking.

Good luck un-ringing that bell.

16/16

@Daojoan - exactly 👍 - we ignore the fact that it is in the vested interest of these tech companies that we get addicted to these dethinking machines. Once we are hooked on them, we lack the means of critical thought to question what the purpose is and what we are as human beings

@retrakker @Daojoan

Take the AI hype in context:
1. Joni Ernst "all going to die anyway" nihilism
2. Elon Musk's "empathy is for the weak" narratives.

Habituating your child to treating people like they treat an AI device.

Frank Herbert -- Dune
"The devices themselves condition the users to employ each other the way they employ machines."

@Npars01 only just catching up on the Ernst stuff. Wow.

@Daojoan @Npars01
Do NOT let your children anywhere near LLMs (so-called "AI")...

Here are a couple of reasons:
https://mastodon.social/@ekis/114613560446815567
and even more disturbing:
https://mastodon.social/@ekis/114613739460407851

@Daojoan @Npars01
And if that's not good enough, how about this...?

People have literally started to worship it. #doomed

"People Are Losing Loved Ones to AI-Fueled Spiritual Fantasies
Self-styled prophets are claiming they have 'awakened' chatbots and accessed the secrets of the universe through ChatGPT"
https://archive.ph/eeesj#selection-1485.0-1485.61

‘Trump and Musk are setting the example’: how companies are becoming emboldened to be more anti-union

As the White House carries out an anti-worker agenda, labor leaders fear corporate America could also grow more hostile

The Guardian

@Npars01

Elon: a sociopath lamenting on the nature of empathy is like a vegan talking about steak recipes.

Ernst: “we’re all gonna get fukt, but at least I’m getting screwed in the pleasant way and get paid for it”

@retrakker @Daojoan
See also a simple nudged AI being very effective in pushing people in the way they're being nudged.
https://researchmap.jp/acubed/published_papers/25006202
アダムス アンドリュー (Andrew A Adams) - The Effects of Nudging a Privacy Setting Suggestion Algorithm's Outputs on User Acceptability - 論文 - researchmap

researchmapは、日本の研究者情報を収集・公開するとともに、研究者等による情報発信の場や研究者等の間の情報交換の場を提供することを目的として、国立研究開発法人科学技術振興機構(JST)が運営するサービスです。

@retrakker @Daojoan
See also a simple nudged AI being very effective in pushing people in the way they're being nudged.
https://researchmap.jp/acubed/published_papers/25006202
アダムス アンドリュー (Andrew A Adams) - The Effects of Nudging a Privacy Setting Suggestion Algorithm's Outputs on User Acceptability - 論文 - researchmap

researchmapは、日本の研究者情報を収集・公開するとともに、研究者等による情報発信の場や研究者等の間の情報交換の場を提供することを目的として、国立研究開発法人科学技術振興機構(JST)が運営するサービスです。

@Daojoan first hand experience of this on reddit agrees with this: https://www.reddit.com/r/ChatGPT/s/OSIbnXh6oA
@Daojoan I'm pretty sure this danger exists (to a lesser extent maybe, or it takes longer) for adults as well.
@thechris @Daojoan Strongly agree! I don't want to sound tyrannical but I told my significant other to avoid ChatGPT, since it's the easiest way to become brainwashed and misinformed. (I feel myself an abusive, control-freak partner for not allowing a so-called AI to abuse and control my love. Quite ironical.)
@Daojoan great thread, additional complexity, it's not about "ChatGPT" only anymore, the technology is integrated in Google Search and many other applications, visible or less visible. If we want to limit kids, limit screentime is the only way i guess but how realistic is that with current smartphone use...also national government and EU are slow or not regulating enough, a hard time to raise kids (mine are 18+ so i just coach them with regard to AI they use regularly by the way...)
@ErikJonker All true. And - as a parent - these are the things keeping me up at night.
@ErikJonker @Daojoan As always, the kids are the savvy ones who know this shit is cringe garbage. It's the adults who are a threat. But adults want to take away kids' access to friendships and information as punishment for adults being awful... 🙄 🤬
@dalias @ErikJonker @Daojoan I wish kids would be that self-aware, but sadly that's not what happened to kids of 2010s when iPhones with selfie cameras and Instagram came out... Broken generation of kids :(
@serg @ErikJonker @Daojoan "Broken generations of kids" is something only members of broken generations of olds would say or even think.

@dalias @ErikJonker @Daojoan I wish you were right, but that's not what the data shows. Check out https://app.thestorygraph.com/books/0ae97ada-0a45-478a-a11a-ec8d01d688d7 and maybe it will change your mind.

To draw a parallel - do you think it's ok to market and sell cigarettes to kids? Do they have enough insight to know that it's cringe?

@serg @ErikJonker @Daojoan No, that kind of propaganda will not change my mind.

This generation is anxious because the olds gave them a fundamentally fucked up world and hoarded the resources they'd need to survive it. Not because they had access to information to learn about how fucked up it is.

@serg @ErikJonker @Daojoan Regarding stuff that's actually harmful, like Facebook or AI, repeatedly the perverse "think of the children" response is to ban children from participating in life, rather than to ban the harmful thing, so that abusers can keep exploiting adults.

Ban it for everyone.

@dalias @ErikJonker @Daojoan gotcha, makes sense. I actually wonder if a total ban of attention economy and addictive engagement strategies would make our society waaaaay healthier. I find it very sad that adults try to hack kids habits in their formative years as they think if they hook them now - they hook them for life. That's the shitty part.
@serg @ErikJonker @Daojoan Ban adtech and tracking and regulate paid speech and that shit would cease to exist on its own.
@dalias @ErikJonker @Daojoan If you have any ideas on how to promote/support an initiative like that - lmk!
@dalias @ErikJonker @Daojoan also, we all are broken atm - kids and adults. I guess we all are trying to figure out how to get out of this shitty trap we got ourselves into.
@serg @ErikJonker @Daojoan They didn't get themselves into it. We (and our parents) put them in it. And must not demean or punish them for that but own up to the fuckery and who's responsible.
@Daojoan I feel like almost all this applies equally if you replace "generative AI" by "social media"
@vegard I don’t disagree with that
@Daojoan 👍I think there is also one other issue. Those agents are super enthusiastic, always polite and happy to explain. It is a pleasant experience to chat about some topic of interest. Our human relationships are not like that - we have bad days, sometimes loose patience, get bored with a topic.
As we grow up we learn how to handle such situations. I'm concerned people may start expecting others around to act like a chatbot and once that fails, loose all motivation to build relationships.
@Daojoan Plenty of food for thought in your thread. I don't even have kids and benefit from reading it. Thanks!
@Daojoan 💯 concurrently, this is happening to "adults"... I'm witnessing it at my place of work in real time.

@Daojoan

We are all of us a product of our environment. Cannot imagine what kind of dysfunction might result for a child growing up thinking their ChatGPT sessions are legitimate sources for role modelling.

It's like what Fox News did to our grandparents.

@ewen @Daojoan

It's what advertisers have done to our brains for 100 years. Shaped us to be passive consumers, to eschew compromise and organizing with fellow workers, and to accept TV news readers in lieu of reading, literacy, and critical thinking.

They set us up for what came next.

@Daojoan
The men in charge of these llm megaprojects are ivy league educated, lifelong readers of the science fiction of the last century - they read the stories predicting exactly what we see happening, and exactly what is being explained here.

What if that *is* the point? If alongside profit for themselves, the reason LLMs must replace anything they can as fast as they can is to hasten the atrophy of critical thinking, replacing it with a dependance on - who other - big tech oligarchs.

They also read #yarvin.

@Daojoan

LLMs will some day be remembered, if they are remembered at all, as the lead paint/leaded fuel/DDT of computing.

@Daojoan important issues you bring up; but aren’t you sort of “preaching to the choir”? some of us witnessed the failure of 2005-2008 first hand: which was educate the educators first… about how companies are monetizing human behavior, how K-12 is being targeted by corporate greed, and once you teach the teacher, they take it from there (turns out they are really smart, just need to be shown); we failed to educate teachers abt social media in its infancy; let’s not fail them now