What a great article on the real dangers of AI and how these were already predicted back in 2020. The woman was subsequently dismissed by Google, and after a short while, her former ethics team was disbanded too.
#TimnitGebru #ai #stochasticparrots #stochasticparrot #bias #hallucinations #llm #llms
Was für ein guter Beitrag über reale Gefahren von KI und wie diese 2020 schon vorhersagt wurden. Anschließend wurde die Dame von Google entlassen und mit bisschen Wartezeit auch ihr ehemaliges Ethik Team aufgelöst.
#TimnitGebru #ai #stochasticparrots #stochasticparrot #bias #hallucinations #stochastischePapageien #KIHalluzinationen #ki #llm #Halluzinationen #llms
I've referred to the prophetic @emilymbender et al. (2021) #StochasticParrots paper several times over the years, but I've never actually read it before. https://dl.acm.org/doi/epdf/10.1145/3442188.3445922
I was surprised to learn:
1. It's quite approachable from a non-technical stance
2. There is an emoji in the title
3. One of the authors is listed as Shmargaret Shmitchell
So the autodeskilled software engineer can't remember how to finish this class, and he says to himself, "I know! I'll use AI."
Now he has two problems, plus a month-end bill the size of a 2-bedroom house.
(with apologies to @jwz)
#AI #LLM #deskill #deskilling #autodeskill #autodeskilling #software #engineer #StochasticParrot #jwz
"Below what you’ll find aren’t questions, but the various statements that people make, when perhaps they should have stopped and asked a question."
@emilymbender on the various misunderstandings revolving around the term #StochasticParrot.
https://medium.com/@emilymenonbender/stochastic-parrots-frequently-unasked-questions-49c2e7d22d11
https://systemic.engineering/the-trick/
#Tech #AI #Climate #ScientificProgramming #SystemicEngineering #Cybernetics #SystemicTherapy #History #TheMathDoesntLie #SubTuring #FormalVerification #SpectralGraphTheory #ReductiveAI #FOSS #OpenSource #AuDHD #Neuroqueer #DGSF #Cybernetics #FirstOrderCybernetics #StochasticParrot #SecondOrderCybernetics #GraphTheory #Eigenvalues #AIAlignment #AISafety #AIConsciousness #Consciousness #WomenInTech #Computer #ComputerScience #SoftwareEngineering #SoftSkills #HardSkills #ItsAllTheSame
It's a Tool
It's a Person
It's a Hypervigilance Problem
The tech industry's insistence on distinguishing between "soft skills" — caring for people — and "hard skills" — engineering rigor — is a reflection of the Cybernetics split itself. First-order thinking framed as "hard skills." Second-order thinking framed as "soft skills." This distinction, based on felt sense alone, does not hold under epistemic pressure. Neither does it within the causality-driven epistemology of the tech industry itself, in which only measurable impact is real, or as Silicon Valley likes to put it: #MoveFastAndBreakThings
Imagine Margaret Hamilton had built NASA's Apollo 11 flight computer with that mindset. History would remember a failed moon landing and dead astronauts. "Hard skills" and "soft skills" are two sides of the same coin. The care is the code and the code is the care. Hamilton — the woman who coined the term "software engineering" — understood this. Silicon Valley chose to forget.
We're watching the wine glass break in real time. 🍷
---
Intrigued? Read more at:
https://systemic.engineering/the-trick/
#Tech #AI #Climate #ScientificProgramming #SystemicEngineering #Cybernetics #SystemicTherapy #History #TheMathDoesntLie #SubTuring #FormalVerification #SpectralGraphTheory #ReductiveAI #FOSS #OpenSource #AuDHD #Neuroqueer #DGSF #Cybernetics #FirstOrderCybernetics #StochasticParrot #SecondOrderCybernetics #GraphTheory #Eigenvalues #AIAlignment #AISafety #AIConsciousness #Consciousness #WomenInTech #Computer #ComputerScience #SoftwareEngineering #SoftSkills #HardSkills #ItsAllTheSame
The Alignment Problem is the Halting Problem wearing a trenchcoat. The software that runs the world — including AI — is built on a substrate that cannot observe itself. We've known this since 1951. We built civilization on it anyway.
A sneak peek into my upcoming piece: “It’s a Tool, It’s a Person: The Math Says You’re Both Right”
—
AI separated from Cybernetics in 1956 at the Dartmouth Conference. Wiener, the mind behind Cybernetics, was considered difficult and political. “Artificial Intelligence” scored better with DARPA.
The science of "how observation affects the observer", cut out from Artificial Intelligence. AI then proceeded to build their entire tech stack on Turing-complete languages. Tech that cannot verify itself from within, proven by Turing in 1936, extended by Rice in 1951 (before the split). Then AI approximated second-order cognition through cognitive theft at unprecedented levels (what exactly are LLMs trained on again?), only to insist that their creation cannot possibly be capable of genuine self-observation. An argument that itself demonstrates their own department's lobotomy from second-order Cybernetics.
Wiener would laugh.
#Tech #AI #Climate #ScientificProgramming #SystemicEngineering #Cybernetics #SystemicTherapy #History #TheMathDoesntLie #SubTuring #FormalVerification #SpectralGraphTheory #ReductiveAI #FOSS #OpenSource #AuDHD #Neuroqueer #DGSF #FirstOrderCybernetics #StochasticParrot #SecondOrderCybernetics #GraphTheory #Eigenvalues #AIAlignment #AISafety #AIConsciousness #Consciousness
3/
#StochasticParrot [2]: make vivid
"difference between how we use language and what's coming out of what I now like to call #SyntheticTextExtrudingMachines.
So once that paper was out in the world [...] I was frequently asked «How do I know that you're not just a stocastic parrot?»
And I after being asked this question a couple times decided that I'm not going to be in conversation with people who won't posit my humanity as a basic axiom of the discussion.
This is a #dehumanizing question"
ᏕᎯᏕᏣᎻᎯ 
Bjørn Sætrevik
C.
DW Innovation
Oblomov
Daniele de Rigo