I love that “you sound scared” has become a way to shut down critics of AI.

…yes.

yes, I absolutely am scared of it.

No, I’m not ashamed of that.

I don’t hate AI. I don't believe it’s going to destroy us terminator style.

But I’m scared half to hell of the misinformation, political divisions, unemployment, manipulation, spam and deepfake porn and what it’s going to do to our world.

Like it or dislike it, everyone should have a healthy level of fear about what this technology can do.

@Daojoan

“When you invent the ship, you also invent the shipwreck; when you invent the plane, you also invent the plane crash; and when you invent electricity, you invent electrocution. Every technology carries its own negativity, which is invented at the same time as technical progress.”

@markmetz @Daojoan Except all those are not *common* outcomes of normal uses of the technology, they are the exceptions, the unintended, while the fears about AI (edit: the problems people complain about/fear) are 1) common (maybe even the norm), and 2) intended (either by the developer or by some of their users).
@mrotteveel @markmetz @Daojoan It's closer to inventing the firearm and therefore gun violence.

That's what a gun is for. For killing things.

AI being used for misinformation, Ads, deepfakes, etc. is not an accident. That's what it's made for. It's what it does.
@Daojoan @markmetz @VinesNFluff @mrotteveel I think a better comparison is the printing press. Sure, it could be used to print propaganda and incite an insurrection. It can also help make accessible a deeper understanding of topics of ever increasing complexity. It can analyze engineering and medical problems in minutes what used to take years. The possibilities that it can unlock are at this point literally beyond our imagination.
@charles @Daojoan @markmetz @VinesNFluff The printing press will print exactly what you tell it to print, from its start. On the other hand, GenAI as it's currently working will tell you the greatest nonsense in a way that is undiscernable from it telling you the truth/correct information.

@Daojoan This reminds us of advice that was really emphasized to Teenage Fiadh when learning to shoot a gun: Have a healthy fear and respect for the powerful technology engineered to kill that you're holding in your hands.

a healthy level of fear about what this technology can do.

@Daojoan “It’s revolutionary!”

So are guns. How well are we doing with those?

@Daojoan I had a disappointing ethics course and the unit on tech opened with the first slide being the Terminator, I was already so very done.
This was in 2018, iirc.

Hollywood AI is not what we are talking about.

It's like asking someone concerned about climate change whether they think Godzilla is gonna show up.

Real, mundane, hideously humdrum dangers exist, and we need to be able to talk about them, ideally without hype spinners trying to hijack the dialogue for their own ends.

@sparrows

"It's like asking someone concerned about climate change whether they think Godzilla is gonna show up." Thank you for crafting the perfect line to reply to these "AI safety" types.

@cholling I felt rather proud of that one, not gonna lie.
@sparrows @Daojoan The Terminator franchise wasn’t about the dangers of AI as such, James Cameron said so. It was about the dangers of militarism and the police state.

@MisuseCase @Daojoan all the more disappointing to have it showing up on the slideshow as the premier danger of AI.

I stand opposed to automated weapons as well, I just think that they're not going to become an independent existential threat anytime soon, just another horrific tool in the military/polices hands.

@sparrows @Daojoan The real danger in AI, or the collection of things we are calling AI, is bigger, harder, and worse policy murder.
@Daojoan I’m not scared because it’s too smart, I’m scared because it’s too dumb
@gumblet @Daojoan I'm not scared about the AI being dumb, I'm scared about people believing it's sooo much smarter than it really is.
@gumblet @Daojoan exactly this. I fear it will fill every place full of garbage and noise. It's already actively doing that.
@Daojoan
AI is a lie. It's predictive programming that lulls the user into complacency by providing quick answers to things that they would normally figure out for themselves. And that's where it becomes dangerous, because the people behind it can steer the lazy.

@Daojoan at the end of the day, it's allways about the who wields the tool. I mean, look at the recent british postal service scandal. People lost jobs, people faced (maybe even got) jail time, because company behind their software would not admit it was faulty.

Glitches in the bits, bad programing, etc. cost lives. When it comes to "AI" just ask JP Morgan if they are willing to tolerate faulty system with "glitches be glitches" rhetoric.

I don't know why should the rest of us.

@Daojoan

What AI advocates sound like.

@Daojoan experts like us warn about the dangers of AI for a while now.

Many you mentioned. Perfectly tailored mass scam being probably the biggest warning. No Indian call centers, but your mothers voice with a convincing story.

Problem is the media putting Terminator style SciFi scenarios into peoples head. If an expert goes on TV to warn about the dangers of AI, they will ask him about murder bots and of course he has to debunk that nonsense, and that is all the audience remembers.

@Daojoan
> I don't believe it’s going to destroy us terminator style.

i am sad that this is not going to happen

@Daojoan
AI will enable the same old, only worse, with less transparency and oversight, at higher speed. What's not to be afraid of, when we see what the "same old" is. Disinformation, cleptocracy, gridlock in all human endeavours.

@Daojoan, I agree with you almost completely... Except that my fear is not what this technology can do, but our imaginative and righteous species can do with it.

For me, at this point, humans are the scary link.

@Daojoan BTW, i think we are going to make amazing things with it. But it is going to take a lot of pruning.
@Daojoan And don't forget electricity and water consumption in data centers.
@CorioPsicologia @Daojoan yes, the number of people who are willing to overlook the environmental cost is really disturbing.

@Rhube @CorioPsicologia I genuinely think a lot of folks haven't even considered that the environmental cost exists. There's just not enough publicly shared information about it.

And honestly - that's on writers and journalists like myself who need to do better.

@Daojoan @CorioPsicologia many do know and don't care, though, that's what enrages me.
@CorioPsicologia always the forgotten part of this shit
@Daojoan We should be scared, not by the tech itself but by the shitty ends people will use it for.
@nini guns don't kill people, people kill people. But we still need to stop giving people guns.

@Daojoan Similarly, LLMs can be useful but it's a very narrow array of use cases. You can't just let anyone use them and they should require some amount of expertise and responsibility in order to use them.

While firearms are far more dangerous than any image, they both have great power and require great responsibility and knowledge to be used.

@Daojoan I mean, they aren't even hiding the fact that they intend to take all our jobs away from us!
@Daojoan You are not scared of AI, You are scared of humanity, and for good reasons
@Daojoan I don't even know that I would say I'm scared. It's just that it's already ruining the Internet, making far too much of it useless. The Internet has been in a slow and steady decline for so long now, and AI is just turbo charging the dumpster fire straight into a nuclear wasteland. And it just makes me sad. And mad.

@Daojoan but yeah, I suppose also a bit fearful for what this does mean for the future.

Hopefully all the wing dings pumping all this money into all this bullshit lose their ass quick enough and this shit starts to fall away. But, that's probably nothing but wishful thinking.

@finner sadly, unlike with crypto, I think it’s here to stay. The path ahead is just mitigating it more than anything.
@Daojoan I agree with you 100%. Seems now we're going to have to fact-check AI.
@unchartedsandbox I know I for one am fact checking everything I read way more often and way more thoroughly. And I’m a journalist. Fact checking is in my job description

@Daojoan

@unchartedsandbox I'm not a journalist. I can fact check but it is a lot of effort and I already have more todo than I have time for.

@Daojoan Generative AI should have never existed. Never ever.

It's not only a tool of capitalism to kill art and creativity, it will also be the weapon for propaganda and fascism.

@Daojoan "scared of AI" as in "scared of mold". Like mold, it's not going to become sentient and eat us all. But also like mold, it has a tendency to spoil previously good things, and my preferred amount of it in my (information) diet is zero with very few, carefully selected exceptions. Those exceptions, or the bries among the internet mold that is AI, are things like automatic transcription or translation.
@jaseg damn I wish I’d thought of this analogy. Nailed it.
@jaseg @Daojoan God, the transcription stuff with SHOULD be a major selling point but it's 'boring'. "We have STT at home" they say and point at DragonSpeak and Google Assistant, because using language models to score possible detections and even predict next ones with far greater accuracy than autocomplete on a phone keyboard is fantastic, but boring in a press release. If it's not something new, who cares that it's an enormous improvement on what we already have AND can run on dinky hardware.

@KayOhtie
yeah this is the one thing that annoys me.

TTS has seen huge enhancements recently, but basically none of them have been rolled out
@jaseg

cordyceps has entered the chat
(google zombie ants)
@jaseg @Daojoan
@p @jaseg @Daojoan irl cordyceps' relationship to humans is probably closer to brie than to the tyrant virus or whatever so the analogy works even better https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3909570/
Pharmacological and therapeutic potential of Cordyceps with special reference to Cordycepin

An entomopathogenic fungus, Cordyceps sp. has been known to have numerous pharmacological and therapeutic implications, especially, in terms of human health making it a suitable candidate for ethno-pharmacological use. Main constituent of the extract ...

PubMed Central (PMC)
@jaseg @Daojoan ai and mold alsp share horror movies being made about them 🤔

With the same justification I may claim

– AI doosters mold AI discussion. In future AI can symbolically mold everything where it has been used, just because it was used there. Mere association incriminates.

– Despite of AI propaganda has already molded our cognitive filters during tens of years: #Finnlandization, nuclear fear, submission and appeasement under evil power politics, etc.

– Why wouldn't the democratization increase #MediaLiteracy just like internet memes did?

@jaseg @Daojoan

@jaseg @Daojoan that's such a good analogy
Eight smart things slime molds can do without a brain

From remembering where they’ve been to recreating the Tokyo rail network, these “slimy aliens” are capable of way more than we give them credit for.

Nova
@jaseg @hisham_hm @Daojoan
I'd add "image recognition for the blind" to that short list, which was
my main inspiration for writing https://2mb.codes/~cmb/ollama-bot.
Right now I'm working on a tool tentatively named vidantilo
(Esperanto for "a seeing tool") that will take an image uploaded via the web,
describe it, and let you ask additional questions about it. And all of this
stuff is free software that runs on infrastructure that I or my friend group owns. "Look ma,
no stupid cloud providers or obnoxious meddlesome megacorps!"
@chris @jaseg @Daojoan nice! the FOSS community definitely needs to "take back" machine learning. The fact that the _idea_ of AI is so intertwined with megacorps in society's mind is a problem. But that same was true of operating systems and so many kinds of software.
@jaseg @Daojoan Mold also makes delicious Tempeh, just saying
@jaseg @Daojoan Also, like mold, no matter how much you dare me to consume it or call me chicken for not consuming it, I'm not going to bite into a thing where it already has it, and be rather worried when I find out something I bit into has it inside of it, originally hidden.

@jaseg @Daojoan I mean we used to have fungus infect graneries and drive whole towns mad, seems good to be wary of it

It also fucks up people without the immunity to fight against it (oops it’s in lungs/blood oh no)

I guess this analogy works pretty well