A phenomenon I've noticed recently is people trying to occupy some untenable middleground wrt to the use of systems sold as "AI" -- this is a position where people try to recognize the harms of this tech but also hold space for "responsible" or "ethical" use.

🧵>>

When someone is trying to hold this untenable position, a few things tend to come up (not everytime, not everyone):

1- Defensiveness. People read criticism of the systems and proposed uses of the systems as accusations that users are "bad people". Thus a criticism of the tech lands as criticism of the user, and tensions flare.
>>

2- Righteousness. People do have legitimate needs, often unmet needs, and the synthetic text extruding machines can *look like* a solution. But just because the problems are real doesn't mean the solution is beneficial, effective, or worth (not always externalized) costs. Unfortunately, pointing out any of this is taken as the same as saying you don't care about the legitimate needs.
>>
3- Whataboutism. This is used to brush off concerns about the externtalities of these systems. You eat meat, you fly on airplanes, etc, etc, how dare you talk about the impacts of data centers?
>>

4- Tone policing. People who are trying to occupy that uncomfortable, untenable space will claim that clear statements of harms/strong principles against use of these systems will "turn others away" as if the centrists are the ones actually pushing for more ethical practice.

But this "other people won't listen" remark I think is really a way of saying "This makes me uncomfortable" while trying to claim to be on the right side of history at the same time.
>>

5- Wishcasting. Some folks will point to scientific results from fields outside their own (usually media coverage thereof) that are marketed as having been done with "AI" and ask: How could you take a hardline against "AI" when it has provided XYZ?
>>
6- Exceptionalism. "I know this can be dangerous for people in general, but I know how to use it carefully."/"I know how to verify every output, and I am not deskilling myself." How do you know? Also, if you acknowledge the dangers to others, what example are you setting by talking about/talking up your use?
>>
So what is the best way out of that uncomfortable, untenable space? I think one key step is disaggregating the (non-coherent) set of technologies sold as "AI". If you don't call the stuff you work with "AI", you aren't saddled with trying to defend any of the rest of it.
>>
The most recent iteration of this conversation I was involved in turned in part on a strange, over-expansive definition of "genAI" which included, for ex, optical character recognition (OCR).
>>

OCR can be a useful tool for many research projects! OCR is also the kind of technology that gets better with better language models, i.e. more fine-grained models of which word(parts) go where. That has been true since before "genAI" and will be true after.

Just because you can use the synthetic media extruding machines to approximate the task of OCR, however, doesn't mean that that task can or should be used to justify the use of "genAI" in research.
>>

I think another important step is a values examination. What is important to you? How are those values supported or not by entering the discourse in a way that holds space for OpenAI/Anthropic/Google/Meta and all the other actors in this massive push to shove "AI" into every part of our lives as "not all bad"?

What are your research goals, what do you value about participating in scholarship, how can you meet those goals/act in accordance with those values and what obstacles are in your way?
>>

Part of what makes that middle ground untenable and uncomfortable, I think, is that it requires carrying water for these clearly bad actors. You can set that bucket down and step out onto firmer ground.

This does require going against the mainstream, but that gets easier when a) you find you're not alone and b) you see how much of mainstream opinion on this is actually the result of marketing.

/fin for now

@emilymbender

i despise AI because of its energy waste, its abuse of source material it rips off without attribution, and how it concentrates power with these amoral techbros who can use it for all sorts of malicious goals

but i always wondered if AI could be a standalone thing, something you ran yourself, at home, so there is no exposure to manipulative outside agendas, if i would have the same objections. assuming sane power usage and respect for creators. and assuming complete privacy

@benroyce You can do this now, with the open source models that run on a local machine. But while they're freely released, they were still trained much the same way at source. @emilymbender
@nzlemming @emilymbender yeah that's a problem

@benroyce @nzlemming @emilymbender

Yup, this seems to be the catch, when you ask people where their training data comes from they either don't know or won't say.

Also, even if they somehow used entirely home-made ethically-obtained training data, it is still destroying the user's brain through lack of mental exercise and burning the planet as the "training" process uses a lot of energy.

@FediThing @nzlemming @emilymbender

yup

that's the dominant topic with #AI:

it makes us dumb

we talk of extending people's abilities with AI

no

we lose abilities (or never gain them)

our brain atrophies like unused muscle

dependent upon a piece of silicon that doesn't care at best. at worst, with corporate AI, works agendas on us, and, not distant scifi but soon, abusive psyops on us

cages on our brain that know us better than we know ourselves, and our brains too flabby to even notice

@benroyce @FediThing @nzlemming @emilymbender Exactly. When Sam Altman said he wanted intelligence to be a commodity that people rent off him, he didn't mean "intelligence" in the sense that police and security services mean it. He meant our ability to think.

He and these other Silicon Valley freaks envision a future in which everyone is utterly dependent on their agents to accomplish any task that makes cognitive demands on us. The tech broligarchy want to infantilize and enslave all humanity.

@ApostateEnglishman @benroyce @FediThing @nzlemming @emilymbender

100% agree. #GenAISlop machines are designed for #outsourcing brain functions. Not only are we guaranteed of becoming ever more stupid, but we’ll pay for the privilege. we could learn a thing or two from #cephalopods .

#StopTheGenAIMadnessNow

Apologies for budding-in. LLM GenAI is in the new again along with its #KoolAid served to our #PoliticalClass. I’ll shut up now and get back in my box.

@RaymondPierreL3 @benroyce @FediThing @nzlemming @emilymbender Well...about that. Let's agree there's a big difference between butting in to constructively contribute to a discussion (which is just how social media works!), and doing so to police how strangers use the fedi, as if someone died and made you the boss.

As Ben says, preach! ✊🏼

@ApostateEnglishman
There are #moderators on the fedi doing a great job in keeping the #fedi vibrant and non-toxic. Dog knows it’s not an easy job.
For the record, I’m not anti AI, just anti #AISlop. In any discussions on this topic it is important to distinguish between the ‘text vaccum/regurgitators’ and trained statistical-engines and pattern-matching AI applications designed to bring a helping hand to humans doing their professional best while respecting data provenance conventions & privacy (not an expert here so words are missing to describe the differences which matter to me — I’m a great fan of what Cory Doctorow @pluralistic has to say on this subject).

Aside from that, I’ll keep preaching… thank you for your toot.