A phenomenon I've noticed recently is people trying to occupy some untenable middleground wrt to the use of systems sold as "AI" -- this is a position where people try to recognize the harms of this tech but also hold space for "responsible" or "ethical" use.

🧡>>

When someone is trying to hold this untenable position, a few things tend to come up (not everytime, not everyone):

1- Defensiveness. People read criticism of the systems and proposed uses of the systems as accusations that users are "bad people". Thus a criticism of the tech lands as criticism of the user, and tensions flare.
>>

2- Righteousness. People do have legitimate needs, often unmet needs, and the synthetic text extruding machines can *look like* a solution. But just because the problems are real doesn't mean the solution is beneficial, effective, or worth (not always externalized) costs. Unfortunately, pointing out any of this is taken as the same as saying you don't care about the legitimate needs.
>>
3- Whataboutism. This is used to brush off concerns about the externtalities of these systems. You eat meat, you fly on airplanes, etc, etc, how dare you talk about the impacts of data centers?
>>

4- Tone policing. People who are trying to occupy that uncomfortable, untenable space will claim that clear statements of harms/strong principles against use of these systems will "turn others away" as if the centrists are the ones actually pushing for more ethical practice.

But this "other people won't listen" remark I think is really a way of saying "This makes me uncomfortable" while trying to claim to be on the right side of history at the same time.
>>

5- Wishcasting. Some folks will point to scientific results from fields outside their own (usually media coverage thereof) that are marketed as having been done with "AI" and ask: How could you take a hardline against "AI" when it has provided XYZ?
>>
6- Exceptionalism. "I know this can be dangerous for people in general, but I know how to use it carefully."/"I know how to verify every output, and I am not deskilling myself." How do you know? Also, if you acknowledge the dangers to others, what example are you setting by talking about/talking up your use?
>>
So what is the best way out of that uncomfortable, untenable space? I think one key step is disaggregating the (non-coherent) set of technologies sold as "AI". If you don't call the stuff you work with "AI", you aren't saddled with trying to defend any of the rest of it.
>>
The most recent iteration of this conversation I was involved in turned in part on a strange, over-expansive definition of "genAI" which included, for ex, optical character recognition (OCR).
>>

OCR can be a useful tool for many research projects! OCR is also the kind of technology that gets better with better language models, i.e. more fine-grained models of which word(parts) go where. That has been true since before "genAI" and will be true after.

Just because you can use the synthetic media extruding machines to approximate the task of OCR, however, doesn't mean that that task can or should be used to justify the use of "genAI" in research.
>>

I think another important step is a values examination. What is important to you? How are those values supported or not by entering the discourse in a way that holds space for OpenAI/Anthropic/Google/Meta and all the other actors in this massive push to shove "AI" into every part of our lives as "not all bad"?

What are your research goals, what do you value about participating in scholarship, how can you meet those goals/act in accordance with those values and what obstacles are in your way?
>>

Part of what makes that middle ground untenable and uncomfortable, I think, is that it requires carrying water for these clearly bad actors. You can set that bucket down and step out onto firmer ground.

This does require going against the mainstream, but that gets easier when a) you find you're not alone and b) you see how much of mainstream opinion on this is actually the result of marketing.

/fin for now

@emilymbender Heard an interview today with two of the execs from Anthropic. The way they describe their products is maddening. They use words like thinking, intuition, and understanding. None of that is going on. I was screaming at the podcast.

@xvf17 @emilymbender THIS IS SO UPSETTING. I am one of those folks advocating for using certain types of machine learning responsibly, like "identify the patients with cancer" which ML tools can do better than humans, and which were trained using ethical data sources.

But the LLM field is just a cesspool. I can *see* use cases for it, but holy shit fruit of the corrupt root system with that training data.

@SomeVeganCheeseIsOk
Oh no dude. This prof thinks you are an asshole then.

Read what she wrote again. She is full of fallacies herself.
@xvf17 @emilymbender

@Noisecolor @xvf17 @emilymbender I don't see that, really. She asks us to make certain specific things more clear in our speech, which is GOOD because "AI" as a term is so overused and awful, and you can't make good decisions on bad information. LLMs *are* a nightmare and *are* heavily overused and *do* have horrendous ethical issues. But machine learning is not always "AI", and I like people being asked to make the distinction because it's an important step.
@SomeVeganCheeseIsOk
Nightmare, heavily, horrendous... I don't think those are words that make anything clear.
I don't know what ai is when you put it in quotes.
I guess the good ai is the one you like and the bad ai is what bad people use or something?
@xvf17 @emilymbender
@SomeVeganCheeseIsOk @emilymbender @Noisecolor LLMs of today are not AI, in the traditional sense. The ChatGPT folks coopted the term. People (like me) who put it in quotes are doing it as a form of protest.

@xvf17
As far as I know AI was coined as simulated intelligence. I think LLMs are exactly that.
Ai is a term that we used to describe a bunch of systems. Chess engines, opponents in video games,... Now LLMs. Perhaps someday when we have even better systems we will call them ai, but for now ai seems to fit LLMs completely.

@SomeVeganCheeseIsOk @emilymbender

@SomeVeganCheeseIsOk @emilymbender @Noisecolor they are not simulated intelligence. That’s precisely my point.
@xvf17
Really? πŸ˜€
How is it not a simulation of intelligence?
@SomeVeganCheeseIsOk @emilymbender
@SomeVeganCheeseIsOk @emilymbender @Noisecolor it doesn’t reason. It doesn’t understand. It can’t explain its thinking. It has no intelligence. Stop believing the hype. For crying out loud.
@SomeVeganCheeseIsOk @emilymbender @Noisecolor @xvf17 don’t look at the apparent successes. Look at the failures. They are moronic nonsensical spews of gibberish. Their failure modes are entirely inconsistent with intelligence.
@xvf17
Thats great for you then. Because if they are so bad, no one will use them, right?
Not like hundreds of millions of people would use such a bad tool daily, creating any kind of pollution or if it.
@SomeVeganCheeseIsOk @emilymbender
@xvf17
Yes, a simulated intelligence exactly. I wish someone invented a term that describes that. Oh, wait,...
@SomeVeganCheeseIsOk @emilymbender

@Noisecolor @xvf17 @emilymbender

Let me clarify: "AI" is an unbounded marketing term with wildly ambitious, ambiguous definitions. No machine performs contextual reasoning like a human at this time, but that's the implication of "AI" to most folks. Machine Learning is a bounded, defined, useful term which talks about compute systems with specific capabilities.

@Noisecolor @xvf17 @emilymbender Large Language Models are a form of machine learning that was built on stolen data by companies who, in part, design it to capture and hold attention for as long as possible, much like social media, to extract paid tokens from users. LLMs are the 1-900 numbers of this age. But worse, because they are simultaneously somehow a social disaster undermining human skills, an ecological disaster, and an economic disaster.
@Noisecolor @xvf17 @emilymbender How you do things matters. What you do with things matters. And everything counts in large amounts.

@SomeVeganCheeseIsOk
But that's not precise nor clear at all. You are mixing tech itself with I don't know what that is, some kind of preaching? It sure sounds like you found your external enemy you can pin everything on and hate together with a group. Like a mob or a cult

@xvf17 @emilymbender

@SomeVeganCheeseIsOk
It's not a marketing term. It's an old term that people have been using for a while. And I don't think it's ever been used to describe a machine person that's alive. It was always used as simulated intelligence. Which LLMs are. It's a very good description.

@xvf17 @emilymbender