Timnit Gebru (she/her).Jun 9, 2023
Here's what I wrote in 2015 when our OpenAI overlords were announced, and after I had a terrible experience at NIPS (a conference now named NeuRIPS after a number of people, mostly women demanded a name change and received death threats for doing so. Interesting to see my reflections from ~8 years ago, not much I'd change except for certain phrases I probably wouldn't use now (e.g. implicit bias).
Show threadTimnit Gebru (she/her).Jun 9, 2023

I struggle to understand Silicon Valley’s libertarians’ allergic reaction to discussing problems caused by the extreme homogeneity of the research circle. The same is true for many in the AI research community of which I am a part. As this thoughtfully written letter to SCOTUS from physicists explains,

The implication that physics or “hard sciences” are somehow divorced from the social realities of racism in our society is completely fallacious.

Show threadTimnit Gebru (she/her).Jun 9, 2023

The exclusion of people from physics solely on the basis of the color of their skin is an outrageous outcome that ought to be a top priority for rectification.

The rhetorical pretense that including everyone in physics class is somehow irrelevant to the practice of physics ignores the fact that we have learned and discovered all the amazing facts about the universe through working together in a community.

Show threadTimnit Gebru (she/her).Jun 9, 2023

The benefits of inclusivity and equity are the same for physics as they are for every other aspect of our world.

The statement holds true for AI and any type of “ism”. One would think that the people trying to “stop AI from harming society” would pay attention to this sort of stuff.

Show threadTimnit Gebru (she/her).Jun 9, 2023
However, amidst the wide acclaim given to Elon Musk and others’ announcement of a “non-profit” venture to “Stop AI from destroying humanity,” only one potential problem has been raised: the fact that all the researchers are working on deep learning.
Show threadTimnit Gebru (she/her).Jun 9, 2023
A White tech tycoon born and raised in South Africa during apartheid, along with an all White all male set of investors and researchers is trying to stop AI from “taking over the world” and the only potential problem we see is that “all the researchers are working on deep learning?”
Show threadTimnit Gebru (she/her).Jun 9, 2023
Google recently came out with a computer vision algorithm that classified black people as Apes. AS APES. Some try to explain away this mishap by stating that the algorithm must have picked out color as an essential discriminator in classifying humans.
Show threadTimnit Gebru (she/her).Jun 9, 2023
If there was even one Black person in the team, or just someone who thinks about race, a product classifying Black people as apes would not have been released. Either the dataset would have been sufficiently augmented, or more research into the algorithm would have been mandated. But a product with this type of misclassification would not have been released. Imagine an algorithm that regularly classifies White people as non-human.
Show threadTimnit Gebru (she/her).Jun 9, 2023

No American company would call this a production ready person detection system.

At this point in these types of conversations people usually mention that there aren’t qualified this-or-that group of people who are deep learning researchers. I can name at least 10 extremely qualified female researchers in my sleep--including one who left the field due to exclusion--and swathes of them can be found here (LINK).

Show threadTimnit Gebru (she/her).Jun 9, 2023
When you ask someone to “recommend” potential researchers in this extremely segregated and homogeneous world, they will recommend other researchers who are their friends, read the same hacker news every day and talk about the same things. They will recommend other boys in the very tight boys network.
Show threadTimnit Gebru (she/her).Jun 9, 2023
Funny enough, the same men feel too uncomfortable to participate in events encouraging women in CS simply because the room might be more than 70% women. Go to the conferences, talk to people, attend the parties and you will see.
Show threadTimnit Gebru (she/her).Jun 9, 2023
As the night proceeds, you will be transported to the Madmen era where drunk old men, professors or company representatives from places such as Google, start unsolicitedly groping some of the handful of women present at the conference parties. And the women are either completely assimilated (a well documented method of survival for minorities) or too uncomfortable to speak up.
Show threadTimnit Gebru (she/her).Jun 9, 2023
But that type of overt caricature of sexism is nothing compared to the covert one bestowed upon us by people who believe they are too objective, rational and intelligent to have biases. Keep in mind they are researchers--researchers who have the skills and resources to learn about most subjects they deem to be worthy of their time. But they are simply not interested in an attempt to understand their implicit biases, read literature or ask questions about it.
Show threadTimnit Gebru (she/her).Jun 9, 2023
These are the people creating AI. And the tasks, values and priorities of the AI agent are reflections of those of its creators. People harm society. We don’t have to project into the future to see AI’s potential adverse effects. It is already happening. However, Silicon Valley does not speak out on atrocities such as the US drone warfare that is illegally killing people.
Show threadTimnit Gebru (she/her).Jun 9, 2023
Because presumably the intelligence occupied by this select group of men (many speak as though they belong to a different species with superior intelligence and rationality), cannot be bothered to think of mundane day to day activities such as war. Even the nuclear bomb was not created by physicists whose day to day life was completely divorced from the complex realities of the world we live in.
Show threadShachihoko

@timnitGebru

"... (many speak as though they belong to a different species with superior intelligence and rationality) ..."

Written in 2015, still accurate in 2023 - maybe moreso than ever, to hear chucklheaded knobgoblins like Musk talk about themselves. 😒 And their self-aggrandizing rhetoric is only getting worse.

Meanwhile, they fret openly about the "existential risk" of AI without acting on their handwringing pleas for a pause on training new models ... 🙄

Jun 9, 2023 at 6:07pmWeb