I've ended up with an inquiry from a #DataScience student interested in examples of #harm coming to people because of #data collection (especially in a war context, but open to anything). Do folks have any favorite pointers / examples I could pass along?
@quinnanya "favorite"isn't exactly the right word, but in the 1930s, IBM Germany explicitly pushed computing machinery as a way to collate and identify "undesirables" (see, Shew, Ashley. 2023. Against Technoableism : Rethinking Who Needs Improvement. First edition. New York: W. W. Norton & Company, pp 89-92)
‘The machine did it coldly’: Israel used AI to identify 37,000 Hamas targets

Israeli intelligence sources reveal use of ‘Lavender’ system in Gaza war and claim permission given to kill civilians in pursuit of low-ranking militants

The Guardian
@quinnanya I don't have a specific reference, but the French law forbids collecting people's racial or religious status, because last time the french state recorded these it was used for deporting people during Nazi occupation. A bit of an extreme example perhaps, and not the most recent, but it still has legal consequences to this day.
@Zwifi That's helpful, thank you!
Janet Vertesi (@[email protected])

In the history of data, reuse is a constant. In human history, regime change is a constant. Hence the extractive repurposing going on at #stackoverflow, #github & #reddit to feed AI and take over your jobs. (And countless injustices, like DACA used for ICE, Nazis using invaded country birth records to find Jews, etc). This is the true “tragedy of the commons”: upon hostile acquisition, what was once a gift indicating membership, care, and community is liable to unethical extraction.

Hachyderm.io
@quinnanya also not a specific example but see https://mathbabe.org/ and her book Weapons of Math Destruction
mathbabe

Exploring and venting about quantitative issues

mathbabe

@quinnanya four great examples here. https://www.abc.net.au/listen/programs/rearvision/the-dark-side-of-census-collections/7860908

I also remember reading about the resistance in Belgium or Holland in WWII sabotaging census records, but I can't find the article I was thinking of.

The dark side of census collections - ABC listen

This year may have been a disaster for the reputation of the Australian census, but this kind of population survey has a long history of controversy. Rear Vision looks back on how censuses have been used and misused in modern times.

ABC listen
During World War II, we did have something to hide

The Godwin lecture: Which lessons about privacy can we learn in the present day from the attack on Amsterdam’s municipal register in 1943?

Medium
@quinnanya Anecdotally, one of my student work positions involved cleaning data from anonymous interviews in a politically unstable area. The names & addresses had already been redacted for interviewee safety, but we also had to look for & remove any other info that could potentially be combined together to make an identifiable profile or narrow down a likely location. It was a good lesson in "Just because the dataset is big, doesn't mean the data isn't distinctive."