there's something real fucking dark about how AI is too inaccurate for tracking people around a grocery store so they have humans to make sure every last item is paid for, whereas if your AI is generating targets for a genocide then a serious error rate is perfectly within acceptable parameters.

@zip just two sides of the same coin, isnt it?

whats that terry pratchett quote about treating people like things?

@vfig @zip "Sin is treating people like things, including yourself, that's what sin is" (or something very close to that). Granny Weatherwax to Mightily Oats in Carpe Jugulum.
@ariaflame @vfig @zip IIRC there's another version with "evil" instead of "sin" in one of the other books.
@TimWardCam @vfig @zip Do you remember which one? I'm only up to Carpe Jugulum in my reread
@ariaflame @vfig @zip Nah, sorry. I'm also re-reading but only up to Lords and Ladies.

@TimWardCam @ariaflame @vfig @zip
What was it that Granny Weatherwax had said once? "Evil starts when you begin to treat people as things". And right now it would happen if you thought there was a thing called a father, and a thing called a mother, and a thing called a daughter, and a thing called a cottage, and told yourself that if you put them all together you had a thing called a happy family.”

― Terry Pratchett, I Shall Wear Midnight
#TerryPratchett #discworld #GrannyWeatherwax

@vfig @zip The key word there, is "coin".

@zip the one article I read made it especially ghoulish. No confirmation and no smart weapons for "low value targets" because they didn't want to waste resources on them.

Conveniently ignoring the whole collateral damage being worse thing or that it's likely a heck of a lot easier to mistake an activist for a low level terrorist than it is to mistake one for a terrorist leader.

The whole thing is just a fractal of wrong. The deeper you look the more wrongness is revealed

@zip its a pretty perfect metaphor for what's important to capital, tbh
@zip pure horror! It's all about the money
@zip capitalism. Genocide doens't cost as much
@zip Is it even an "error rate" when they design the system to blow people up when they're at home with their families?

@zip Actually ... one of the things that these AI systems are about is minimising complaints from irate punters, because call centres are *expensive*.

Someone who gets charged the wrong amount for their groceries is going to complain.

An innocent victim who gets killed is not going to complain.

A terrorist who is mis-identified as harmless is not going to complain.

@zip It's Cory Doctorow's "Shitty technology adoption curve" in action: A new technology's success depends on who gets the negative consequences. Move too far up the privilege gradient, and the idea is dead.

https://pluralistic.net/2022/08/21/great-taylors-ghost/

Pluralistic: 21 Aug 2022 The Shitty Technology Adoption Curve Reaches Apogee – Pluralistic: Daily links from Cory Doctorow

@zip @Floppy Almost as if they don’t see the Palestinians they’re murdering as people or something.
@aral @zip @Floppy Welcome to Israel, I guess?
@aral @zip @Floppy I am confused, #Israel operates grocery stores or #Amazon is involved in #Genocide?
@utzer @zip @Floppy You’re not confused, you’re a troll. Goodbye.

@zip

It all just depends on your tolerance for error. I wish I were joking.

@zip the targeting is indiscriminate and the AI is a convenient fig leaf so they can pretend it’s not just arbitrary murder.
@zip @aral oh, but one of those things can make you actually loose out on some profit, while the other has no consequence to you at all… 😶

@zip Guess what both cases have in common: It's about maximizing #Profit...

After all, the comany that does the #AI also profits from #ammo consumption but in the other case, said AI #Corporation won't reimburse #InventoryLosses due to malfunction.

#AbolishCapitalism

@zip the stupidest, most clumsily written dystopia

@zip I feel like the outrage about the AI generated kill list is hiding something even more evil: if the “AI” was magically 100% accurate, up to 20 innocent people being considered acceptable collateral damage for a “low-ranking militiaman” target

like, holy shit.

@uint8_t @zip yes, that was the thing that was like holy shit what... but once again, the "machine" used to tech-wash the humans doing the evil... like it's horrifying that you're using AI to not just do your evil shit more evilly but to also distance yourself from it, and that's like, 95% of AI use cases at this point
Military Morality

A philosophy webcomic about the inevitable anguish of living a brief life in an absurd world. Also Jokes

@zip likely because sociopathic decision makers are more concerned with losing a penny than a human life
@zip To be fair, how can a genocide go wrong by excess?
@zip now you have me wondering how many underpaid workers in India are deciding which people to kill in Gaza

@zip

It is a matter of what your real goal is.

"Make sure everyone pays" is harder than "Kill this guy, no matter how much collateral damage".

@zip
Especially when the AI is instructed to kill them all

@zip acceptable margins of error are lower in grocery billing than in genocide.

#gaza

@zip all religion and nationalism is fascism.
@zip
Our Elites seem to think that AI washes the blood from their hands.
@currentbias

@zip I agree completely with your general idea, but a detail is wrong.

Amazon's cart checkouts were in fact evaluated by an AI program on the spot: however, some large number of those carts were later re-evaluated by a person to train the AI for later iterations, almost certainly because the AI was so bad at its task.

@zip AI systems owners need to be held legally liable for the actions of their AI systems. Only then will they really pause long enough to consider the implications of their implementations.