Upol Ehsan

🧵 1/
While we justifiably fight about opaque algorithms, there's a more sinister opacity -- whether an algorithm exists in the first place. But the solution isn't just making things "transparent". 🤯

💯 Next to bad algorithms in law enforcement, the next most sinister one that undoubtedly touches almost everyone are algorithms around housing.

💡 Often people aren't even aware there's an algorithm pulling the strings behind the scene.

#AI #ResponsibleAI #XAI #academia

https://www.propublica.org/article/how-your-shadow-credit-score-could-decide-whether-you-get-an-apartment

How Your Shadow Credit Score Could Decide Whether You Get an Apartment

The vast tenant screening industry is subject to less regulation than credit scoring agencies, even though experts warn that algorithms could introduce racial or other illegal biases that can prevent people from getting housing.

ProPublica
Aug 9, 2023 at 9:55pmWeb
Show threadUpol EhsanAug 9, 2023

2/
✨ Typically, the solution proposed is that we need to make these mechanisms "transparent" as if the revelation is sufficient.

❌ Wrong. It's necessary but not sufficient.

🤔 If you know there's an algorithm but **cannot do anything about it**, does it solve the problem?

🎯 What's needed is **recourse**-- a way to fight back meaningfully. Not just *contest*, but actually have *voice* in the contestation, have a fair shot of taking down the invisible hand.
/🧵 END