Wow super-cool piece covering the enraging workings of software that makes decisions about people's real lives. The algorithm discriminates but in opaque ways so it's hard to find recourse against this "suspicion machine".
It is an example of what Cathy O'Neil calls "Weapons of Math Destruction".
I'm a big fan of this book. O'Neil makes the concepts around the misuse of Big Data accessible; she's funny, too, and makes you laugh even as you're boiling inside. Worth a read, imo.
Because algorithms are used everywhere, from teacher evaluations to policing to college admissions, on and on.