In Ontario, an ”AI tool” being used to predict prisoners’ behavior. Its primary feature is disproportionately placing Black prisoners in maximum security. The whole point of ”AI” is often to maintain or even strengthen prejudice, while displacing blame onto something ”other” – that the public is made to think is computationally neutral.
Prejudice is cemented by humans through the complete process of interplay with the software, from ideation to creation to usage: selection, development, implementation, interpretation and action. And there is no such thing as seeing into the future.
”The program assigns each prisoner a score from 0 to 100 that determines whether they’ll be placed in minimum, medium, or maximum security detention.”
https://breachmedia.ca/black-prisoners-are-assigned-harsher-living-conditions-in-ontario-jails-thanks-to-ai/