Gregory's Server@Wolven We knew something was up when we did a Google Maps mashup of the mortgage data with a map of the City of Philadelphia and just looked at each other with eyes the size of saucers. When we brought the data back, the experiment was shut down immediately. The institution then started thinking about latent bias in underwriting so it came to a good result, but it also made me incredibly skeptical of the premise of AI-driven underwriting.
@brianonbarrington @Wolven Here's another similar story, this time using AI to flag people for welfare fraud investigation: https://www.wired.com/story/welfare-state-algorithms/#intcid=_wired-verso-hp-trending_145b7ab1-a36c-4aca-8059-42e2e8304e38_popular4-1
Almost ten years ago I had a friend who was researching AI bias for his master's thesis. I had a sense that it was very prescient research but I couldn't quite get my head around what the real world implications would be. Welp!