The technology, which is more prone to misidentify black individuals—up to 100 times according to a 2019 U.S. study—led to Williams' wrongful 30-hour detainment.

He is now suing for compensation and a ban on the tech for suspect identification.

The case highlights broader concerns about AI bias, as AI often learns from datasets that underrepresent people of color.

Mindtech, a UK startup, aims to mitigate bias by creating diverse "digital humans" for AI training, while experts warn of potential cultural insensitivities with synthetic data.

Calls to address these biases have intensified, especially when AI misrepresents demographics, as seen in an experiment showing AI-generated "fast food workers" predominantly as people with darker skin tones, not reflecting actual labor statistics.

Detroit police assert they use facial recognition with checks such as supervisor oversight but acknowledge it's only an investigative lead, not conclusive evidence.