Microsoft concluded it would lead to innocent women and minorities being disproportionately held for questioning because the artificial intelligence has been trained on mostly white and male pictures.
bias - News, Features, and Slideshows
News about bias
Gender is a "a big, big thing" to get wrong
The system taught itself that male candidates were preferable