International Business Machines Corporation
DETECTING AND NOTIFYING FOR POTENTIAL BIASES IN ARTIFICIAL INTELLIGENCE APPLICATIONS

Abstract:

An implicit bias monitoring system is provided. The system receives sensor data including video and audio that are captured during an interaction between a first individual and a second individual. The system determines a set of attributes associated with the interaction based on the received sensor data, the set of attributes comprising at least one of race and gender of the second individual. The system detects an implicit bias based on a combination of the determined set of attributes and a bias profile. The system generates an alert based on the detected implicit bias.