International Business Machines Corporation
DETECTING AND MITIGATING BIAS IN NATURAL LANGUAGE PROCESSING

Abstract:

An embodiment for detecting and mitigating bias is provided. The embodiment may include receiving real-world data from a database. The embodiment may also include creating an inverted index from the real-world data. The embodiment may further include analyzing words in the inverted index. The analyzation may identify a plurality of categories in the real-world data. The embodiment may also include generating a structure template containing various entities within each category of the plurality of categories. The embodiment may further include receiving a test record of the structure template. The embodiment may also include providing alternative entities in the test record where bias is likely to occur. The embodiment may further include storing the test record. The embodiment may also include in response to determining bias exists, indicating a corrective action.