International Business Machines Corporation
WORD EMBEDDING QUALITY ASSESSMENT THROUGH ASYMMETRY

Abstract:

An approach to determine the quality of encodings assigned to a word by a word embedding model. The approach may include determining the asymmetry of two embeddings associated with two words from a word embedding model. The asymmetry of the two words from a preexisting evocation dataset may be determined. The asymmetry of the two embeddings may be compared to the asymmetry from the evocation dataset to generate an encoding quality score.