International Business Machines Corporation
Method and system for language and domain acceleration with embedding evaluation

Abstract:

A method, system and a computer program product are provided for generating a natural language model that is substantially independent of languages and domains by transforming monolingual embeddings into a multilingual embeddings in a first shared embedding space using a cross-lingual learning process, and then transforming the multilingual embeddings into cross-domain, multilingual embeddings in a second shared embedding space using a cross-domain learning process, where the multilingual embeddings and/or cross-domain, multilingual embeddings are evaluated to measure a degree to which the embeddings associate a set of target concepts with a set of attribute words.