Microsoft Corporation
GENERATION OF OPTIMIZED SPOKEN LANGUAGE UNDERSTANDING MODEL THROUGH JOINT TRAINING WITH INTEGRATED ACOUSTIC KNOWLEDGE-SPEECH MODULE

Abstract:

A speech module is joint trained with a knowledge module by transforming a first knowledge graph into an acoustic knowledge graph. The knowledge module is trained on the acoustic knowledge graph. Then, the knowledge module is integrated with the speech module to generate an integrated knowledge-speech module. In some instances, the speech module included in the integrated knowledge-speech module is aligned with a language module to generate an optimized speech model configured to leverage acoustic information and acoustic-based knowledge information, along with language information.