International Business Machines Corporation
System and method for cognitive multilingual speech training and recognition

Abstract:

The present invention provides a method and system for analyzing human speech during natural language processing interactions between humans and computers to aid in computer learning. The method processes human language tutorial videos each having a visual track, an audio track and captions. Multiple videos are simultaneously processed in parallel using stream processing to identify spoken words or phrases in the videos by comparing them with benchmark words/phrases stored on a computer. Confidence scores are determined for each of the spoken words/phrases which are assigned to a list of the benchmark words/phrases on the computer when a threshold value is met. A system administrator can identify spoken words/phrases to which the threshold value is not met.