Adobe Inc.
Context-Aware Video Subtitles

Abstract:

Generation of context-aware subtitles for a video is described. A subtitle context system receives video subtitles, extracts words from the subtitles, and determines a part of speech describing each word's use in the video. The subtitle context system then determines a difficulty score for each of the words based on the length of the word, a frequency with which the word is used in the language of the video, and a language proficiency score for a user viewing the video. To identify which words of the subtitles are likely difficult for the viewing user to understand, the subtitle context system compares the computed difficulty scores to a difficulty score threshold. For each word having a difficulty score that satisfies the threshold, a definition and one or more synonyms are ascertained. During video playback, the definition and synonyms for difficult to understand words are displayed concurrently with the word.