GoPro, Inc.
Systems and methods for intelligently synchronizing events in visual content with musical features in audio content

Abstract:

Systems for synchronizing events or transitions in visual content with musical features in audio content are configured to obtain audio and visual content; determine a minimum, maximum, and/or a target display duration for items of visual content; determine a first playback-time in the first audio content to associate with a start-of-display time for the first visual content; identify a first timeframe in the first audio content corresponding to a range of acceptable end-of-display times for the first visual content; identify musical features within the first timeframe; identify a candidate musical feature among the identified musical features in accordance with a hierarchy; and/or define a first candidate end-of-display time that aligns with the playback time of the candidate musical feature. A set of candidate end-of-display times are defined for multiple visual content items in a single multimedia project, the set identified by seeking a solution that increases rank among the hierarchy.