Honda Motor Co., Ltd.
SYSTEMS AND METHODS FOR SHARED CROSS-MODAL TRAJECTORY PREDICTION

Abstract:

Systems and methods for trajectory prediction and motion device control include receiving a first set of data about a surrounding environment of a motion device. The first set of data includes first sensory data and first position data. The method includes receiving a second set of data about the surrounding environment of the motion device. The second set of data includes second sensory data and second position data, where the first sensory data differs in modality from the second sensory data. The method also includes extracting features from the first set of data that model motion behavior of the motion device, and extracting features from the second set of data that model motion behavior of the motion device. The method includes inputting the features into a machine learning model, and computing a first trajectory based on a first latent variable and a second trajectory based on a second latent variable.