The Boeing Company
Systems and methods of augmented reality visualization based on sensor data

Abstract:

A device is configured to determine a movement of a vehicle based on vehicle sensor data, and a movement of an augmented reality (AR) headset based on headset sensor data. The device is configured to estimate a user portion of the movement of the AR headset caused by a movement of a user and not caused by the movement of the vehicle. The device is configured to determine a gaze target of the user based on the user portion and to generate visualization data based on the gaze target. Responsive to determining that the gaze target is inside the vehicle, the visualization data includes a first visual depiction of a first point of interest that is outside the vehicle. Responsive to determining that the gaze target is outside the vehicle, the visualization data includes a second visual depiction of a second point of interest that is inside the vehicle.