The Boeing Company
Marker-to-model location pairing and registration for augmented reality applications

Abstract:

A method for providing just-in-time access to data for calibrating an augmented reality (AR) device relative to an operation environment and then using the calibration data to register virtual content generated by the AR device with a scene being viewed by a user in the operation environment. An AR device is calibrated by pairing marker identifiers of 2-D markers affixed to objects in a physical environment with 3-D locations of those objects specified in a virtual environment containing 3-D model of those objects and then a marker-to-model location pairing list is generated. The pairing list is used to align displayed virtual 3-D content with an object appearing in the visualized physical environment. A location correction is computed at run-time based on a current AR device-to-marker offset computed from an image of the 2-D marker and the 3-D location of the object retrieved from the pairing list.