Apple Inc.
Dense-based object tracking using multiple reference images

Abstract:

One exemplary implementation involves a pixel-based (also referred to as a dense-based approach) to object detection and tracking that can provide more accurate results than a feature-based approach. The efficiency of the detection and tracking is improved by using a reference image of the object that has similar characteristics (e.g., scale, lighting, blur, and the like) as the depiction of the object in the frame. In some implementations, a reference image of an appropriate scale is selected or interpolated based on the scale of the object depicted in the real world image. In other implementations, the real world image is adjusted to better match the reference image. The detection and tracking of the object can be performed with sufficient accuracy and efficiency for computer-generated reality (CGR) and other applications in which it is desirable to detect and track objects in real time.