Meta Platforms, Inc.
Systems and methods for displaying augmented-reality objects

Abstract:

A computer-implemented method for displaying augmented-reality objects may include capturing, by an augmented-reality system, an image of a user's hand. The method may also include applying a machine learning model to the image to identify a set of key points and determine a gesture of the hand based on the key points. In addition, the method may include identifying a targeted area of the image containing a portion of a finger based on the key points and the gesture and, subsequently, detecting a pair of edge contours of the finger by performing a computer vision method on the targeted area. Furthermore, the method may include extrapolating a location to place an augmented-reality object on the finger. Finally, the method may include displaying, by the augmented-reality system, the augmented-reality object at the location on the finger by tracking the key points. Various other methods, systems, and computer-readable media are also disclosed.