Meta Platforms, Inc.
Detecting Augmented-Reality Targets

Abstract:

In one embodiment, a method includes receiving deep-learning (DL)-feature representations and local-feature descriptors, wherein the DL-feature representations and the local-feature descriptors are extracted from an image that includes a first depiction of a real-world object; identifying a set of potentially matching DL-feature representations based on a comparison of the received DL-feature representations with stored DL-feature representations associated with a plurality of augmented-reality (AR) targets; determining, from a set of potentially matching AR targets associated with the set of potentially matching DL-feature representations, a matching AR target based on a comparison of the received one or more local-feature descriptors with stored local-feature descriptors associated with the set of potentially matching AR targets, wherein the stored local-feature descriptors are extracted from the set of potentially matching AR targets; and sending, to the client computing device, information configured to render an AR effect associated with the determined matching AR target.