Meta Platforms, Inc.
Image segmentation in virtual reality environments

Abstract:

In one embodiment, a method includes delineating a region in a two-dimensional (2D) image in a virtual reality environment, generating a mask based on an object detected in the delineated region, wherein the mask is defined by a perimeter, and generating a virtual object in the virtual reality environment, where the virtual object incorporates the detected object, and the virtual object is generated by applying the mask to a three-dimensional (3D) object. Delineating a region may include receiving user input that delineates the region, and the input may trace a perimeter of the region. Delineating a region may include detecting an object and determining a perimeter of the detected object. The detected object may be classified as corresponding to a specified object type. The 2D image may include a camera perspective view of an object in the virtual reality environment.