Roblox Corporation
3D ASSET GENERATION FROM 2D IMAGES

Abstract:

Some implementations relate to methods, systems, and computer-readable media to generate 3D assets from 2D images. In some implementations, a computer-implemented method to generate a 3D asset for an object using a trained machine learning model includes providing a 2D image of the object as input to the trained machine learning model, obtaining a template 3D mesh and a representative of a class of objects of interest that includes the object, generating based on the template 3D mesh and the representative of the class, a rigged 3D mesh for the object, deforming and posing the rigged 3D mesh to match the 2D image, and applying a texture extracted from the 2D image to the deformed and posed 3D mesh to create the 3D asset of the object.