Roblox Corporation
ROBUST FACIAL ANIMATION FROM VIDEO USING NEURAL NETWORKS

Last updated:

Abstract:

Implementations described herein relate to methods, systems, and computer-readable media to generate animations for a 3D avatar from input video captured at a client device. A camera may capture video of a face while a trained face detection model and a trained regression model output a set of FACS weights, head poses, and facial landmarks to be translated into the animations of the 3D avatar. Additionally, a higher level-of-detail may be intelligently selected based upon user preferences and/or computing conditions at the client device.

Status:
Application
Type:

Utility

Filling date:

22 Feb 2022

Issue date:

25 Aug 2022