Roblox Corporation
ROBUST FACIAL ANIMATION FROM VIDEO USING NEURAL NETWORKS
Last updated:
Abstract:
Implementations described herein relate to methods, systems, and computer-readable media to generate animations for a 3D avatar from input video captured at a client device. A camera may capture video of a face while a trained face detection model and a trained regression model output a set of FACS weights, head poses, and facial landmarks to be translated into the animations of the 3D avatar. Additionally, a higher level-of-detail may be intelligently selected based upon user preferences and/or computing conditions at the client device.
Status:
Application
Type:
Utility
Filling date:
22 Feb 2022
Issue date:
25 Aug 2022