Microsoft Corporation
ANIMATING PHYSIOLOGICAL CHARACTERISTICS ON 2D OR 3D AVATARS

Abstract:

Systems and methods are directed to animating subtle physiological processes directly on avatars and photos. That is, physiologically-grounded spatial, color space, and temporal modifications may be made to the appearance of an avatar to simulate a physiological characteristic, such as blood flow. More specifically, a frame of a video sequence and a physiological signal may be received. An attention mask may be generated based on the received physiological signal, where the attention mask includes attention weights indicative of a strength of the physiological signal for differing portions of the frame of the video sequence. Accordingly, a pixel adjustment value based on the physiological signal and the attention mask may be generated and applied to an identified pixel in the frame of the video sequence.