Projects People Publications Code/Datasets

Learning NeRFs for Talking Face Videos

Project Image
In this project, we learn neural implicit representations for talking human faces. We model the 4D face geometry and appearance using neural radiance fields (NeRFs). Our goal is to synthesize high-quality talking face videos. We focus on two main applications: (a) lip synchronization, where the synthesized face follows a target audio, and (b) facial expression transfer, where the synthesized face follows target expressions.

Publications