MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model

Muyao Niu 1,2,   Xiaodong Cun 2,*,   Xintao Wang 2,   Yong Zhang 2,   Ying Shan 2,   Yinqiang Zheng 1,*

1 The University of Tokyo

,

2 Tencent AI Lab

,

* Corresponding Author

European Conference on Computer Vision (ECCV) 2024

Arxiv Code 🤗 HuggingFace Model

Result Gallery for Keypoint-based Facial Image Animation

Keypoints from driven-audio (click to play)

Keypoints from driven-video (click to play)

Home Page