MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model

Muyao Niu 1,2,   Xiaodong Cun 2,*,   Xintao Wang 2,   Yong Zhang 2,   Ying Shan 2,   Yinqiang Zheng 1,*

1 The University of Tokyo

,

2 Tencent AI Lab

,

* Corresponding Author

European Conference on Computer Vision (ECCV) 2024

Arxiv Code 🤗 HuggingFace Model

Result Gallery for Trajectory-based Image Animation

Image

Trajectories

Flow

Output

Home Page