Muyao Niu (牛慕尧)

Hi, I'm Muyao Niu. I am a 1st year Ph.D. student in the Department of Mechano-Informatics, the University of Tokyo (UTokyo). My supervisor is Prof. Yinqiang Zheng . I received my B.E. degree from Dalian University of Technology in 2022. My research interests include AIGC, Computational Photography, and 3D Vision.

Email / Github / Google Scholar / WeChat: MyNiuuu

Selected 5 Papers

	MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model Muyao Niu, Xiaodong Cun, Xintao Wang, Yong Zhang, Ying Shan, Yinqiang Zheng ECCV, 2024 project page / paper / code We introduce MOFA-Video to adapt motions from different domains to the frozen Video Diffusion Model. MOFA-Video can effectively animate a single image using various types of control signals, including trajectories, keypoint sequences, and their combinations.
	AniCrafter: Customizing Realistic Human-Centric Animation via Avatar-Background Conditioning in Video Diffusion Models Muyao Niu, Mingdeng Cao, Yifan Zhan, Qingtian Zhu, Mingze Ma, Jiancheng Zhao, Yanhong Zeng, Zhihang Zhong, Xiao Sun, Yinqiang Zheng arXiv, 2025 project page / paper / code We leverage "3DGS Avatar + Background Video" as guidance for the video diffusion model to insert and animate anyone into any scene following given motion sequence.
	Visionary: The World Model Carrier Built on WebGPU-Powered Gaussian Splatting Platform Yuning Gong, Yifei Liu, Yifan Zhan, Muyao Niu, Xueying Li, Yuanjun Liao, Jiaming Chen, Yuanyuan Gao, Jiaqi Chen, Minming Chen, Li Zhou, Yuning Zhang, Wei Wang, Xiaoqing Hou, Huaxi Huang, Shixiang Tang, Le Ma, Dingwen Zhang, Xue Yang, Junchi Yan, Yanchi Zhang, Yinqiang Zheng, Xiao Sun, Zhihang Zhong arXiv, 2025 project page / paper / code We build an open platform via WebGPU and ONNX Runtime, enabling real-time rendering of diverse Gaussian Splatting variants (3DGS, MLP-based 3DGS, 4DGS, Neural Avatars).
	Visibility Constrained Wide-band Illumination Spectrum Design for Seeing-in-the-Dark Muyao Niu, Zhuoxiao Li, Zhihang Zhong, Yinqiang Zheng CVPR, 2023 paper / code We designed an optimal illumination spectrum in the VIS-NIR range by considering human vision constraints, which significantly improves translation performance. A fully differentiable model was proposed, which includes the imaging process, human visual perception, and the enhancement network.
	RS-NeRF: Neural Radiance Fields from Rolling Shutter Images Muyao Niu, Tong Chen, Yifan Zhan, Zhuoxiao Li, Xiang Ji, Yinqiang Zheng ECCV, 2024 paper / code We improve NeRF to consider the RS distortions with two technologies: camera trajectory smoothness regularization and multi-sampling strategy.

Full List

Interns

2024.08 - 2025.07: Computer Vision Research Intern at Shanghai AI Lab, mentored by Zhihang Zhong and Xiao Sun.
2023.12 - 2024.06: Computer Vision Research Intern at Computer Vision Center (CVC), Tencent AI Lab, mentored by Xiaodong Cun.
2021.08 - 2022.01: Computer Vision Research Intern at SenseVideo Group, SenseTime Research, mentored by Siwei Tang.

Awards/Scholarships

BOOST NAIS Special Research Scholarship (3,900,000 JPY / year), The University of Tokyo, 2024.10 - 2027.09
WING-CFS Special Research Assistant Scholarship (2,160,000 JPY / year), The University of Tokyo, 2023.04 - 2024.09
Teijin Scholarship, 2023.04 - 2024.09
JASSO Scholarship, 2022.10 - 2023.04
National Scholarship of China (Undergraduate Students), 2019.09 - 2021.08

The template comes from the personal website of Jon Barron.