I am currently a first-year Ph.D. student at the AI3 Institute of Fudan University, supervised by Prof. Siyu Zhu. Prior to this, I obtained my bachelorβs degree from the School of Software Engineering, Sun Yat-sen University. My research focuses on Vision Generative Model, Multi-modal Large Language Model and Unified Model.
π₯ News
- 2025.08: Β ππΒ Hallo4 is accepted by SIGGRAPH Asia 2025.
- 2025.02: Β ππΒ Hallo3 is accepted by CVPR 2025.
- 2025.01: Β ππΒ Hallo2 is accepted by ICLR 2025.
π Publications
Hallo4: High-Fidelity Dynamic Portrait Animation via Direct Preference Optimization
Jiahao Cui*, Yan Chen*, Mingwang Xu*, Hanlin Shang, Yuxuan Chen, Yun Zhan, Zilong Dong, Yao Yao, Jingdong Wang, Siyu Zhu
- Powered by DPO, Halla4 generates lifelike audio-driven avatar videos with rich emotional expression and highly accurate lip synchronization.
Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer
Jiahao Cui, Hui Li, Yun Zhan, Hanlin Shang, Kaihui Cheng, Yuqi Ma, Shan Mu, Hang Zhou, Jingdong Wang, Siyu Zhu
- Hallo3 can generate highly realistic avatars with dynamic backgrounds, expressive foregrounds, and various head orientations, which collectively contribute to creating remarkably vivid and lifelike talking head.
Hallo2: Long-Duration and High-Resolution Audio-driven Portrait Image Animation
Jiahao Cui*, Hui Li*, Yao Yao, Hao Zhu, Hanlin Shang, Kaihui Cheng, Hang Zhou, Siyu Zhu, Jingdong Wang
- A new avatar video generative model capable of generating stunning 4K resolution videos for up to 1 hour!
π Honors and Awards
- 2023.12: National Scholarship
- 2023.11: Sun Yat-sen University Outstanding Student Scholarship, First Class
- 2022.12: National Scholarship
- 2022.12: Sun Yat-sen University Outstanding Student Scholarship, First Class
π Educations
- 2025.09 - present: Ph.D student, AI3 Institute, Fudan University.
- 2021.09 - 2025.06: Undergraduate student, School of Software Engineering, Sun Yat-sen University.
π» Internships
- 2025.06 - 2025.09: PCG ARCLab, Tencent, China.
π¬ Services
- Reviewer: SIGGRAPH Asia 2025.