WAM-Diff: A Masked Diffusion VLA Framework with MoE and Online Reinforcement Learning for Autonomous Driving

Mingwang Xu^*, Jiahao Cui^*, Feipeng Cai^*, Hanlin Shang^*, Zhihao Zhu, Shan Luan, Yifang Xu, Neng Zhang, Yaoyi Li, Jia Cai, Siyu Zhu

• WAM-Diff is a masked-diffusion VLA framework for autonomous driving, achieving 91.0 PDMS on NAVSIM-v1 and 89.7 EPDMS on NAVSIM-v2.

WAM-Flow: Parallel Coarse-to-Fine Motion Planning via Discrete Flow Matching for Autonomous Driving

Yifang Xu^*, Jiahao Cui^*, Zhihao Zhu^*, Hanlin Shang, Shan Luan, Mingwang Xu, Feipeng Cai, Neng Zhang, Yaoyi Li, Jia Cai, Siyu Zhu

• WAM-Flow is a VLA planner that uses discrete flow matching for parallel coarse-to-fine trajectory generation, achieving 90.3 PDMS on NAVSIM v1.

Hallo4: High-Fidelity Dynamic Portrait Animation via Direct Preference Optimization

Jiahao Cui^*, Yan Chen^*, Mingwang Xu^*, Hanlin Shang, Yuxuan Chen, Yun Zhan, Zilong Dong, Yao Yao, Jingdong Wang, Siyu Zhu

• Powered by DPO, Halla4 generates lifelike audio-driven avatar videos with rich emotional expression and highly accurate lip synchronization.

Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer

Jiahao Cui, Hui Li, Yun Zhan, Hanlin Shang, Kaihui Cheng, Yuqi Ma, Shan Mu, Hang Zhou, Jingdong Wang, Siyu Zhu

• Hallo3 can generate highly realistic avatars with dynamic backgrounds, expressive foregrounds, and various head orientations, which collectively contribute to creating remarkably vivid and lifelike talking head.

Hallo2: Long-Duration and High-Resolution Audio-driven Portrait Image Animation

Jiahao Cui^*, Hui Li^*, Yao Yao, Hao Zhu, Hanlin Shang, Kaihui Cheng, Hang Zhou, Siyu Zhu, Jingdong Wang

• A new avatar video generative model capable of generating stunning 4K resolution videos for up to 1 hour!