Zunnan Xu
Student at Tsinghua University
Hi, I am a student at Tsinghua University. Currently, my research centers on multi-modal learning and generative models, with the ultimate goal of building a unified perception–generation engine that can understand, predict, and interact with the physical world.
I am especially interested in how these models can be distilled into efficient engines that enable systems to perform robust visual reasoning and generative modeling in complex, unstructured environments. I now focus more on rethinking problems and offering simple, effective solutions. If you have any use cases you would like to share, please feel free to contact me!
News
| 2025 | One paper accepted to NeurIPS 2025. |
|---|---|
| 2025 | Two papers accepted to ICCV 2025. |
| 2025 | Received Outstanding Reviewer Award at CVPR 2025. |
| 2025 | Three papers accepted to CVPR 2025. |
| 2024 | One paper accepted to EMNLP 2024. |
| 2024 | Won 3rd prize in CVPR 2024 OVD challenge. |
| 2024 | Two papers accepted to ICML 2024 workshop. |
| 2024 | One paper accepted to NeurIPS 2024. |
| 2023 | One paper accepted to ICCV 2023. |
Research Interests
- Generative Vision & World Models: Scaling Diffusion Transformers (DiT) and Flow Matching to build high-fidelity physics simulators (e.g., HunyuanVideo) that serve as the "brain's imagination".
- Embodied Foundation Models: Integrating world modeling into unified VLA architectures (e.g., WALL-OSS) to achieve long-horizon manipulation and generalization.
- Multimodal Understanding: Leveraging parameter-efficient fine-tuning (PEFT) and reinforcement learning (RL) to align vision and language features and enable fine-grained multi-modal understanding.
Selected Publications
(* denotes equal contribution)
2D Video & Image Generation
Hunyuanportrait: Implicit condition control for enhanced portrait animation
CVPR 2025
HunyuanVideo: A Systematic Framework For Large Video Generative Models
Technical Report, 2024
Audio-visual controlled video diffusion with masked selective state spaces modeling for natural talking head generation
ICCV 2025
Alignment is All You Need: A Training-free Augmentation Strategy for Pose-guided Video Generation
CVG@ICML 2024
Zero-shot 3D-Aware Trajectory-Guided image-to-video generation via Test-Time Training
AAAI 2026
Fireedit: Fine-grained instruction-based image editing via region-aware vision language model
CVPR 2025
InterAnimate: Taming Region-aware Diffusion Model for Realistic Human Interaction Animation
ACMMM 2025
Vision-Language Models
Bridging vision and language encoders: Parameter-efficient tuning for referring image segmentation
ICCV 2023
Igniting vlms toward the embodied space
Technical Report, 2025
SAM-R1: Leveraging SAM for Reward Feedback in Multimodal Segmentation via Reinforcement Learning
NeurIPS 2025
Densely Connected Parameter-Efficient Tuning for Referring Image Segmentation
AAAI 2025
Enhancing Fine-grained Multi-modal Alignment via Adapters: A Parameter-Efficient Training Framework
WANT@ICML 2024
MaPPER: Multimodal Prior-guided Parameter Efficient Tuning for Referring Expression Comprehension
EMNLP 2024
3D Motion & Assets Synthesis
Mambatalk: Efficient holistic gesture synthesis with selective state space models
NeurIPS 2024
Chain of generation: Multi-modal gesture synthesis via cascaded conditional control
AAAI 2024
Separate to Collaborate: Dual-Stream Diffusion Model for Coordinated Piano Hand Motion Synthesis
ACMMM 2025
Freetalker: Controllable speech and text-driven gesture generation based on diffusion models
ICASSP 2024
Atom: Aligning text-to-motion model at event-level with gpt-4vision reward
CVPR 2025
Reparo: Compositional 3d assets generation with differentiable 3d layout alignment
ICCV 2025
Consistent123: One image to highly consistent 3d asset using case-aware diffusion priors
ACMMM 2024
Honors & Awards
| 2025 | Outstanding Scholarship of Tencent Rhino-Bird Research Elite Program |
| 2025 | Golden Award in International Exhibition of Inventions Geneva |
| 2024 | Graduate National Scholarship |
| 2024 | Tencent Rhino-Bird Research Elite Program Student |
| 2023 | Outstanding Graduate (Bachelor's Level) |
| 2022 | Golden Award in iGEM Competition |
| 2021 | Golden Award in National College Student Algorithm Design and Programming Challenge |
| 2020 | Undergraduate National Scholarship |
Academic Services
Reviewer for:
- Journal: IEEE TPAMI, IEEE TIP, TMLR, MIR, AI
- Conference: CVPR, ICCV, ECCV, NeurIPS, ICML, ICLR, ACL, EMNLP, NAACL, WACV