Fanhu Zeng

I'm currently a Master student at Institute of Automation, Chinese Academy of Sciences (CASIA), supervised by Prof. Xu-Yao Zhang and Prof. Cheng-Lin Liu. My major is Pattern Recognition and Intelligent System.

Before that, I obtained my Bachlor degree from Nanjing University of Aeronautics and Astronautics (NUAA) majoring in Automation.

My research interests lie in:
1. Trustworthy AI

Uncertainty Estimation
Out-of-distribution Detection
Continual Learning

2. Multimodal Large Language models

Prompt Learning/LoRA
Downstream Application

3. Efficient AI

Model Merging
Token Compression/Model Acceleration
Image Compression

I am particularly interested in the up-to-date combination of Multimodal Large Language Models with (1) Trustworthy AI like Hallucination, Continual Instruction Tuning (2) Reliable reasoning and so on.

📣 I am looking for PhD opportunities for these directions starting in 26Spring or 26Fall. I would greatly appreciate it if you have any available positions or suggestions.

👏 Welcome all forms of academic discussion and collaboration. Feel free to contact me!

Email📧: challengezengfh (at) gmail (dot) com / Google Scholar / Github / LinkedIn

Education

M.S. @ Institute of Automation, Chinese Academy of Sciences, 2022-2025
Advisor: Prof. Xu-Yao Zhang and Prof. Cheng-Lin Liu
B.S. @ Nanjing University of Aeronautics and Astronautics, 2018-2022
Advisor: Prof. Xin Yang and Prof. Fuyang Chen

News

[2025.11] I will attend NeurIPS 2025. See you in San Diego, US!
[2025.09] One paper (RobustMerge) is accepted to NeurIPS 2025 as a Spotlight !!
[2025.08] One paper (ModalPrompt) is accepted to EMNLP 2025!!
[2025.06] One paper (FCIT) is accepted to ICCV 2025. Congratulations to all my collaborators!
[2025.05] Two papers (HiDe-LLaVA, ChartEdit) are accepted to ACL 2025. Congratulations to all my collaborators!
[2025.02] One paper (MambaIC) is accepted to CVPR 2025!!
[2025.01] One paper (Local-Prompt) is accepted to ICLR 2025.

Research Experience

Research Intern @ Institute for Al Industry Research, Tsinghua University, China, 2024.05-2025.02
Advisor: Yan Wang
Research Intern @ Baidu, Inc., China, 2023.02-2024.01
Advisor: Deli Yu

Selected Publications [View All]

* indicates equal contribution

	RobustMerge: Parameter-Efficient Model Merging for MLLMs with Direction Robustness Fanhu Zeng, Haiyang Guo, Fei Zhu, Li Shen, Hao Tang The Thirty-ninth Annual Conference on Neural Information Processing Systems (NeurIPS), 2025, Spotlight, acceptance rate: 3.1% arXiv / Code
	ModalPrompt: Towards Efficient Multimodal Continual Instruction Tuning with Dual-Modality Guided Prompt Fanhu Zeng, Fei Zhu, Haiyang Guo, Xu-Yao Zhang, Cheng-Lin Liu The 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2025 Paper / arXiv / Code
	Federated Continual Instruction Tuning Haiyang Guo, Fanhu Zeng, Fei Zhu, Wenzhuo Liu, Da-Han Wang, Jian Xu, Xu-Yao Zhang, Cheng-Lin Liu International Conference on Computer Vision (ICCV), 2025 Paper / arXiv / Code
	HiDe-LLaVA: Hierarchical Decoupling for Continual Instruction Tuning of Multimodal Large Language Model Haiyang Guo, Fanhu Zeng`, Ziwei Xiang, Fei Zhu, Da-Han Wang, Xu-Yao Zhang, Cheng-Lin Liu Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (ACL), 2025 Paper / arXiv / Code
	MambaIC: State Space Models for High-Performance Learned Image Compression Fanhu Zeng, Hao Tang, Yihua Shao, Siyu Chen, Ling Shao, Yan Wang Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025 Paper / arXiv / Code
	Local-Prompt: Extensible Local Prompts for Few-Shot Out-of-Distribution Detection Fanhu Zeng, Zhen Cheng, Fei Zhu, Hongxin Wei, Xu-Yao Zhang The Thirteenth International Conference on Learning Representations (ICLR), 2025 Paper / arXiv / Code
	MCITlib: Multimodal Continual Instruction Tuning Library and Benchmark Haiyang Guo, Fei Zhu, Hongbo Zhao, Fanhu Zeng, Wenzhuo Liu, Shijie Ma, Da-Han Wang, Xu-Yao Zhang Workshop on Multimodal Continual Learning, International Conference on Computer Vision (ICCV), 2025, Oral arXiv / Code
	Continual Learning for Generative AI: From LLMs to MLLMs and Beyond Haiyang Guo, Fanhu Zeng, Fei Zhu, Jiayi Wang, Xukai Wang, Jingang Zhou, Hongbo Zhao, Wenzhuo Liu, Shijie Ma, Da-Han Wang, Xu-Yao Zhang, Cheng-Lin Liu arXiv / Code
All Publications →

Academic Services

Conference Reviewer: NeurIPS (2024), ICLR (2025, 2026), CVPR (2025, 2026), ICCV (2025), EMNLP (2023)

Website Template