Jiaqi Wang 王佳琦
Research Scientist & PI
Shanghai AI Laboratory
E-mail: wjqdev@gmail.com
Biography
Jiaqi Wang is a Research Scientist at Shanghai AI Laboratory. Before that, he received his Ph.D. at Multimedia Laboratory (MMLab) of The Chinese University of Hong Kong (CUHK), supervised by Prof. Dahua Lin. He also worked closely with Prof. Chen Change Loy.
His research interests focus on Multimodal Learning, Visual Perception, and AI Content Creation in both 2D and 3D open worlds. He has published over 50 papers in leading journals and conferences, including TPAMI, CVPR, ICCV, ECCV, NeurIPS, ICML, and ICLR, accumulating more than 13,000 citations on Google Scholar. Two of his papers have been recognized among the Most Influential ECCV Papers of 2024 (MMBench, ShareGPT4V), and another paper was nominated as a CVPR 2023 Award Candidate. Additionally, he was recognized in the Stanford/Elsevier Top 2% Scientists List in 2024.
As the lead researcher of the InternLM-XComposer multimodal large model series, our project has achieved over 4 million downloads and once ranked fifth among over 750,000 models on HuggingFace Trending.
We have opening positions for research interns (undergraduate, master, Ph.D. and gap year students are all welcomed) and full-time researchers. Please drop me an e-mail (wjqdev@gmail.com) if you are interested.
News
- [2025-02] Four paper accepted to CVPR 2025.
- [2024-01] We release InternLM-XComposer-2.5-Reward, a simple yet effective multi-modal reward model for large vision-language models (LVLMs).
- [2025-01] Three paper accepted to ICLR 2025.
- [2024-12] We release InternLM-XComposer-2.5-OmniLive, a comprehensive multimodal system for long-term streaming video and audio interactions.
- [2025-09] One paper accepted to TPAMI.
- [2024-09] Selected into Standford/Elsevier Top 2% Scientisits List 2024
- [2024-09] Two Most Influential ECCV Papers 2024 (Rank 2: MMBENCH; Rank 4: ShareGPT4V)
- [2024-09] Nine paper accepted to NeurIPS 2024 (Four in D&B Track, One Spotlight).
- [2024-07] We release InternLM-XComposer-2.5, a versatile large vision language model supporting long-contextual input and output.
- [2024-07] Three paper accepted to ECCV 2024 (One Oral).
- [2024-04] We are hosting V3Det Challenge jointly with Visual Perception via Learning in an Open World Workshop at CVPR 2024.
- [2024-04] We release InternLM-XComposer2-4KHD, a pioneering large vision-language model handling resolutions from 336 pixels to 4K HD.
- [2024-02] Four paper accepted to CVPR 2024 (Two Spotlights).
- [2024-01] We release InternLM-XComposer2, a groundbreaking vision-language large model excelling in free-form text-image composition and comprehension.
- [2023-09] We release InternLM-XComposer, a large foundation model for advanced text-image comprehension and composition.
- [2023-09] One paper accepted to AAAI 2024.
- [2023-07] One paper accepted to Siggraph Asia 2023.
- [2023-07] One paper accepted to ICCV 2023. (One Oral)
- [2023-02] One paper accepted to ICML 2023.
- [2023-02] Four papers accepted to CVPR 2023. (One Award Candidate)
- [2023-01] One papers accepted to ICLR 2023. (One Spotlight)
- [2022-10] Two papers accepted to AAAI 2023. (One Oral)
- [2022-07] One paper accepted to NeurIPS 2022.
- [2022-02] One paper accepted to CVPR 2022.
- [2021-11] Received his Ph.D. from MMLab and Join Shanghai AI Laboratory
- [2021-10] One paper accepted to TIP.
- [2021-09] One paper accepted to NeurIPS 2021.
- [2021-04] One paper accepted to TPAMI.
- [2021-03] One paper accepted to CVPR 2021.
- [2020-07] One paper accepted to ECCV 2020 (One Spotlight).
- [2019-11] 1st prize in COCO 2019 Object Detection Challenge (without external data).
(Team Leader, Team: MMDet) - [2019-07] One paper accepted to ICCV 2019 (One Oral).
- [2019-02] Two papers accepted to CVPR 2019.
- [2018-09] MMDetection is released. See Technical Report.
- [2018-09] 1st prize in COCO 2018 Object Detection Challenge. (Team: MMDet)
- [2018-02] One paper accepted to CVPR 2018.
- [2017-08] Awarded Hong Kong Ph.D. Fellowship Scheme (HKPFS) and Join MMLab.
Publications
➡️ Full List
In NeurIPS 2024. Xiaoyi Dong *, Pan Zhang *, Yuhang Zang*, Yuhang Cao, Bin Wang, Linke Ouyang, Songyang Zhang, Haodong Duan, Maosong Cao, Wenwei Zhang, Yining Li, Hang Yan, Yang Gao, Zhe Chen, Xinyue Zhang, Wei Li, Jingwen Li, Wenhai Wang, Kai Chen, Conghui He, Xingcheng Zhang, Jifeng Dai, Yu Qiao, Dahua Lin, Jiaqi Wang# (* equal contribution, # corresponding author)
In Arxiv 2024. Ziyu Liu *, Zeyi Sun *, Yuhang Zang, Wei Li, Pan Zhang, Xiaoyi Dong, Yuanjun Xiong, Dahua Lin, Jiaqi Wang
In Arxiv 2024. Shuangrui Ding *, Zihan Liu *, Xiaoyi Dong, Pan Zhang, Rui Qian, Conghui He, Dahua Lin, Jiaqi Wang (* equal contribution)
In Arxiv 2024. Xiaoyi Dong *, Pan Zhang *, Yuhang Zang*, Yuhang Cao, Bin Wang, Linke Ouyang, Xilin Wei, Songyang Zhang, Haodong Duan, Maosong Cao, Wenwei Zhang, Yining Li, Hang Yan, Yang Gao, Xinyue Zhang, Wei Li, Jingwen Li, Kai Chen, Conghui He, Xingcheng Zhang, Yu Qiao, Dahua Lin, Jiaqi Wang# (* equal contribution, # corresponding author)
In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024, as Spotlight. Zhangyang Qi*, Ye Fang*, Zeyi Sun*, Xiaoyang Wu, Tong Wu, Jiaqi Wang#, Dahua Lin, Hengshuang Zhao# (* equal contribution, # corresponding authors)
In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024, as Spotlight. Qidong Huang, Xiaoyi Dong, Pan Zhang, Bin Wang, Conghui He, Jiaqi Wang, Dahua Lin, Weiming Zhang, Nenghai Yu
In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024. Zeyi Sun*, Ye Fang*, Tong Wu, Pan Zhang, Yuhang Zang, Shu Kong, Yuanjun Xiong, Dahua Lin, Jiaqi Wang (* equal contribution)
In Arxiv 2023. Pan Zhang *, Xiaoyi Dong *, Bin Wang, Yuhang Cao, Chao Xu, Linke Ouyang, Zhiyuan Zhao, Shuangrui Ding, Songyang Zhang, Haodong Duan, Wenwei Zhang, Hang Yan, Xinyue Zhang, Wei Li, Jingwen Li, Kai Chen, Conghui He, Xingcheng Zhang, Yu Qiao, Dahua Lin, Jiaqi Wang# (* equal contribution, # corresponding author)
In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024. Jiaming Han, Kaixiong Gong, Yiyuan Zhang, Jiaqi Wang, Kaipeng Zhang, Dahua Lin, Yu Qiao, Peng Gao, Xiangyu Yue
In ECCV 2024. Lin Chen*, Jinsong Li*, Xiaoyi Dong, Pan Zhang, Conghui He, Jiaqi Wang, Feng Zhao, Dahua Lin (* equal contribution)
In SIGGRAPH Asia 2023, conference track. Tong Wu*, Zhibing Li*, Shuai Yang*, Pan Zhang, Xingang Pan, Jiaqi Wang, Ziwei Liu, Dahua Lin (* equal contribution)
In AAAI 2024. Bin Wang, Fan Wu, Xiao Han, Jiahui Peng, Huaping Zhong, Pan Zhang, Xiaoyi Dong, Weijia Li, Wei Li, Jiaqi Wang, Conghui He
In IEEE International Conference on Computer Vision (ICCV) 2023, as Oral. A Detection dataset with more than 13,000 Categories,
Jiaqi Wang*, Pan Zhang*, Tao Chu*, Yuhang Cao*, Yujie Zhou, Tong Wu, Bin Wang, Conghui He, Dahua Lin (* equal contribution)
Jiaqi Wang*, Pan Zhang*, Tao Chu*, Yuhang Cao*, Yujie Zhou, Tong Wu, Bin Wang, Conghui He, Dahua Lin (* equal contribution)
In International Conference on Machine Learning (ICML) 2023
Dachuan Shi, Chaofan Tao, Ying Jin, Zhendong Yang, Yuan Chun#, Jiaqi Wang#
(# corresponding authors)
Dachuan Shi, Chaofan Tao, Ying Jin, Zhendong Yang, Yuan Chun#, Jiaqi Wang#
(# corresponding authors)
In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023
Tao Chu, Pan Zhang, Qiong Liu, Jiaqi Wang
Tao Chu, Pan Zhang, Qiong Liu, Jiaqi Wang
In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023
Shilong Zhang, Xinjiang Wang, Jiaqi Wang, Jiangmiao Pang, Chengqi Lyu, Wenwei Zhang, Ping Luo, Kai Chen
Shilong Zhang, Xinjiang Wang, Jiaqi Wang, Jiangmiao Pang, Chengqi Lyu, Wenwei Zhang, Ping Luo, Kai Chen
In International Conference on Learning Representations (ICLR) 2023, as Spotlight
Tong Wu, Jiaqi Wang#, Xingang Pan, Xudong Xu, Christian Theobalt, Ziwei Liu, Dahua Lin#
(# corresponding authors)
Tong Wu, Jiaqi Wang#, Xingang Pan, Xudong Xu, Christian Theobalt, Ziwei Liu, Dahua Lin#
(# corresponding authors)
In AAAI Conference on Artificial Intelligence (AAAI) 2023, as Oral
Yujie Zhou, Haodong Duan, Anyi Rao, Bing Su, Jiaqi Wang
Yujie Zhou, Haodong Duan, Anyi Rao, Bing Su, Jiaqi Wang
In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2022
Zhao Yang*, Jiaqi Wang*, Yansong Tang, Kai Chen, Hengshuang Zhao, Philip H.S. Torr
(* equal contribution)
Zhao Yang*, Jiaqi Wang*, Yansong Tang, Kai Chen, Hengshuang Zhao, Philip H.S. Torr
(* equal contribution)
In IEEE Transactions on Image Processing (TIP) 2021
Rui Xu, Minghao Guo, Jiaqi Wang, Xiaoxiao Li, Bolei Zhou, Chen Change Loy
Rui Xu, Minghao Guo, Jiaqi Wang, Xiaoxiao Li, Bolei Zhou, Chen Change Loy
In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 2021
Jiaqi Wang, Kai Chen, Rui Xu, Ziwei Liu, Chen Change Loy, Dahua Lin
Jiaqi Wang, Kai Chen, Rui Xu, Ziwei Liu, Chen Change Loy, Dahua Lin
In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021
Jiaqi Wang, Wenwei Zhang, Yuhang Zang, Yuhang Cao, Jiangmiao Pang, Tao Gong,
Kai Chen, Ziwei Liu, Chen Change Loy, Dahua Lin
Jiaqi Wang, Wenwei Zhang, Yuhang Zang, Yuhang Cao, Jiangmiao Pang, Tao Gong,
Kai Chen, Ziwei Liu, Chen Change Loy, Dahua Lin
In European Conference on Computer Vision (ECCV) 2020, as Spotlight
Jiaqi Wang, Wenwei Zhang, Yuhang Cao, Kai Chen, Jiangmiao Pang, Tao Gong, Jianping Shi, Chen Change Loy, Dahua Lin
Jiaqi Wang, Wenwei Zhang, Yuhang Cao, Kai Chen, Jiangmiao Pang, Tao Gong, Jianping Shi, Chen Change Loy, Dahua Lin
In IEEE International Conference on Computer Vision (ICCV) 2019, as Oral
Jiaqi Wang, Kai Chen, Rui Xu, Ziwei Liu, Chen Change Loy, Dahua Lin
Jiaqi Wang, Kai Chen, Rui Xu, Ziwei Liu, Chen Change Loy, Dahua Lin
In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2019
Jiaqi Wang*, Kai Chen*, Shuo Yang, Chen Change Loy, Dahua Lin (* equal contribution)
Jiaqi Wang*, Kai Chen*, Shuo Yang, Chen Change Loy, Dahua Lin (* equal contribution)
Projects
As Project Leader
Over 4 million downloads
Once ranked 5th among over 750,000 models on HuggingFace Trending
InternLM-XComposer-2.5-Reward A Simple Yet Effective Multi-Modal Reward Model
InternLM-XComposer-2.5-OmniLive A Specialized Generalist Multimodal System for Streaming Video and Audio Interactions
InternLM-XComposer-2.5 A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output
InternLM-XComposer2-4KHD A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD
InternLM-XComposer2 Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Models
InternLM-XComposer A Vision-Language Large Model for Advanced Text-image Comprehension and Composition
Over 4 million downloads
Once ranked 5th among over 750,000 models on HuggingFace Trending
InternLM-XComposer-2.5-Reward A Simple Yet Effective Multi-Modal Reward Model
InternLM-XComposer-2.5-OmniLive A Specialized Generalist Multimodal System for Streaming Video and Audio Interactions
InternLM-XComposer-2.5 A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output
InternLM-XComposer2-4KHD A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD
InternLM-XComposer2 Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Models
InternLM-XComposer A Vision-Language Large Model for Advanced Text-image Comprehension and Composition
Honors and Awards
- Standford/Elsevier Top 2% Scientisits List, 2024
- Two Most Influential ECCV Papers 2024 (MMBench, ShareGPT4V)
- CVPR 2023 Award Candidate
- 1st prize in COCO Object Detection Challenge (without external data) (Team Leader, Team: MMDet), 2019
- 1st prize in COCO Object Detection Challenge (Team: MMDet), 2018
- Hong Kong Ph.D. Fellowship Scheme (HKPFS), 2017
- National Scholarship, 2016
- National Scholarship, 2015
- National Scholarship, 2014