---
title: "Chunyuan Li — all works — Elamur Research"
description: "All 43 works of Chunyuan Li in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/chunyuan-li/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/chunyuan-li/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Chunyuan Li](https://md.research.elamur.ai/free/en/authors/chunyuan-li/) / all works

# Chunyuan Li — all works

43 works · [← Chunyuan Li](https://md.research.elamur.ai/free/en/authors/chunyuan-li/)

1. [**Visual Instruction Tuning arXiv:2304.08485**Haotian Liu, Chunyuan Li, Qingyang Wu, et al.*2023 · 2,617 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-visual-instruction-tuning/)
2. **[Improved Baselines with Visual Instruction Tuning](https://md.research.elamur.ai/free/en/papers/liu-2023-improved-baselines-visual-instruction-tuning/) [IEEE Computer Society Conference on Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/venues/ieee-computer-society-conference-on-computer-vision-and-pattern-recognition/)**Haotian Liu, Chunyuan Li, Yuheng Li, et al.*2023 · 2,614 citations*
3. **[Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks](https://md.research.elamur.ai/free/en/papers/li-2020-oscar-object-semantics-aligned-pre/) [Lecture notes in computer science](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/)**Xiujun Li, Xi Yin, Chunyuan Li, et al.*2020 · 1,877 citations*
4. **[Grounded Language-Image Pre-training ↗](https://doi.org/10.1109/cvpr52688.2022.01069) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Liunian Harold Li et al.*2022 · 1,207 citations*
5. **[A whole-slide foundation model for digital pathology from real-world data ↗](https://doi.org/10.1038/s41586-024-07441-w) Nature · no summary yet**Hanwen Xu et al.*2024 · 904 citations*
6. **[LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day](https://md.research.elamur.ai/free/en/papers/li-2023-llava-med-training-large-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Chunyuan Li, Cliff Wong, Sheng Zhang, et al.*2023 · 692 citations*
7. [**Instruction Tuning with GPT-4 arXiv:2304.03277**Baolin Peng, Chunyuan Li, Pengcheng He, et al.*2023 · 662 citations*](https://md.research.elamur.ai/free/en/papers/peng-2023-instruction-tuning-gpt-4/)
8. **[RegionCLIP: Region-based Language-Image Pretraining ↗](https://doi.org/10.1109/cvpr52688.2022.01629) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Yiwu Zhong et al.*2022 · 639 citations*
9. **[GLIGEN: Open-Set Grounded Text-to-Image Generation ↗](https://doi.org/10.1109/cvpr52729.2023.02156) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Yuheng Li et al.*2023 · 615 citations*
10. [**LLaVA-OneVision: Easy Visual Task Transfer arXiv:2408.03326**Bo Li, Yuanhan Zhang, Dong Guo, et al.*2024 · 477 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-llava-onevision-easy-visual-task/)
11. [**Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection arXiv:2303.05499**Shilong Liu, Zhaoyang Zeng, Tianhe Ren, et al.*2023 · 472 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-grounding-dino-marrying-dino-grounded/)
12. [**MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts arXiv:2310.02255**Pan Lu, Hritik Bansal, Tony Xia, et al.*2023 · 468 citations*](https://md.research.elamur.ai/free/en/papers/lu-2023-mathvista-evaluating-mathematical-reasoning-foundation/)
13. **[Joint Embedding of Words and Labels for Text Classification](https://md.research.elamur.ai/free/en/papers/wang-2018-joint-embedding-words-labels-text/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Guoyin Wang, Chunyuan Li, Wenlin Wang, et al.*2018 · 465 citations*
14. **[Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms](https://md.research.elamur.ai/free/en/papers/shen-2018-baseline-needs-more-love-simple/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Dinghan Shen, Guoyin Wang, Wenlin Wang, et al.*2018 · 386 citations*
15. **[OCRBench: On the Hidden Mystery of OCR in Large Multimodal Models](https://md.research.elamur.ai/free/en/papers/liu-2023-ocrbench-hidden-mystery-ocr-large/) [Science China Information Sciences](https://md.research.elamur.ai/free/en/venues/science-china-information-sciences/)**Yuliang Liu, Zhang Li, Mingxin Huang, et al.*2023 · 306 citations*
16. **[Cyclical Annealing Schedule: A Simple Approach to Mitigating KL Vanishing ↗](https://aclanthology.org/N19-1021/) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · no summary yet**Hao Fu et al.*2019 · 280 citations*
17. **[Few-shot Natural Language Generation for Task-Oriented Dialog](https://md.research.elamur.ai/free/en/papers/peng-2020-few-shot-natural-language-generation/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Baolin Peng, Chenguang Zhu, Chunyuan Li, et al.*2020 · 256 citations*
18. **[Preconditioned Stochastic Gradient Langevin Dynamics for Deep Neural Networks ↗](https://doi.org/10.1609/aaai.v30i1.10200) Proceedings of the AAAI Conference on Artificial Intelligence · no summary yet**Chunyuan Li et al.*2016 · 237 citations*
19. **[Generalized Decoding for Pixel, Image, and Language ↗](https://doi.org/10.1109/cvpr52729.2023.01451) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Xueyan Zou et al.*2023 · 219 citations*
20. **[Unified Contrastive Learning in Image-Text-Label Space ↗](https://doi.org/10.1109/cvpr52688.2022.01857) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Jianwei Yang et al.*2022 · 219 citations*
21. **[Towards Language-Free Training for Text-to-Image Generation ↗](https://doi.org/10.1109/cvpr52688.2022.01738) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Yufan Zhou et al.*2022 · 216 citations*
22. **[Optimus: Organizing Sentences via Pre-trained Modeling of a Latent Space](https://md.research.elamur.ai/free/en/papers/li-2020-optimus-organizing-sentences-pre-trained/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Chunyuan Li, Xiang Gao, Yuan Li, et al.*2020 · 208 citations*
23. [**Aligning Large Multimodal Models with Factually Augmented RLHF arXiv:2309.14525**Zhiqing Sun, Sheng Shen, Shengcao Cao, et al.*2023 · 176 citations*](https://md.research.elamur.ai/free/en/papers/sun-2023-aligning-large-multimodal-models-factually/)
24. **[Measuring the Intrinsic Dimension of Objective Landscapes ↗](https://arxiv.org/abs/1804.08838) arXiv:1804.08838 · no summary yet**Chunyuan Li et al.*2018 · 143 citations*
25. **[Few-Shot Named Entity Recognition: An Empirical Baseline Study ↗](https://aclanthology.org/2021.emnlp-main.813/) Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yet**Jiaxin Huang et al.*2021 · 140 citations*
26. **[Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4V ↗](https://arxiv.org/abs/2310.11441) arXiv:2310.11441 · no summary yet**Jianwei Yang et al.*2023 · 137 citations*
27. **[Aligning Large Multimodal Models with Factually Augmented RLHF ↗](https://aclanthology.org/2024.findings-acl.775/) Findings of the Association for Computational Linguistics: ACL 2024 · no summary yet**Zhiqing Sun et al.*2024 · 136 citations*
28. **[Towards Building The Federatedgpt: Federated Instruction Tuning ↗](https://doi.org/10.1109/icassp48485.2024.10447454) IEEE International Conference on Acoustics Speech and Signal Processing · no summary yet**Jianyi Zhang et al.*2024 · 129 citations*
29. **[LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models ↗](https://arxiv.org/abs/2407.07895) arXiv:2407.07895 · no summary yet**Feng Li et al.*2024 · 127 citations*
30. **[Learning Generic Sentence Representations Using Convolutional Neural Networks ↗](https://aclanthology.org/D17-1254/) Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing · no summary yet**Zhe Gan et al.*2017 · 118 citations*
31. **[POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training ↗](https://aclanthology.org/2020.emnlp-main.698/) Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yet**Yizhe Zhang et al.*2020 · 116 citations*
32. **[Robust Navigation with Language Pretraining and Stochastic Sampling ↗](https://aclanthology.org/D19-1159/) Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yet**Xiujun Li et al.*2019 · 116 citations*
33. **[LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models](https://md.research.elamur.ai/free/en/papers/zhang-2025-lmms-eval-reality-check-evaluation/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Kaichen Zhang, Bo Li, Peiyuan Zhang, et al.*2025 · 115 citations*
34. **[Focal Attention for Long-Range Interactions in Vision Transformers ↗](https://openalex.org/W3213783001) neural information processing systems · no summary yet**Jianwei Yang et al.*2021 · 85 citations*
35. **[Long Context Transfer from Language to Vision ↗](https://arxiv.org/abs/2406.16852) arXiv:2406.16852 · no summary yet**Peiyuan Zhang et al.*2024 · 73 citations*
36. **[Scaling Vision-Language Models with Sparse Mixture of Experts ↗](https://aclanthology.org/2023.findings-emnlp.758/) Findings of the Association for Computational Linguistics: EMNLP 2023 · no summary yet**Sheng Shen et al.*2023 · 70 citations*
37. **[MuirBench: A Comprehensive Benchmark for Robust Multi-image Understanding ↗](https://arxiv.org/abs/2406.09411) arXiv (Cornell University) · no summary yet**Fei Wang et al.*2024 · 48 citations*
38. **[Learning Customized Visual Models with Retrieval-Augmented Knowledge ↗](https://doi.org/10.1109/cvpr52729.2023.01454) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Haotian Liu et al.*2023 · 45 citations*
39. **[Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward](https://md.research.elamur.ai/free/en/papers/zhang-2025-direct-preference-optimization-video-large/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Ruohong Zhang, Liangke Gui, Zhiqing Sun, et al.*2025 · 32 citations*
40. **[DoubleTransfer at MEDIQA 2019: Multi-Source Transfer Learning for Natural Language Understanding in the Medical Domain ↗](https://aclanthology.org/W19-5042/) Proceedings of the 18th BioNLP Workshop and Shared Task · no summary yet**Yichong Xu et al.*2019 · 22 citations*
41. **[An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models ↗](https://arxiv.org/abs/2309.09958) arXiv (Cornell University) · no summary yet**Yadong Lu et al.*2023 · 18 citations*
42. **[BiomedJourney: Counterfactual Biomedical Image Generation by Instruction-Learning from Multimodal Patient Journeys ↗](https://arxiv.org/abs/2310.10765) arXiv (Cornell University) · no summary yet**Yu Gu et al.*2023 · 16 citations*
43. **[Rethinking Sentiment Style Transfer ↗](https://aclanthology.org/2021.findings-emnlp.135/) Findings of the Association for Computational Linguistics: EMNLP 2021 · no summary yet**Ping Yu et al.*2021 · 8 citations*