---
title: "SPD-Faith Bench — paper by Lv et al. (2026)"
description: "Based on these findings, the authors propose SAGE, a training-free framework that strengthens visual… 75 references, cited by 1 paper here."
authors: ["Weijiang Lv", "Yaoxuan Feng", "Xiaobo Xia", "Jiayu Wang", "Yan Jing", "Wenchao Chen", "Bo Chen"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.995/"
doi: "10.18653/v1/2026.findings-acl.995"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/lv-2026-spd-faith-bench-diagnosing-improving/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/lv-2026-spd-faith-bench-diagnosing-improving/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/17/) / SPD-Faith Bench: Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Models

# SPD-Faith Bench: Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Models

**Authors:** Weijiang Lv, Yaoxuan Feng, [Xiaobo Xia](https://md.research.elamur.ai/free/en/authors/xiaobo-xia/), Jiayu Wang, Yan Jing, Wenchao Chen and [Bo Chen](https://md.research.elamur.ai/free/en/authors/bo-chen/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.995/) · [PDF](https://aclanthology.org/2026.findings-acl.995.pdf) · [DOI 10.18653/v1/2026.findings-acl.995](https://doi.org/10.18653/v1/2026.findings-acl.995) · [OpenAlex](https://openalex.org/W7166800498)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/lv-2026-spd-faith-bench-diagnosing-improving/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Chain-of-Thought traces from multimodal large language models (MLLMs) often look coherent, yet they may not reflect how visual evidence actually drives the answer. Earlier work mostly measured perceptual hallucinations. This paper targets reasoning-level unfaithfulness instead. The authors built SPD-Faith Bench on fine-grained image difference reasoning. Comparing two nearly identical pictures forces models to use visual evidence and blocks language-prior shortcuts. Testing 12 open-source and proprietary MLLMs revealed two recurring failures: perceptual blindness and perception-reasoning dissociation. Mechanistic analysis linked both to visual attention that fades during reasoning and to representation shifts in the residual stream. Based on these findings, the authors propose SAGE, a training-free framework that strengthens visual routing and aligns generated reasoning with what the model perceives. SAGE improves faithfulness metrics on the new benchmark and also reduces hallucinations on MME and CHAIR. The study shows that faithfulness needs its own evaluation, separate from answer correctness.

## Key points
- **Benchmark design.** SPD-Faith Bench has 3,000 image pairs in two subsets:
  - a single-difference subset, split into easy, medium and hard by instance density;
  - a multi-difference subset with 2–5 controlled changes.
- **Edit construction.** Each edit is a color change, an object removal or a position change. GPT-4o planned the edits, LaMa inpainting carried them out, and humans verified the results.
- **Evaluation protocol.** Metrics cover three dimensions:
  - overall perception of the image pair, scored with DS and DQR;
  - how faithfully differences are perceived, scored with TF1 and CF1;
  - how faithfully the model reasons, scored with CR and DRF.
- **SAGE on SPD-Faith Bench.** With Qwen2.5-VL-7B, SAGE raised CR from 38.2 to 43.8 and DRF from 29.5 to 33.7 over greedy decoding, beating VCD, SC, SR, API and Zoom-Refine.
- **SAGE on other benchmarks and limitations.**
  - On MME, SAGE scored 1702.81, compared with 1649.13 for AGLA.
  - On CHAIR with LLaVA-1.5-7B, it reached C_S 42.3, C_I 12.7 and Recall 81.8.
  - The evaluation is limited to image difference captioning.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

🧭 Topics (3): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,426 works · [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 657 works

## Cite

Cite as: Weijiang Lv, Yaoxuan Feng, Xiaobo Xia, Jiayu Wang, Yan Jing, Wenchao Chen and Bo Chen. 2026. SPD-Faith Bench: Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Models. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{lv2026spd,
  title = {{SPD-Faith Bench: Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Models}},
  author = {Weijiang Lv, Yaoxuan Feng, Xiaobo Xia, Jiayu Wang, Yan Jing, Wenchao Chen and Bo Chen},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.995},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.995}
}
```

- [← previous Sparse Adapter Fusion for Continual Learning in NLP](https://md.research.elamur.ai/free/en/papers/zeng-2026-sparse-adapter-fusion-continual-learning/)
- [next → Speak in Context: Multilingual ASR with Speech–Context Alignment via Contrastive Learning](https://md.research.elamur.ai/free/en/papers/zhang-2026-speak-context-multilingual-asr-speech/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/17/)

## References

75 references, 33 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Wenbin An, Feng Tian, Sicong Leng, Jiahao Nie, Haonan Lin, QianYing Wang, Ping Chen, Xiaoqin Zhang, and Shijian Lu. 2025. Mitigating object hallucinations in large vision-language models with assembly of global and local attention. In CVPR, pages 29915– 29926. [find](https://scholar.google.com/scholar?q=Wenbin+An%2C+Feng+Tian%2C+Sicong+Leng%2C+Jiahao+Nie%2C+Haonan+Lin%2C+QianYing+Wang%2C+Ping+Chen%2C+Xiaoqin+Zhang%2C+and+Shijian+Lu%2E+2025%2E+Mitigating+object+hallucinations+in+large+vision%2Dlanguage+models+with+assembly)
2. Peter Anderson, Basura Fernando, Mark Johnson, and Stephen Gould. 2016. [Spice: Semantic propositional image caption evaluation](https://md.research.elamur.ai/free/en/papers/anderson-2016-spice-semantic-propositional-image-caption/). In ECCV, pages 382–398.
3. Iván Arcuschin, Jett Janiak, Robert Krzyzanowski, Senthooran Rajamanoharan, Neel Nanda, and Arthur Conmy. 2025. Chain-of-thought reasoning in the wild is not always faithful. arXiv preprint arXiv:2503.08679. [find](https://scholar.google.com/scholar?q=Iv%C3%A1n+Arcuschin%2C+Jett+Janiak%2C+Robert+Krzyzanowski%2C+Senthooran+Rajamanoharan%2C+Neel+Nanda%2C+and+Arthur+Conmy%2E+2025%2E+Chain%2Dof%2Dthought+reasoning+in+the+wild+is+not+always+faithful%2E+arXiv+preprint+arXiv%3A2503)
4. Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou. 2023. [Qwen-vl: A frontier large vision-language model with versatile abilities](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-vl-versatile-vision-language/). arXiv preprint arXiv:2308.12966, 1(2):3.
5. Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, and 1 others. 2025. Qwen2. 5-vl technical report. arXiv preprint arXiv:2502.13923. — [Qwen2.5-VL Technical Report](https://md.research.elamur.ai/free/en/papers/bai-2025-qwen2-5-vl-technical/)
6. Zechen Bai, Pichao Wang, Tianjun Xiao, Tong He, Zongbo Han, Zheng Zhang, and Mike Zheng Shou. 2024. Hallucination of multimodal [large language models: A survey](https://md.research.elamur.ai/free/en/papers/minaee-2024-large-language-models-survey/). arXiv preprint arXiv:2404.18930.
7. Satanjeev Banerjee and Alon Lavie. 2005. [Meteor: An automatic metric for mt evaluation with improved correlation with human judgments](https://md.research.elamur.ai/free/en/papers/banerjee-2005-meteor-automatic-metric-mt-evaluation/). In ACL Workshop, pages 65–72.
8. Fazl Barez, Tung-Yu Wu, Iván Arcuschin, Michael Lan, Vincent Wang, Noah Siegel, Nicolas Collignon, Clement Neo, Isabelle Lee, Alasdair Paren, and 1 others. 2025. Chain-of-thought is not explainability. Preprint, alphaXiv, page v1. [find](https://scholar.google.com/scholar?q=Fazl+Barez%2C+Tung%2DYu+Wu%2C+Iv%C3%A1n+Arcuschin%2C+Michael+Lan%2C+Vincent+Wang%2C+Noah+Siegel%2C+Nicolas+Collignon%2C+Clement+Neo%2C+Isabelle+Lee%2C+Alasdair+Paren%2C+and+1+others%2E+2025%2E+Chain%2Dof%2Dthought+is+not+explainability)
9. Alexander Black, Jing Shi, Yifei Fan, Tu Bui, and John Collomosse. 2024. Vixen: Visual text comparison network for image difference captioning. In AAAI, pages 846–854. [find](https://scholar.google.com/scholar?q=Alexander+Black%2C+Jing+Shi%2C+Yifei+Fan%2C+Tu+Bui%2C+and+John+Collomosse%2E+2024%2E+Vixen%3A+Visual+text+comparison+network+for+image+difference+captioning%2E+In+AAAI%2C+pages+846%E2%80%93854%2E)
10. Lin Chen, Jinsong Li, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Zehui Chen, Haodong Duan, Jiaqi Wang, Yu Qiao, Dahua Lin, and 1 others. 2024a. [Are we on the right way for evaluating large vision-language models?](https://md.research.elamur.ai/free/en/papers/chen-2024-right-way-evaluating-large-vision/) In NeurIPS, pages 27056–27087.
11. Zhe Chen, Weiyun Wang, Yue Cao, Yangzhou Liu, Zhangwei Gao, Erfei Cui, Jinguo Zhu, Shenglong Ye, Hao Tian, Zhaoyang Liu, and 1 others. 2024b. [Expanding performance boundaries of open-source multimodal models with model, data, and test-time scaling](https://md.research.elamur.ai/free/en/papers/chen-2024-expanding-performance-boundaries-open/). arXiv preprint arXiv:2412.05271.
12. Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, and 1 others. 2025. [Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities](https://md.research.elamur.ai/free/en/papers/comanici-2025-gemini-2-5-pushing-frontier/). arX…
13. Wenliang Dai, Junnan Li, Dongxu Li, Anthony Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale N Fung, and Steven Hoi. 2023. [Instructblip: Towards general-purpose vision-language models with instruction tuning](https://md.research.elamur.ai/free/en/papers/dai-2023-instructblip-towards-general-purpose-vision/). In NeurIPS, pages 49250–49267.
14. Yexing Du, Ziyang Ma, Yifan Yang, Keqi Deng, Xie Chen, Bo Yang, Yang Xiang, Ming Liu, and Bing Qin. 2024. Cot-st: Enhancing llm-based speech translation with multimodal chain-of-thought. arXiv preprint arXiv:2409.19510. — [arXiv:2409.19510](https://arxiv.org/abs/2409.19510) [find](https://scholar.google.com/scholar?q=Yexing+Du%2C+Ziyang+Ma%2C+Yifan+Yang%2C+Keqi+Deng%2C+Xie+Chen%2C+Bo+Yang%2C+Yang+Xiang%2C+Ming+Liu%2C+and+Bing+Qin%2E+2024%2E+Cot%2Dst%3A+Enhancing+llm%2Dbased+speech+translation+with+multimodal+chain%2Dof%2Dthought%2E+arXiv+preprin)
15. Jesseba Fernando and Grigori Guitchounts. 2025. Transformer dynamics: A neuroscientific approach to interpretability of large language models. arXiv preprint arXiv:2502.12131. — [arXiv:2502.12131](https://arxiv.org/abs/2502.12131) [find](https://scholar.google.com/scholar?q=Jesseba+Fernando+and+Grigori+Guitchounts%2E+2025%2E+Transformer+dynamics%3A+A+neuroscientific+approach+to+interpretability+of+large+language+models%2E+arXiv+preprint+arXiv%3A2502%2E12131%2E+%E2%80%94+%5BarXiv%3A2502%2E12131%5D%28htt)
16. Maxwell Forbes, Christine Kaeser-Chen, Piyush Sharma, and Serge Belongie. 2019. Neural naturalist: Generating fine-grained image comparisons. arXiv preprint arXiv:1909.04101. [find](https://scholar.google.com/scholar?q=Maxwell+Forbes%2C+Christine+Kaeser%2DChen%2C+Piyush+Sharma%2C+and+Serge+Belongie%2E+2019%2E+Neural+naturalist%3A+Generating+fine%2Dgrained+image+comparisons%2E+arXiv+preprint+arXiv%3A1909%2E04101%2E)
17. Chaoyou Fu, Peixian Chen, Yunhang Shen, Yulei Qin, Mengdan Zhang, Xu Lin, Jinrui Yang, Xiawu Zheng, Ke Li, Xing Sun, and 1 others. 2025. [Mme: A comprehensive evaluation benchmark for multimodal large language models](https://md.research.elamur.ai/free/en/papers/fu-2023-mme-comprehensive-evaluation-benchmark-multimodal/). In NeurIPS Datasets and Benchmarks Track.
18. Timin Gao, Peixian Chen, Mengdan Zhang, Chaoyou Fu, Yunhang Shen, Yan Zhang, Shengchuan Zhang, Xiawu Zheng, Xing Sun, Liujuan Cao, and 1 others. 2024. Cantor: Inspiring multimodal chain-of-thought of mllm. In ACM MM, pages 9096–9105. [find](https://scholar.google.com/scholar?q=Timin+Gao%2C+Peixian+Chen%2C+Mengdan+Zhang%2C+Chaoyou+Fu%2C+Yunhang+Shen%2C+Yan+Zhang%2C+Shengchuan+Zhang%2C+Xiawu+Zheng%2C+Xing+Sun%2C+Liujuan+Cao%2C+and+1+others%2E+2024%2E+Cantor%3A+Inspiring+multimodal+chain%2Dof%2Dthought+of+)
19. Mor Geva, Avi Caciularu, Kevin Wang, and Yoav Goldberg. 2022. Transformer feed-forward layers build predictions by promoting concepts in the vocabulary space. In EMNLP, pages 30–45. others. 2024. [Gpt-4o system card](https://md.research.elamur.ai/free/en/papers/openai-2024-gpt-4o-system-card/). arXiv preprint arXiv:2410.21276.
20. Harsh Jhamtani and Taylor Berg-Kirkpatrick. 2018. Learning to describe differences between pairs of similar images. arXiv preprint arXiv:1808.10584. [find](https://scholar.google.com/scholar?q=Harsh+Jhamtani+and+Taylor+Berg%2DKirkpatrick%2E+2018%2E+Learning+to+describe+differences+between+pairs+of+similar+images%2E+arXiv+preprint+arXiv%3A1808%2E10584%2E)
21. Jingjing Jiang, Chao Ma, Xurui Song, Hanwang Zhang, and Jun Luo. 2025. Corvid: Improving multimodal large language models towards chain-of-thought reasoning. In ICCV, pages 3034–3046. [find](https://scholar.google.com/scholar?q=Jingjing+Jiang%2C+Chao+Ma%2C+Xurui+Song%2C+Hanwang+Zhang%2C+and+Jun+Luo%2E+2025%2E+Corvid%3A+Improving+multimodal+large+language+models+towards+chain%2Dof%2Dthought+reasoning%2E+In+ICCV%2C+pages+3034%E2%80%933046%2E)
22. Tamera Lanham, Anna Chen, Ansh Radhakrishnan, Benoit Steiner, Carson Denison, Danny Hernandez, Dustin Li, Esin Durmus, Evan Hubinger, Jackson Kernion, and 1 others. 2023. [Measuring faithfulness in chain-of-thought reasoning](https://md.research.elamur.ai/free/en/papers/lanham-2023-measuring-faithfulness-chain-thought-reasoning/). arXiv preprint arXiv:2307.13702.
23. Sicong Leng, Hang Zhang, Guanzheng Chen, Xin Li, Shijian Lu, Chunyan Miao, and Lidong Bing. 2024. [Mitigating object hallucinations in large vision-language models through visual contrastive decoding](https://md.research.elamur.ai/free/en/papers/leng-2023-mitigating-object-hallucinations-large-vision/). In CVPR, pages 13872–13882.
24. Junxian Li, Xinyue Xu, Sai Ma, and Sichao Li. 2025a. Faithact: Faithfulness planning and acting in mllms. arXiv preprint arXiv:2511.08409. — [arXiv:2511.08409](https://arxiv.org/abs/2511.08409) [find](https://scholar.google.com/scholar?q=Junxian+Li%2C+Xinyue+Xu%2C+Sai+Ma%2C+and+Sichao+Li%2E+2025a%2E+Faithact%3A+Faithfulness+planning+and+acting+in+mllms%2E+arXiv+preprint+arXiv%3A2511%2E08409%2E+%E2%80%94+%5BarXiv%3A2511%2E08409%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2511%2E08409%29)
25. Yi Li, Hualiang Wang, Xinpeng Ding, Haonan Wang, and Xiaomeng Li. 2025b. Token activation map to visually explain multimodal llms. arXiv preprint arXiv:2506.23270. — [arXiv:2506.23270](https://arxiv.org/abs/2506.23270) [find](https://scholar.google.com/scholar?q=Yi+Li%2C+Hualiang+Wang%2C+Xinpeng+Ding%2C+Haonan+Wang%2C+and+Xiaomeng+Li%2E+2025b%2E+Token+activation+map+to+visually+explain+multimodal+llms%2E+arXiv+preprint+arXiv%3A2506%2E23270%2E+%E2%80%94+%5BarXiv%3A2506%2E23270%5D%28https%3A%2F%2Farxiv%2Eo)
26. Yifan Li, Yifan Du, Kun Zhou, Jinpeng Wang, Wayne Xin Zhao, and Ji-Rong Wen. 2023. [Evaluating object hallucination in large vision-language models](https://md.research.elamur.ai/free/en/papers/li-2023-evaluating-object-hallucination-large-vision/). arXiv preprint arXiv:2305.10355.
27. Chin-Yew Lin. 2004. [Rouge: A package for automatic evaluation of summaries](https://md.research.elamur.ai/free/en/papers/lin-2004-rouge-package-automatic-evaluation-summaries/). In Text Summarization Branches Out, pages 74–81.
28. Mor Geva, Roei Schuster, Jonathan Berant, and Omer Levy. 2021. Transformer feed-forward layers are key-value memories. In EMNLP, pages 5484–5495. [find](https://scholar.google.com/scholar?q=Mor+Geva%2C+Roei+Schuster%2C+Jonathan+Berant%2C+and+Omer+Levy%2E+2021%2E+Transformer+feed%2Dforward+layers+are+key%2Dvalue+memories%2E+In+EMNLP%2C+pages+5484%E2%80%935495%2E)
29. Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014. [Microsoft coco: Common objects in context](https://md.research.elamur.ai/free/en/papers/lin-2014-microsoft-coco-common-objects-context/). In ECCV, pages 740– 755.
30. Meng-Hao Guo, Jiajun Xu, Yi Zhang, Jiaxi Song, Haoyang Peng, Yi-Xuan Deng, Xinzhi Dong, Kiyohiro Nakayama, Zhengyang Geng, Chen Wang, and 1 others. 2025. R-bench: Graduate-level multidisciplinary benchmarks for llm & mllm complex reasoning evaluation. In ICML. [find](https://scholar.google.com/scholar?q=Meng%2DHao+Guo%2C+Jiajun+Xu%2C+Yi+Zhang%2C+Jiaxi+Song%2C+Haoyang+Peng%2C+Yi%2DXuan+Deng%2C+Xinzhi+Dong%2C+Kiyohiro+Nakayama%2C+Zhengyang+Geng%2C+Chen+Wang%2C+and+1+others%2E+2025%2E+R%2Dbench%3A+Graduate%2Dlevel+multidisciplinary+benc)
31. Zihao Lin, Samyadeep Basu, Mohammad Beigi, Varun Manjunatha, Ryan A Rossi, Zichao Wang, Yufan Zhou, Sriram Balasubramanian, Arman Zarei, Keivan Rezaei, and 1 others. 2025. A survey on mechanistic interpretability for multi-modal foundation models. arXiv preprint arXiv:2502.17516. — [arXiv:2502.17516](https://arxiv.org/abs/2502.17516) [find](https://scholar.google.com/scholar?q=Zihao+Lin%2C+Samyadeep+Basu%2C+Mohammad+Beigi%2C+Varun+Manjunatha%2C+Ryan+A+Rossi%2C+Zichao+Wang%2C+Yufan+Zhou%2C+Sriram+Balasubramanian%2C+Arman+Zarei%2C+Keivan+Rezaei%2C+and+1+others%2E+2025%2E+A+survey+on+mechanistic+inte)
32. Qidong Huang, Xiaoyi Dong, Pan Zhang, Bin Wang, Conghui He, Jiaqi Wang, Dahua Lin, Weiming Zhang, and Nenghai Yu. 2024. Opera: Alleviating hallucination in multi-modal large language models via over-trust penalty and retrospection-allocation. In CVPR, pages 13418–13427. [find](https://scholar.google.com/scholar?q=Qidong+Huang%2C+Xiaoyi+Dong%2C+Pan+Zhang%2C+Bin+Wang%2C+Conghui+He%2C+Jiaqi+Wang%2C+Dahua+Lin%2C+Weiming+Zhang%2C+and+Nenghai+Yu%2E+2024%2E+Opera%3A+Alleviating+hallucination+in+multi%2Dmodal+large+language+models+via+over%2Dt)
33. Shi Liu, Kecheng Zheng, and Wei Chen. 2024a. Paying more attention to image: A training-free method for alleviating hallucination in lvlms. In ECCV, pages 125–140. [find](https://scholar.google.com/scholar?q=Shi+Liu%2C+Kecheng+Zheng%2C+and+Wei+Chen%2E+2024a%2E+Paying+more+attention+to+image%3A+A+training%2Dfree+method+for+alleviating+hallucination+in+lvlms%2E+In+ECCV%2C+pages+125%E2%80%93140%2E)
34. Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, and 1 Yuan Liu, Haodong Duan, Yuanhan Zhang, Bo Li, Songyang Zhang, Wangbo Zhao, Yike Yuan, Jiaqi Wang, Conghui He, Ziwei Liu, and 1 others. 2024b. [Mmbench: Is yo…](https://md.research.elamur.ai/free/en/papers/liu-2023-mmbench-multi-modal-model-all/)
35. Zhining Liu, Ziyi Chen, Hui Liu, Chen Luo, Xianfeng Tang, Suhang Wang, Joy Zeng, Zhenwei Dai, Zhan Shi, Tianxin Wei, and 1 others. 2025a. Seeing but not believing: Probing the disconnect between visual attention and answer correctness in vlms. arXiv preprint arXiv:2510.17771. — [arXiv:2510.17771](https://arxiv.org/abs/2510.17771) [find](https://scholar.google.com/scholar?q=Zhining+Liu%2C+Ziyi+Chen%2C+Hui+Liu%2C+Chen+Luo%2C+Xianfeng+Tang%2C+Suhang+Wang%2C+Joy+Zeng%2C+Zhenwei+Dai%2C+Zhan+Shi%2C+Tianxin+Wei%2C+and+1+others%2E+2025a%2E+Seeing+but+not+believing%3A+Probing+the+disconnect+between+visua)
36. Hao Shao, Shengju Qian, Han Xiao, Guanglu Song, Zhuofan Zong, Letian Wang, Yu Liu, and Hongsheng Li. 2024. Visual cot: Advancing multimodal language models with a comprehensive dataset and benchmark for chain-of-thought reasoning. In NeurIPS, pages 8612–8642. [find](https://scholar.google.com/scholar?q=Hao+Shao%2C+Shengju+Qian%2C+Han+Xiao%2C+Guanglu+Song%2C+Zhuofan+Zong%2C+Letian+Wang%2C+Yu+Liu%2C+and+Hongsheng+Li%2E+2024%2E+Visual+cot%3A+Advancing+multimodal+language+models+with+a+comprehensive+dataset+and+benchmark+f)
37. Zujing Liu, Junwen Pan, Qi She, Yuan Gao, and Guisong Xia. 2025b. On the faithfulness of visual thinking: Measurement and enhancement. arXiv preprint arXiv:2510.23482. — [arXiv:2510.23482](https://arxiv.org/abs/2510.23482) [find](https://scholar.google.com/scholar?q=Zujing+Liu%2C+Junwen+Pan%2C+Qi+She%2C+Yuan+Gao%2C+and+Guisong+Xia%2E+2025b%2E+On+the+faithfulness+of+visual+thinking%3A+Measurement+and+enhancement%2E+arXiv+preprint+arXiv%3A2510%2E23482%2E+%E2%80%94+%5BarXiv%3A2510%2E23482%5D%28https%3A%2F%2Farx)
38. Xu Shen, Song Wang, Zhen Tan, Laura Yao, Xinyu Zhao, Kaidi Xu, Xin Wang, and Tianlong Chen. 2025. Faithcot-bench: Benchmarking instance-level faithfulness of chain-of-thought reasoning. arXiv preprint arXiv:2510.04040. — [arXiv:2510.04040](https://arxiv.org/abs/2510.04040) [find](https://scholar.google.com/scholar?q=Xu+Shen%2C+Song+Wang%2C+Zhen+Tan%2C+Laura+Yao%2C+Xinyu+Zhao%2C+Kaidi+Xu%2C+Xin+Wang%2C+and+Tianlong+Chen%2E+2025%2E+Faithcot%2Dbench%3A+Benchmarking+instance%2Dlevel+faithfulness+of+chain%2Dof%2Dthought+reasoning%2E+arXiv+preprint)
39. Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chunyuan Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, and Jianfeng Gao. 2023. [Mathvista: Evaluating mathematical reasoning of foundation models in visual contexts](https://md.research.elamur.ai/free/en/papers/lu-2023-mathvista-evaluating-mathematical-reasoning-foundation/). arXiv preprint arXiv:2310.02255.
40. Run Luo, Lu Wang, Wanwei He, Longze Chen, Jiaming Li, and Xiaobo Xia. 2025a. Gui-r1: A generalist r1-style vision-language action model for gui agents. arXiv preprint arXiv:2504.10458. — [arXiv:2504.10458](https://arxiv.org/abs/2504.10458) [find](https://scholar.google.com/scholar?q=Run+Luo%2C+Lu+Wang%2C+Wanwei+He%2C+Longze+Chen%2C+Jiaming+Li%2C+and+Xiaobo+Xia%2E+2025a%2E+Gui%2Dr1%3A+A+generalist+r1%2Dstyle+vision%2Dlanguage+action+model+for+gui+agents%2E+arXiv+preprint+arXiv%3A2504%2E10458%2E+%E2%80%94+%5BarXiv%3A2504%2E1)
41. Run Luo, Xiaobo Xia, Lu Wang, Longze Chen, Renke Shan, Jing Luo, Min Yang, and Tat-Seng Chua. 2026. Next-omni: Towards any-to-any omnimodal foundation models with discrete flow matching. In ICLR. [find](https://scholar.google.com/scholar?q=Run+Luo%2C+Xiaobo+Xia%2C+Lu+Wang%2C+Longze+Chen%2C+Renke+Shan%2C+Jing+Luo%2C+Min+Yang%2C+and+Tat%2DSeng+Chua%2E+2026%2E+Next%2Domni%3A+Towards+any%2Dto%2Dany+omnimodal+foundation+models+with+discrete+flow+matching%2E+In+ICLR%2E)
42. Run Luo, Haonan Zhang, Longze Chen, Ting-En Lin, Xiong Liu, Yuchuan Wu, Min Yang, Yongbin Li, Minzheng Wang, Pengpeng Zeng, and 1 others. 2025b. Mmevol: Empowering multimodal large language models with evol-instruct. In ACL Findings, pages 19655–19682. [find](https://scholar.google.com/scholar?q=Run+Luo%2C+Haonan+Zhang%2C+Longze+Chen%2C+Ting%2DEn+Lin%2C+Xiong+Liu%2C+Yuchuan+Wu%2C+Min+Yang%2C+Yongbin+Li%2C+Minzheng+Wang%2C+Pengpeng+Zeng%2C+and+1+others%2E+2025b%2E+Mmevol%3A+Empowering+multimodal+large+language+models+wit)
43. Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, and 1 others. 2023. Self-refine: Iterative refinement with self-feedback. In NeurIPS, pages 46534–46594. [find](https://scholar.google.com/scholar?q=Aman+Madaan%2C+Niket+Tandon%2C+Prakhar+Gupta%2C+Skyler+Hallinan%2C+Luyu+Gao%2C+Sarah+Wiegreffe%2C+Uri+Alon%2C+Nouha+Dziri%2C+Shrimai+Prabhumoye%2C+Yiming+Yang%2C+and+1+others%2E+2023%2E+Self%2Drefine%3A+Iterative+refinement+with)
44. Chancharik Mitra, Brandon Huang, Trevor Darrell, and Roei Herzig. 2024. Compositional chain-of-thought prompting for large multimodal models. In CVPR, pages 14420–14431. [find](https://scholar.google.com/scholar?q=Chancharik+Mitra%2C+Brandon+Huang%2C+Trevor+Darrell%2C+and+Roei+Herzig%2E+2024%2E+Compositional+chain%2Dof%2Dthought+prompting+for+large+multimodal+models%2E+In+CVPR%2C+pages+14420%E2%80%9314431%2E)
45. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. [Bleu: a method for automatic evaluation of machine translation](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/). In ACL, pages 311–318.
46. Dong Huk Park, Trevor Darrell, and Anna Rohrbach. 2019. Robust change captioning. In ICCV, pages 4624–4633. [find](https://scholar.google.com/scholar?q=Dong+Huk+Park%2C+Trevor+Darrell%2C+and+Anna+Rohrbach%2E+2019%2E+Robust+change+captioning%2E+In+ICCV%2C+pages+4624%E2%80%934633%2E)
47. Yi Peng, Peiyu Wang, Xiaokun Wang, Yichen Wei, Jiangbo Pei, Weijie Qiu, Ai Jian, Yunzhuo Hao, Jiachun Pan, Tianyidan Xie, and 1 others. 2025. [Skywork r1v: Pioneering multimodal reasoning with chain-of-thought](https://md.research.elamur.ai/free/en/papers/peng-2025-skywork-r1v-pioneering-multimodal/). arXiv preprint arXiv:2504.05599.
48. Anna Rohrbach, Lisa Anne Hendricks, Kaylee Burns, Trevor Darrell, and Kate Saenko. 2018. [Object hallucination in image captioning](https://md.research.elamur.ai/free/en/papers/rohrbach-2018-object-hallucination-image-captioning/). arXiv preprint arXiv:1809.02156.
49. Jiajie Su, Haoyuan Wang, Xiaohua Feng, Yunshan Ma, Xiaobo Xia, Yuyuan Li, Xiaolin Zheng, Jianmao Xiao, and Chaochao Chen. 2026. Out-of-distribution generalization via invariant trajectories for multimodal large language model editing. arXiv preprint arXiv:2601.19700. — [arXiv:2601.19700](https://arxiv.org/abs/2601.19700) [find](https://scholar.google.com/scholar?q=Jiajie+Su%2C+Haoyuan+Wang%2C+Xiaohua+Feng%2C+Yunshan+Ma%2C+Xiaobo+Xia%2C+Yuyuan+Li%2C+Xiaolin+Zheng%2C+Jianmao+Xiao%2C+and+Chaochao+Chen%2E+2026%2E+Out%2Dof%2Ddistribution+generalization+via+invariant+trajectories+for+multim)
50. Roman Suvorov, Elizaveta Logacheva, Anton Mashikhin, Anastasia Remizova, Arsenii Ashukha, Aleksei Silvestrov, Naejin Kong, Harshith Goka, Kiwoong Park, and Victor Lempitsky. 2021. Resolution-robust large mask inpainting with fourier convolutions. arXiv preprint arXiv:2109.07161. — [arXiv:2109.07161](https://arxiv.org/abs/2109.07161) [find](https://scholar.google.com/scholar?q=Roman+Suvorov%2C+Elizaveta+Logacheva%2C+Anton+Mashikhin%2C+Anastasia+Remizova%2C+Arsenii+Ashukha%2C+Aleksei+Silvestrov%2C+Naejin+Kong%2C+Harshith+Goka%2C+Kiwoong+Park%2C+and+Victor+Lempitsky%2E+2021%2E+Resolution%2Drobust+la)
51. Anand Swaroop, Akshat Nallani, Saksham Uboweja, Adiliia Uzdenova, Michael Nguyen, Kevin Zhu, Sunishchal Dev, Ashwinee Panda, Vasu Sharma, and Maheep Chaudhary. 2025. Frit: Using causal importance to improve chain-of-thought faithfulness. arXiv preprint arXiv:2509.13334. — [arXiv:2509.13334](https://arxiv.org/abs/2509.13334) [find](https://scholar.google.com/scholar?q=Anand+Swaroop%2C+Akshat+Nallani%2C+Saksham+Uboweja%2C+Adiliia+Uzdenova%2C+Michael+Nguyen%2C+Kevin+Zhu%2C+Sunishchal+Dev%2C+Ashwinee+Panda%2C+Vasu+Sharma%2C+and+Maheep+Chaudhary%2E+2025%2E+Frit%3A+Using+causal+importance+to+i)
52. Hao Tan, Franck Dernoncourt, Zhe Lin, Trung Bui, and Mohit Bansal. 2019. Expressing visual relationships via language. arXiv preprint arXiv:1906.07689. [find](https://scholar.google.com/scholar?q=Hao+Tan%2C+Franck+Dernoncourt%2C+Zhe+Lin%2C+Trung+Bui%2C+and+Mohit+Bansal%2E+2019%2E+Expressing+visual+relationships+via+language%2E+arXiv+preprint+arXiv%3A1906%2E07689%2E)
53. V Team, Wenyi Hong, Wenmeng Yu, Xiaotao Gu, Guo Wang, Guobing Gan, Haomiao Tang, Jiale Cheng, Ji Qi, Junhui Ji, Lihang Pan, Shuaiqi Duan, Weihan Wang, Yan Wang, Yean Cheng, Zehai He, Zhe Su, Zhen Yang, Ziyang Pan, and 69 others. 2025. [Glm-4.5v and glm-4.1v-thinking: Towards versatile multimodal reas…](https://md.research.elamur.ai/free/en/papers/team-2025-v-glm-4-5v-glm/)
54. Miles Turpin, Julian Michael, Ethan Perez, and Samuel Bowman. 2023. [Language models don’t always say what they think: Unfaithful explanations in chain-of-thought prompting](https://md.research.elamur.ai/free/en/papers/turpin-2023-language-models-don-t-always/). In NeurIPS, pages 74952–74965.
55. Ramakrishna Vedantam, C Lawrence Zitnick, and Devi Parikh. 2015. [Cider: Consensus-based image description evaluation](https://md.research.elamur.ai/free/en/papers/vedantam-2014-cider-consensus-based-image-description/). In CVPR, pages 4566–4575.
56. Haifeng Wang, Jiwei Li, Hua Wu, Eduard Hovy, and Yu Sun. 2023. Pre-trained language models and their applications. Engineering, 25:51–65. [find](https://scholar.google.com/scholar?q=Haifeng+Wang%2C+Jiwei+Li%2C+Hua+Wu%2C+Eduard+Hovy%2C+and+Yu+Sun%2E+2023%2E+Pre%2Dtrained+language+models+and+their+applications%2E+Engineering%2C+25%3A51%E2%80%9365%2E)
57. Ke Wang, Junting Pan, Weikang Shi, Zimu Lu, Houxing Ren, Aojun Zhou, Mingjie Zhan, and Hongsheng Li. 2024a. [Measuring multimodal mathematical reasoning with math-vision dataset](https://md.research.elamur.ai/free/en/papers/wang-2024-measuring-multimodal-mathematical-reasoning-math/). In NeurIPS, pages 95095–95169.
58. Peng Wang, Shuai Bai, Sinan Tan, Shijie Wang, Zhihao Fan, Jinze Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, and 1 others. 2024b. [Qwen2-vl: Enhancing vision-language model’s perception of the world at any resolution](https://md.research.elamur.ai/free/en/papers/wang-2024-qwen2-vl-enhancing-vision/). arXiv preprint arXiv:2409.12191.
59. Xintong Wang, Jingheng Pan, Liang Ding, and Chris Biemann. 2024c. Mitigating hallucinations in large vision-language models with instruction contrastive decoding. arXiv preprint arXiv:2403.18715. [find](https://scholar.google.com/scholar?q=Xintong+Wang%2C+Jingheng+Pan%2C+Liang+Ding%2C+and+Chris+Biemann%2E+2024c%2E+Mitigating+hallucinations+in+large+vision%2Dlanguage+models+with+instruction+contrastive+decoding%2E+arXiv+preprint+arXiv%3A2403%2E18715%2E)
60. Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2022. [Self-consistency improves chain of thought reasoning in language models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/). arXiv preprint arXiv:2203.11171.
61. Yaoting Wang, Shengqiong Wu, Yuecheng Zhang, Shuicheng Yan, Ziwei Liu, Jiebo Luo, and Hao Fei. 2025. Multimodal chain-of-thought reasoning: A comprehensive survey. arXiv preprint arXiv:2503.12605. — [arXiv:2503.12605](https://arxiv.org/abs/2503.12605) [find](https://scholar.google.com/scholar?q=Yaoting+Wang%2C+Shengqiong+Wu%2C+Yuecheng+Zhang%2C+Shuicheng+Yan%2C+Ziwei+Liu%2C+Jiebo+Luo%2C+and+Hao+Fei%2E+2025%2E+Multimodal+chain%2Dof%2Dthought+reasoning%3A+A+comprehensive+survey%2E+arXiv+preprint+arXiv%3A2503%2E12605%2E+%E2%80%94+%5B)
62. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). In NeurIPS, pages 24824–24837.
63. Lai Wei, Wenkai Wang, Xiaoyu Shen, Yu Xie, Zhihao Fan, Xiaojin Zhang, Zhongyu Wei, and Wei Chen. 2024. Mc-cot: A modular collaborative cot framework for zero-shot medical-vqa with llm and mllm integration. arXiv preprint arXiv:2410.04521. — [arXiv:2410.04521](https://arxiv.org/abs/2410.04521) [find](https://scholar.google.com/scholar?q=Lai+Wei%2C+Wenkai+Wang%2C+Xiaoyu+Shen%2C+Yu+Xie%2C+Zhihao+Fan%2C+Xiaojin+Zhang%2C+Zhongyu+Wei%2C+and+Wei+Chen%2E+2024%2E+Mc%2Dcot%3A+A+modular+collaborative+cot+framework+for+zero%2Dshot+medical%2Dvqa+with+llm+and+mllm+integra)
64. Qiong Wu, Xiangcong Yang, Yiyi Zhou, Chenxin Fang, Baiyang Song, Xiaoshuai Sun, and Rongrong Ji. 2025. Grounded chain-of-thought for multimodal large language models. arXiv preprint arXiv:2503.12799. — [arXiv:2503.12799](https://arxiv.org/abs/2503.12799) [find](https://scholar.google.com/scholar?q=Qiong+Wu%2C+Xiangcong+Yang%2C+Yiyi+Zhou%2C+Chenxin+Fang%2C+Baiyang+Song%2C+Xiaoshuai+Sun%2C+and+Rongrong+Ji%2E+2025%2E+Grounded+chain%2Dof%2Dthought+for+multimodal+large+language+models%2E+arXiv+preprint+arXiv%3A2503%2E12799%2E+)
65. Xuan Yu, Dayan Guan, and Yanfeng Gu. 2025. Zoom-refine: Boosting high-resolution multimodal understanding via localized zoom and self-refinement. arXiv preprint arXiv:2506.01663. — [arXiv:2506.01663](https://arxiv.org/abs/2506.01663) [find](https://scholar.google.com/scholar?q=Xuan+Yu%2C+Dayan+Guan%2C+and+Yanfeng+Gu%2E+2025%2E+Zoom%2Drefine%3A+Boosting+high%2Dresolution+multimodal+understanding+via+localized+zoom+and+self%2Drefinement%2E+arXiv+preprint+arXiv%3A2506%2E01663%2E+%E2%80%94+%5BarXiv%3A2506%2E01663%5D%28)
66. Zeping Yu and Sophia Ananiadou. 2024. Neuron-level knowledge attribution in large language models. In EMNLP, pages 3267–3280. [find](https://scholar.google.com/scholar?q=Zeping+Yu+and+Sophia+Ananiadou%2E+2024%2E+Neuron%2Dlevel+knowledge+attribution+in+large+language+models%2E+In+EMNLP%2C+pages+3267%E2%80%933280%2E)
67. Daoan Zhang, Junming Yang, Hanjia Lyu, Zijian Jin, Yuan Yao, Mingkai Chen, and Jiebo Luo. 2024a. Cocot: Contrastive chain-of-thought prompting for large multimodal models with multiple image inputs. arXiv preprint arXiv:2401.02582. — [arXiv:2401.02582](https://arxiv.org/abs/2401.02582) [find](https://scholar.google.com/scholar?q=Daoan+Zhang%2C+Junming+Yang%2C+Hanjia+Lyu%2C+Zijian+Jin%2C+Yuan+Yao%2C+Mingkai+Chen%2C+and+Jiebo+Luo%2E+2024a%2E+Cocot%3A+Contrastive+chain%2Dof%2Dthought+prompting+for+large+multimodal+models+with+multiple+image+inputs%2E+a)
68. Duzhen Zhang, Yahan Yu, Jiahua Dong, Chenxing Li, Dan Su, Chenhui Chu, and Dong Yu. 2024b. [Mm-llms: Recent advances in multimodal large language models](https://md.research.elamur.ai/free/en/papers/zhang-2024-mm-llms-recent-advances-multimodal/). arXiv preprint arXiv:2401.13601.
69. Jiarui Zhang, Mahyar Khayatkhoei, Prateek Chhikara, and Filip Ilievski. 2025a. Mllms know where to look: Training-free perception of small visual details with multimodal llms. arXiv preprint arXiv:2502.17422. — [arXiv:2502.17422](https://arxiv.org/abs/2502.17422) [find](https://scholar.google.com/scholar?q=Jiarui+Zhang%2C+Mahyar+Khayatkhoei%2C+Prateek+Chhikara%2C+and+Filip+Ilievski%2E+2025a%2E+Mllms+know+where+to+look%3A+Training%2Dfree+perception+of+small+visual+details+with+multimodal+llms%2E+arXiv+preprint+arXiv%3A250)
70. Jusheng Zhang, Kaitong Cai, Xiaoyang Guo, Sidi Liu, Qinhan Lv, Ruiqi Chen, Jing Yang, Yijia Fan, Xiaofei Sun, Jian Wang, and 1 others. 2025b. Mm-cot: A benchmark for probing visual chain-of-thought reasoning in multimodal models. arXiv preprint arXiv:2512.08228. — [arXiv:2512.08228](https://arxiv.org/abs/2512.08228) [find](https://scholar.google.com/scholar?q=Jusheng+Zhang%2C+Kaitong+Cai%2C+Xiaoyang+Guo%2C+Sidi+Liu%2C+Qinhan+Lv%2C+Ruiqi+Chen%2C+Jing+Yang%2C+Yijia+Fan%2C+Xiaofei+Sun%2C+Jian+Wang%2C+and+1+others%2E+2025b%2E+Mm%2Dcot%3A+A+benchmark+for+probing+visual+chain%2Dof%2Dthought+re)
71. Zhuosheng Zhang, Aston Zhang, Mu Li, Hai Zhao, George Karypis, and Alex Smola. 2023. [Multimodal chain-of-thought reasoning in language models](https://md.research.elamur.ai/free/en/papers/zhang-2023-multimodal-chain-thought-reasoning-language/). arXiv preprint arXiv:2302.00923.
72. Zhiyu Wu, Xiaokang Chen, Zizheng Pan, Xingchao Liu, Wen Liu, Damai Dai, Huazuo Gao, Yiyang Ma, Chengyue Wu, Bingxuan Wang, and 1 others. 2024. [Deepseek-vl2: Mixture-of-experts vision-language models for advanced multimodal understanding](https://md.research.elamur.ai/free/en/papers/wu-2024-deepseek-vl2-mixture-experts/). arXiv preprint arXiv:2412.10302.
73. An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, and 1 others. 2025. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/). arXiv preprint arXiv:2505.09388.
74. Yuan Yao, Tianyu Yu, Ao Zhang, Chongyi Wang, Junbo Cui, Hongji Zhu, Tianchi Cai, Haoyu Li, Weilin Zhao, Zhihui He, and 1 others. 2024. [Minicpm-v: A gpt-4v level mllm on your phone](https://md.research.elamur.ai/free/en/papers/yao-2024-minicpm-v-gpt-4v/). arXiv preprint arXiv:2408.01800.
75. Runpeng Yu, Weihao Yu, and Xinchao Wang. 2024. Attention prompting on image for large vision-language models. In ECCV, pages 251–268. [find](https://scholar.google.com/scholar?q=Runpeng+Yu%2C+Weihao+Yu%2C+and+Xinchao+Wang%2E+2024%2E+Attention+prompting+on+image+for+large+vision%2Dlanguage+models%2E+In+ECCV%2C+pages+251%E2%80%93268%2E)

*Updated 1 November 2026*