---
title: "Putting Captions to the Test — paper by Wang et al. (2026)"
description: "The authors propose judging a caption by how well it substitutes for the video itself: an LLM reads only the caption and… 47 references."
authors: ["Zizhen Wang", "Bo Feng", "Zhengfeng Lai", "Shiyu Li", "Yang Lu", "Meng Cao", "Ping Huang", "Xiaoming Simon Wang"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.777/"
doi: "10.18653/v1/2026.acl-long.777"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wang-2026-putting-captions-test-evaluating-video/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wang-2026-putting-captions-test-evaluating-video/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/40/) / Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering

# Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering

**Authors:** Zizhen Wang, Bo Feng, Zhengfeng Lai, [Shiyu Li](https://md.research.elamur.ai/free/en/authors/shiyu-li/), Yang Lu, [Meng Cao](https://md.research.elamur.ai/free/en/authors/meng-cao/), Ping Huang and Xiaoming Simon Wang · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.777/) · [PDF](https://aclanthology.org/2026.acl-long.777.pdf) · [DOI 10.18653/v1/2026.acl-long.777](https://doi.org/10.18653/v1/2026.acl-long.777) · [OpenAlex](https://openalex.org/W7166834561)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Reference-based metrics for video captioning, such as BLEU, CIDEr, BERTScore and LLM judges, tend to penalize good captions that use different wording or focus on different valid details than the reference. They also give a single score, so you cannot see *why* a caption is weak. The authors propose judging a caption by how well it substitutes for the video itself: an LLM reads only the caption and answers multiple-choice questions about the clip.

Their benchmark, CapQuiz, contains:
- videos drawn from held-out splits of existing datasets,
- questions generated by strong VLLMs, filtered automatically and then checked by humans,
- answer options that include plausible distractors.

Answers are sorted into true positives, false positives and false negatives. From these the authors derive CapP (factuality), CapR (coverage) and their combination, CapF1.

The authors report that CapQuiz agrees with human judgments better than existing metrics. Their analysis shows that current VLLMs are precise but incomplete, and perform noticeably worse on inferential questions than on descriptive ones. The main value is a diagnostic, reference-free evaluation that separates factual trustworthiness from coverage.

## Key points
- **Size and taxonomy:** CapQuiz has 1,204 videos and 23,632 human-verified multiple-choice QA pairs, about 19.63 per video, each with five options. The videos cover 24 domains grouped into 5 super-categories, and the questions fall into 10 types under the Descriptive and Inferential categories.
- **Video sources:** To limit contamination, videos come from test or held-out splits of 10 public benchmarks, including VideoMME, NextQA, MVBench, PerceptionTest, VDC and Dream1K. Short, medium and long clips (up to 120 s) appear in roughly a 6:3:1 ratio.
- **Question generation:** Questions were over-generated with Gemini-2.5-Pro and GPT-4o and then filtered. GPT-4.1 serves as the answering judge.
- **Prompt sensitivity:** Switching to a more detailed captioning prompt shifts individual scores considerably (for example, Gemini-2.5-flash drops 3.07% while GPT-4.1 gains 4.81%). However, the main trends persist: models trade factuality against coverage and show a gap on reasoning questions.
- **Limitations:** The questions are English-only, the question set cannot cover every visual detail (so CapR is a proxy), and relying on a closed-source judge may affect reproducibility.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

🧭 Topics (1): [❓ Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/) · 441 works

## Cite

Cite as: Zizhen Wang, Bo Feng, Zhengfeng Lai, Shiyu Li, Yang Lu, Meng Cao, Ping Huang and Xiaoming Simon Wang. 2026. Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{wang2026putting,
  title = {{Putting Captions to the Test: Evaluating Video Caption Quality through Multiple-Choice Question Answering}},
  author = {Zizhen Wang, Bo Feng, Zhengfeng Lai, Shiyu Li, Yang Lu, Meng Cao, Ping Huang and Xiaoming Simon Wang},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.777},
  url = {https://doi.org/10.18653/v1/2026.acl-long.777}
}
```

- [← previous Pushing the Frontiers of Scientific Fact-Checking: The SCINLP Dataset](https://md.research.elamur.ai/free/en/papers/maab-2026-pushing-frontiers-scientific-fact-checking/)
- [next → PyraMathBench: Evaluating and Improving Mathematical Capability in Large Language Models](https://md.research.elamur.ai/free/en/papers/ouyang-2026-pyramathbench-evaluating-improving-mathematical-capability/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/40/)

## References

47 references, 17 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Peter Anderson, Basura Fernando, Mark Johnson, and Stephen Gould. 2016. [Spice: Semantic propositional image caption evaluation](https://md.research.elamur.ai/free/en/papers/anderson-2016-spice-semantic-propositional-image-caption/). In European conference on computer vision, pages 382–398. Springer.
2. Shuai Bai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Lianghao Deng, Wei Ding, Chang Gao, Chunjiang Ge, Wenbin Ge, Zhifang Guo, Qidong Huang, Jie Huang, Fei Huang, Binyuan Hui, Shutong Jiang, Zhaohai Li, Mingsheng Li, and 45 others. 2025. [Qwen3-vl technical report](https://md.research.elamur.ai/free/en/papers/bai-2025-qwen3-vl-technical-report/). Preprint, ar…
3. Satanjeev Banerjee and Alon Lavie. 2005. [Meteor: An automatic metric for mt evaluation with improved correlation with human judgments](https://md.research.elamur.ai/free/en/papers/banerjee-2005-meteor-automatic-metric-mt-evaluation/). In Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization, pages 65–72.
4. Wenhao Chai, Enxin Song, Yilun Du, Chenlin Meng, Vashisht Madhavan, Omer Bar-Tal, Jenq-Neng Hwang, Saining Xie, and Christopher D Manning. 2024. Auroracap: Efficient, performant video detailed captioning and a new benchmark. arXiv preprint arXiv:2410.03051. [find](https://scholar.google.com/scholar?q=Wenhao+Chai%2C+Enxin+Song%2C+Yilun+Du%2C+Chenlin+Meng%2C+Vashisht+Madhavan%2C+Omer+Bar%2DTal%2C+Jenq%2DNeng+Hwang%2C+Saining+Xie%2C+and+Christopher+D+Manning%2E+2024%2E+Auroracap%3A+Efficient%2C+performant+video+detailed+caption)
5. David Chen and William B Dolan. 2011. [Collecting highly parallel data for paraphrase evaluation](https://md.research.elamur.ai/free/en/papers/chen-2011-collecting-highly-parallel-data-paraphrase/). In Proceedings of the 49th annual meeting of the association for computational linguistics: human language technologies, pages 190–200.
6. Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, and 1 others. 2025. [Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities](https://md.research.elamur.ai/free/en/papers/comanici-2025-gemini-2-5-pushing-frontier/). arX…
7. Xinyu Fang, Kangrui Mao, Haodong Duan, Xiangyu Zhao, Yining Li, Dahua Lin, and Kai Chen. 2024. Mmbench-video: A long-form multi-shot benchmark for holistic video understanding. Advances in Neural Information Processing Systems, 37:89098–89124. [find](https://scholar.google.com/scholar?q=Xinyu+Fang%2C+Kangrui+Mao%2C+Haodong+Duan%2C+Xiangyu+Zhao%2C+Yining+Li%2C+Dahua+Lin%2C+and+Kai+Chen%2E+2024%2E+Mmbench%2Dvideo%3A+A+long%2Dform+multi%2Dshot+benchmark+for+holistic+video+understanding%2E+Advances+in+Neural+Info)
8. Chaoyou Fu, Yuhan Dai, Yongdong Luo, Lei Li, Shuhuai Ren, Renrui Zhang, Zihan Wang, Chenyu Zhou, Yunhang Shen, Mengdan Zhang, and 1 others. 2025. [Video-mme: The first-ever comprehensive evaluation benchmark of multi-modal llms in video analysis](https://md.research.elamur.ai/free/en/papers/fu-2024-video-mme-first-ever-comprehensive/). In Proceedings of the Computer Vision and Pattern Reco…
9. Jinlan Fu, See Kiong Ng, Zhengbao Jiang, and Pengfei Liu. 2024. Gptscore: Evaluate as you desire. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 6556–6576. [find](https://scholar.google.com/scholar?q=Jinlan+Fu%2C+See+Kiong+Ng%2C+Zhengbao+Jiang%2C+and+Pengfei+Liu%2E+2024%2E+Gptscore%3A+Evaluate+as+you+desire%2E+In+Proceedings+of+the+2024+Conference+of+the+North+American+Chapter+of+the+Association+for+Computation)
10. Kilem Gwet. 2001. Handbook of inter-rater reliability: How to estimate the level of agreement between two or multiple raters. Gaithersburg, MD: STATAXIS Publishing Company. [find](https://scholar.google.com/scholar?q=Kilem+Gwet%2E+2001%2E+Handbook+of+inter%2Drater+reliability%3A+How+to+estimate+the+level+of+agreement+between+two+or+multiple+raters%2E+Gaithersburg%2C+MD%3A+STATAXIS+Publishing+Company%2E)
11. Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, and Yejin Choi. 2021. [Clipscore: A reference-free evaluation metric for image captioning](https://md.research.elamur.ai/free/en/papers/hessel-2021-clipscore-reference-free-evaluation-metric/). arXiv preprint arXiv:2104.08718.
12. Anwen Hu, Shizhe Chen, Liang Zhang, and Qin Jin. 2023. Infometic: An informative metric for reference-free image caption evaluation. arXiv preprint arXiv:2305.06002. [find](https://scholar.google.com/scholar?q=Anwen+Hu%2C+Shizhe+Chen%2C+Liang+Zhang%2C+and+Qin+Jin%2E+2023%2E+Infometic%3A+An+informative+metric+for+reference%2Dfree+image+caption+evaluation%2E+arXiv+preprint+arXiv%3A2305%2E06002%2E)
13. Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, and 1 others. 2024. [Gpt-4o system card](https://md.research.elamur.ai/free/en/papers/openai-2024-gpt-4o-system-card/). arXiv preprint arXiv:2410.21276.
14. Ming Jiang, Qiuyuan Huang, Lei Zhang, Xin Wang, Pengchuan Zhang, Zhe Gan, Jana Diesner, and Jianfeng Gao. 2019. Tiger: Text-to-image grounding for image caption evaluation. arXiv preprint arXiv:1909.02050. [find](https://scholar.google.com/scholar?q=Ming+Jiang%2C+Qiuyuan+Huang%2C+Lei+Zhang%2C+Xin+Wang%2C+Pengchuan+Zhang%2C+Zhe+Gan%2C+Jana+Diesner%2C+and+Jianfeng+Gao%2E+2019%2E+Tiger%3A+Text%2Dto%2Dimage+grounding+for+image+caption+evaluation%2E+arXiv+preprint+arXiv%3A1909%2E0)
15. Woojun Jung and Junyeong Kim. 2025. Qeva: A reference-free evaluation metric for narrative video summarization with multimodal question answering. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 24632–24642. [find](https://scholar.google.com/scholar?q=Woojun+Jung+and+Junyeong+Kim%2E+2025%2E+Qeva%3A+A+reference%2Dfree+evaluation+metric+for+narrative+video+summarization+with+multimodal+question+answering%2E+In+Findings+of+the+Association+for+Computational+Ling)
16. Maurice George Kendall. 1948. Rank correlation methods. [find](https://scholar.google.com/scholar?q=Maurice+George+Kendall%2E+1948%2E+Rank+correlation+methods%2E)
17. Muhammad Uzair Khattak, Muhammad Ferjad Naeem, Jameel Hassan, Muzammal Naseer, Federico Tombari, Fahad Shahbaz Khan, and Salman Khan. 2025. How good is my video-lmm? complex video reasoning and robustness evaluation suite for video-lmms. In Proceedings of the Computer Vision and Pattern Recognition… [find](https://scholar.google.com/scholar?q=Muhammad+Uzair+Khattak%2C+Muhammad+Ferjad+Naeem%2C+Jameel+Hassan%2C+Muzammal+Naseer%2C+Federico+Tombari%2C+Fahad+Shahbaz+Khan%2C+and+Salman+Khan%2E+2025%2E+How+good+is+my+video%2Dlmm%3F+complex+video+reasoning+and+robust)
18. Ranjay Krishna, Kenji Hata, Frederic Ren, Li Fei-Fei, and Juan Carlos Niebles. 2017. Dense-captioning events in videos. In Proceedings of the IEEE international conference on computer vision, pages 706–715. [find](https://scholar.google.com/scholar?q=Ranjay+Krishna%2C+Kenji+Hata%2C+Frederic+Ren%2C+Li+Fei%2DFei%2C+and+Juan+Carlos+Niebles%2E+2017%2E+Dense%2Dcaptioning+events+in+videos%2E+In+Proceedings+of+the+IEEE+international+conference+on+computer+vision%2C+pages+70)
19. Luis Lebron, Yvette Graham, Kevin McGuinness, Konstantinos Kouramas, and Noel E O’Connor. 2022. Bertha: Video captioning evaluation via transfer-learned human assessment. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 1566–1575. [find](https://scholar.google.com/scholar?q=Luis+Lebron%2C+Yvette+Graham%2C+Kevin+McGuinness%2C+Konstantinos+Kouramas%2C+and+Noel+E+O%E2%80%99Connor%2E+2022%2E+Bertha%3A+Video+captioning+evaluation+via+transfer%2Dlearned+human+assessment%2E+In+Proceedings+of+the+Thirtee)
20. Hwanhee Lee, Thomas Scialom, Seunghyun Yoon, Franck Dernoncourt, and Kyomin Jung. 2021. Qace: Asking questions to evaluate an image caption. arXiv preprint arXiv:2108.12560. [find](https://scholar.google.com/scholar?q=Hwanhee+Lee%2C+Thomas+Scialom%2C+Seunghyun+Yoon%2C+Franck+Dernoncourt%2C+and+Kyomin+Jung%2E+2021%2E+Qace%3A+Asking+questions+to+evaluate+an+image+caption%2E+arXiv+preprint+arXiv%3A2108%2E12560%2E)
21. Kuang-Huei Lee, Xi Chen, Gang Hua, Houdong Hu, and Xiaodong He. 2018. Stacked cross attention for image-text matching. In Proceedings of the European conference on computer vision (ECCV), pages 201–216. [find](https://scholar.google.com/scholar?q=Kuang%2DHuei+Lee%2C+Xi+Chen%2C+Gang+Hua%2C+Houdong+Hu%2C+and+Xiaodong+He%2E+2018%2E+Stacked+cross+attention+for+image%2Dtext+matching%2E+In+Proceedings+of+the+European+conference+on+computer+vision+%28ECCV%29%2C+pages+201%E2%80%9321)
22. Kunchang Li, Yali Wang, Yinan He, Yizhuo Li, Yi Wang, Yi Liu, Zun Wang, Jilan Xu, Guo Chen, Ping Luo, and 1 others. 2024. [Mvbench: A comprehensive multi-modal video understanding benchmark](https://md.research.elamur.ai/free/en/papers/li-2023-mvbench-comprehensive-multi-modal-video/). In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22195–22206.
23. Chin-Yew Lin. 2004. [Rouge: A package for automatic evaluation of summaries](https://md.research.elamur.ai/free/en/papers/lin-2004-rouge-package-automatic-evaluation-summaries/). In Text summarization branches out, pages 74–81.
24. Zhiqiu Lin, Deepak Pathak, Baiqi Li, Jiayao Li, Xide Xia, Graham Neubig, Pengchuan Zhang, and Deva Ramanan. 2024. Evaluating text-to-visual generation with image-to-text generation. In European Conference on Computer Vision, pages 366–384. Springer. [find](https://scholar.google.com/scholar?q=Zhiqiu+Lin%2C+Deepak+Pathak%2C+Baiqi+Li%2C+Jiayao+Li%2C+Xide+Xia%2C+Graham+Neubig%2C+Pengchuan+Zhang%2C+and+Deva+Ramanan%2E+2024%2E+Evaluating+text%2Dto%2Dvisual+generation+with+image%2Dto%2Dtext+generation%2E+In+European+Confer)
25. Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. 2023. [G-eval: Nlg evaluation using gpt-4 with better human alignment](https://md.research.elamur.ai/free/en/papers/liu-2023-g-eval-nlg-evaluation-gpt/). arXiv preprint arXiv:2303.16634.
26. Muhammad Maaz, Hanoona Rasheed, Salman Khan, and Fahad Khan. 2024. [Video-chatgpt: Towards detailed video understanding via large vision and language models](https://md.research.elamur.ai/free/en/papers/maaz-2023-video-chatgpt-towards-detailed-video/). In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12585– 12602.
27. George A Miller. 1995. [Wordnet: a lexical database for english](https://md.research.elamur.ai/free/en/papers/miller-1994-wordnet/). Communications of the ACM, 38(11):39–41.
28. OpenAI. 2025. Gpt-5.1: A smarter, more conversational chatgpt. [https://openai.com/index/gpt-5-1/](https://openai.com/index/gpt-5-1/). [↗](https://openai.com/index/gpt-5-1/)
29. OpenAI. 2025. Introducing gpt-4.1 in the api. [https://openai.com/index/gpt-4-1/](https://openai.com/index/gpt-4-1/). Accessed: 2025-04-14. [↗](https://openai.com/index/gpt-4-1/)
30. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. [Bleu: a method for automatic evaluation of machine translation](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/). In Proceedings of the 40th annual meeting of the Association for Computational Linguistics, pages 311–318.
31. Viorica Patraucean, Lucas Smaira, Ankush Gupta, Adria Recasens, Larisa Markeeva, Dylan Banarse, Skanda Koppula, Mateusz Malinowski, Yi Yang, Carl Doersch, and 1 others. 2023. Perception test: A diagnostic benchmark for multimodal video models. Advances in Neural Information Processing Systems, 36:42… [find](https://scholar.google.com/scholar?q=Viorica+Patraucean%2C+Lucas+Smaira%2C+Ankush+Gupta%2C+Adria+Recasens%2C+Larisa+Markeeva%2C+Dylan+Banarse%2C+Skanda+Koppula%2C+Mateusz+Malinowski%2C+Yi+Yang%2C+Carl+Doersch%2C+and+1+others%2E+2023%2E+Perception+test%3A+A+diagno)
32. Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, and 1 others. 2021. [Learning transferable visual models from natural language supervision](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/). In International conference on machine learning, pages 8748–8…
33. Charles Spearman. 1961. " general intelligence" objectively determined and measured. [find](https://scholar.google.com/scholar?q=Charles+Spearman%2E+1961%2E+%22+general+intelligence%22+objectively+determined+and+measured%2E)
34. Ramakrishna Vedantam, C Lawrence Zitnick, and Devi Parikh. 2015. [Cider: Consensus-based image description evaluation](https://md.research.elamur.ai/free/en/papers/vedantam-2014-cider-consensus-based-image-description/). In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4566–4575.
35. Jiawei Wang, Liping Yuan, Yuchen Zhang, and Haomiao Sun. 2024. Tarsier: Recipes for training and evaluating large video description models. arXiv preprint arXiv:2407.00634. — [arXiv:2407.00634](https://arxiv.org/abs/2407.00634) [find](https://scholar.google.com/scholar?q=Jiawei+Wang%2C+Liping+Yuan%2C+Yuchen+Zhang%2C+and+Haomiao+Sun%2E+2024%2E+Tarsier%3A+Recipes+for+training+and+evaluating+large+video+description+models%2E+arXiv+preprint+arXiv%3A2407%2E00634%2E+%E2%80%94+%5BarXiv%3A2407%2E00634%5D%28https%3A)
36. Sijin Wang, Ruiping Wang, Ziwei Yao, Shiguang Shan, and Xilin Chen. 2020. Cross-modal scene graph matching for relationship-aware image-text retrieval. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 1508– 1517. [find](https://scholar.google.com/scholar?q=Sijin+Wang%2C+Ruiping+Wang%2C+Ziwei+Yao%2C+Shiguang+Shan%2C+and+Xilin+Chen%2E+2020%2E+Cross%2Dmodal+scene+graph+matching+for+relationship%2Daware+image%2Dtext+retrieval%2E+In+Proceedings+of+the+IEEE%2FCVF+winter+conference)
37. Sijin Wang, Ziwei Yao, Ruiping Wang, Zhongqin Wu, and Xilin Chen. 2021. Faier: Fidelity and adequacy ensured image caption evaluation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14050–14059. [find](https://scholar.google.com/scholar?q=Sijin+Wang%2C+Ziwei+Yao%2C+Ruiping+Wang%2C+Zhongqin+Wu%2C+and+Xilin+Chen%2E+2021%2E+Faier%3A+Fidelity+and+adequacy+ensured+image+caption+evaluation%2E+In+Proceedings+of+the+IEEE%2FCVF+Conference+on+Computer+Vision+and+)
38. Weiyun Wang, Zhangwei Gao, Lixin Gu, Hengjun Pu, Long Cui, Xingguang Wei, Zhaoyang Liu, Linglin Jing, Shenglong Ye, Jie Shao, and 1 others. 2025. [Internvl3](https://md.research.elamur.ai/free/en/papers/wang-2025-internvl3-5-advancing-open/). 5: Advancing open-source multimodal models in versatility, reasoning, and efficiency. arXiv preprint arXiv:2508.18265.
39. Xin Wang, Jiawei Wu, Junkun Chen, Lei Li, Yuan-Fang Wang, and William Yang Wang. 2019. Vatex: A large-scale, high-quality multilingual dataset for video-and-language research. In Proceedings of the IEEE/CVF international conference on computer vision, pages 4581–4591. [find](https://scholar.google.com/scholar?q=Xin+Wang%2C+Jiawei+Wu%2C+Junkun+Chen%2C+Lei+Li%2C+Yuan%2DFang+Wang%2C+and+William+Yang+Wang%2E+2019%2E+Vatex%3A+A+large%2Dscale%2C+high%2Dquality+multilingual+dataset+for+video%2Dand%2Dlanguage+research%2E+In+Proceedings+of+the+IE)
40. Haoning Wu, Dongxu Li, Bei Chen, and Junnan Li. 2024. Longvideobench: A benchmark for long-context interleaved video-language understanding. Advances in Neural Information Processing Systems, 37:28828–28857. [find](https://scholar.google.com/scholar?q=Haoning+Wu%2C+Dongxu+Li%2C+Bei+Chen%2C+and+Junnan+Li%2E+2024%2E+Longvideobench%3A+A+benchmark+for+long%2Dcontext+interleaved+video%2Dlanguage+understanding%2E+Advances+in+Neural+Information+Processing+Systems%2C+37%3A28828)
41. Junbin Xiao, Xindi Shang, Angela Yao, and Tat-Seng Chua. 2021. Next-qa: Next phase of question-answering to explaining temporal actions. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9777–9786. [find](https://scholar.google.com/scholar?q=Junbin+Xiao%2C+Xindi+Shang%2C+Angela+Yao%2C+and+Tat%2DSeng+Chua%2E+2021%2E+Next%2Dqa%3A+Next+phase+of+question%2Danswering+to+explaining+temporal+actions%2E+In+Proceedings+of+the+IEEE%2FCVF+conference+on+computer+vision+an)
42. Jun Xu, Tao Mei, Ting Yao, and Yong Rui. 2016. Msr-vtt: A large video description dataset for bridging video and language. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 5288–5296. [find](https://scholar.google.com/scholar?q=Jun+Xu%2C+Tao+Mei%2C+Ting+Yao%2C+and+Yong+Rui%2E+2016%2E+Msr%2Dvtt%3A+A+large+video+description+dataset+for+bridging+video+and+language%2E+In+Proceedings+of+the+IEEE+conference+on+computer+vision+and+pattern+recognit)
43. Shijia Yang, Yunong Liu, Bohan Zhai, Ximeng Sun, Zicheng Liu, Emad Barsoum, Manling Li, and Chenfeng Xu. 2025. Captionqa: Is your caption as useful as the image itself? arXiv preprint arXiv:2511.21025. — [arXiv:2511.21025](https://arxiv.org/abs/2511.21025) [find](https://scholar.google.com/scholar?q=Shijia+Yang%2C+Yunong+Liu%2C+Bohan+Zhai%2C+Ximeng+Sun%2C+Zicheng+Liu%2C+Emad+Barsoum%2C+Manling+Li%2C+and+Chenfeng+Xu%2E+2025%2E+Captionqa%3A+Is+your+caption+as+useful+as+the+image+itself%3F+arXiv+preprint+arXiv%3A2511%2E21025)
44. Liping Yuan, Jiawei Wang, Haomiao Sun, Yuchen Zhang, and Yuan Lin. 2025. Tarsier2: Advancing large vision-language models from detailed video description to comprehensive video understanding. Preprint, arXiv:2501.07888. — [arXiv:2501.07888](https://arxiv.org/abs/2501.07888) [find](https://scholar.google.com/scholar?q=Liping+Yuan%2C+Jiawei+Wang%2C+Haomiao+Sun%2C+Yuchen+Zhang%2C+and+Yuan+Lin%2E+2025%2E+Tarsier2%3A+Advancing+large+vision%2Dlanguage+models+from+detailed+video+description+to+comprehensive+video+understanding%2E+Preprint)
45. Shi-Xue Zhang, Hongfa Wang, Duojun Huang, Xin Li, Xiaobin Zhu, and Xu-Cheng Yin. 2025. Vcapsbench: A large-scale fine-grained benchmark for video caption quality evaluation. arXiv preprint arXiv:2505.23484. — [arXiv:2505.23484](https://arxiv.org/abs/2505.23484) [find](https://scholar.google.com/scholar?q=Shi%2DXue+Zhang%2C+Hongfa+Wang%2C+Duojun+Huang%2C+Xin+Li%2C+Xiaobin+Zhu%2C+and+Xu%2DCheng+Yin%2E+2025%2E+Vcapsbench%3A+A+large%2Dscale+fine%2Dgrained+benchmark+for+video+caption+quality+evaluation%2E+arXiv+preprint+arXiv%3A2505%2E)
46. Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2019. Bertscore: Evaluating text generation with bert. arXiv preprint arXiv:1904.09675. [find](https://scholar.google.com/scholar?q=Tianyi+Zhang%2C+Varsha+Kishore%2C+Felix+Wu%2C+Kilian+Q+Weinberger%2C+and+Yoav+Artzi%2E+2019%2E+Bertscore%3A+Evaluating+text+generation+with+bert%2E+arXiv+preprint+arXiv%3A1904%2E09675%2E)
47. Yuanhan Zhang, Jinming Wu, Wei Li, Bo Li, Zejun Ma, Ziwei Liu, and Chunyuan Li. 2024. Video instruction tuning with synthetic data. Preprint, arXiv:2410.02713. [find](https://scholar.google.com/scholar?q=Yuanhan+Zhang%2C+Jinming+Wu%2C+Wei+Li%2C+Bo+Li%2C+Zejun+Ma%2C+Ziwei+Liu%2C+and+Chunyuan+Li%2E+2024%2E+Video+instruction+tuning+with+synthetic+data%2E+Preprint%2C+arXiv%3A2410%2E02713%2E)

*Updated 1 November 2026*