---
title: "Qwen3-Omni Technical Report — Xu 2025"
description: "Multimodal LLMs often lose ground in one modality when they gain in another."
authors: ["Jin Xu", "Zhifang Guo", "Hangrui Hu", "Yunfei Chu", "Xiong Wang", "Jinzheng He", "Yuxuan Wang", "Xian Shi", "Ting He", "Xinfa Zhu", "Yuanjun Lv", "Yongqi Wang", "Dake Guo", "He Wang", "Linhan Ma", "Pei Zhang", "Xinyu Zhang", "Hongkun Hao", "Zishan Guo", "Baosong Yang", "Bin Zhang", "Ziyang Ma", "Xipin Wei", "Shuai Bai", "Keqin Chen", "Xuejing Liu", "Peng Wang", "Mingkun Yang", "Dayiheng Liu", "Xingzhang Ren", "Bo Zheng", "Rui Men", "Fan Zhou", "Bowen Yu", "Jianxin Yang", "Le Yu", "Jingren Zhou", "Junyang Lin"]
year: 2025
venue: "arXiv:2509.17765"
source: "https://arxiv.org/abs/2509.17765"
doi: "10.48550/arxiv.2509.17765"
arxiv: "2509.17765"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/xu-2025-qwen3-omni-technical-report/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/xu-2025-qwen3-omni-technical-report/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/) / Qwen3-Omni Technical Report

# Qwen3-Omni Technical Report

**Authors:** [Jin Xu](https://md.research.elamur.ai/free/en/authors/jin-xu/), [Zhifang Guo](https://md.research.elamur.ai/free/en/authors/zhifang-guo/), [Hangrui Hu](https://md.research.elamur.ai/free/en/authors/hangrui-hu/), [Yunfei Chu](https://md.research.elamur.ai/free/en/authors/yunfei-chu/), [Xiong Wang](https://md.research.elamur.ai/free/en/authors/xiong-wang/), [Jinzheng He](https://md.research.elamur.ai/free/en/authors/jinzheng-he/), [Yuxuan Wang](https://md.research.elamur.ai/free/en/authors/yuxuan-wang/), Xian Shi, [Ting He](https://md.research.elamur.ai/free/en/authors/ting-he/), Xinfa Zhu, [Yuanjun Lv](https://md.research.elamur.ai/free/en/authors/yuanjun-lv/), Yongqi Wang et al. (38 authors) · **Year:** 2025 · **Venue:** arXiv:2509.17765 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2509.17765) · [PDF](https://arxiv.org/pdf/2509.17765) · [DOI 10.48550/arxiv.2509.17765](https://doi.org/10.48550/arxiv.2509.17765) · [arXiv 2509.17765](https://arxiv.org/abs/2509.17765) · [OpenAlex](https://openalex.org/W4415255153)

**Citations:** 2 citations (openalex-snapshot · 2026-10-14) · [111](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Multimodal LLMs often lose ground in one modality when they gain in another. The Qwen Team built Qwen3-Omni, a single end-to-end model that handles text, images, audio and video and responds with text or streaming speech. It does this without falling below same-sized single-modality Qwen models. The model extends the Thinker–Talker design of Qwen2.5-Omni. Both parts become Mixture-of-Experts, and Whisper is replaced by a new AuT audio encoder trained from scratch. The Talker predicts multi-codebook speech codecs, and a light causal ConvNet turns them into audio frame by frame. The authors credit parity across modalities mainly to blending unimodal and cross-modal data early in text pretraining. The release also includes a reasoning-focused Thinking variant and an audio Captioner, since no general-purpose audio captioning model was available to researchers. Qwen3-Omni shows especially strong results on audio and audio-visual tasks, where it beats several closed systems. Because the weights are open, it is a practical base for multilingual speech and multimodal work.

## Key points
- On 36 audio and audio-visual benchmarks, the model is the best open-source system on 32 and the best overall on 22. It surpasses Gemini-2.5-Pro, Seed-ASR and GPT-4o-Transcribe.
- AuT (Audio Transformer) has about 0.6B parameters and was trained on 20 million hours of supervised audio, produces tokens at 12.5 Hz, and uses dynamic attention windows of 1–8 s. The vision encoder comes from Qwen3-VL and is initialized from SigLIP2-So400m (about 543M parameters).
- Language coverage is 119 languages for text, 19 for speech understanding and 10 for speech generation. The model can take audio inputs of up to 40 minutes for ASR and spoken-language understanding.
- Speech generation uses MTP modules to predict residual codebooks, and Code2Wav swaps block-wise DiT for a causal ConvNet. Together these give a theoretical cold-start first-packet latency of 234 ms.
- Qwen3-Omni-30B-A3B, -Thinking and -Captioner are released under the Apache 2.0 license.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

111 papers of our library cite it (of the 140673 whose bibliographies we read); 4 of them have a page here, 107 not yet.

- [Multi-Task Instruction Tuning via Data Scheduling for Low-Resource Arabic SpeechLLMs](https://md.research.elamur.ai/free/en/papers/bhatti-2026-multi-task-instruction-tuning-data/)
- [Multilingual Long-Form Speech Instruction Following: KIT's Submission to IWSLT 2026](https://md.research.elamur.ai/free/en/papers/ugan-2026-multilingual-long-form-speech-instruction/)
- [Nuha-Speech: Building General-Purpose Arabic Speech-LLMs](https://md.research.elamur.ai/free/en/papers/wang-2026-nuha-speech-building-general-purpose/)
- [Test-Time Adaptation of an Offline Multimodal Foundation Model for Simultaneous Speech Translation](https://md.research.elamur.ai/free/en/papers/xing-2026-test-time-adaptation-offline-multimodal/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{xu2025qwen3,
  title = {{Qwen3-Omni Technical Report}},
  author = {Xu, Jin and Guo, Zhifang and Hu, Hangrui and Chu, Yunfei and Wang, Xiong and He, Jinzheng and Wang, Yuxuan and Shi, Xian and He, Ting and Zhu, Xinfa and Lv, Yuanjun and Wang, Yongqi and Guo, Dake and Wang, He and Ma, Linhan and Zhang, Pei and Zhang, Xinyu and Hao, Hongkun and Guo, Zishan and Yang, Baosong and Zhang, Bin and Ma, Ziyang and Wei, Xipin and Bai, Shuai and Chen, Keqin and Liu, Xuejing and Wang, Peng and Yang, Mingkun and Liu, Dayiheng and Ren, Xingzhang and Zheng, Bo and Men, Rui and Zhou, Fan and Yu, Bowen and Yang, Jianxin and Yu, Le and Zhou, Jingren and Lin, Junyang},
  year = {2025},
  doi = {10.48550/arxiv.2509.17765},
  eprint = {2509.17765},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2509.17765}
}
```

- [← previous Qwen3 Technical Report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/)
- [next → Qwen3-VL Technical Report](https://md.research.elamur.ai/free/en/papers/bai-2025-qwen3-vl-technical-report/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/)

## References

75 references, 24 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Pravesh Agrawal, Szymon Antoniak, Emma Bou Hanna, Baptiste Bout, Devendra Chaplot, Jessica Chudnovsky, Diogo Costa, Baudouin De Monicault, Saurabh Garg, Theophile Gervet, Soham Ghosh, Amélie Héliou, Paul Jacob, Albert Q. Jiang, Kartik Khandelwal, Timothée Lacroix, Guillaume Lample, Diego Las Casas,… [find](https://scholar.google.com/scholar?q=Pravesh+Agrawal%2C+Szymon+Antoniak%2C+Emma+Bou+Hanna%2C+Baptiste+Bout%2C+Devendra+Chaplot%2C+Jessica+Chudnovsky%2C+Diogo+Costa%2C+Baudouin+De+Monicault%2C+Saurabh+Garg%2C+Theophile+Gervet%2C+Soham+Ghosh%2C+Am%C3%A9lie+H%C3%A9liou%2C+P)
2. AIME. AIME problems and solutions, 2025. URL [https://artofproblemsolving.com/wiki/index.php/A](https://artofproblemsolving.com/wiki/index.php/A) IME_Problems_and_Solutions. [↗](https://artofproblemsolving.com/wiki/index.php/A)
3. Philip Anastassiou, Jiawei Chen, Jitong Chen, Yuanzhe Chen, Zhuo Chen, Ziyi Chen, Jian Cong, Lelai Deng, Chuang Ding, Lu Gao, et al. Seed-tts: A family of high-quality versatile speech generation models. arXiv preprint arXiv:2406.02430, 2024. [find](https://scholar.google.com/scholar?q=Philip+Anastassiou%2C+Jiawei+Chen%2C+Jitong+Chen%2C+Yuanzhe+Chen%2C+Zhuo+Chen%2C+Ziyi+Chen%2C+Jian+Cong%2C+Lelai+Deng%2C+Chuang+Ding%2C+Lu+Gao%2C+et+al%2E+Seed%2Dtts%3A+A+family+of+high%2Dquality+versatile+speech+generation+mode)
4. Anthropic. Introducing Claude, 2023a. URL [https://www.anthropic.com/index/introducing-claude](https://www.anthropic.com/index/introducing-claude). [↗](https://www.anthropic.com/index/introducing-claude)
5. Anthropic. Claude 2. Technical report, Anthropic, 2023b. URL [https://www-files.anthropic.com/pro](https://www-files.anthropic.com/pro) duction/images/Model-Card-Claude-2.pdf. [↗](https://www-files.anthropic.com/pro)
6. Anthropic. The Claude 3 model family: Opus, Sonnet, Haiku. Technical report, Anthropic, AI, 2024. URL [https://www-cdn.anthropic.com/de8ba9b01c9ab7cbabf5c33b80b7bbc618857627/Model_Card_Claude_](https://www-cdn.anthropic.com/de8ba9b01c9ab7cbabf5c33b80b7bbc618857627/Model_Card_Claude_) 3.pdf. [↗](https://www-cdn.anthropic.com/de8ba9b01c9ab7cbabf5c33b80b7bbc618857627/Model_Card_Claude_)
7. Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, Jianxin Ma, Rui Men, Xingzhang Ren, Xuancheng Ren, Chuanqi Tan, Sinan Tan, Jianhong Tu, P… [find](https://scholar.google.com/scholar?q=Jinze+Bai%2C+Shuai+Bai%2C+Yunfei+Chu%2C+Zeyu+Cui%2C+Kai+Dang%2C+Xiaodong+Deng%2C+Yang+Fan%2C+Wenbin+Ge%2C+Yu+Han%2C+Fei+Huang%2C+Binyuan+Hui%2C+Luo+Ji%2C+Mei+Li%2C+Junyang+Lin%2C+Runji+Lin%2C+Dayiheng+Liu%2C+Gao+Liu%2C+Chengqiang+Lu%2C+) [our card](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/)
8. Jinze Bai, Shuai Bai, Shusheng Yang, Shijie Wang, Sinan Tan, Peng Wang, Junyang Lin, Chang Zhou, and Jingren Zhou. Qwen-VL: A frontier large vision-language model with versatile abilities. CoRR, abs/2308.12966, 2023b. [find](https://scholar.google.com/scholar?q=Jinze+Bai%2C+Shuai+Bai%2C+Shusheng+Yang%2C+Shijie+Wang%2C+Sinan+Tan%2C+Peng+Wang%2C+Junyang+Lin%2C+Chang+Zhou%2C+and+Jingren+Zhou%2E+Qwen%2DVL%3A+A+frontier+large+vision%2Dlanguage+model+with+versatile+abilities%2E+CoRR%2C+abs%2F2) [our card](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-vl-versatile-vision-language/)
9. Shuai Bai, Keqin Chen, Xuejing Liu, Jialin Wang, Wenbin Ge, Sibo Song, Kai Dang, Peng Wang, Shijie Wang, Jun Tang, et al. Qwen2. 5-vl technical report. arXiv preprint arXiv:2502.13923, 2025. [find](https://scholar.google.com/scholar?q=Shuai+Bai%2C+Keqin+Chen%2C+Xuejing+Liu%2C+Jialin+Wang%2C+Wenbin+Ge%2C+Sibo+Song%2C+Kai+Dang%2C+Peng+Wang%2C+Shijie+Wang%2C+Jun+Tang%2C+et+al%2E+Qwen2%2E+5%2Dvl+technical+report%2E+arXiv+preprint+arXiv%3A2502%2E13923%2C+2025%2E) [our card](https://md.research.elamur.ai/free/en/papers/bai-2025-qwen2-5-vl-technical/)
10. Dmitry Bogdanov, Minz Won, Philip Tovstogan, Alastair Porter, and Xavier Serra. The mtg-jamendo dataset for automatic music tagging. ICML, 2019. [find](https://scholar.google.com/scholar?q=Dmitry+Bogdanov%2C+Minz+Won%2C+Philip+Tovstogan%2C+Alastair+Porter%2C+and+Xavier+Serra%2E+The+mtg%2Djamendo+dataset+for+automatic+music+tagging%2E+ICML%2C+2019%2E)
11. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners. In NeurIPS, 2020. [find](https://scholar.google.com/scholar?q=Tom+Brown%2C+Benjamin+Mann%2C+Nick+Ryder%2C+Melanie+Subbiah%2C+Jared+D+Kaplan%2C+Prafulla+Dhariwal%2C+Arvind+Neelakantan%2C+Pranav+Shyam%2C+Girish+Sastry%2C+Amanda+Askell%2C+et+al%2E+Language+models+are+few%2Dshot+learners%2E+)
12. Federico Cassano, John Gouwar, Daniel Nguyen, Sydney Nguyen, Luna Phipps-Costin, Donald Pinckney, Ming-Ho Yee, Yangtian Zi, Carolyn Jane Anderson, Molly Q. Feldman, Arjun Guha, Michael Greenberg, and Abhinav Jangda. MultiPL-E: A scalable and polyglot approach to benchmarking neural code generation.… [find](https://scholar.google.com/scholar?q=Federico+Cassano%2C+John+Gouwar%2C+Daniel+Nguyen%2C+Sydney+Nguyen%2C+Luna+Phipps%2DCostin%2C+Donald+Pinckney%2C+Ming%2DHo+Yee%2C+Yangtian+Zi%2C+Carolyn+Jane+Anderson%2C+Molly+Q%2E+Feldman%2C+Arjun+Guha%2C+Michael+Greenberg%2C+and+)
13. Lin Chen, Jinsong Li, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Zehui Chen, Haodong Duan, Jiaqi Wang, Yu Qiao, Dahua Lin, et al. Are we on the right way for evaluating large vision-language models? arXiv:2403.20330, 2024a. [find](https://scholar.google.com/scholar?q=Lin+Chen%2C+Jinsong+Li%2C+Xiaoyi+Dong%2C+Pan+Zhang%2C+Yuhang+Zang%2C+Zehui+Chen%2C+Haodong+Duan%2C+Jiaqi+Wang%2C+Yu+Qiao%2C+Dahua+Lin%2C+et+al%2E+Are+we+on+the+right+way+for+evaluating+large+vision%2Dlanguage+models%3F+arXiv%3A2) [our card](https://md.research.elamur.ai/free/en/papers/chen-2024-right-way-evaluating-large-vision/)
14. Yiming Chen, Xianghu Yue, Chen Zhang, Xiaoxue Gao, Robby T Tan, and Haizhou Li. Voicebench: Benchmarking llm-based voice assistants. arXiv preprint arXiv:2410.17196, 2024b. [find](https://scholar.google.com/scholar?q=Yiming+Chen%2C+Xianghu+Yue%2C+Chen+Zhang%2C+Xiaoxue+Gao%2C+Robby+T+Tan%2C+and+Haizhou+Li%2E+Voicebench%3A+Benchmarking+llm%2Dbased+voice+assistants%2E+arXiv+preprint+arXiv%3A2410%2E17196%2C+2024b%2E)
15. Yushen Chen, Zhikang Niu, Ziyang Ma, Keqi Deng, Chunhui Wang, Jian Zhao, Kai Yu, and Xie Chen. F5-tts: A fairytaler that fakes fluent and faithful speech with flow matching. arXiv preprint arXiv:2410.06885, 2024c. [find](https://scholar.google.com/scholar?q=Yushen+Chen%2C+Zhikang+Niu%2C+Ziyang+Ma%2C+Keqi+Deng%2C+Chunhui+Wang%2C+Jian+Zhao%2C+Kai+Yu%2C+and+Xie+Chen%2E+F5%2Dtts%3A+A+fairytaler+that+fakes+fluent+and+faithful+speech+with+flow+matching%2E+arXiv+preprint+arXiv%3A2410%2E)
16. Junhao Cheng, Yuying Ge, Teng Wang, Yixiao Ge, Jing Liao, and Ying Shan. Video-holmes: Can MLLM think like holmes for complex video reasoning? CoRR, abs/2505.21374, 2025. — [arXiv:2505.21374](https://arxiv.org/abs/2505.21374) [find](https://scholar.google.com/scholar?q=Junhao+Cheng%2C+Yuying+Ge%2C+Teng+Wang%2C+Yixiao+Ge%2C+Jing+Liao%2C+and+Ying+Shan%2E+Video%2Dholmes%3A+Can+MLLM+think+like+holmes+for+complex+video+reasoning%3F+CoRR%2C+abs%2F2505%2E21374%2C+2025%2E+%E2%80%94+%5BarXiv%3A2505%2E21374%5D%28https%3A%2F%2F)
17. Yunfei Chu, Jin Xu, Xiaohuan Zhou, Qian Yang, Shiliang Zhang, Zhijie Yan, Chang Zhou, and Jingren Zhou. Qwen-Audio: Advancing universal audio understanding via unified large-scale audio-language models. CoRR, abs/2311.07919, 2023. [find](https://scholar.google.com/scholar?q=Yunfei+Chu%2C+Jin+Xu%2C+Xiaohuan+Zhou%2C+Qian+Yang%2C+Shiliang+Zhang%2C+Zhijie+Yan%2C+Chang+Zhou%2C+and+Jingren+Zhou%2E+Qwen%2DAudio%3A+Advancing+universal+audio+understanding+via+unified+large%2Dscale+audio%2Dlanguage+model) [our card](https://md.research.elamur.ai/free/en/papers/chu-2023-qwen-audio-advancing-universal/)
18. Yunfei Chu, Jin Xu, Qian Yang, Haojie Wei, Xipin Wei, Zhifang Guo, Yichong Leng, Yuanjun Lv, Jinzheng He, Junyang Lin, et al. Qwen2-audio technical report. arXiv preprint arXiv:2407.10759, 2024. [find](https://scholar.google.com/scholar?q=Yunfei+Chu%2C+Jin+Xu%2C+Qian+Yang%2C+Haojie+Wei%2C+Xipin+Wei%2C+Zhifang+Guo%2C+Yichong+Leng%2C+Yuanjun+Lv%2C+Jinzheng+He%2C+Junyang+Lin%2C+et+al%2E+Qwen2%2Daudio+technical+report%2E+arXiv+preprint+arXiv%3A2407%2E10759%2C+2024%2E) [our card](https://md.research.elamur.ai/free/en/papers/chu-2024-qwen2-audio-technical-report/)
19. Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, et al. Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities. arXiv preprint a… [find](https://scholar.google.com/scholar?q=Gheorghe+Comanici%2C+Eric+Bieber%2C+Mike+Schaekermann%2C+Ice+Pasupat%2C+Noveen+Sachdeva%2C+Inderjit+Dhillon%2C+Marcel+Blistein%2C+Ori+Ram%2C+Dan+Zhang%2C+Evan+Rosen%2C+et+al%2E+Gemini+2%2E5%3A+Pushing+the+frontier+with+advance) [our card](https://md.research.elamur.ai/free/en/papers/comanici-2025-gemini-2-5-pushing-frontier/)
20. Zhihao Du, Yuxuan Wang, Qian Chen, Xian Shi, Xiang Lv, Tianyu Zhao, Zhifu Gao, Yexin Yang, Changfeng Gao, Hui Wang, et al. Cosyvoice 2: Scalable streaming speech synthesis with large language models. arXiv preprint arXiv:2412.10117, 2024. [find](https://scholar.google.com/scholar?q=Zhihao+Du%2C+Yuxuan+Wang%2C+Qian+Chen%2C+Xian+Shi%2C+Xiang+Lv%2C+Tianyu+Zhao%2C+Zhifu+Gao%2C+Yexin+Yang%2C+Changfeng+Gao%2C+Hui+Wang%2C+et+al%2E+Cosyvoice+2%3A+Scalable+streaming+speech+synthesis+with+large+language+models%2E+)
21. Zhihao Du, Changfeng Gao, Yuxuan Wang, Fan Yu, Tianyu Zhao, Hao Wang, Xiang Lv, Hui Wang, Chongjia Ni, Xian Shi, Keyu An, Guanrou Yang, Yabin Li, Yanni Chen, Zhifu Gao, Qian Chen, Yue Gu, Mengzhe Chen, Yafeng Chen, Shiliang Zhang, Wen Wang, and Jieping Ye. Cosyvoice 3: Towards in-the-wild speech gen… — [arXiv:2505.17589](https://arxiv.org/abs/2505.17589) [find](https://scholar.google.com/scholar?q=Zhihao+Du%2C+Changfeng+Gao%2C+Yuxuan+Wang%2C+Fan+Yu%2C+Tianyu+Zhao%2C+Hao+Wang%2C+Xiang+Lv%2C+Hui+Wang%2C+Chongjia+Ni%2C+Xian+Shi%2C+Keyu+An%2C+Guanrou+Yang%2C+Yabin+Li%2C+Yanni+Chen%2C+Zhifu+Gao%2C+Qian+Chen%2C+Yue+Gu%2C+Mengzhe+Chen)
22. Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao, Aston Zhang, Aurélien Rodriguez,… [find](https://scholar.google.com/scholar?q=Abhimanyu+Dubey%2C+Abhinav+Jauhri%2C+Abhinav+Pandey%2C+Abhishek+Kadian%2C+Ahmad+Al%2DDahle%2C+Aiesha+Letman%2C+Akhil+Mathur%2C+Alan+Schelten%2C+Amy+Yang%2C+Angela+Fan%2C+Anirudh+Goyal%2C+Anthony+Hartshorn%2C+Aobo+Yang%2C+Archi+M)
23. Sefik Emre Eskimez, Xiaofei Wang, Manthan Thakker, Canrun Li, Chung-Hsien Tsai, Zhen Xiao, Hemin Yang, Zirun Zhu, Min Tang, Xu Tan, et al. E2 tts: Embarrassingly easy fully non-autoregressive zero-shot tts. In 2024 IEEE Spoken Language Technology Workshop (SLT), pp. 682–689. [find](https://scholar.google.com/scholar?q=Sefik+Emre+Eskimez%2C+Xiaofei+Wang%2C+Manthan+Thakker%2C+Canrun+Li%2C+Chung%2DHsien+Tsai%2C+Zhen+Xiao%2C+Hemin+Yang%2C+Zirun+Zhu%2C+Min+Tang%2C+Xu+Tan%2C+et+al%2E+E2+tts%3A+Embarrassingly+easy+fully+non%2Dautoregressive+zero%2Dsho)
24. Chaoyou Fu, Yuhan Dai, Yondong Luo, Lei Li, Shuhuai Ren, Renrui Zhang, Zihan Wang, Chenyu Zhou, Yunhang Shen, Mengdan Zhang, et al. Video-mme: The first-ever comprehensive evaluation benchmark of multi-modal llms in video analysis. arXiv:2405.21075, 2024. [find](https://scholar.google.com/scholar?q=Chaoyou+Fu%2C+Yuhan+Dai%2C+Yondong+Luo%2C+Lei+Li%2C+Shuhuai+Ren%2C+Renrui+Zhang%2C+Zihan+Wang%2C+Chenyu+Zhou%2C+Yunhang+Shen%2C+Mengdan+Zhang%2C+et+al%2E+Video%2Dmme%3A+The+first%2Dever+comprehensive+evaluation+benchmark+of+mult) [our card](https://md.research.elamur.ai/free/en/papers/fu-2024-video-mme-first-ever-comprehensive/)
25. Aryo Pradipta Gema, Joshua Ong Jun Leang, Giwon Hong, Alessio Devoto, Alberto Carlo Maria Mancino, Rohit Saxena, Xuanli He, Yu Zhao, Xiaotang Du, Mohammad Reza Ghasemi Madani, et al. Are we done with mmlu? CoRR, abs/2406.04127, 2024. [find](https://scholar.google.com/scholar?q=Aryo+Pradipta+Gema%2C+Joshua+Ong+Jun+Leang%2C+Giwon+Hong%2C+Alessio+Devoto%2C+Alberto+Carlo+Maria+Mancino%2C+Rohit+Saxena%2C+Xuanli+He%2C+Yu+Zhao%2C+Xiaotang+Du%2C+Mohammad+Reza+Ghasemi+Madani%2C+et+al%2E+Are+we+done+with+)
26. Gemini Team. Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. Technical report, Google, 2024. URL [https://storage.googleapis.com/deepmind-media/gemini/gemi](https://storage.googleapis.com/deepmind-media/gemini/gemi) ni_v1_5_report.pdf. [↗](https://storage.googleapis.com/deepmind-media/gemini/gemi) [our card](https://md.research.elamur.ai/free/en/papers/gemini-2024-team-gemini-1-5-unlocking-multimodal/)
27. Arushi Goel, Sreyan Ghosh, Jaehyeon Kim, Sonal Kumar, Zhifeng Kong, Sang-gil Lee, Chao-Han Huck Yang, Ramani Duraiswami, Dinesh Manocha, Rafael Valle, et al. Audio flamingo 3: Advancing audio intelligence with fully open large audio language models. arXiv preprint arXiv:2507.08128, 2025. — [arXiv:2507.08128](https://arxiv.org/abs/2507.08128) [find](https://scholar.google.com/scholar?q=Arushi+Goel%2C+Sreyan+Ghosh%2C+Jaehyeon+Kim%2C+Sonal+Kumar%2C+Zhifeng+Kong%2C+Sang%2Dgil+Lee%2C+Chao%2DHan+Huck+Yang%2C+Ramani+Duraiswami%2C+Dinesh+Manocha%2C+Rafael+Valle%2C+et+al%2E+Audio+flamingo+3%3A+Advancing+audio+intellig)
28. Tianrui Guan, Fuxiao Liu, Xiyang Wu, Ruiqi Xian, Zongxia Li, Xiaoyu Liu, Xijun Wang, Lichang Chen, Furong Huang, Yaser Yacoob, Dinesh Manocha, and Tianyi Zhou. Hallusionbench: An advanced diagnostic suite for entangled language hallucination and visual illusion in large vision-language models. In IE… [find](https://scholar.google.com/scholar?q=Tianrui+Guan%2C+Fuxiao+Liu%2C+Xiyang+Wu%2C+Ruiqi+Xian%2C+Zongxia+Li%2C+Xiaoyu+Liu%2C+Xijun+Wang%2C+Lichang+Chen%2C+Furong+Huang%2C+Yaser+Yacoob%2C+Dinesh+Manocha%2C+and+Tianyi+Zhou%2E+Hallusionbench%3A+An+advanced+diagnostic+s) [our card](https://md.research.elamur.ai/free/en/papers/guan-2023-hallusionbench-advanced-diagnostic-suite-entangled/)
29. Yun He, Di Jin, Chaoqi Wang, Chloe Bi, Karishma Mandyam, Hejia Zhang, Chen Zhu, Ning Li, Tengyu Xu, Hongjiang Lv, Shruti Bhosale, Chenguang Zhu, Karthik Abinav Sankararaman, Eryk Helenowski, Melanie Kambadur, Aditya Tayade, Hao Ma, Han Fang, and Sinong Wang. Multi-if: Benchmarking llms on multi-turn… — [doi:10.48550/arxiv.2410.15553](https://doi.org/10.48550/arxiv.2410.15553) [find](https://scholar.google.com/scholar?q=Yun+He%2C+Di+Jin%2C+Chaoqi+Wang%2C+Chloe+Bi%2C+Karishma+Mandyam%2C+Hejia+Zhang%2C+Chen+Zhu%2C+Ning+Li%2C+Tengyu+Xu%2C+Hongjiang+Lv%2C+Shruti+Bhosale%2C+Chenguang+Zhu%2C+Karthik+Abinav+Sankararaman%2C+Eryk+Helenowski%2C+Melanie+K)
30. Jack Hong, Shilin Yan, Jiayin Cai, Xiaolong Jiang, Yao Hu, and Weidi Xie. Worldsense: Evaluating real-world omnimodal understanding for multimodal llms. CoRR, abs/2502.04326, 2025. — [arXiv:2502.04326](https://arxiv.org/abs/2502.04326) [find](https://scholar.google.com/scholar?q=Jack+Hong%2C+Shilin+Yan%2C+Jiayin+Cai%2C+Xiaolong+Jiang%2C+Yao+Hu%2C+and+Weidi+Xie%2E+Worldsense%3A+Evaluating+real%2Dworld+omnimodal+understanding+for+multimodal+llms%2E+CoRR%2C+abs%2F2502%2E04326%2C+2025%2E+%E2%80%94+%5BarXiv%3A2502%2E04326)
31. Aniruddha Kembhavi, Mike Salvato, Eric Kolve, Minjoon Seo, Hannaneh Hajishirzi, and Ali Farhadi. A diagram is worth a dozen images. In ECCV, 2016. [find](https://scholar.google.com/scholar?q=Aniruddha+Kembhavi%2C+Mike+Salvato%2C+Eric+Kolve%2C+Minjoon+Seo%2C+Hannaneh+Hajishirzi%2C+and+Ali+Farhadi%2E+A+diagram+is+worth+a+dozen+images%2E+In+ECCV%2C+2016%2E) [our card](https://md.research.elamur.ai/free/en/papers/kembhavi-2016-diagram-worth-dozen-images/)
32. Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, and Ion Stoica. Efficient memory management for large language model serving with pagedattention. In Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles, 2023. [find](https://scholar.google.com/scholar?q=Woosuk+Kwon%2C+Zhuohan+Li%2C+Siyuan+Zhuang%2C+Ying+Sheng%2C+Lianmin+Zheng%2C+Cody+Hao+Yu%2C+Joseph+E%2E+Gonzalez%2C+Hao+Zhang%2C+and+Ion+Stoica%2E+Efficient+memory+management+for+large+language+model+serving+with+pagedat)
33. Edith Law, Kris West, Michael I Mandel, Mert Bay, and J Stephen Downie. Evaluation of algorithms using games: The case of music tagging. In ISMIR, pp. 387–392, 2009. [find](https://scholar.google.com/scholar?q=Edith+Law%2C+Kris+West%2C+Michael+I+Mandel%2C+Mert+Bay%2C+and+J+Stephen+Downie%2E+Evaluation+of+algorithms+using+games%3A+The+case+of+music+tagging%2E+In+ISMIR%2C+pp%2E+387%E2%80%93392%2C+2009%2E)
34. Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. arXiv:2301.12597, 2023. [find](https://scholar.google.com/scholar?q=Junnan+Li%2C+Dongxu+Li%2C+Silvio+Savarese%2C+and+Steven+Hoi%2E+Blip%2D2%3A+Bootstrapping+language%2Dimage+pre%2Dtraining+with+frozen+image+encoders+and+large+language+models%2E+arXiv%3A2301%2E12597%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/li-2023-blip-2-bootstrapping-language-image/)
35. Bill Yuchen Lin, Ronan Le Bras, Kyle Richardson, Ashish Sabharwal, Radha Poovendran, Peter Clark, and Yejin Choi. ZebraLogic: On the scaling limits of LLMs for logical reasoning. CoRR, abs/2502.01100, 2025. [find](https://scholar.google.com/scholar?q=Bill+Yuchen+Lin%2C+Ronan+Le+Bras%2C+Kyle+Richardson%2C+Ashish+Sabharwal%2C+Radha+Poovendran%2C+Peter+Clark%2C+and+Yejin+Choi%2E+ZebraLogic%3A+On+the+scaling+limits+of+LLMs+for+logical+reasoning%2E+CoRR%2C+abs%2F2502%2E01100%2C)
36. Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. Visual instruction tuning. arXiv:2304.08485, 2023. [find](https://scholar.google.com/scholar?q=Haotian+Liu%2C+Chunyuan+Li%2C+Qingyang+Wu%2C+and+Yong+Jae+Lee%2E+Visual+instruction+tuning%2E+arXiv%3A2304%2E08485%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/liu-2023-visual-instruction-tuning/)
37. Pan Lu, Hritik Bansal, Tony Xia, Jiacheng Liu, Chunyuan Li, Hannaneh Hajishirzi, Hao Cheng, Kai-Wei Chang, Michel Galley, and Jianfeng Gao. Mathvista: Evaluating mathematical reasoning of foundation models in visual contexts. In ICLR, 2024. [find](https://scholar.google.com/scholar?q=Pan+Lu%2C+Hritik+Bansal%2C+Tony+Xia%2C+Jiacheng+Liu%2C+Chunyuan+Li%2C+Hannaneh+Hajishirzi%2C+Hao+Cheng%2C+Kai%2DWei+Chang%2C+Michel+Galley%2C+and+Jianfeng+Gao%2E+Mathvista%3A+Evaluating+mathematical+reasoning+of+foundation+m) [our card](https://md.research.elamur.ai/free/en/papers/lu-2023-mathvista-evaluating-mathematical-reasoning-foundation/)
38. Ahmed Masry, Do Xuan Long, Jia Qing Tan, Shafiq Joty, and Enamul Hoque. Chartqa: A benchmark for question answering about charts with visual and logical reasoning. arXiv:2203.10244, 2022. [find](https://scholar.google.com/scholar?q=Ahmed+Masry%2C+Do+Xuan+Long%2C+Jia+Qing+Tan%2C+Shafiq+Joty%2C+and+Enamul+Hoque%2E+Chartqa%3A+A+benchmark+for+question+answering+about+charts+with+visual+and+logical+reasoning%2E+arXiv%3A2203%2E10244%2C+2022%2E) [our card](https://md.research.elamur.ai/free/en/papers/masry-2022-chartqa-benchmark-question-answering-about/)
39. OpenAI. ChatML, 2022. URL [https://github.com/openai/openai-python/blob/e389823ba013a24b4c3](https://github.com/openai/openai-python/blob/e389823ba013a24b4c3) 2ce38fa0bd87e6bccae94/chatml.md. [↗](https://github.com/openai/openai-python/blob/e389823ba013a24b4c3)
40. OpenAI. GPT4 technical report. CoRR, abs/2303.08774, 2023. [find](https://scholar.google.com/scholar?q=OpenAI%2E+GPT4+technical+report%2E+CoRR%2C+abs%2F2303%2E08774%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/)
41. OpenAI. Hello GPT-4o, 2024. URL [https://openai.com/index/hello-gpt-4o/](https://openai.com/index/hello-gpt-4o/). [↗](https://openai.com/index/hello-gpt-4o/)
42. Samuel J. Paech. Creative writing v3, 2024. URL [https://eqbench.com/creative_writing.html](https://eqbench.com/creative_writing.html). [↗](https://eqbench.com/creative_writing.html)
43. Roni Paiss, Ariel Ephrat, Omer Tov, Shiran Zada, Inbar Mosseri, Michal Irani, and Tali Dekel. Teaching CLIP to count to ten. In IEEE/CVF International Conference on Computer Vision, ICCV 2023, Paris, France, October 1-6, 2023, pp. 3147–3157. [find](https://scholar.google.com/scholar?q=Roni+Paiss%2C+Ariel+Ephrat%2C+Omer+Tov%2C+Shiran+Zada%2C+Inbar+Mosseri%2C+Michal+Irani%2C+and+Tali+Dekel%2E+Teaching+CLIP+to+count+to+ten%2E+In+IEEE%2FCVF+International+Conference+on+Computer+Vision%2C+ICCV+2023%2C+Paris%2C+)
44. Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn. Direct preference optimization: Your language model is secretly a reward model. In NeurIPS, 2023. [find](https://scholar.google.com/scholar?q=Rafael+Rafailov%2C+Archit+Sharma%2C+Eric+Mitchell%2C+Christopher+D%2E+Manning%2C+Stefano+Ermon%2C+and+Chelsea+Finn%2E+Direct+preference+optimization%3A+Your+language+model+is+secretly+a+reward+model%2E+In+NeurIPS%2C+2023)
45. David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman. GPQA: A graduate-level Google-proof Q&A benchmark. CoRR, abs/2311.12022, 2023. [find](https://scholar.google.com/scholar?q=David+Rein%2C+Betty+Li+Hou%2C+Asa+Cooper+Stickland%2C+Jackson+Petty%2C+Richard+Yuanzhe+Pang%2C+Julien+Dirani%2C+Julian+Michael%2C+and+Samuel+R%2E+Bowman%2E+GPQA%3A+A+graduate%2Dlevel+Google%2Dproof+Q%26A+benchmark%2E+CoRR%2C+abs%2F2) [our card](https://md.research.elamur.ai/free/en/papers/rein-2023-gpqa-graduate-level-google-proof/)
46. S Sakshi, Utkarsh Tyagi, Sonal Kumar, Ashish Seth, Ramaneswaran Selvakumar, Oriol Nieto, Ramani Duraiswami, Sreyan Ghosh, and Dinesh Manocha. Mmau: A massive multi-task audio understanding and reasoning benchmark, 2024. URL https://arxiv.org/abs/2410.19168. [↗](https://arxiv.org/abs/2410.19168)
47. Jianlin Su, Murtadha H. M. Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, and Yunfeng Liu. Roformer: Enhanced Transformer with rotary position embedding. Neurocomputing, 568:127063, 2024. [find](https://scholar.google.com/scholar?q=Jianlin+Su%2C+Murtadha+H%2E+M%2E+Ahmed%2C+Yu+Lu%2C+Shengfeng+Pan%2C+Wen+Bo%2C+and+Yunfeng+Liu%2E+Roformer%3A+Enhanced+Transformer+with+rotary+position+embedding%2E+Neurocomputing%2C+568%3A127063%2C+2024%2E)
48. Changli Tang, Yixuan Li, Yudong Yang, Jimin Zhuang, Guangzhi Sun, Wei Li, Zejun Ma, and Chao Zhang. video-salmonn 2: Captioning-enhanced audio-visual large language models. CoRR, abs/2506.15220, 2025. — [arXiv:2506.15220](https://arxiv.org/abs/2506.15220) [find](https://scholar.google.com/scholar?q=Changli+Tang%2C+Yixuan+Li%2C+Yudong+Yang%2C+Jimin+Zhuang%2C+Guangzhi+Sun%2C+Wei+Li%2C+Zejun+Ma%2C+and+Chao+Zhang%2E+video%2Dsalmonn+2%3A+Captioning%2Denhanced+audio%2Dvisual+large+language+models%2E+CoRR%2C+abs%2F2506%2E15220%2C+2025%2E)
49. Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv:2307.09288, 2023. [find](https://scholar.google.com/scholar?q=Hugo+Touvron%2C+Louis+Martin%2C+Kevin+Stone%2C+Peter+Albert%2C+Amjad+Almahairi%2C+Yasmine+Babaei%2C+Nikolay+Bashlykov%2C+Soumya+Batra%2C+Prajjwal+Bhargava%2C+Shruti+Bhosale%2C+et+al%2E+Llama+2%3A+Open+foundation+and+fine%2Dtun)
50. Michael Tschannen, Alexey Gritsenko, Xiao Wang, Muhammad Ferjad Naeem, Ibrahim Alabdulmohsin, Nikhil Parthasarathy, Talfan Evans, Lucas Beyer, Ye Xia, Basil Mustafa, Olivier Hénaff, Jeremiah Harmsen, Andreas Steiner, and Xiaohua Zhai. Siglip 2: Multilingual vision-language encoders with improved sem… [find](https://scholar.google.com/scholar?q=Michael+Tschannen%2C+Alexey+Gritsenko%2C+Xiao+Wang%2C+Muhammad+Ferjad+Naeem%2C+Ibrahim+Alabdulmohsin%2C+Nikhil+Parthasarathy%2C+Talfan+Evans%2C+Lucas+Beyer%2C+Ye+Xia%2C+Basil+Mustafa%2C+Olivier+H%C3%A9naff%2C+Jeremiah+Harmsen%2C+)
51. George Tzanetakis and Perry Cook. Musical genre classification of audio signals. IEEE Transactions on speech and audio processing, 10(5):293–302, 2002. [find](https://scholar.google.com/scholar?q=George+Tzanetakis+and+Perry+Cook%2E+Musical+genre+classification+of+audio+signals%2E+IEEE+Transactions+on+speech+and+audio+processing%2C+10%285%29%3A293%E2%80%93302%2C+2002%2E)
52. Dingdong Wang, Jincenzi Wu, Junan Li, Dongchao Yang, Xueyuan Chen, Tianhua Zhang, and Helen Meng. MMSU: A massive multi-task spoken language understanding and reasoning benchmark. CoRR, abs/2506.04779, 2025a. doi: 10.48550/ARXIV.2506.04779. URL https://doi.org/10.48550/arXiv.250 6.04779. — [doi:10.48550/arxiv.2506.04779](https://doi.org/10.48550/arxiv.2506.04779) [↗](https://doi.org/10.48550/arXiv.250)
53. Ke Wang, Junting Pan, Weikang Shi, Zimu Lu, Mingjie Zhan, and Hongsheng Li. Measuring multimodal mathematical reasoning with math-vision dataset. arXiv:2402.14804, 2024a. [find](https://scholar.google.com/scholar?q=Ke+Wang%2C+Junting+Pan%2C+Weikang+Shi%2C+Zimu+Lu%2C+Mingjie+Zhan%2C+and+Hongsheng+Li%2E+Measuring+multimodal+mathematical+reasoning+with+math%2Dvision+dataset%2E+arXiv%3A2402%2E14804%2C+2024a%2E) [our card](https://md.research.elamur.ai/free/en/papers/wang-2024-measuring-multimodal-mathematical-reasoning-math/)
54. Weihan Wang, Zehai He, Wenyi Hong, Yean Cheng, Xiaohan Zhang, Ji Qi, Shiyu Huang, Bin Xu, Yuxiao Dong, Ming Ding, and Jie Tang. Lvbench: An extreme long video understanding benchmark. CoRR, abs/2406.08035, 2024b. [find](https://scholar.google.com/scholar?q=Weihan+Wang%2C+Zehai+He%2C+Wenyi+Hong%2C+Yean+Cheng%2C+Xiaohan+Zhang%2C+Ji+Qi%2C+Shiyu+Huang%2C+Bin+Xu%2C+Yuxiao+Dong%2C+Ming+Ding%2C+and+Jie+Tang%2E+Lvbench%3A+An+extreme+long+video+understanding+benchmark%2E+CoRR%2C+abs%2F2406%2E0)
55. Xinsheng Wang, Mingqi Jiang, Ziyang Ma, Ziyu Zhang, Songxiang Liu, Linqin Li, Zheng Liang, Qixi Zheng, Rui Wang, Xiaoqin Feng, Weizhen Bian, Zhen Ye, Sitong Cheng, Ruibin Yuan, Zhixian Zhao, Xinfa Zhu, Jiahao Pan, Liumeng Xue, Pengcheng Zhu, Yunlin Chen, Zhifei Li, Xie Chen, Lei Xie, Yike Guo, and W… — [arXiv:2503.01710](https://arxiv.org/abs/2503.01710) [find](https://scholar.google.com/scholar?q=Xinsheng+Wang%2C+Mingqi+Jiang%2C+Ziyang+Ma%2C+Ziyu+Zhang%2C+Songxiang+Liu%2C+Linqin+Li%2C+Zheng+Liang%2C+Qixi+Zheng%2C+Rui+Wang%2C+Xiaoqin+Feng%2C+Weizhen+Bian%2C+Zhen+Ye%2C+Sitong+Cheng%2C+Ruibin+Yuan%2C+Zhixian+Zhao%2C+Xinfa+Zhu)
56. Yiming Wang, Pei Zhang, Jialong Tang, Haoran Wei, Baosong Yang, Rui Wang, Chenshu Sun, Feitong Sun, Jiran Zhang, Junxuan Wu, Qiqian Cang, Yichang Zhang, Fei Huang, Junyang Lin, Fei Huang, and Jingren Zhou. Polymath: Evaluating mathematical reasoning in multilingual contexts. CoRR, abs/2504.18428, 20… — [doi:10.48550/arxiv.2504.18428](https://doi.org/10.48550/arxiv.2504.18428) [find](https://scholar.google.com/scholar?q=Yiming+Wang%2C+Pei+Zhang%2C+Jialong+Tang%2C+Haoran+Wei%2C+Baosong+Yang%2C+Rui+Wang%2C+Chenshu+Sun%2C+Feitong+Sun%2C+Jiran+Zhang%2C+Junxuan+Wu%2C+Qiqian+Cang%2C+Yichang+Zhang%2C+Fei+Huang%2C+Junyang+Lin%2C+Fei+Huang%2C+and+Jingren+)
57. Yuancheng Wang, Haoyue Zhan, Liwei Liu, Ruihong Zeng, Haotian Guo, Jiachen Zheng, Qiang Zhang, Xueyao Zhang, Shunsi Zhang, and Zhizheng Wu. Maskgct: Zero-shot text-to-speech with masked generative codec transformer. arXiv preprint arXiv:2409.00750, 2024c. — [arXiv:2409.00750](https://arxiv.org/abs/2409.00750) [find](https://scholar.google.com/scholar?q=Yuancheng+Wang%2C+Haoyue+Zhan%2C+Liwei+Liu%2C+Ruihong+Zeng%2C+Haotian+Guo%2C+Jiachen+Zheng%2C+Qiang+Zhang%2C+Xueyao+Zhang%2C+Shunsi+Zhang%2C+and+Zhizheng+Wu%2E+Maskgct%3A+Zero%2Dshot+text%2Dto%2Dspeech+with+masked+generative+cod)
58. Shangda Wu, Zhancheng Guo, Ruibin Yuan, Junyan Jiang, Seungheon Doh, Gus Xia, Juhan Nam, Xiaobing Li, Feng Yu, and Maosong Sun. Clamp 3: Universal music information retrieval across unaligned modalities and unseen languages. arXiv preprint arXiv:2502.10362, 2025a. [find](https://scholar.google.com/scholar?q=Shangda+Wu%2C+Zhancheng+Guo%2C+Ruibin+Yuan%2C+Junyan+Jiang%2C+Seungheon+Doh%2C+Gus+Xia%2C+Juhan+Nam%2C+Xiaobing+Li%2C+Feng+Yu%2C+and+Maosong+Sun%2E+Clamp+3%3A+Universal+music+information+retrieval+across+unaligned+modaliti)
59. Yuning Wu, Jiahao Mei, Ming Yan, Chenliang Li, Shaopeng Lai, Yuran Ren, Zijia Wang, Ji Zhang, Mengyue Wu, Qin Jin, and Fei Huang. WritingBench: A comprehensive benchmark for generative writing. CoRR, abs/2503.05244, 2025b. — [arXiv:2503.05244](https://arxiv.org/abs/2503.05244) [find](https://scholar.google.com/scholar?q=Yuning+Wu%2C+Jiahao+Mei%2C+Ming+Yan%2C+Chenliang+Li%2C+Shaopeng+Lai%2C+Yuran+Ren%2C+Zijia+Wang%2C+Ji+Zhang%2C+Mengyue+Wu%2C+Qin+Jin%2C+and+Fei+Huang%2E+WritingBench%3A+A+comprehensive+benchmark+for+generative+writing%2E+CoRR%2C+)
60. Jin Xu, Zhifang Guo, Jinzheng He, Hangrui Hu, Ting He, Shuai Bai, Keqin Chen, Jialin Wang, Yang Fan, Kai Dang, et al. Qwen2. 5-omni technical report. arXiv preprint arXiv:2503.20215, 2025. [find](https://scholar.google.com/scholar?q=Jin+Xu%2C+Zhifang+Guo%2C+Jinzheng+He%2C+Hangrui+Hu%2C+Ting+He%2C+Shuai+Bai%2C+Keqin+Chen%2C+Jialin+Wang%2C+Yang+Fan%2C+Kai+Dang%2C+et+al%2E+Qwen2%2E+5%2Domni+technical+report%2E+arXiv+preprint+arXiv%3A2503%2E20215%2C+2025%2E) [our card](https://md.research.elamur.ai/free/en/papers/xu-2025-qwen2-5-omni-technical/)
61. Fanjia Yan, Huanzhi Mao, Charlie Cheng-Jie Ji, Tianjun Zhang, Shishir G. Patil, Ion Stoica, and Joseph E. Gonzalez. Berkeley function calling leaderboard. [https://gorilla.cs.berkeley.edu/blogs/8_berkel](https://gorilla.cs.berkeley.edu/blogs/8_berkel) ey_function_calling_leaderboard.html, 2024. [↗](https://gorilla.cs.berkeley.edu/blogs/8_berkel)
62. An Yang, Baosong Yang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Zhou, Chengpeng Li, Chengyuan Li, Dayiheng Liu, Fei Huang, et al. Qwen2 technical report. arXiv:2407.10671, 2024. [find](https://scholar.google.com/scholar?q=An+Yang%2C+Baosong+Yang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chang+Zhou%2C+Chengpeng+Li%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+et+al%2E+Qwen2+technical+report%2E+arXiv%3A2407%2E10671%2C+2024%2E)
63. An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, et al. Qwen3 technical report. arXiv preprint arXiv:2505.09388, 2025a. [find](https://scholar.google.com/scholar?q=An+Yang%2C+Anfeng+Li%2C+Baosong+Yang%2C+Beichen+Zhang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chang+Gao%2C+Chengen+Huang%2C+Chenxu+Lv%2C+et+al%2E+Qwen3+technical+report%2E+arXiv+preprint+arXiv%3A2505%2E09388%2C+2025a%2E) [our card](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/)
64. Qize Yang, Shimin Yao, Weixuan chen, Shenghao Fu, Detao Bai, Jiaxing Zhao, Boyuan Sun, Bowen Yin, Xihan Wei, and Jingren Zhou. Humanomniv2: From understanding to omni-modal reasoning with context. CoRR, abs/2506.21277, 2025b. — [arXiv:2506.21277](https://arxiv.org/abs/2506.21277) [find](https://scholar.google.com/scholar?q=Qize+Yang%2C+Shimin+Yao%2C+Weixuan+chen%2C+Shenghao+Fu%2C+Detao+Bai%2C+Jiaxing+Zhao%2C+Boyuan+Sun%2C+Bowen+Yin%2C+Xihan+Wei%2C+and+Jingren+Zhou%2E+Humanomniv2%3A+From+understanding+to+omni%2Dmodal+reasoning+with+context%2E+CoR)
65. Ruibin Yuan, Yinghao Ma, Yizhi Li, Ge Zhang, Xingran Chen, Hanzhi Yin, Yiqi Liu, Jiawen Huang, Zeyue Tian, Binyue Deng, et al. Marble: Music audio representation benchmark for universal evaluation. Advances in Neural Information Processing Systems, 36:39626–39647, 2023. [find](https://scholar.google.com/scholar?q=Ruibin+Yuan%2C+Yinghao+Ma%2C+Yizhi+Li%2C+Ge+Zhang%2C+Xingran+Chen%2C+Hanzhi+Yin%2C+Yiqi+Liu%2C+Jiawen+Huang%2C+Zeyue+Tian%2C+Binyue+Deng%2C+et+al%2E+Marble%3A+Music+audio+representation+benchmark+for+universal+evaluation%2E+Ad)
66. Xiang Yue, Yuansheng Ni, Kai Zhang, Tianyu Zheng, Ruoqi Liu, Ge Zhang, Samuel Stevens, Dongfu Jiang, Weiming Ren, Yuxuan Sun, et al. Mmmu: A massive multi-discipline multimodal understanding and reasoning benchmark for expert agi. arXiv:2311.16502, 2023. [find](https://scholar.google.com/scholar?q=Xiang+Yue%2C+Yuansheng+Ni%2C+Kai+Zhang%2C+Tianyu+Zheng%2C+Ruoqi+Liu%2C+Ge+Zhang%2C+Samuel+Stevens%2C+Dongfu+Jiang%2C+Weiming+Ren%2C+Yuxuan+Sun%2C+et+al%2E+Mmmu%3A+A+massive+multi%2Ddiscipline+multimodal+understanding+and+reaso) [our card](https://md.research.elamur.ai/free/en/papers/yue-2023-mmmu-massive-multi-discipline-multimodal/)
67. Xiang Yue, Tianyu Zheng, Yuansheng Ni, Yubo Wang, Kai Zhang, Shengbang Tong, Yuxuan Sun, Ming Yin, Botao Yu, Ge Zhang, et al. Mmmu-pro: A more robust multi-discipline multimodal understanding benchmark. arXiv preprint arXiv:2409.02813, 2024. [find](https://scholar.google.com/scholar?q=Xiang+Yue%2C+Tianyu+Zheng%2C+Yuansheng+Ni%2C+Yubo+Wang%2C+Kai+Zhang%2C+Shengbang+Tong%2C+Yuxuan+Sun%2C+Ming+Yin%2C+Botao+Yu%2C+Ge+Zhang%2C+et+al%2E+Mmmu%2Dpro%3A+A+more+robust+multi%2Ddiscipline+multimodal+understanding+benchmar)
68. Yongyi Zang, Sean O’Brien, Taylor Berg-Kirkpatrick, Julian McAuley, and Zachary Novack. Are you really listening? boosting perceptual awareness in music-qa benchmarks. arXiv preprint arXiv:2504.00369, 2025. — [arXiv:2504.00369](https://arxiv.org/abs/2504.00369) [find](https://scholar.google.com/scholar?q=Yongyi+Zang%2C+Sean+O%E2%80%99Brien%2C+Taylor+Berg%2DKirkpatrick%2C+Julian+McAuley%2C+and+Zachary+Novack%2E+Are+you+really+listening%3F+boosting+perceptual+awareness+in+music%2Dqa+benchmarks%2E+arXiv+preprint+arXiv%3A2504%2E00369%2C)
69. Bowen Zhang, Congchao Guo, Geng Yang, Hang Yu, Haozhe Zhang, Heidi Lei, Jialong Mai, Junjie Yan, Kaiyue Yang, Mingqi Yang, Peikai Huang, Ruiyang Jin, Sitan Jiang, Weihua Cheng, Yawei Li, Yichen Xiao, Yiying Zhou, Yongmao Zhang, Yuan Lu, and Yucen He. Minimax-speech: Intrinsic zero-shot text-to-speec… — [arXiv:2505.07916](https://arxiv.org/abs/2505.07916) [find](https://scholar.google.com/scholar?q=Bowen+Zhang%2C+Congchao+Guo%2C+Geng+Yang%2C+Hang+Yu%2C+Haozhe+Zhang%2C+Heidi+Lei%2C+Jialong+Mai%2C+Junjie+Yan%2C+Kaiyue+Yang%2C+Mingqi+Yang%2C+Peikai+Huang%2C+Ruiyang+Jin%2C+Sitan+Jiang%2C+Weihua+Cheng%2C+Yawei+Li%2C+Yichen+Xiao%2C+)
70. Chujie Zheng, Shixuan Liu, Mingze Li, Xiong-Hui Chen, Bowen Yu, Chang Gao, Kai Dang, Yuqiong Liu, Rui Men, An Yang, et al. Group sequence policy optimization. arXiv preprint arXiv:2507.18071, 2025. [find](https://scholar.google.com/scholar?q=Chujie+Zheng%2C+Shixuan+Liu%2C+Mingze+Li%2C+Xiong%2DHui+Chen%2C+Bowen+Yu%2C+Chang+Gao%2C+Kai+Dang%2C+Yuqiong+Liu%2C+Rui+Men%2C+An+Yang%2C+et+al%2E+Group+sequence+policy+optimization%2E+arXiv+preprint+arXiv%3A2507%2E18071%2C+2025%2E) [our card](https://md.research.elamur.ai/free/en/papers/zheng-2025-group-sequence-policy-optimization/)
71. Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, and Le Hou. Instruction-following evaluation for large language models. CoRR, abs/2311.07911, 2023. [find](https://scholar.google.com/scholar?q=Jeffrey+Zhou%2C+Tianjian+Lu%2C+Swaroop+Mishra%2C+Siddhartha+Brahma%2C+Sujoy+Basu%2C+Yi+Luan%2C+Denny+Zhou%2C+and+Le+Hou%2E+Instruction%2Dfollowing+evaluation+for+large+language+models%2E+CoRR%2C+abs%2F2311%2E07911%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/zhou-2023-instruction-following-evaluation-large-language/)
72. Junjie Zhou, Yan Shu, Bo Zhao, Boya Wu, Zhengyang Liang, Shitao Xiao, Minghao Qin, Xi Yang, Yongping Xiong, Bo Zhang, Tiejun Huang, and Zheng Liu. MLVU: benchmarking multi-task long video understanding. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2025, Nashville, TN, USA,… [find](https://scholar.google.com/scholar?q=Junjie+Zhou%2C+Yan+Shu%2C+Bo+Zhao%2C+Boya+Wu%2C+Zhengyang+Liang%2C+Shitao+Xiao%2C+Minghao+Qin%2C+Xi+Yang%2C+Yongping+Xiong%2C+Bo+Zhang%2C+Tiejun+Huang%2C+and+Zheng+Liu%2E+MLVU%3A+benchmarking+multi%2Dtask+long+video+understandin)
73. Ziwei Zhou, Rui Wang, and Zuxuan Wu. Daily-omni: Towards audio-visual reasoning with temporal alignment across modalities. CoRR, abs/2505.17862, 2025b. — [arXiv:2505.17862](https://arxiv.org/abs/2505.17862) [find](https://scholar.google.com/scholar?q=Ziwei+Zhou%2C+Rui+Wang%2C+and+Zuxuan+Wu%2E+Daily%2Domni%3A+Towards+audio%2Dvisual+reasoning+with+temporal+alignment+across+modalities%2E+CoRR%2C+abs%2F2505%2E17862%2C+2025b%2E+%E2%80%94+%5BarXiv%3A2505%2E17862%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2505%2E)
74. Deyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li, and Mohamed Elhoseiny. Minigpt-4: Enhancing vision-language understanding with advanced large language models. arXiv:2304.10592, 2023. [find](https://scholar.google.com/scholar?q=Deyao+Zhu%2C+Jun+Chen%2C+Xiaoqian+Shen%2C+Xiang+Li%2C+and+Mohamed+Elhoseiny%2E+Minigpt%2D4%3A+Enhancing+vision%2Dlanguage+understanding+with+advanced+large+language+models%2E+arXiv%3A2304%2E10592%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/zhu-2023-minigpt-4-enhancing-vision-language/)
75. Haina Zhu, Yizhi Zhou, Hangting Chen, Jianwei Yu, Ziyang Ma, Rongzhi Gu, Yi Luo, Wei Tan, and Xie Chen. Muq: Self-supervised music representation learning with mel residual vector quantization. arXiv preprint arXiv:2501.01108, 2025. — [arXiv:2501.01108](https://arxiv.org/abs/2501.01108) [find](https://scholar.google.com/scholar?q=Haina+Zhu%2C+Yizhi+Zhou%2C+Hangting+Chen%2C+Jianwei+Yu%2C+Ziyang+Ma%2C+Rongzhi+Gu%2C+Yi+Luo%2C+Wei+Tan%2C+and+Xie+Chen%2E+Muq%3A+Self%2Dsupervised+music+representation+learning+with+mel+residual+vector+quantization%2E+arXiv+)