---
title: "DeepResearcher — Zheng 2025"
description: "LLM agents that search the web are promising for deep research."
authors: ["Yuxiang Zheng", "Dayuan Fu", "Xiangkun Hu", "Xiaojie Cai", "Lyumanshan Ye", "Pengrui Lu", "Pengfei Liu"]
year: 2025
venue: "Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/2025.emnlp-main.22/"
doi: "10.18653/v1/2025.emnlp-main.22"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zheng-2025-deepresearcher-scaling-deep-research-reinforcement/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zheng-2025-deepresearcher-scaling-deep-research-reinforcement/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/) / DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environments

# DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environments

**Authors:** Yuxiang Zheng, Dayuan Fu, [Xiangkun Hu](https://md.research.elamur.ai/free/en/authors/xiangkun-hu/), Xiaojie Cai, Lyumanshan Ye, Pengrui Lu, [Pengfei Liu](https://md.research.elamur.ai/free/en/authors/pengfei-liu/) · **Year:** 2025 · **Venue:** Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2025.emnlp-main.22/) · [PDF](https://aclanthology.org/2025.emnlp-main.22.pdf) · [DOI 10.18653/v1/2025.emnlp-main.22](https://doi.org/10.18653/v1/2025.emnlp-main.22) · [OpenAlex](https://openalex.org/W4416037139)

**Citations:** 21 citations (openalex-snapshot · 2026-10-14) · [87](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
LLM agents that search the web are promising for deep research. Existing open methods either depend on fragile hand-written prompts or train with RL against fixed local corpora, which do not reflect the messy, changing open web. DeepResearcher is a framework for training such agents end-to-end with reinforcement learning while they query live search engines. The agent alternates between explicit reasoning, issuing search queries, browsing pages, and answering. Training uses only an outcome reward: F1 on short factual answers, plus a format penalty. A separate browsing agent reads pages segment by segment and keeps only question-relevant notes. The authors also solved practical problems, including API rate limits, network latency, anti-crawling defences, and varied page layouts.

On open-domain QA, the Qwen2.5-7B-Instruct-based agent beat prompt-engineered baselines by up to 28.9 points and RAG-trained RL agents by up to 7.2 points. Training also produced planning, verification, and self-correction behaviours without being taught them. This suggests that training in the real web environment matters for building research agents that work in practice.

## Key points
- **Baselines and gains:** DeepResearcher is compared with prompt-based agents and with RAG-based RL systems (Search-R1, R1-Searcher, ReSearch). It improves on them by up to 28.9 and 7.2 points respectively.
- **Agent loop:**
  - Reasoning is wrapped in `<think>` tags, following DeepSeek-R1.
  - Searches use a JSON `web_search` call that returns the top-10 results as title, URL, and snippet.
  - A `web_browse` tool is handled by a browsing agent with short-term memory, which decides when to stop reading.
  - Final responses go inside `<answer>` tags.
- **Training dynamics:** During RL, F1 rises across 1- to 4-hop questions, and the number of tool calls and response length increase.
- **Emergent behaviours:** The trained agent plans multi-hop steps, cross-checks answers it has already found, and reformulates queries when results do not fit. It also declines to answer when no reliable answer is found, which current QA metrics do not reward.
- **Limitations and code:** Experiments use only a 7B model, and the F1-based reward is unsuited to long-form, open-ended research. The code is available at github.com/GAIR-NLP/DeepResearcher.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

87 papers of our library cite it (of the 140884 whose bibliographies we read); 1 of them have a page here, 86 not yet.

- [Large Language Models for Information Retrieval: A Survey](https://md.research.elamur.ai/free/en/papers/zhu-2023-large-language-models-information-retrieval/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zheng2025deepresearcher,
  title = {{DeepResearcher: Scaling Deep Research via Reinforcement Learning in Real-world Environments}},
  author = {Zheng, Yuxiang and Fu, Dayuan and Hu, Xiangkun and Cai, Xiaojie and Ye, Lyumanshan and Lu, Pengrui and Liu, Pengfei},
  booktitle = {Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing},
  year = {2025},
  doi = {10.18653/v1/2025.emnlp-main.22},
  url = {https://doi.org/10.18653/v1/2025.emnlp-main.22}
}
```

- [← previous Decomposability and the syntactic flexibility of Hebrew idioms](https://md.research.elamur.ai/free/en/papers/lingbulk-2025-dolev-decomposability-syntactic-flexibility-hebrew-idioms/)
- [next → DeepSeek-Prover-V2: Advancing Formal Mathematical Reasoning via Reinforcement Learning for Subgoal Decomposition](https://md.research.elamur.ai/free/en/papers/ren-2025-deepseek-prover-v2-advancing-formal/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/)

## References

38 references, 14 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Salaheddin Alzubi, Creston Brooks, Purva Chiniya, Edoardo Contente, Chiara von Gerlach, Lucas Irwin, Yihan Jiang, Arda Kaz, Windsor Nguyen, Sewoong Oh, and 1 others. 2025. Open deep search: Democratizing search with open-source reasoning agents. arXiv preprint arXiv:2503.20201. — [arXiv:2503.20201](https://arxiv.org/abs/2503.20201) [find](https://scholar.google.com/scholar?q=Salaheddin+Alzubi%2C+Creston+Brooks%2C+Purva+Chiniya%2C+Edoardo+Contente%2C+Chiara+von+Gerlach%2C+Lucas+Irwin%2C+Yihan+Jiang%2C+Arda+Kaz%2C+Windsor+Nguyen%2C+Sewoong+Oh%2C+and+1+others%2E+2025%2E+Open+deep+search%3A+Democratiz)
2. CAMEL-AI.org. 2025. Owl: Optimized workforce learning for general multi-agent assistance in real-world task automation. [https://github.com/](https://github.com/) camel-ai/owl. Accessed: 2025-03-07. [↗](https://github.com/)
3. Mingyang Chen, Tianpeng Li, Haoze Sun, Yijie Zhou, Chenzheng Zhu, Haofen Wang, Jeff Z. Pan, Wen Zhang, Huajun Chen, Fan Yang, Zenan Zhou, and Weipeng Chen. 2025. Research: Learning to reason with search for llms via reinforcement learning. Preprint, arXiv:2503.19470. [find](https://scholar.google.com/scholar?q=Mingyang+Chen%2C+Tianpeng+Li%2C+Haoze+Sun%2C+Yijie+Zhou%2C+Chenzheng+Zhu%2C+Haofen+Wang%2C+Jeff+Z%2E+Pan%2C+Wen+Zhang%2C+Huajun+Chen%2C+Fan+Yang%2C+Zenan+Zhou%2C+and+Weipeng+Chen%2E+2025%2E+Research%3A+Learning+to+reason+with+sear)
4. Wenfeng Feng, Chuzhan Hao, Yuewei Zhang, Jingyi Song, and Hao Wang. 2025. Airrag: Activating intrinsic reasoning for retrieval augmented generation via tree-based search. arXiv preprint arXiv:2501.10053. — [arXiv:2501.10053](https://arxiv.org/abs/2501.10053) [find](https://scholar.google.com/scholar?q=Wenfeng+Feng%2C+Chuzhan+Hao%2C+Yuewei+Zhang%2C+Jingyi+Song%2C+and+Hao+Wang%2E+2025%2E+Airrag%3A+Activating+intrinsic+reasoning+for+retrieval+augmented+generation+via+tree%2Dbased+search%2E+arXiv+preprint+arXiv%3A2501%2E100)
5. Dayuan Fu, Keqing He, Yejie Wang, Wentao Hong, Zhuoma Gongque, Weihao Zeng, Wei Wang, Jingang Wang, Xunliang Cai, and Weiran Xu. 2025. Agentrefine: Enhancing agent generalization through refinement tuning. arXiv preprint arXiv:2501.01702. — [arXiv:2501.01702](https://arxiv.org/abs/2501.01702) [find](https://scholar.google.com/scholar?q=Dayuan+Fu%2C+Keqing+He%2C+Yejie+Wang%2C+Wentao+Hong%2C+Zhuoma+Gongque%2C+Weihao+Zeng%2C+Wei+Wang%2C+Jingang+Wang%2C+Xunliang+Cai%2C+and+Weiran+Xu%2E+2025%2E+Agentrefine%3A+Enhancing+agent+generalization+through+refinement+tu)
6. Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, Haofen Wang, and Haofen Wang. 2023. Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997, 2. [find](https://scholar.google.com/scholar?q=Yunfan+Gao%2C+Yun+Xiong%2C+Xinyu+Gao%2C+Kangxiang+Jia%2C+Jinliu+Pan%2C+Yuxi+Bi%2C+Yi+Dai%2C+Jiawei+Sun%2C+Haofen+Wang%2C+and+Haofen+Wang%2E+2023%2E+Retrieval%2Daugmented+generation+for+large+language+models%3A+A+survey%2E+arXiv+) [our card](https://md.research.elamur.ai/free/en/papers/gao-2023-retrieval-augmented-generation-large-language/)
7. Google. 2024. Gemini deep research. [find](https://scholar.google.com/scholar?q=Google%2E+2024%2E+Gemini+deep+research%2E)
8. Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, and 1 others. 2025. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948. [find](https://scholar.google.com/scholar?q=Daya+Guo%2C+Dejian+Yang%2C+Haowei+Zhang%2C+Junxiao+Song%2C+Ruoyu+Zhang%2C+Runxin+Xu%2C+Qihao+Zhu%2C+Shirong+Ma%2C+Peiyi+Wang%2C+Xiao+Bi%2C+and+1+others%2E+2025%2E+Deepseek%2Dr1%3A+Incentivizing+reasoning+capability+in+llms+via+r) [our card](https://md.research.elamur.ai/free/en/papers/deepseek-2025-ai-deepseek-r1-incentivizing-reasoning-capability/)
9. Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, and Akiko Aizawa. 2020. Constructing a multi-hop QA dataset for comprehensive evaluation of reasoning steps. In Proceedings of the 28th International Conference on Computational Linguistics, pages 6609–6625, Barcelona, Spain (Online). International Comm… [find](https://scholar.google.com/scholar?q=Xanh+Ho%2C+Anh%2DKhoa+Duong+Nguyen%2C+Saku+Sugawara%2C+and+Akiko+Aizawa%2E+2020%2E+Constructing+a+multi%2Dhop+QA+dataset+for+comprehensive+evaluation+of+reasoning+steps%2E+In+Proceedings+of+the+28th+International+Con) [our card](https://md.research.elamur.ai/free/en/papers/ho-2020-constructing-multi-hop-qa-dataset/)
10. Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, Chenyu Ran, Lingfeng Xiao, Chenglin Wu, and Jürgen Schmidhuber. 2024. MetaGPT: Meta programming for a multi-agent collaborative framework. In The T… [find](https://scholar.google.com/scholar?q=Sirui+Hong%2C+Mingchen+Zhuge%2C+Jonathan+Chen%2C+Xiawu+Zheng%2C+Yuheng+Cheng%2C+Jinlin+Wang%2C+Ceyao+Zhang%2C+Zili+Wang%2C+Steven+Ka+Shing+Yau%2C+Zijuan+Lin%2C+Liyang+Zhou%2C+Chenyu+Ran%2C+Lingfeng+Xiao%2C+Chenglin+Wu%2C+and+J%C3%BCr) [our card](https://md.research.elamur.ai/free/en/papers/hong-2023-metagpt-meta-programming-multi/)
11. Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, and 1 others. 2024. Gpt-4o system card. arXiv preprint arXiv:2410.21276. [find](https://scholar.google.com/scholar?q=Aaron+Hurst%2C+Adam+Lerer%2C+Adam+P+Goucher%2C+Adam+Perelman%2C+Aditya+Ramesh%2C+Aidan+Clark%2C+AJ+Ostrow%2C+Akila+Welihinda%2C+Alan+Hayes%2C+Alec+Radford%2C+and+1+others%2E+2024%2E+Gpt%2D4o+system+card%2E+arXiv+preprint+arXiv%3A2) [our card](https://md.research.elamur.ai/free/en/papers/openai-2024-gpt-4o-system-card/)
12. Bowen Jin, Hansi Zeng, Zhenrui Yue, Dong Wang, Hamed Zamani, and Jiawei Han. 2025. Searchr1: Training llms to reason and leverage search engines with reinforcement learning. arXiv preprint arXiv:2503.09516. [find](https://scholar.google.com/scholar?q=Bowen+Jin%2C+Hansi+Zeng%2C+Zhenrui+Yue%2C+Dong+Wang%2C+Hamed+Zamani%2C+and+Jiawei+Han%2E+2025%2E+Searchr1%3A+Training+llms+to+reason+and+leverage+search+engines+with+reinforcement+learning%2E+arXiv+preprint+arXiv%3A2503%2E) [our card](https://md.research.elamur.ai/free/en/papers/jin-2025-search-r1-training-llms-reason/)
13. Mandar Joshi, Eunsol Choi, Daniel Weld, and Luke Zettlemoyer. 2017. TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1601–1611, Vancouver… [find](https://scholar.google.com/scholar?q=Mandar+Joshi%2C+Eunsol+Choi%2C+Daniel+Weld%2C+and+Luke+Zettlemoyer%2E+2017%2E+TriviaQA%3A+A+large+scale+distantly+supervised+challenge+dataset+for+reading+comprehension%2E+In+Proceedings+of+the+55th+Annual+Meeting+) [our card](https://md.research.elamur.ai/free/en/papers/joshi-2017-triviaqa-large-scale-distantly-supervised/)
14. Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019. Natural… [find](https://scholar.google.com/scholar?q=Tom+Kwiatkowski%2C+Jennimaria+Palomaki%2C+Olivia+Redfield%2C+Michael+Collins%2C+Ankur+Parikh%2C+Chris+Alberti%2C+Danielle+Epstein%2C+Illia+Polosukhin%2C+Jacob+Devlin%2C+Kenton+Lee%2C+Kristina+Toutanova%2C+Llion+Jones%2C+Matt) [our card](https://md.research.elamur.ai/free/en/papers/kwiatkowski-2019-natural-questions-benchmark-question-answering/)
15. Xiaoxi Li, Guanting Dong, Jiajie Jin, Yuyao Zhang, Yujia Zhou, Yutao Zhu, Peitian Zhang, and Zhicheng Dou. 2025a. Search-o1: Agentic search-enhanced large reasoning models. arXiv preprint arXiv:2501.05366. [find](https://scholar.google.com/scholar?q=Xiaoxi+Li%2C+Guanting+Dong%2C+Jiajie+Jin%2C+Yuyao+Zhang%2C+Yujia+Zhou%2C+Yutao+Zhu%2C+Peitian+Zhang%2C+and+Zhicheng+Dou%2E+2025a%2E+Search%2Do1%3A+Agentic+search%2Denhanced+large+reasoning+models%2E+arXiv+preprint+arXiv%3A2501%2E0) [our card](https://md.research.elamur.ai/free/en/papers/li-2025-search-o1-agentic-search-enhanced/)
16. Xuefeng Li, Haoyang Zou, and Pengfei Liu. 2025b. Limr: Less is more for rl scaling. Preprint, arXiv:2502.11886. [find](https://scholar.google.com/scholar?q=Xuefeng+Li%2C+Haoyang+Zou%2C+and+Pengfei+Liu%2E+2025b%2E+Limr%3A+Less+is+more+for+rl+scaling%2E+Preprint%2C+arXiv%3A2502%2E11886%2E)
17. Xuefeng Li, Haoyang Zou, and Pengfei Liu. 2025c. Torl: Scaling tool-integrated rl. Preprint, arXiv:2503.23383. [find](https://scholar.google.com/scholar?q=Xuefeng+Li%2C+Haoyang+Zou%2C+and+Pengfei+Liu%2E+2025c%2E+Torl%3A+Scaling+tool%2Dintegrated+rl%2E+Preprint%2C+arXiv%3A2503%2E23383%2E)
18. Xinbin Liang, Jinyu Xiang, Zhaoyang Yu, Jiayi Zhang, and Sirui Hong. 2025. Openmanus: An open-source framework for building general ai agents. [https://github.com/mannaandpoem/OpenManus](https://github.com/mannaandpoem/OpenManus). [↗](https://github.com/mannaandpoem/OpenManus)
19. Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Hannaneh Hajishirzi, and Daniel Khashabi. 2022. When not to trust language models: Investigating effectiveness and limitations of parametric and non-parametric memories. arXiv preprint. [find](https://scholar.google.com/scholar?q=Alex+Mallen%2C+Akari+Asai%2C+Victor+Zhong%2C+Rajarshi+Das%2C+Hannaneh+Hajishirzi%2C+and+Daniel+Khashabi%2E+2022%2E+When+not+to+trust+language+models%3A+Investigating+effectiveness+and+limitations+of+parametric+and+no)
20. OpenAI. 2024. Learning to reason with llms, september 2024. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2024%2E+Learning+to+reason+with+llms%2C+september+2024%2E)
21. OpenAI. 2025. Deep research system card. Technical report, OpenAI. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2025%2E+Deep+research+system+card%2E+Technical+report%2C+OpenAI%2E)
22. Ofir Press, Muru Zhang, Sewon Min, Ludwig Schmidt, Noah A Smith, and Mike Lewis. 2022. Measuring and narrowing the compositionality gap in language models. arXiv preprint arXiv:2210.03350. [find](https://scholar.google.com/scholar?q=Ofir+Press%2C+Muru+Zhang%2C+Sewon+Min%2C+Ludwig+Schmidt%2C+Noah+A+Smith%2C+and+Mike+Lewis%2E+2022%2E+Measuring+and+narrowing+the+compositionality+gap+in+language+models%2E+arXiv+preprint+arXiv%3A2210%2E03350%2E)
23. Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, and 1 others. 2023. Toolllm: Facilitating large language models to master 16000+ real-world apis. arXiv preprint arXiv:2307.16789. [find](https://scholar.google.com/scholar?q=Yujia+Qin%2C+Shihao+Liang%2C+Yining+Ye%2C+Kunlun+Zhu%2C+Lan+Yan%2C+Yaxi+Lu%2C+Yankai+Lin%2C+Xin+Cong%2C+Xiangru+Tang%2C+Bill+Qian%2C+and+1+others%2E+2023%2E+Toolllm%3A+Facilitating+large+language+models+to+master+16000%2B+real%2Dw) [our card](https://md.research.elamur.ai/free/en/papers/qin-2023-toolllm-facilitating-large-language-models/)
24. Qwen, :, An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, and 25 others. 2025. Qwen2.5 technical report. Preprint, arXiv:2412.15115. [find](https://scholar.google.com/scholar?q=Qwen%2C+%3A%2C+An+Yang%2C+Baosong+Yang%2C+Beichen+Zhang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Haoran+Wei%2C+Huan+Lin%2C+Jian+Yang%2C+Jianhong+Tu%2C+Jianwei+Zhang%2C+Jianxin+Yang%2C+Jiaxi+)
25. Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Eric Hambro, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom. 2023. Toolformer: Language models can teach themselves to use tools. Advances in Neural Information Processing Systems, 36:68539–68551. [find](https://scholar.google.com/scholar?q=Timo+Schick%2C+Jane+Dwivedi%2DYu%2C+Roberto+Dess%C3%AC%2C+Roberta+Raileanu%2C+Maria+Lomeli%2C+Eric+Hambro%2C+Luke+Zettlemoyer%2C+Nicola+Cancedda%2C+and+Thomas+Scialom%2E+2023%2E+Toolformer%3A+Language+models+can+teach+themselves+) [our card](https://md.research.elamur.ai/free/en/papers/schick-2023-toolformer-language-models-can-teach/)
26. Huatong Song, Jinhao Jiang, Yingqian Min, Jie Chen, Zhipeng Chen, Wayne Xin Zhao, Lei Fang, and Ji-Rong Wen. 2025. R1-searcher: Incentivizing the search capability in llms via reinforcement learning. arXiv preprint arXiv:2503.05592. [find](https://scholar.google.com/scholar?q=Huatong+Song%2C+Jinhao+Jiang%2C+Yingqian+Min%2C+Jie+Chen%2C+Zhipeng+Chen%2C+Wayne+Xin+Zhao%2C+Lei+Fang%2C+and+Ji%2DRong+Wen%2E+2025%2E+R1%2Dsearcher%3A+Incentivizing+the+search+capability+in+llms+via+reinforcement+learning%2E+) [our card](https://md.research.elamur.ai/free/en/papers/song-2025-r1-searcher-incentivizing-search/)
27. Kimi Team, Angang Du, Bofei Gao, Bowei Xing, Changjiu Jiang, Cheng Chen, Cheng Li, Chenjun Xiao, Chenzhuang Du, Chonghua Liao, and 1 others. 2025. Kimi k1.5: Scaling reinforcement learning with llms. arXiv preprint arXiv:2501.12599. [find](https://scholar.google.com/scholar?q=Kimi+Team%2C+Angang+Du%2C+Bofei+Gao%2C+Bowei+Xing%2C+Changjiu+Jiang%2C+Cheng+Chen%2C+Cheng+Li%2C+Chenjun+Xiao%2C+Chenzhuang+Du%2C+Chonghua+Liao%2C+and+1+others%2E+2025%2E+Kimi+k1%2E5%3A+Scaling+reinforcement+learning+with+llms%2E+) [our card](https://md.research.elamur.ai/free/en/papers/kimi-2025-team-kimi-k1-5-scaling-reinforcement/)
28. Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal. 2022. MuSiQue: Multi-hop questions via single-hop question composition. Transactions of the Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Harsh+Trivedi%2C+Niranjan+Balasubramanian%2C+Tushar+Khot%2C+and+Ashish+Sabharwal%2E+2022%2E+MuSiQue%3A+Multi%2Dhop+questions+via+single%2Dhop+question+composition%2E+Transactions+of+the+Association+for+Computational+Li)
29. Prakhar Verma, Sukruta Prakash Midigeshi, Gaurav Sinha, Arno Solin, Nagarajan Natarajan, and Amit Sharma. 2025. Plan*rag: Efficient test-time planning for retrieval augmented generation. Preprint, arXiv:2410.20753. — [arXiv:2410.20753](https://arxiv.org/abs/2410.20753) [find](https://scholar.google.com/scholar?q=Prakhar+Verma%2C+Sukruta+Prakash+Midigeshi%2C+Gaurav+Sinha%2C+Arno+Solin%2C+Nagarajan+Natarajan%2C+and+Amit+Sharma%2E+2025%2E+Plan%2Arag%3A+Efficient+test%2Dtime+planning+for+retrieval+augmented+generation%2E+Preprint%2C+arX)
30. Zhenrui Yue, Honglei Zhuang, Aijun Bai, Kai Hui, Rolf Jagerman, Hansi Zeng, Zhen Qin, Dong Wang, Xuanhui Wang, and Michael Bendersky. 2024b. Inference scaling for long-context retrieval augmented generation. arXiv preprint arXiv:2410.04343. — [arXiv:2410.04343](https://arxiv.org/abs/2410.04343) [find](https://scholar.google.com/scholar?q=Zhenrui+Yue%2C+Honglei+Zhuang%2C+Aijun+Bai%2C+Kai+Hui%2C+Rolf+Jagerman%2C+Hansi+Zeng%2C+Zhen+Qin%2C+Dong+Wang%2C+Xuanhui+Wang%2C+and+Michael+Bendersky%2E+2024b%2E+Inference+scaling+for+long%2Dcontext+retrieval+augmented+gene)
31. Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric P. Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023. Judging llm-as-a-judge with mt-bench and chatbot arena. In Advances in Neural Information Processing Systems 36: A… [find](https://scholar.google.com/scholar?q=Lianmin+Zheng%2C+Wei%2DLin+Chiang%2C+Ying+Sheng%2C+Siyuan+Zhuang%2C+Zhanghao+Wu%2C+Yonghao+Zhuang%2C+Zi+Lin%2C+Zhuohan+Li%2C+Dacheng+Li%2C+Eric+P%2E+Xing%2C+Hao+Zhang%2C+Joseph+E%2E+Gonzalez%2C+and+Ion+Stoica%2E+2023%2E+Judging+llm%2Das)
32. Yuxiang Zheng, Shichao Sun, Lin Qiu, Dongyu Ru, Cheng Jiayang, Xuefeng Li, Jifan Lin, Binjie Wang, Yun Luo, Renjie Pan, Yang Xu, Qingkai Min, Zizhao Zhang, Yiwen Wang, Wenjie Li, and Pengfei Liu. 2024. OpenResearcher: Unleashing AI for accelerated scientific research. In Proceedings of the 2024 Conf… [find](https://scholar.google.com/scholar?q=Yuxiang+Zheng%2C+Shichao+Sun%2C+Lin+Qiu%2C+Dongyu+Ru%2C+Cheng+Jiayang%2C+Xuefeng+Li%2C+Jifan+Lin%2C+Binjie+Wang%2C+Yun+Luo%2C+Renjie+Pan%2C+Yang+Xu%2C+Qingkai+Min%2C+Zizhao+Zhang%2C+Yiwen+Wang%2C+Wenjie+Li%2C+and+Pengfei+Liu%2E+2024)
33. Xiaohua Wang, Zhenghua Wang, Xuan Gao, Feiran Zhang, Yixin Wu, Zhibo Xu, Tianyuan Shi, Zhengyuan Wang, Shizheng Li, Qi Qian, and 1 others. 2024a. Searching for best practices in retrieval-augmented generation. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing,… [find](https://scholar.google.com/scholar?q=Xiaohua+Wang%2C+Zhenghua+Wang%2C+Xuan+Gao%2C+Feiran+Zhang%2C+Yixin+Wu%2C+Zhibo+Xu%2C+Tianyuan+Shi%2C+Zhengyuan+Wang%2C+Shizheng+Li%2C+Qi+Qian%2C+and+1+others%2E+2024a%2E+Searching+for+best+practices+in+retrieval%2Daugmented+ge)
34. Ziting Wang, Haitao Yuan, Wei Dong, Gao Cong, and Feifei Li. 2024b. Corag: A cost-constrained retrieval optimization system for retrieval-augmented generation. arXiv preprint arXiv:2411.00744. xAI. 2025. Grok 3. — [arXiv:2411.00744](https://arxiv.org/abs/2411.00744) [find](https://scholar.google.com/scholar?q=Ziting+Wang%2C+Haitao+Yuan%2C+Wei+Dong%2C+Gao+Cong%2C+and+Feifei+Li%2E+2024b%2E+Corag%3A+A+cost%2Dconstrained+retrieval+optimization+system+for+retrieval%2Daugmented+generation%2E+arXiv+preprint+arXiv%3A2411%2E00744%2E+xAI%2E+20)
35. Yuqing Yang, Ethan Chern, Xipeng Qiu, Graham Neubig, and Pengfei Liu. 2024. Alignment for honesty. Advances in Neural Information Processing Systems, 37:63565–63598. [find](https://scholar.google.com/scholar?q=Yuqing+Yang%2C+Ethan+Chern%2C+Xipeng+Qiu%2C+Graham+Neubig%2C+and+Pengfei+Liu%2E+2024%2E+Alignment+for+honesty%2E+Advances+in+Neural+Information+Processing+Systems%2C+37%3A63565%E2%80%9363598%2E)
36. Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W. Cohen, Ruslan Salakhutdinov, and Christopher D. Manning. 2018. HotpotQA: A dataset for diverse, explainable multi-hop question answering. In Conference on Empirical Methods in Natural Language Processing (EMNLP). [find](https://scholar.google.com/scholar?q=Zhilin+Yang%2C+Peng+Qi%2C+Saizheng+Zhang%2C+Yoshua+Bengio%2C+William+W%2E+Cohen%2C+Ruslan+Salakhutdinov%2C+and+Christopher+D%2E+Manning%2E+2018%2E+HotpotQA%3A+A+dataset+for+diverse%2C+explainable+multi%2Dhop+question+answering) [our card](https://md.research.elamur.ai/free/en/papers/yang-2018-hotpotqa-dataset-diverse-explainable-multi/)
37. Tian Yu, Shaolei Zhang, and Yang Feng. 2024. Auto-rag: Autonomous retrieval-augmented generation for large language models. arXiv preprint arXiv:2411.19443. — [arXiv:2411.19443](https://arxiv.org/abs/2411.19443) [find](https://scholar.google.com/scholar?q=Tian+Yu%2C+Shaolei+Zhang%2C+and+Yang+Feng%2E+2024%2E+Auto%2Drag%3A+Autonomous+retrieval%2Daugmented+generation+for+large+language+models%2E+arXiv+preprint+arXiv%3A2411%2E19443%2E+%E2%80%94+%5BarXiv%3A2411%2E19443%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F)
38. Murong Yue, Wenlin Yao, Haitao Mi, Dian Yu, Ziyu Yao, and Dong Yu. 2024a. Dots: Learning to reason dynamically in llms via optimal reasoning trajectories search. arXiv preprint arXiv:2410.03864. — [arXiv:2410.03864](https://arxiv.org/abs/2410.03864) [find](https://scholar.google.com/scholar?q=Murong+Yue%2C+Wenlin+Yao%2C+Haitao+Mi%2C+Dian+Yu%2C+Ziyu+Yao%2C+and+Dong+Yu%2E+2024a%2E+Dots%3A+Learning+to+reason+dynamically+in+llms+via+optimal+reasoning+trajectories+search%2E+arXiv+preprint+arXiv%3A2410%2E03864%2E+%E2%80%94+%5Bar)