---
title: "Agentic Reasoning — paper by Wu et al. (2025)"
description: "The authors propose Agentic Reasoning, a framework in which a reasoning model… 23.8% accuracy. 27 references, cited by 15 papers here."
authors: ["Junde Wu", "Jiayuan Zhu", "Yuyuan Liu", "Min Xu", "Yueming Jin"]
year: 2025
venue: "Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2025.acl-long.1383/"
doi: "10.18653/v1/2025.acl-long.1383"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wu-2025-agentic-reasoning-streamlined-framework-enhancing/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wu-2025-agentic-reasoning-streamlined-framework-enhancing/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/2/) / Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools

# Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools

**Authors:** [Junde Wu](https://md.research.elamur.ai/free/en/authors/junde-wu/), [Jiayuan Zhu](https://md.research.elamur.ai/free/en/authors/jiayuan-zhu/), [Yuyuan Liu](https://md.research.elamur.ai/free/en/authors/yuyuan-liu/), [Min Xu](https://md.research.elamur.ai/free/en/authors/min-xu/) and [Yueming Jin](https://md.research.elamur.ai/free/en/authors/yueming-jin/) · **Year:** 2025 · **Venue:** [Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2025](https://md.research.elamur.ai/free/en/venues/acl/2025/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2025.acl-long.1383/) · [PDF](https://aclanthology.org/2025.acl-long.1383.pdf) · [DOI 10.18653/v1/2025.acl-long.1383](https://doi.org/10.18653/v1/2025.acl-long.1383) · [OpenAlex](https://openalex.org/W4412889788)

**Citations:** 30 citations (OpenAlex, 2026-10-14) · [15](https://md.research.elamur.ai/free/en/papers/wu-2025-agentic-reasoning-streamlined-framework-enhancing/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Reasoning LLMs trained with outcome-based reinforcement learning do well in math and code, where answers are easy to check. They struggle with open-ended, knowledge-heavy questions that need fact gathering, calculation and keeping track of many connected ideas. The authors propose Agentic Reasoning, a framework in which a reasoning model such as DeepSeek-R1 hands subtasks to auxiliary LLM agents. While reasoning, the model emits special tokens with a query. Generation pauses, the matching agent handles the request using the current context, and its answer is fed back into the chain. Experiments showed that three agents are broadly useful:
- a Web-Search agent,
- a Code agent,
- a Mind-Map agent that keeps the reasoning context as a knowledge graph.

On Humanity's Last Exam, the system raises DeepSeek-R1 to a new state of the art among public models. It comes close to the proprietary OpenAI Deep Research. Domain experts also judged it helpful for automating manual research work. This suggests that open models with well-designed tools can approach closed deep-research systems. The code and data are publicly released.

## Key points
- **Humanity's Last Exam:** Agentic Reasoning with DeepSeek-R1 reaches 23.8% accuracy. That is 14.4 points above the base model and 2.8 points below OpenAI Deep Research (26.6%).
- **Mind-Map agent:** A graph-construction LLM extracts entities and relations from the reasoning chain, following a GraphRAG-style approach. It then applies community clustering with per-cluster summaries and answers memory queries via RAG over the graph.
- **Web-Search agent:** The pipeline has four stages:
  - it splits the query into search-ready sub-queries;
  - it runs them through a search engine;
  - a re-ranking model scores the results, and if the average relevance of the top 10 pages falls below a threshold, the queries are refined again;
  - RAG is applied per sub-query, and an LLM merges the answers into one snippet.
- **Werewolf test:** Against seven players with over five years of experience, the model won 72% of games. Without the Mind-Map, its win rate dropped to 36%.
- **Stated limitations:**
  - higher compute cost and latency, because agents are called one after another;
  - no checking of source credibility;
  - continued exposure to LLM hallucinations.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Carnegie Mellon University](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) — University, Pittsburgh, United States · 539 works · 179,533 citations
- [University of Oxford](https://md.research.elamur.ai/free/en/universities/university-of-oxford/) — University, Oxford, United Kingdom · 104 works · 157,183 citations
- [National University of Singapore](https://md.research.elamur.ai/free/en/universities/national-university-of-singapore/) — University, Singapore, Singapore · 180 works · 34,304 citations
- [Mohamed bin Zayed University of Artificial Intelligence](https://md.research.elamur.ai/free/en/universities/mohamed-bin-zayed-university-of-artificial-intelligence/) — University, Abu Dhabi, United Arab Emirates · 124 works · 5,676 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,426 works

## Cite

Cite as: Junde Wu, Jiayuan Zhu, Yuyuan Liu, Min Xu and Yueming Jin. 2025. Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{wu2025agentic,
  title = {{Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools}},
  author = {Junde Wu, Jiayuan Zhu, Yuyuan Liu, Min Xu and Yueming Jin},
  booktitle = {Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2025},
  doi = {10.18653/v1/2025.acl-long.1383},
  url = {https://doi.org/10.18653/v1/2025.acl-long.1383}
}
```

- [← previous WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines](https://md.research.elamur.ai/free/en/papers/winata-2025-worldcuisines-massive-scale-benchmark-multilingual/)
- [next → Disentangling Memory and Reasoning Ability in Large Language Models](https://md.research.elamur.ai/free/en/papers/jin-2025-disentangling-memory-reasoning-ability-large/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/2/)

## References

27 references, 10 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Darren Edge, Ha Trinh, Newman Cheng, Joshua Bradley, Alex Chao, Apurva Mody, Steven Truitt, and Jonathan Larson. 2024. From local to global: A graph rag approach to query-focused summarization. arXiv preprint arXiv:2404.16130. [find](https://scholar.google.com/scholar?q=Darren+Edge%2C+Ha+Trinh%2C+Newman+Cheng%2C+Joshua+Bradley%2C+Alex+Chao%2C+Apurva+Mody%2C+Steven+Truitt%2C+and+Jonathan+Larson%2E+2024%2E+From+local+to+global%3A+A+graph+rag+approach+to+query%2Dfocused+summarization%2E+arXiv+)
2. Zhen Huang, Haoyang Zou, Xuefeng Li, Yixiu Liu, Yuxiang Zheng, Ethan Chern, Shijie Xia, Yiwei Qin, Weizhe Yuan, and Pengfei Liu. 2024. O1 replication journey–part 2: Surpassing o1-preview through simple distillation, big progress or bitter lesson? arXiv preprint arXiv:2411.16489. [find](https://scholar.google.com/scholar?q=Zhen+Huang%2C+Haoyang+Zou%2C+Xuefeng+Li%2C+Yixiu+Liu%2C+Yuxiang+Zheng%2C+Ethan+Chern%2C+Shijie+Xia%2C+Yiwei+Qin%2C+Weizhe+Yuan%2C+and+Pengfei+Liu%2E+2024%2E+O1+replication+journey%E2%80%93part+2%3A+Surpassing+o1%2Dpreview+through+simp)
3. Shayekh Bin Islam, Md Asib Rahman, KSM Hossain, Enamul Hoque, Shafiq Joty, and Md Rizwan Parvez. 2024. Open-rag: Enhanced retrieval-augmented reasoning with open-source large language models. arXiv preprint arXiv:2410.01782. [find](https://scholar.google.com/scholar?q=Shayekh+Bin+Islam%2C+Md+Asib+Rahman%2C+KSM+Hossain%2C+Enamul+Hoque%2C+Shafiq+Joty%2C+and+Md+Rizwan+Parvez%2E+2024%2E+Open%2Drag%3A+Enhanced+retrieval%2Daugmented+reasoning+with+open%2Dsource+large+language+models%2E+arXiv+pr)
4. Aaron Jaech, Adam Kalai, Adam Lerer, Adam Richardson, Ahmed El-Kishky, Aiden Low, Alec Helyar, Aleksander Madry, Alex Beutel, Alex Carney, et al. 2024. [Openai o1 system card](https://md.research.elamur.ai/free/en/papers/openai-2024-openai-o1-system-card/). arXiv preprint arXiv:2412.16720.
5. M Abdul Khaliq, P Chang, M Ma, Bernhard Pflugfelder, and F Miletić. 2024. Ragar, your falsehood radar: Rag-augmented reasoning for political fact-checking using multimodal large language models. arXiv preprint arXiv:2404.12065. [find](https://scholar.google.com/scholar?q=M+Abdul+Khaliq%2C+P+Chang%2C+M+Ma%2C+Bernhard+Pflugfelder%2C+and+F+Miletic%CC%81%2E+2024%2E+Ragar%2C+your+falsehood+radar%3A+Rag%2Daugmented+reasoning+for+political+fact%2Dchecking+using+multimodal+large+language+models%2E+arXi)
6. Kuang-Huei Lee, Xinyun Chen, Hiroki Furuta, John Canny, and Ian Fischer. 2024. [A human-inspired reading agent with gist memory of very long contexts](https://md.research.elamur.ai/free/en/papers/lee-2024-human-inspired-reading-agent-gist/). arXiv preprint arXiv:2402.09727.
7. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020. [Retrieval-augmented generation for knowledge-intensive nlp tasks](https://md.research.elamur.ai/free/en/papers/lewis-2020-retrieval-augmented-generation-knowledge-intensive/). Advances in Neural Information Processing Systems, 33:9459–9474.
8. Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, et al. 2022. [Solving quantitative reasoning problems with language models](https://md.research.elamur.ai/free/en/papers/lewkowycz-2022-solving-quantitative-reasoning-problems-language/). Advances in Neural Information Processing Systems, 35:3843– 3857.
9. Xiaoxi Li, Guanting Dong, Jiajie Jin, Yuyao Zhang, Yujia Zhou, Yutao Zhu, Peitian Zhang, and Zhicheng Dou. 2025. [Search-o1: Agentic search-enhanced large reasoning models](https://md.research.elamur.ai/free/en/papers/li-2025-search-o1-agentic-search-enhanced/). arXiv preprint arXiv:2501.05366.
10. Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, et al. 2024. Deepseek-v3 technical report. arXiv preprint arXiv:2412.19437. [find](https://scholar.google.com/scholar?q=Aixin+Liu%2C+Bei+Feng%2C+Bing+Xue%2C+Bingxuan+Wang%2C+Bochao+Wu%2C+Chengda+Lu%2C+Chenggang+Zhao%2C+Chengqi+Deng%2C+Chenyu+Zhang%2C+Chong+Ruan%2C+et+al%2E+2024%2E+Deepseek%2Dv3+technical+report%2E+arXiv+preprint+arXiv%3A2412%2E19437%2E)
11. Xusheng Luo, Shaojun Xu, and Changliu Liu. 2023. Obtaining hierarchy from human instructions: an llms-based approach. In CoRL 2023 Workshop on Learning Effective Abstractions for Planning (LEAP). [find](https://scholar.google.com/scholar?q=Xusheng+Luo%2C+Shaojun+Xu%2C+and+Changliu+Liu%2E+2023%2E+Obtaining+hierarchy+from+human+instructions%3A+an+llms%2Dbased+approach%2E+In+CoRL+2023+Workshop+on+Learning+Effective+Abstractions+for+Planning+%28LEAP%29%2E)
12. Grégoire Mialon, Clémentine Fourrier, Craig Swift, Thomas Wolf, Yann LeCun, and Thomas Scialom. 2023. [Gaia: a benchmark for general ai assistants](https://md.research.elamur.ai/free/en/papers/mialon-2023-gaia-benchmark-general-ai-assistants/). arXiv preprint arXiv:2311.12983.
13. OpenAI. Learning to reason with LLMs. Charles Packer, Vivian Fang, Shishir_G Patil, Kevin Lin, Sarah Wooders, and Joseph_E Gonzalez. 2023. Memgpt: Towards llms as operating systems. [find](https://scholar.google.com/scholar?q=OpenAI%2E+Learning+to+reason+with+LLMs%2E+Charles+Packer%2C+Vivian+Fang%2C+Shishir%5FG+Patil%2C+Kevin+Lin%2C+Sarah+Wooders%2C+and+Joseph%5FE+Gonzalez%2E+2023%2E+Memgpt%3A+Towards+llms+as+operating+systems%2E)
14. Keivalya Pandya and Mehfuza Holia. 2023. Automating customer service using langchain: Building custom open-source gpt chatbot for organizations. arXiv preprint arXiv:2310.05421. — [arXiv:2310.05421](https://arxiv.org/abs/2310.05421) [find](https://scholar.google.com/scholar?q=Keivalya+Pandya+and+Mehfuza+Holia%2E+2023%2E+Automating+customer+service+using+langchain%3A+Building+custom+open%2Dsource+gpt+chatbot+for+organizations%2E+arXiv+preprint+arXiv%3A2310%2E05421%2E+%E2%80%94+%5BarXiv%3A2310%2E05421%5D%28h)
15. Long Phan, Alice Gatti, Ziwen Han, Nathaniel Li, Josephina Hu, Hugh Zhang, Chen Bo Calvin Zhang, Mohamed Shaaban, John Ling, Sean Shi, Michael Choi, Anish Agrawal, Arnav Chopra, Adam Khoja, Ryan Kim, Richard Ren, Jason Hausenloy, Oliver Zhang, Mantas Mazeika, Tung Nguyen, Daron Anderson, Imad Ali Sh… — [Humanity's Last Exam](https://md.research.elamur.ai/free/en/papers/phan-2025-humanity-s-last-exam/)
16. Di Zhang, Jianbo Wu, Jingdi Lei, Tong Che, Jiatong Li, Tong Xie, Xiaoshui Huang, Shufei Zhang, Marco Pavone, Yuqiang Li, et al. 2024. Llama-berry: Pairwise optimization for o1-like olympiad-level mathematical reasoning. arXiv preprint arXiv:2410.02884. [find](https://scholar.google.com/scholar?q=Di+Zhang%2C+Jianbo+Wu%2C+Jingdi+Lei%2C+Tong+Che%2C+Jiatong+Li%2C+Tong+Xie%2C+Xiaoshui+Huang%2C+Shufei+Zhang%2C+Marco+Pavone%2C+Yuqiang+Li%2C+et+al%2E+2024%2E+Llama%2Dberry%3A+Pairwise+optimization+for+o1%2Dlike+olympiad%2Dlevel+math)
17. Wanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye, and Yanlin Wang. 2024. Memorybank: Enhancing large language models with long-term memory. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 19724–19731. [find](https://scholar.google.com/scholar?q=Wanjun+Zhong%2C+Lianghong+Guo%2C+Qiqi+Gao%2C+He+Ye%2C+and+Yanlin+Wang%2E+2024%2E+Memorybank%3A+Enhancing+large+language+models+with+long%2Dterm+memory%2E+In+Proceedings+of+the+AAAI+Conference+on+Artificial+Intelligence)
18. Yiwei Qin, Xuefeng Li, Haoyang Zou, Yixiu Liu, Shijie Xia, Zhen Huang, Yixin Ye, Weizhe Yuan, Hector Liu, Yuanzhi Li, et al. 2024. O1 replication journey: A strategic progress report–part 1. arXiv preprint arXiv:2410.18982. [find](https://scholar.google.com/scholar?q=Yiwei+Qin%2C+Xuefeng+Li%2C+Haoyang+Zou%2C+Yixiu+Liu%2C+Shijie+Xia%2C+Zhen+Huang%2C+Yixin+Ye%2C+Weizhe+Yuan%2C+Hector+Liu%2C+Yuanzhi+Li%2C+et+al%2E+2024%2E+O1+replication+journey%3A+A+strategic+progress+report%E2%80%93part+1%2E+arXiv+pre)
19. David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R Bowman. 2023. [Gpqa: A graduate-level google-proof q&a benchmark](https://md.research.elamur.ai/free/en/papers/rein-2023-gpqa-graduate-level-google-proof/). arXiv preprint arXiv:2311.12022.
20. Yijia Shao, Yucheng Jiang, Theodore A Kanell, Peter Xu, Omar Khattab, and Monica S Lam. 2024. [Assisting in writing wikipedia-like articles from scratch with large language models](https://md.research.elamur.ai/free/en/papers/shao-2024-assisting-writing-wikipedia-like-articles/). arXiv preprint arXiv:2402.14207.
21. DeepSeek Team. 2024. Deepseek-r1-lite-preview is now live: unleashing supercharged reasoning power. [find](https://scholar.google.com/scholar?q=DeepSeek+Team%2E+2024%2E+Deepseek%2Dr1%2Dlite%2Dpreview+is+now+live%3A+unleashing+supercharged+reasoning+power%2E)
22. Qwen Team. Qwq: Reflect deeply on the boundaries of the unknown, november 2024. URL [https://qwenlm.github](https://qwenlm.github). io/blog/qwq-32b-preview. [↗](https://qwenlm.github)
23. Vincent A Traag, Ludo Waltman, and Nees Jan Van Eck. 2019. From louvain to leiden: guaranteeing well-connected communities. Scientific reports, 9(1):1– 12. [find](https://scholar.google.com/scholar?q=Vincent+A+Traag%2C+Ludo+Waltman%2C+and+Nees+Jan+Van+Eck%2E+2019%2E+From+louvain+to+leiden%3A+guaranteeing+well%2Dconnected+communities%2E+Scientific+reports%2C+9%281%29%3A1%E2%80%93+12%2E)
24. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). Advances in neural information processing systems, 35:24824–24837.
25. Junde Wu, Jiayuan Zhu, Yunli Qi, Jingkun Chen, Min Xu, Filippo Menolascina, and Vicente Grau. 2024. Medical graph rag: Towards safe medical large language model via graph retrieval-augmented generation. arXiv preprint arXiv:2408.04187. — [arXiv:2408.04187](https://arxiv.org/abs/2408.04187) [find](https://scholar.google.com/scholar?q=Junde+Wu%2C+Jiayuan+Zhu%2C+Yunli+Qi%2C+Jingkun+Chen%2C+Min+Xu%2C+Filippo+Menolascina%2C+and+Vicente+Grau%2E+2024%2E+Medical+graph+rag%3A+Towards+safe+medical+large+language+model+via+graph+retrieval%2Daugmented+generatio)
26. An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, et al. 2024. Qwen2. 5 technical report. arXiv preprint arXiv:2412.15115. [find](https://scholar.google.com/scholar?q=An+Yang%2C+Baosong+Yang%2C+Beichen+Zhang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Haoran+Wei%2C+et+al%2E+2024%2E+Qwen2%2E+5+technical+report%2E+arXiv+preprint+arXiv%3A2412%2E15115%2E)
27. Hui Yang, Sifu Yue, and Yunzhong He. 2023. Auto-gpt for online decision making: Benchmarks and additional opinions. arXiv preprint arXiv:2306.02224. [find](https://scholar.google.com/scholar?q=Hui+Yang%2C+Sifu+Yue%2C+and+Yunzhong+He%2E+2023%2E+Auto%2Dgpt+for+online+decision+making%3A+Benchmarks+and+additional+opinions%2E+arXiv+preprint+arXiv%3A2306%2E02224%2E)

*Updated 31 October 2026*