---
title: "CheckRLM — paper by Xu et al. (2026) — summary and ideas"
description: "Reasoning Language Models (RLMs) such as OpenAI-o1 and DeepSeek-R1 produce long chains of thought. 52 references."
authors: ["Dingling Xu", "Ruobing Wang", "Qingfei Zhao", "Yukun Yan", "Zhichun Wang", "Daren Zha", "Shi Yu", "Zhenghao Liu", "Shuo Wang", "Xu Han", "Maosong Sun"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.1780/"
doi: "10.18653/v1/2026.acl-long.1780"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/xu-2026-checkrlm-effective-knowledge-thought-coherence/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/xu-2026-checkrlm-effective-knowledge-thought-coherence/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/26/) / CheckRLM: Effective Knowledge–Thought Coherence Checking in Retrieval-Augmented Reasoning

# CheckRLM: Effective Knowledge–Thought Coherence Checking in Retrieval-Augmented Reasoning

**Authors:** [Dingling Xu](https://md.research.elamur.ai/free/en/authors/dingling-xu/), [Ruobing Wang](https://md.research.elamur.ai/free/en/authors/ruobing-wang/), [Qingfei Zhao](https://md.research.elamur.ai/free/en/authors/qingfei-zhao/), [Yukun Yan](https://md.research.elamur.ai/free/en/authors/yukun-yan/), [Zhichun Wang](https://md.research.elamur.ai/free/en/authors/zhichun-wang/), [Daren Zha](https://md.research.elamur.ai/free/en/authors/daren-zha/), [Shi Yu](https://md.research.elamur.ai/free/en/authors/shi-yu/), [Zhenghao Liu](https://md.research.elamur.ai/free/en/authors/zhenghao-liu/), [Shuo Wang](https://md.research.elamur.ai/free/en/authors/shuo-wang/), [Xu Han](https://md.research.elamur.ai/free/en/authors/xu-han/) and [Maosong Sun](https://md.research.elamur.ai/free/en/authors/maosong-sun/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.1780/) · [PDF](https://aclanthology.org/2026.acl-long.1780.pdf) · [DOI 10.18653/v1/2026.acl-long.1780](https://doi.org/10.18653/v1/2026.acl-long.1780) · [OpenAlex](https://openalex.org/W7166840697)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Reasoning Language Models (RLMs) such as OpenAI-o1 and DeepSeek-R1 produce long chains of thought. On knowledge-intensive questions, a single wrong fact early in the chain can spread to later steps and corrupt the final answer, a problem known as error accumulation. CheckRLM addresses this with Retrieval-Augmented Generation (RAG) applied while the model is still reasoning.

The framework has two modules:
- **In-process knowledge claim recognition** pulls query-relevant factual claims out of each newly generated reasoning segment, which helps locate possible mistakes.
- **Localized knowledge coherence correction** uses those claims plus the question to retrieve documents. It then makes small, token-level edits so the segment agrees with external knowledge before reasoning continues.

Both modules are trained jointly with DPO. In experiments on multi-hop QA (2WikiMQA, MuSiQue), checking during reasoning beat Vanilla RAG, Search-o1 and checking after reasoning. It also used fewer tokens and less time than the retrieval-heavy baselines. The work matters because it shows that correcting facts early is both more accurate and cheaper than fixing a finished chain.

## Key points
- **Setup:** QwQ-32B serves as the reasoning model. Llama-3.3-70B-Instruct serves as the claim-recognition and correction model.
- **Results on 2WikiMQA (Figure 4; values read from a garbled PDF extraction, so the pairing is approximate):**
  - CheckRLM's in-reasoning check: F1 ≈ 73.4, about 1364 tokens, ~3.3 s.
  - Search-o1: F1 ≈ 71.4, about 2009 tokens, ~3.9 s.
  - Post-reasoning check: F1 ≈ 60.2.
  - Vanilla RAG: F1 ≈ 46.4.
  - Direct Reasoning: F1 ≈ 34.6.
- **When corrections happen:** Most fixes occur at the first or second checking step on both 2WikiMQA and MuSiQue. This suggests errors are caught before they propagate, with little need for deep or repeated checking.
- **Limitations:** The method covers only textual knowledge from a single knowledge base. Multimodal and multi-source verification is left for future work.
- **Availability:** Code and data are released at github.com/AI9Stars/CheckRLM.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Tsinghua University](https://md.research.elamur.ai/free/en/universities/tsinghua-university/) — University, Beijing, China · 415 works · 94,028 citations
- [Chinese Academy of Sciences](https://md.research.elamur.ai/free/en/government/chinese-academy-of-sciences/) — Government body, Beijing, China · 246 works · 24,951 citations
- [Northeastern University](https://md.research.elamur.ai/free/en/universities/northeastern-university/) — University, Boston, United States · 68 works · 7,316 citations
- [University of Chinese Academy of Sciences](https://md.research.elamur.ai/free/en/universities/university-of-chinese-academy-of-sciences/) — University, Beijing, China · 188 works · 8,743 citations
- [Institute of Information Engineering](https://md.research.elamur.ai/free/en/labs/institute-of-information-engineering/) — Research institute, Beijing, China · 41 works · 1,485 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 3,486 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,730 works

🧭 Topics (2): [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,685 works · [🔍 Information retrieval & search](https://md.research.elamur.ai/free/en/topics/information-retrieval/) · 552 works

## Cite

Cite as: Dingling Xu, Ruobing Wang, Qingfei Zhao, Yukun Yan, Zhichun Wang, Daren Zha, Shi Yu, Zhenghao Liu, Shuo Wang, Xu Han and Maosong Sun. 2026. CheckRLM: Effective Knowledge–Thought Coherence Checking in Retrieval-Augmented Reasoning. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{xu2026checkrlm,
  title = {{CheckRLM: Effective Knowledge–Thought Coherence Checking in Retrieval-Augmented Reasoning}},
  author = {Dingling Xu, Ruobing Wang, Qingfei Zhao, Yukun Yan, Zhichun Wang, Daren Zha, Shi Yu, Zhenghao Liu, Shuo Wang, Xu Han and Maosong Sun},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.1780},
  url = {https://doi.org/10.18653/v1/2026.acl-long.1780}
}
```

- [← previous CheckMIABench: Firm Foundations For Membership Inference Attacks on Language Models](https://md.research.elamur.ai/free/en/papers/wang-2026-checkmiabench-firm-foundations-membership-inference/)
- [next → ChemReason-Bench: Benchmarking Large Language Models for Procedural Reasoning in Experimental Chemistry](https://md.research.elamur.ai/free/en/papers/zhang-2026-chemreason-bench-benchmarking-large-language/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/26/)

## References

52 references, 35 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi. 2024. [Self-rag: Learning to retrieve, generate, and critique through self-reflection](https://md.research.elamur.ai/free/en/papers/asai-2023-self-rag-learning-retrieve-generate/). dataset of incomplete information reading comprehension questions. In Proceedings of the 2020 Conference on Empirical Methods in Natural Lang…
2. Jinlan Fu, See-Kiong Ng, Zhengbao Jiang, and Pengfei Liu. 2024. GPTScore: Evaluate as you desire. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 6556–6576, Mexico City, M… [find](https://scholar.google.com/scholar?q=Jinlan+Fu%2C+See%2DKiong+Ng%2C+Zhengbao+Jiang%2C+and+Pengfei+Liu%2E+2024%2E+GPTScore%3A+Evaluate+as+you+desire%2E+In+Proceedings+of+the+2024+Conference+of+the+North+American+Chapter+of+the+Association+for+Computation)
3. Yunfan Gao, Yun Xiong, Yijie Zhong, Yuxi Bi, Ming Xue, and Haofen Wang. 2025. Synergizing rag and reasoning: A systematic review. arXiv preprint arXiv:2504.15909. — [arXiv:2504.15909](https://arxiv.org/abs/2504.15909) [find](https://scholar.google.com/scholar?q=Yunfan+Gao%2C+Yun+Xiong%2C+Yijie+Zhong%2C+Yuxi+Bi%2C+Ming+Xue%2C+and+Haofen+Wang%2E+2025%2E+Synergizing+rag+and+reasoning%3A+A+systematic+review%2E+arXiv+preprint+arXiv%3A2504%2E15909%2E+%E2%80%94+%5BarXiv%3A2504%2E15909%5D%28https%3A%2F%2Farxiv%2Eor)
4. Xinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, and Jie Zhou. 2026. DeepRAG: Thinking to retrieve step by step for large language models. In The Fourteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Xinyan+Guan%2C+Jiali+Zeng%2C+Fandong+Meng%2C+Chunlei+Xin%2C+Yaojie+Lu%2C+Hongyu+Lin%2C+Xianpei+Han%2C+Le+Sun%2C+and+Jie+Zhou%2E+2026%2E+DeepRAG%3A+Thinking+to+retrieve+step+by+step+for+large+language+models%2E+In+The+Fourtee)
5. Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Peiyi Wang, Qihao Zhu, Runxin Xu, Ruoyu Zhang, Shirong Ma, Xiao Bi, Xiaokang Zhang, Xingkai Yu, Yu Wu, Z. F. Wu, Zhibin Gou, Zhihong Shao, Zhuoshu Li, Ziyi Gao, Aixin Liu, and 175 others. 2025. DeepSeek-R1 incentivizes reasoning in LLMs through rein… [find](https://scholar.google.com/scholar?q=Daya+Guo%2C+Dejian+Yang%2C+Haowei+Zhang%2C+Junxiao+Song%2C+Peiyi+Wang%2C+Qihao+Zhu%2C+Runxin+Xu%2C+Ruoyu+Zhang%2C+Shirong+Ma%2C+Xiao+Bi%2C+Xiaokang+Zhang%2C+Xingkai+Yu%2C+Yu+Wu%2C+Z%2E+F%2E+Wu%2C+Zhibin+Gou%2C+Zhihong+Shao%2C+Zhuoshu+Li)
6. Yancheng He, Shilong Li, Jiaheng Liu, Weixun Wang, Xingyuan Bu, Ge Zhang, Zy Peng, Zhaoxiang Zhang, Zhicheng Zheng, Wenbo Su, and 1 others. 2025. [Can large language models detect errors in long chain-of-thought reasoning?](https://md.research.elamur.ai/free/en/papers/he-2025-can-large-language-models-detect/) In Proceedings of the 63rd Annual Meeting of the Association for Computational…
7. Qiguang Chen, Libo Qin, Jinhao Liu, Dengyun Peng, Jiannan Guan, Peng Wang, Mengkang Hu, Yuhang Zhou, Te Gao, and Wanxiang Che. 2025. [Towards reasoning era: A survey of long chain-of-thought for reasoning large language models](https://md.research.elamur.ai/free/en/papers/chen-2025-towards-reasoning-era-survey-long/). arXiv preprint arXiv:2503.09567.
8. Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, and Akiko Aizawa. 2020. [Constructing a multi-hop QA dataset for comprehensive evaluation of reasoning steps](https://md.research.elamur.ai/free/en/papers/ho-2020-constructing-multi-hop-qa-dataset/). In Proceedings of the 28th International Conference on Computational Linguistics, pages 6609–6625, Barcelona, Spain (Online). International Comm…
9. Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, and 1 others. 2024. [The llama 3 herd of models](https://md.research.elamur.ai/free/en/papers/grattafiori-2024-llama-3-herd-models/). arXiv e-prints, pages arXiv–2407.
10. Qisheng Hu, Quanyu Long, and Wenya Wang. 2025. Coordinating search-informed reasoning and reasoning-guided search in claim verification. arXiv preprint arXiv:2506.07528. [find](https://scholar.google.com/scholar?q=Qisheng+Hu%2C+Quanyu+Long%2C+and+Wenya+Wang%2E+2025%2E+Coordinating+search%2Dinformed+reasoning+and+reasoning%2Dguided+search+in+claim+verification%2E+arXiv+preprint+arXiv%3A2506%2E07528%2E)
11. James Ferguson, Matt Gardner, Hannaneh Hajishirzi, Tushar Khot, and Pradeep Dasigi. 2020. [find](https://scholar.google.com/scholar?q=James+Ferguson%2C+Matt+Gardner%2C+Hannaneh+Hajishirzi%2C+Tushar+Khot%2C+and+Pradeep+Dasigi%2E+2020%2E)
12. IIRC: A Gautier Izacard, Patrick Lewis, Maria Lomeli, Lucas Hosseini, Fabio Petroni, Timo Schick, Jane Dwivedi-Yu, Armand Joulin, Sebastian Riedel, and Edouard Grave. 2023. [Atlas: Few-shot learning with retrieval augmented language models](https://md.research.elamur.ai/free/en/papers/izacard-2022-atlas-few-shot-learning-retrieval/). Journal of Machine Learning Research, 24(251):1–43.
13. Soyeong Jeong, Jinheon Baek, Sukmin Cho, Sung Ju Hwang, and Jong Park. 2024. [Adaptive-RAG: Learning to adapt retrieval-augmented large language models through question complexity](https://md.research.elamur.ai/free/en/papers/jeong-2024-adaptive-rag-learning-adapt-retrieval/). In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Hu…
14. Zhengbao Jiang, Frank F Xu, Luyu Gao, Zhiqing Sun, Qian Liu, Jane Dwivedi-Yu, Yiming Yang, Jamie Callan, and Graham Neubig. 2023. [Active retrieval augmented generation](https://md.research.elamur.ai/free/en/papers/jiang-2023-active-retrieval-augmented-generation/). In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 7969–7992.
15. Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. [Large language models are zero-shot reasoners](https://md.research.elamur.ai/free/en/papers/kojima-2022-large-language-models-zero-shot/). Advances in neural information processing systems, 35:22199– 22213.
16. Aviral Kumar, Vincent Zhuang, Rishabh Agarwal, Yi Su, John D Co-Reyes, Avi Singh, Kate Baumli, Shariq Iqbal, Colton Bishop, Rebecca Roelofs, Lei M Zhang, Kay McKinney, Disha Shrivastava, Cosmin Paduraru, George Tucker, Doina Precup, Feryal Behbahani, and Aleksandra Faust. 2025. [Training language mod…](https://md.research.elamur.ai/free/en/papers/kumar-2024-training-language-models-self-correct/)
17. Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph Gonzalez, Hao Zhang, and Ion Stoica. 2023. [Efficient memory management for large language model serving with pagedattention](https://md.research.elamur.ai/free/en/papers/kwon-2023-efficient-memory-management-large-language/). In Proceedings of the 29th symposium on operating systems principles, pages 611–626.
18. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, and 1 others. 2020. [Retrieval-augmented generation for knowledge-intensive nlp tasks](https://md.research.elamur.ai/free/en/papers/lewis-2020-retrieval-augmented-generation-knowledge-intensive/). Advances in neural information processing systems, 33:9459–…
19. Xiaoxi Li, Guanting Dong, Jiajie Jin, Yuyao Zhang, Yujia Zhou, Yutao Zhu, Peitian Zhang, and Zhicheng Dou. 2025. [Search-o1: Agentic search-enhanced large reasoning models](https://md.research.elamur.ai/free/en/papers/li-2025-search-o1-agentic-search-enhanced/). In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 5420–5438, Suzhou, China. Assoc…
20. Xinzhe Li. 2025. A survey on llm test-time compute via search: Tasks, llm profiling, search algorithms, and relevant frameworks. arXiv preprint arXiv:2501.10069. — [arXiv:2501.10069](https://arxiv.org/abs/2501.10069) [find](https://scholar.google.com/scholar?q=Xinzhe+Li%2E+2025%2E+A+survey+on+llm+test%2Dtime+compute+via+search%3A+Tasks%2C+llm+profiling%2C+search+algorithms%2C+and+relevant+frameworks%2E+arXiv+preprint+arXiv%3A2501%2E10069%2E+%E2%80%94+%5BarXiv%3A2501%2E10069%5D%28https%3A%2F%2Farxiv%2Eorg)
21. Yushen Li, Jinpeng Wang, Tao Dai, Jieming Zhu, Jun Yuan, Rui Zhang, and Shu-Tao Xia. 2024. Rat: Retrieval-augmented transformer for click-through rate prediction. In Companion Proceedings of the ACM Web Conference 2024, pages 867–870. [find](https://scholar.google.com/scholar?q=Yushen+Li%2C+Jinpeng+Wang%2C+Tao+Dai%2C+Jieming+Zhu%2C+Jun+Yuan%2C+Rui+Zhang%2C+and+Shu%2DTao+Xia%2E+2024%2E+Rat%3A+Retrieval%2Daugmented+transformer+for+click%2Dthrough+rate+prediction%2E+In+Companion+Proceedings+of+the+ACM+W)
22. Zhan Ling, Yunhao Fang, Xuanlin Li, Zhiao Huang, Mingu Lee, Roland Memisevic, and Hao Su. 2023. [Deductive verification of chain-of-thought reasoning](https://md.research.elamur.ai/free/en/papers/ling-2023-deductive-verification-chain-thought-reasoning/). Advances in Neural Information Processing Systems, 36:36407–36433.
23. Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. 2023. [G-eval: NLG evaluation using gpt-4 with better human alignment](https://md.research.elamur.ai/free/en/papers/liu-2023-g-eval-nlg-evaluation-gpt/). In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 2511–2522, Singapore. Association for Computational Lin…
24. OpenAI. 2024. Learning to reason with llms, september 2024. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2024%2E+Learning+to+reason+with+llms%2C+september+2024%2E)
25. Fabio Petroni, Aleksandra Piktus, Angela Fan, Patrick Lewis, Majid Yazdani, Nicola De Cao, James Thorne, Yacine Jernite, Vladimir Karpukhin, Jean Maillard, and 1 others. 2021. [Kilt: a benchmark for knowledge intensive language tasks](https://md.research.elamur.ai/free/en/papers/petroni-2020-kilt-benchmark-knowledge-intensive-language/). In Proceedings of the 2021 Conference of the North American Chapte…
26. Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D Manning, Stefano Ermon, and Chelsea Finn. 2023. [Direct preference optimization: Your language model is secretly a reward model](https://md.research.elamur.ai/free/en/papers/rafailov-2023-direct-preference-optimization-language-model/). Advances in neural information processing systems, 36:53728–53741.
27. Ori Ram, Yoav Levine, Itay Dalmedigos, Dor Muhlgay, Amnon Shashua, Kevin Leyton-Brown, and Yoav Shoham. 2023. [In-context retrieval-augmented language models](https://md.research.elamur.ai/free/en/papers/ram-2023-context-retrieval-augmented-language-models/). Transactions of the Association for Computational Linguistics, 11:1316–1331.
28. Hao Sun, Zile Qiao, Jiayan Guo, Xuanbo Fan, Yingyan Hou, Yong Jiang, Pengjun Xie, Yan Zhang, Fei Huang, and Jingren Zhou. 2025. [Zerosearch: Incentivize the search capability of llms without searching](https://md.research.elamur.ai/free/en/papers/sun-2025-zerosearch-incentivize-search-capability-llms/). arXiv preprint arXiv:2505.04588.
29. Qwen Team. 2025. Qwq-32b: Embracing the power of reinforcement learning. [find](https://scholar.google.com/scholar?q=Qwen+Team%2E+2025%2E+Qwq%2D32b%3A+Embracing+the+power+of+reinforcement+learning%2E)
30. Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal. 2022. Musique: Multi-hop questions via single-hop question composition. Transactions of the Association for Computational Linguistics, 10:539–554. [find](https://scholar.google.com/scholar?q=Harsh+Trivedi%2C+Niranjan+Balasubramanian%2C+Tushar+Khot%2C+and+Ashish+Sabharwal%2E+2022%2E+Musique%3A+Multi%2Dhop+questions+via+single%2Dhop+question+composition%2E+Transactions+of+the+Association+for+Computational+Li)
31. Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, and Ashish Sabharwal. 2023. [Interleaving retrieval with chain-of-thought reasoning for knowledge-intensive multi-step questions](https://md.research.elamur.ai/free/en/papers/trivedi-2022-interleaving-retrieval-chain-thought-reasoning/). In Proceedings of the 61st annual meeting of the association for computational linguistics (volume 1: long papers), p…
32. Gladys Tyen, Hassan Mansoor, Victor Cărbune, Yuanzhu Peter Chen, and Tony Mak. 2024. [Llms cannot find reasoning errors, but can correct them given the error location](https://md.research.elamur.ai/free/en/papers/tyen-2024-llms-cannot-find-reasoning-errors/). In Findings of the Association for Computational Linguistics: ACL 2024, pages 13894–13908.
33. Ruobing Wang, Qingfei Zhao, Yukun Yan, Daren Zha, Yuxuan Chen, Shi Yu, Zhenghao Liu, Yixuan Wang, Shuo Wang, Xu Han, Zhiyuan Liu, and Maosong Sun. 2025. DeepNote: Note-centric deep retrieval-augmented generation. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 19688–1… [find](https://scholar.google.com/scholar?q=Ruobing+Wang%2C+Qingfei+Zhao%2C+Yukun+Yan%2C+Daren+Zha%2C+Yuxuan+Chen%2C+Shi+Yu%2C+Zhenghao+Liu%2C+Yixuan+Wang%2C+Shuo+Wang%2C+Xu+Han%2C+Zhiyuan+Liu%2C+and+Maosong+Sun%2E+2025%2E+DeepNote%3A+Note%2Dcentric+deep+retrieval%2Daugmented)
34. Xiaohua Wang, Zhenghua Wang, Xuan Gao, Feiran Zhang, Yixin Wu, Zhibo Xu, Tianyuan Shi, Zhengyuan Wang, Shizheng Li, Qi Qian, and 1 others. 2024. [Searching for best practices in retrieval-augmented generation](https://md.research.elamur.ai/free/en/papers/wang-2024-searching-best-practices-retrieval-augmented/). In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing,…
35. Jason Wei, Nguyen Karina, Hyung Won Chung, Yunxin Joy Jiao, Spencer Papay, Amelia Glaese, John Schulman, and William Fedus. 2024. [Measuring short-form factuality in large language models](https://md.research.elamur.ai/free/en/papers/wei-2024-measuring-short-form-factuality-large/). arXiv preprint arXiv:2411.04368.
36. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). Advances in neural information processing systems, 35:24824– 24837.
37. Yixuan Weng, Minjun Zhu, Fei Xia, Bin Li, Shizhu He, Shengping Liu, Bin Sun, Kang Liu, and Jun Zhao. 2023. [Large language models are better reasoners with self-verification](https://md.research.elamur.ai/free/en/papers/weng-2023-large-language-models-are-better/). In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 2550–2575.
38. Shitao Xiao, Zheng Liu, Peitian Zhang, and Niklas Muennighoff. 2023. [C-pack: Packaged resources to advance general chinese embedding](https://md.research.elamur.ai/free/en/papers/xiao-2023-c-pack-packed-resources/). Preprint, arXiv:2309.07597.
39. Guangzhi Xiong, Qiao Jin, Xiao Wang, Yin Fang, Haolin Liu, Yifan Yang, Fangyuan Chen, Zhixing Song, Dengyu Wang, Minjia Zhang, and 1 others. 2025. Rag-gym: Optimizing reasoning and search agents with process supervision. arXiv preprint arXiv:2502.13957. — [arXiv:2502.13957](https://arxiv.org/abs/2502.13957) [find](https://scholar.google.com/scholar?q=Guangzhi+Xiong%2C+Qiao+Jin%2C+Xiao+Wang%2C+Yin+Fang%2C+Haolin+Liu%2C+Yifan+Yang%2C+Fangyuan+Chen%2C+Zhixing+Song%2C+Dengyu+Wang%2C+Minjia+Zhang%2C+and+1+others%2E+2025%2E+Rag%2Dgym%3A+Optimizing+reasoning+and+search+agents+with+)
40. An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, and 1 others. 2025. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/). arXiv preprint arXiv:2505.09388.
41. An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, and 22 others. 2024. Qwen2.5 technical report. arXiv preprint arXi… [find](https://scholar.google.com/scholar?q=An+Yang%2C+Baosong+Yang%2C+Beichen+Zhang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Haoran+Wei%2C+Huan+Lin%2C+Jian+Yang%2C+Jianhong+Tu%2C+Jianwei+Zhang%2C+Jianxin+Yang%2C+Jiaxi+Yang%2C+Jin)
42. Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, and Christopher D Manning. 2018. [Hotpotqa: A dataset for diverse, explainable multi-hop question answering](https://md.research.elamur.ai/free/en/papers/yang-2018-hotpotqa-dataset-diverse-explainable-multi/). In Proceedings of the 2018 conference on empirical methods in natural language processing, pages 2369–…
43. Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Tom Griffiths, Yuan Cao, and Karthik Narasimhan. 2023. Tree of thoughts: Deliberate problem solving with large language models. Advances in neural information processing systems, 36:11809–11822. [find](https://scholar.google.com/scholar?q=Shunyu+Yao%2C+Dian+Yu%2C+Jeffrey+Zhao%2C+Izhak+Shafran%2C+Tom+Griffiths%2C+Yuan+Cao%2C+and+Karthik+Narasimhan%2E+2023%2E+Tree+of+thoughts%3A+Deliberate+problem+solving+with+large+language+models%2E+Advances+in+neural+inf)
44. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik R Narasimhan, and Yuan Cao. 2022. [React: Synergizing reasoning and acting in language models](https://md.research.elamur.ai/free/en/papers/yao-2022-react-synergizing-reasoning-acting-language/). In The eleventh international conference on learning representations.
45. Zijun Yao, Yantao Liu, Yanxu Chen, Jianhui Chen, Junfeng Fang, Lei Hou, Juanzi Li, and Tat-Seng Chua. 2025. Are reasoning models more prone to hallucination? arXiv preprint arXiv:2505.23646. — [arXiv:2505.23646](https://arxiv.org/abs/2505.23646) [find](https://scholar.google.com/scholar?q=Zijun+Yao%2C+Yantao+Liu%2C+Yanxu+Chen%2C+Jianhui+Chen%2C+Junfeng+Fang%2C+Lei+Hou%2C+Juanzi+Li%2C+and+Tat%2DSeng+Chua%2E+2025%2E+Are+reasoning+models+more+prone+to+hallucination%3F+arXiv+preprint+arXiv%3A2505%2E23646%2E+%E2%80%94+%5BarXiv%3A)
46. Michihiro Yasunaga, Xinyun Chen, Yujia Li, Panupong Pasupat, Jure Leskovec, Percy Liang, Ed H. Chi, and Denny Zhou. 2024. [Large language models as analogical reasoners](https://md.research.elamur.ai/free/en/papers/yasunaga-2023-large-language-models-analogical-reasoners/). In International Conference on Learning Representations, volume 2024, pages 17019–17045.
47. Duzhen Zhang, Zhong-Zhi Li, Ming-Liang Zhang, Jiaxin Zhang, Zengyan Liu, Yuxuan Yao, Haotian Xu, Junhao Zheng, Xiuyi Chen, Yingying Zhang, Fei Yin, Jiahua Dong, Zhijiang Guo, Le Song, and Cheng-Lin Liu. 2026. [From System 1 to System 2: A Survey of Reasoning Large Language Models](https://md.research.elamur.ai/free/en/papers/li-2025-system-1-system-2-survey/) . IEEE Transactions…
48. Zhuosheng Zhang, Aston Zhang, Mu Li, and Alex Smola. 2023. [Automatic chain of thought prompting in large language models](https://md.research.elamur.ai/free/en/papers/zhang-2022-automatic-chain-thought-prompting-large/). In The Eleventh International Conference on Learning Representations.
49. Qingfei Zhao, Ruobing Wang, Yukuo Cen, Daren Zha, Shicheng Tan, Yuxiao Dong, and Jie Tang. 2024. LongRAG: A dual-perspective retrieval-augmented generation paradigm for long-context question answering. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 2… [find](https://scholar.google.com/scholar?q=Qingfei+Zhao%2C+Ruobing+Wang%2C+Yukuo+Cen%2C+Daren+Zha%2C+Shicheng+Tan%2C+Yuxiao+Dong%2C+and+Jie+Tang%2E+2024%2E+LongRAG%3A+A+dual%2Dperspective+retrieval%2Daugmented+generation+paradigm+for+long%2Dcontext+question+answering)
50. Qingfei Zhao, Ruobing Wang, Dingling Xu, Daren Zha, and Limin Liu. 2025. [R-search: Empowering llm reasoning with search via multi-reward reinforcement learning](https://md.research.elamur.ai/free/en/papers/zhao-2026-r-search-empowering-llm-reasoning/). arXiv preprint arXiv:2506.04185.
51. Denny Zhou, Nathanael Schärli, Le Hou, Jason Wei, Nathan Scales, Xuezhi Wang, Dale Schuurmans, Claire Cui, Olivier Bousquet, Quoc V Le, and Ed H. Chi. 2023. [Least-to-most prompting enables complex reasoning in large language models](https://md.research.elamur.ai/free/en/papers/al-2022-least-most-prompting-enables-complex/). In The Eleventh International Conference on Learning Representation…
52. Kunlun Zhu, Yifan Luo, Dingling Xu, Yukun Yan, Zhenghao Liu, Shi Yu, Ruobing Wang, Shuo Wang, Yishan Li, Nan Zhang, Xu Han, Zhiyuan Liu, and Maosong Sun. 2025. [RAGEval: Scenario specific RAG evaluation dataset generation framework](https://md.research.elamur.ai/free/en/papers/zhu-2025-rageval-scenario-specific-rag-evaluation/). In Proceedings of the 63rd Annual Meeting of the Association for Com…

*Updated 2 November 2026*