---
title: "Beyond Meta-Reasoning — paper by Zhuang et al. (2026)"
description: "The authors propose Metacognitive Consolidation, which draws on Anderson's idea of proceduralization: experience from past… 31 references."
authors: ["Ziqing Zhuang", "Linhai Zhang", "Jiasheng Si", "Deyu Zhou", "Yulan He"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.1095/"
doi: "10.18653/v1/2026.acl-long.1095"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhuang-2026-beyond-meta-reasoning-metacognitive-consolidation/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhuang-2026-beyond-meta-reasoning-metacognitive-consolidation/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/10/) / Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning

# Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning

**Authors:** [Ziqing Zhuang](https://md.research.elamur.ai/free/en/authors/ziqing-zhuang/), [Linhai Zhang](https://md.research.elamur.ai/free/en/authors/linhai-zhang/), [Jiasheng Si](https://md.research.elamur.ai/free/en/authors/jiasheng-si/), [Deyu Zhou](https://md.research.elamur.ai/free/en/authors/deyu-zhou/) and [Yulan He](https://md.research.elamur.ai/free/en/authors/yulan-he/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.1095/) · [PDF](https://aclanthology.org/2026.acl-long.1095.pdf) · [DOI 10.18653/v1/2026.acl-long.1095](https://doi.org/10.18653/v1/2026.acl-long.1095) · [OpenAlex](https://openalex.org/W7166838440)

**Citations:** 1 citations (OpenAlex, 2026-10-14)

## Summary

The paper addresses a gap in LLM meta-reasoning. Most current approaches are episodic: they plan or intervene within one problem and then discard what they learned. As a result, the same mistakes recur and the costly verification and retry routines run again from scratch. The authors propose Metacognitive Consolidation, which draws on Anderson's idea of proceduralization: experience from past reasoning episodes is turned into reusable procedural knowledge.

Their instantiation, MC², has two loops around a frozen backbone:

- **Inner loop (Meta-Reasoning Orchestrator, MRO):** solving is split among a Reasoner, a Monitor and a Controller. This produces explicit, attributable traces of each attempt, its critique and its correction.
- **Outer loop (MetaCognitive Accumulator, MCA):** these traces are distilled at several timescales into evolving meta-knowledge. That knowledge rewrites the role-specific prompts used on later instances.

Experiments across several benchmarks and backbone models report consistent gains over meta-reasoning baselines, and accuracy rises as experience accumulates (e.g., on MATH-500). The work matters because it converts per-instance test-time compute into lasting improvement without any fine-tuning.

## Key points

- **MRO loop:** the Monitor's report contains a verdict, the location of the first suspicious step and a short critique. The Controller then chooses ACCEPT, PATCH or RESTART, and the loop runs for at most N iterations.
- **MCA hierarchy:** knowledge is consolidated in three levels:
  - instance-level reflections, built by a deterministic extractor;
  - batch-level micro-lessons, formed through in-batch distillation;
  - slowly evolving global meta-knowledge.
  
  Separate streams are kept for the Reasoner, Monitor and Controller.
- **Learning mechanism:** all learning happens at test time through prompt-based policy updates (P_t → P_t+1). Model parameters stay unchanged, so the accumulated knowledge remains inspectable.
- **Positioning:** the method differs from memory approaches such as ReasoningBank, Reflexion, Buffer of Thoughts and ReasonFlux. Those store task-level solution content, whereas MC² stores knowledge about how to monitor and control reasoning.
- **Stated limitations:** consolidation is task-specific, with no cross-task transfer yet. The multiple roles add inference overhead. Internalizing the knowledge into weights is left for future work. The excerpt omits the detailed result tables, so specific scores are not reported here.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [The Alan Turing Institute](https://md.research.elamur.ai/free/en/labs/the-alan-turing-institute/) — Research institute, London, United Kingdom · 29 works · 4,368 citations
- [King's College London](https://md.research.elamur.ai/free/en/universities/king-s-college-london/) — University, London, United Kingdom · 42 works · 1,617 citations
- [Southeast University](https://md.research.elamur.ai/free/en/universities/southeast-university-cn/) — University, Nanjing, China · 28 works · 354 citations
- [Qilu University of Technology](https://md.research.elamur.ai/free/en/universities/qilu-university-of-technology/) — University, Jinan, China · 4 works · 3 citations
- [Shandong Academy of Sciences](https://md.research.elamur.ai/free/en/universities/shandong-academy-of-sciences/) — University, Jinan, China · 2 works · 1 citation

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,426 works

## Cite

Cite as: Ziqing Zhuang, Linhai Zhang, Jiasheng Si, Deyu Zhou and Yulan He. 2026. Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhuang2026beyond,
  title = {{Beyond Meta-Reasoning: Metacognitive Consolidation for Self-Improving LLM Reasoning}},
  author = {Ziqing Zhuang, Linhai Zhang, Jiasheng Si, Deyu Zhou and Yulan He},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.1095},
  url = {https://doi.org/10.18653/v1/2026.acl-long.1095}
}
```

- [← previous Beyond Compromise: Pareto-Lenient Consensus for Efficient Multi-Preference LLM Alignment](https://md.research.elamur.ai/free/en/papers/tan-2026-beyond-compromise-pareto-lenient-consensus/)
- [next → Beyond Static Personas: Situational Personality Steering for Large Language Models](https://md.research.elamur.ai/free/en/papers/wei-2026-beyond-static-personas-situational-personality/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/10/)

## References

31 references, 13 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Rakefet Ackerman and Valerie A. Thompson. 2017. Meta-reasoning: Monitoring and control of thinking and reasoning. Trends in Cognitive Sciences, 21(8):607–617. [find](https://scholar.google.com/scholar?q=Rakefet+Ackerman+and+Valerie+A%2E+Thompson%2E+2017%2E+Meta%2Dreasoning%3A+Monitoring+and+control+of+thinking+and+reasoning%2E+Trends+in+Cognitive+Sciences%2C+21%288%29%3A607%E2%80%93617%2E)
2. John R Anderson. 1982. Acquisition of cognitive skill. Psychological review, 89(4):369. [find](https://scholar.google.com/scholar?q=John+R+Anderson%2E+1982%2E+Acquisition+of+cognitive+skill%2E+Psychological+review%2C+89%284%29%3A369%2E)
3. Ali Behrouz, Meisam Razaviyayn, Peilin Zhong, and Vahab Mirrokni. 2025a. Nested learning: The illusion of deep learning architectures. In The Thirty-ninth Annual Conference on Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Ali+Behrouz%2C+Meisam+Razaviyayn%2C+Peilin+Zhong%2C+and+Vahab+Mirrokni%2E+2025a%2E+Nested+learning%3A+The+illusion+of+deep+learning+architectures%2E+In+The+Thirty%2Dninth+Annual+Conference+on+Neural+Information+Proce)
4. Ali Behrouz, Peilin Zhong, and Vahab Mirrokni. 2025b. Titans: Learning to memorize at test time. In The Thirty-ninth Annual Conference on Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Ali+Behrouz%2C+Peilin+Zhong%2C+and+Vahab+Mirrokni%2E+2025b%2E+Titans%3A+Learning+to+memorize+at+test+time%2E+In+The+Thirty%2Dninth+Annual+Conference+on+Neural+Information+Processing+Systems%2E)
5. Wenhu Chen, Ming Yin, Max Ku, Pan Lu, Yixin Wan, Xueguang Ma, Jianyu Xu, Xinyi Wang, and Tony Xia. 2023. [TheoremQA: A theorem-driven question answering dataset](https://md.research.elamur.ai/free/en/papers/chen-2023-theoremqa-theorem-driven-question-answering/). In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 7889–7901, Singapore. Association for Comp…
6. Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021. [Training verifiers to solve math word problems](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/). Preprint, arXiv:2110.14168.
7. Peizhong Gao, Ao Xie, Shaoguang Mao, Wenshan Wu, Yan Xia, Haipeng Mi, and Furu Wei. 2024. Meta reasoning for large language models. arXiv preprint arXiv:2406.11698. — [arXiv:2406.11698](https://arxiv.org/abs/2406.11698) [find](https://scholar.google.com/scholar?q=Peizhong+Gao%2C+Ao+Xie%2C+Shaoguang+Mao%2C+Wenshan+Wu%2C+Yan+Xia%2C+Haipeng+Mi%2C+and+Furu+Wei%2E+2024%2E+Meta+reasoning+for+large+language+models%2E+arXiv+preprint+arXiv%3A2406%2E11698%2E+%E2%80%94+%5BarXiv%3A2406%2E11698%5D%28https%3A%2F%2Farxiv%2E)
8. Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, and 1 others. 2025. [Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2025-deepseek-r1-incentivizing-reasoning-capability/). arXiv preprint arXiv:2501.12948.
9. Yancheng He, Shilong Li, Jiaheng Liu, Weixun Wang, Xingyuan Bu, Ge Zhang, Z.y. Peng, Zhaoxiang Zhang, Zhicheng Zheng, Wenbo Su, and Bo Zheng. 2025. [Can large language models detect errors in long chain-of-thought reasoning?](https://md.research.elamur.ai/free/en/papers/he-2025-can-large-language-models-detect/) In Proceedings of the 63rd Annual Meeting of the Association for Computation…
10. Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021. [Measuring mathematical problem solving with the MATH dataset](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/). In Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 2).
11. Qin Liu, Wenxuan Zhou, Nan Xu, James Y. Huang, Fei Wang, Sheng Zhang, Hoifung Poon, and Muhao Chen. 2025. [Metascale: Test-time scaling with evolving meta-thoughts](https://md.research.elamur.ai/free/en/papers/liu-2026-metascale-test-time-scaling-evolving/). Preprint, arXiv:2503.13447.
12. Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark. 2023. Self-refine: Iterative refinement with… [find](https://scholar.google.com/scholar?q=Aman+Madaan%2C+Niket+Tandon%2C+Prakhar+Gupta%2C+Skyler+Hallinan%2C+Luyu+Gao%2C+Sarah+Wiegreffe%2C+Uri+Alon%2C+Nouha+Dziri%2C+Shrimai+Prabhumoye%2C+Yiming+Yang%2C+Shashank+Gupta%2C+Bodhisattwa+Prasad+Majumder%2C+Katherine+Her)
13. OpenAI, Aaron Jaech, Adam Kalai, Adam Lerer, Adam Richardson, Ahmed El-Kishky, Aiden Low, Alec Helyar, Aleksander Madry, Alex Beutel, Alex Carney, Alex Iftimie, Alex Karpenko, Alex Tachard Passos, Alexander Neitz, Alexander Prokofiev, Alexander Wei, Allison Tam, Ally Bennett, and 243 others. 2024. O… — [OpenAI o1 System Card](https://md.research.elamur.ai/free/en/papers/openai-2024-openai-o1-system-card/)
14. Siru Ouyang, Jun Yan, I-Hung Hsu, Yanfei Chen, Ke Jiang, Zifeng Wang, Rujun Han, Long T. Le, Samira Daruki, Xiangru Tang, Vishy Tirumalashetty, George Lee, Mahsan Rofouei, Hangfei Lin, Jiawei Han, Chen-Yu Lee, and Tomas Pfister. 2025. Reasoningbank: Scaling agent self-evolving with reasoning memory.… — [arXiv:2509.25140](https://arxiv.org/abs/2509.25140) [find](https://scholar.google.com/scholar?q=Siru+Ouyang%2C+Jun+Yan%2C+I%2DHung+Hsu%2C+Yanfei+Chen%2C+Ke+Jiang%2C+Zifeng+Wang%2C+Rujun+Han%2C+Long+T%2E+Le%2C+Samira+Daruki%2C+Xiangru+Tang%2C+Vishy+Tirumalashetty%2C+George+Lee%2C+Mahsan+Rofouei%2C+Hangfei+Lin%2C+Jiawei+Han%2C+Che)
15. Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik R Narasimhan, and Shunyu Yao. 2023. [Reflexion: language agents with verbal reinforcement learning](https://md.research.elamur.ai/free/en/papers/shinn-2023-reflexion-language-agents-verbal-reinforcement/). In Thirty-seventh Conference on Neural Information Processing Systems.
16. Charlie Victor Snell, Jaehoon Lee, Kelvin Xu, and Aviral Kumar. 2025. Scaling LLM test-time compute optimally can be more effective than scaling parameters for reasoning. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Charlie+Victor+Snell%2C+Jaehoon+Lee%2C+Kelvin+Xu%2C+and+Aviral+Kumar%2E+2025%2E+Scaling+LLM+test%2Dtime+compute+optimally+can+be+more+effective+than+scaling+parameters+for+reasoning%2E+In+The+Thirteenth+Internation)
17. Yuan Sui, Yufei He, Tri Cao, Simeng Han, Yulin Chen, and Bryan Hooi. 2025. [Meta-reasoner: Dynamic guidance for optimized inference-time reasoning in large language models](https://md.research.elamur.ai/free/en/papers/sui-2026-meta-reasoner-dynamic-guidance-optimized/). Preprint, arXiv:2502.19918.
18. Mirac Suzgun and Adam Tauman Kalai. 2024. [Meta-prompting: Enhancing language models with task-agnostic scaffolding](https://md.research.elamur.ai/free/en/papers/suzgun-2024-meta-prompting-enhancing-language-models/). arXiv preprint arXiv:2401.12954.
19. Hexiang Tan, Fei Sun, Sha Liu, Du Su, Qi Cao, Xin Chen, Jingang Wang, Xunliang Cai, Yuanzhuo Wang, Huawei Shen, and Xueqi Cheng. 2025. [Too consistent to detect: A study of self-consistent errors in LLMs](https://md.research.elamur.ai/free/en/papers/tan-2025-too-consistent-detect-study-self/). In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages…
20. Ziyu Wan, Yunxiang LI, Xiaoyu Wen, Yan Song, Hanjing Wang, Linyi Yang, Mark Schmidt, Jun Wang, Weinan Zhang, Shuyue Hu, and Ying Wen. 2025. ReMA: Learning to meta-think for LLMs with multi-agent reinforcement learning. In The Thirty-ninth Annual Conference on Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Ziyu+Wan%2C+Yunxiang+LI%2C+Xiaoyu+Wen%2C+Yan+Song%2C+Hanjing+Wang%2C+Linyi+Yang%2C+Mark+Schmidt%2C+Jun+Wang%2C+Weinan+Zhang%2C+Shuyue+Hu%2C+and+Ying+Wen%2E+2025%2E+ReMA%3A+Learning+to+meta%2Dthink+for+LLMs+with+multi%2Dagent+reinf)
21. Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2023. [Self-consistency improves chain of thought reasoning in language models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/). In The Eleventh International Conference on Learning Representations.
22. Yuqing Wang and Yun Zhao. 2024. Metacognitive prompting improves understanding in large language models. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), pages 1914–1926, Mexico… [find](https://scholar.google.com/scholar?q=Yuqing+Wang+and+Yun+Zhao%2E+2024%2E+Metacognitive+prompting+improves+understanding+in+large+language+models%2E+In+Proceedings+of+the+2024+Conference+of+the+North+American+Chapter+of+the+Association+for+Comp)
23. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed H. Chi, Quoc V Le, and Denny Zhou. 2022. [Chain of thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). In Advances in Neural Information Processing Systems.
24. Yangzhen Wu, Zhiqing Sun, Shanda Li, Sean Welleck, and Yiming Yang. 2025. Inference scaling laws: An empirical analysis of compute-optimal inference for LLM problem-solving. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Yangzhen+Wu%2C+Zhiqing+Sun%2C+Shanda+Li%2C+Sean+Welleck%2C+and+Yiming+Yang%2E+2025%2E+Inference+scaling+laws%3A+An+empirical+analysis+of+compute%2Doptimal+inference+for+LLM+problem%2Dsolving%2E+In+The+Thirteenth+Internat)
25. Jun Xu, Xinkai Du, Yu Ao, Peilong Zhao, Yang Li, Ling Zhong, Lin Yuan, Zhongpu Bo, Xiaorui Wang, Mengshu Sun, and 1 others. 2025. Thinker: Training llms in hierarchical thinking for deep search via multi-turn interaction. arXiv preprint arXiv:2511.07943. — [arXiv:2511.07943](https://arxiv.org/abs/2511.07943) [find](https://scholar.google.com/scholar?q=Jun+Xu%2C+Xinkai+Du%2C+Yu+Ao%2C+Peilong+Zhao%2C+Yang+Li%2C+Ling+Zhong%2C+Lin+Yuan%2C+Zhongpu+Bo%2C+Xiaorui+Wang%2C+Mengshu+Sun%2C+and+1+others%2E+2025%2E+Thinker%3A+Training+llms+in+hierarchical+thinking+for+deep+search+via+mu)
26. Hanqi Yan, Linhai Zhang, Jiazheng Li, Zhenyi Shen, and Yulan He. 2025. Position: LLMs need a bayesian meta-reasoning framework for more robust and generalizable reasoning. In Forty-second International Conference on Machine Learning Position Paper Track. [find](https://scholar.google.com/scholar?q=Hanqi+Yan%2C+Linhai+Zhang%2C+Jiazheng+Li%2C+Zhenyi+Shen%2C+and+Yulan+He%2E+2025%2E+Position%3A+LLMs+need+a+bayesian+meta%2Dreasoning+framework+for+more+robust+and+generalizable+reasoning%2E+In+Forty%2Dsecond+Internationa)
27. Chenxu Yang, Qingyi Si, Mz Dai, Dingyu Yao, Mingyu Zheng, Minghui Chen, Zheng Lin, and Weiping Wang. 2025. Test-time prompt intervention. arXiv preprint arXiv:2508.02511. — [arXiv:2508.02511](https://arxiv.org/abs/2508.02511) [find](https://scholar.google.com/scholar?q=Chenxu+Yang%2C+Qingyi+Si%2C+Mz+Dai%2C+Dingyu+Yao%2C+Mingyu+Zheng%2C+Minghui+Chen%2C+Zheng+Lin%2C+and+Weiping+Wang%2E+2025%2E+Test%2Dtime+prompt+intervention%2E+arXiv+preprint+arXiv%3A2508%2E02511%2E+%E2%80%94+%5BarXiv%3A2508%2E02511%5D%28https%3A%2F%2F)
28. Ling Yang, Zhaochen Yu, Tianjun Zhang, Shiyi Cao, Minkai Xu, Wentao Zhang, Joseph E. Gonzalez, and Bin CUI. 2024. Buffer of thoughts: Thought-augmented reasoning with large language models. In The Thirty-eighth Annual Conference on Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Ling+Yang%2C+Zhaochen+Yu%2C+Tianjun+Zhang%2C+Shiyi+Cao%2C+Minkai+Xu%2C+Wentao+Zhang%2C+Joseph+E%2E+Gonzalez%2C+and+Bin+CUI%2E+2024%2E+Buffer+of+thoughts%3A+Thought%2Daugmented+reasoning+with+large+language+models%2E+In+The+Thi)
29. Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, and Karthik R Narasimhan. 2023. Tree of thoughts: Deliberate problem solving with large language models. In Thirty-seventh Conference on Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Shunyu+Yao%2C+Dian+Yu%2C+Jeffrey+Zhao%2C+Izhak+Shafran%2C+Thomas+L%2E+Griffiths%2C+Yuan+Cao%2C+and+Karthik+R+Narasimhan%2E+2023%2E+Tree+of+thoughts%3A+Deliberate+problem+solving+with+large+language+models%2E+In+Thirty%2Dseve)
30. Zijing Zhang, Ziyang Chen, Mingxiao Li, Zhaopeng Tu, and Xiaolong Li. 2025. Rlvmr: Reinforcement learning with verifiable meta-reasoning rewards for robust long-horizon agents. arXiv preprint arXiv:2507.22844. — [arXiv:2507.22844](https://arxiv.org/abs/2507.22844) [find](https://scholar.google.com/scholar?q=Zijing+Zhang%2C+Ziyang+Chen%2C+Mingxiao+Li%2C+Zhaopeng+Tu%2C+and+Xiaolong+Li%2E+2025%2E+Rlvmr%3A+Reinforcement+learning+with+verifiable+meta%2Dreasoning+rewards+for+robust+long%2Dhorizon+agents%2E+arXiv+preprint+arXiv%3A25)
31. Jiaru Zou, Ling Yang, Jingwen Gu, Jiahao Qiu, Ke Shen, Jingrui He, and Mengdi Wang. 2025. Reasonflux-PRM: Trajectory-aware PRMs for long chain-of-thought reasoning in LLMs. In The Thirty-ninth Annual Conference on Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Jiaru+Zou%2C+Ling+Yang%2C+Jingwen+Gu%2C+Jiahao+Qiu%2C+Ke+Shen%2C+Jingrui+He%2C+and+Mengdi+Wang%2E+2025%2E+Reasonflux%2DPRM%3A+Trajectory%2Daware+PRMs+for+long+chain%2Dof%2Dthought+reasoning+in+LLMs%2E+In+The+Thirty%2Dninth+Annual+)

*Updated 1 November 2026*