---
title: "Blind Spot Navigation in Large Language Model Reasoning with"
description: "As a result, they keep returning to familiar directions and miss parts of the solution space the authors… 54 references, cited by 1 paper here."
authors: ["Jinghan Zhang", "Fengran Mo", "Tharindu Cyril Weerasooriya", "Xinyue Ye", "Dongjie Wang", "Yanjie Fu", "Kunpeng Liu"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: EACL 2026"
source: "https://aclanthology.org/2026.findings-eacl.191/"
doi: "10.18653/v1/2026.findings-eacl.191"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhang-2026-blind-spot-navigation-large-language/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhang-2026-blind-spot-navigation-large-language/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/) / Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorer

# Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorer

**Authors:** [Jinghan Zhang](https://md.research.elamur.ai/free/en/authors/jinghan-zhang/), [Fengran Mo](https://md.research.elamur.ai/free/en/authors/fengran-mo/), Tharindu Cyril Weerasooriya, Xinyue Ye, [Dongjie Wang](https://md.research.elamur.ai/free/en/authors/dongjie-wang/), [Yanjie Fu](https://md.research.elamur.ai/free/en/authors/yanjie-fu/) and [Kunpeng Liu](https://md.research.elamur.ai/free/en/authors/kunpeng-liu/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: EACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-eacl.191/) · [PDF](https://aclanthology.org/2026.findings-eacl.191.pdf) · [DOI 10.18653/v1/2026.findings-eacl.191](https://doi.org/10.18653/v1/2026.findings-eacl.191) · [OpenAlex](https://openalex.org/W7140144297)

**Citations:** 2 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/zhang-2026-blind-spot-navigation-large-language/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Tree-like and multi-chain prompting methods such as ToT usually refine or extend reasoning paths the model has already produced. As a result, they keep returning to familiar directions and miss parts of the solution space the authors call "blind spots." This paper proposes Thought Space Explorer (TSE) to push LLMs into those unexplored regions.

TSE works in three stages:
1. It scores each reasoning step's influence on the conclusion, using relative gradients, and keeps the most important ones as key nodes.
2. It creates a new node by fusing information from two key nodes in different chains, then grows fresh branches from that node.
3. It reasons jointly over the whole expanded structure to produce the answer.

For black-box models, the gradient-based steps are replaced by the LLM's own semantic judgment and self-evaluation.

The method was tested with Qwen3-4B and Qwen3-8B on math and QA benchmarks. TSE achieves the best average accuracy, more diverse and more correct intermediate paths, and a favourable token–accuracy balance. This makes structured reasoning more practical under limited compute.

## Key points
- Benchmarks are GSM8K, AIME24, AIME25 and GPQA-Diamond. Baselines are Direct output, Think, ToT, RATT and Self-Route.
- On average accuracy, TSE scores 64.8% with Qwen3-4B (next best is Think at 61.5%) and 65.5% with Qwen3-8B (next best is Self-Route at 64.4%). TSE does not win every single benchmark.
- With Qwen3-4B, TSE reaches 66.7% on AIME24 and 50.0% on AIME25. With Qwen3-8B, it reaches 53.3% on AIME25, compared with 23.3% for Direct output.
- Path diversity was measured as 1 minus the mean Jaccard similarity between reasoning steps. On GPQA-D, TSE produced the most diverse paths, ahead of the tree-based ToT and RATT.
- On AIME24 with Qwen3-8B, TSE shows the best token-versus-accuracy trade-off. ToT's exponential token growth put it off the chart. Stated limitations include:
  - extra cost compared with direct decoding;
  - dependence on prompt quality in the black-box variant;
  - no tests yet in domains such as legal or medical reasoning.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Université de Montréal](https://md.research.elamur.ai/free/en/universities/universite-de-montreal/) — University, Montreal, Canada · 68 works · 79,382 citations
- [Arizona State University](https://md.research.elamur.ai/free/en/universities/arizona-state-university/) — University, Tempe, United States · 50 works · 2,032 citations
- [Accenture](https://md.research.elamur.ai/free/en/companies/accenture/) — Company, Zurich, Switzerland · 6 works · 27 citations
- [University of Kansas](https://md.research.elamur.ai/free/en/universities/university-of-kansas/) — University, Lawrence, United States · 8 works · 32 citations
- [University of Alabama](https://md.research.elamur.ai/free/en/universities/university-of-alabama/) — University, Tuscaloosa, United States · 6 works · 403 citations
- [Clemson University](https://md.research.elamur.ai/free/en/universities/clemson-university/) — University, Clemson, United States · 2 works · 28 citations
- [Accenture (United States)](https://md.research.elamur.ai/free/en/companies/accenture-united-states/) — Company, New York, United States · 5 works · 261 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,426 works

## Cite

Cite as: Jinghan Zhang, Fengran Mo, Tharindu Cyril Weerasooriya, Xinyue Ye, Dongjie Wang, Yanjie Fu and Kunpeng Liu. 2026. Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorer. Findings of the Association for Computational Linguistics: EACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhang2026blind,
  title = {{Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorer}},
  author = {Jinghan Zhang, Fengran Mo, Tharindu Cyril Weerasooriya, Xinyue Ye, Dongjie Wang, Yanjie Fu and Kunpeng Liu},
  booktitle = {Findings of the Association for Computational Linguistics: EACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-eacl.191},
  url = {https://doi.org/10.18653/v1/2026.findings-eacl.191}
}
```

- [← previous Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMs](https://md.research.elamur.ai/free/en/papers/xu-2026-bit-bit-progressive-qat-strategy/)
- [next → Breaking the Illusion of Reasoning in Polish LLMs: Quality over Quantity of Thought](https://md.research.elamur.ai/free/en/papers/pihulski-2026-breaking-illusion-reasoning-polish-llms/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/)

## References

54 references, 17 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, and 1 others. 2023. [Gpt-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). arXiv preprint arXiv:2303.08774.
2. Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Michal Podstawski, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Hubert Niewiadomski, Piotr Nyczyk, and 1 others. 2024. Graph of thoughts: Solving elaborate problems with large language models. In Proceedings of the AAAI Conference on A… [find](https://scholar.google.com/scholar?q=Maciej+Besta%2C+Nils+Blach%2C+Ales+Kubicek%2C+Robert+Gerstenberger%2C+Michal+Podstawski%2C+Lukas+Gianinazzi%2C+Joanna+Gajda%2C+Tomasz+Lehmann%2C+Hubert+Niewiadomski%2C+Piotr+Nyczyk%2C+and+1+others%2E+2024%2E+Graph+of+thought)
3. Qiguang Chen, Libo Qin, Jinhao Liu, Dengyun Peng, Jiannan Guan, Peng Wang, Mengkang Hu, Yuhang Zhou, Te Gao, and Wanxiang Che. 2025. [Towards reasoning era: A survey of long chain-of-thought for reasoning large language models](https://md.research.elamur.ai/free/en/papers/chen-2025-towards-reasoning-era-survey-long/). arXiv preprint arXiv:2503.09567.
4. Zheng Chu, Jingchang Chen, Qianglong Chen, Weijiang Yu, Tao He, Haotian Wang, Weihua Peng, Ming Liu, Bing Qin, and Ting Liu. 2023. A survey of chain of thought reasoning: Advances, frontiers and future. arXiv preprint arXiv:2309.15402. [find](https://scholar.google.com/scholar?q=Zheng+Chu%2C+Jingchang+Chen%2C+Qianglong+Chen%2C+Weijiang+Yu%2C+Tao+He%2C+Haotian+Wang%2C+Weihua+Peng%2C+Ming+Liu%2C+Bing+Qin%2C+and+Ting+Liu%2E+2023%2E+A+survey+of+chain+of+thought+reasoning%3A+Advances%2C+frontiers+and+futur)
5. Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, and 1 others. 2021. [Training verifiers to solve math word problems](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/). arXiv preprint arXiv:2110.14168.
6. Sujan Dutta, Deepak Pandita, Tharindu Cyril Weerasooriya, Marcos Zampieri, Christopher M Homan, and Ashiqur R KhudaBukhsh. 2025. Annotator reliability through in-context learning (student abstract). In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 29356–29358. [find](https://scholar.google.com/scholar?q=Sujan+Dutta%2C+Deepak+Pandita%2C+Tharindu+Cyril+Weerasooriya%2C+Marcos+Zampieri%2C+Christopher+M+Homan%2C+and+Ashiqur+R+KhudaBukhsh%2E+2025%2E+Annotator+reliability+through+in%2Dcontext+learning+%28student+abstract%29%2E+I)
7. Xidong Feng, Ziyu Wan, Muning Wen, Stephen Marcus McAleer, Ying Wen, Weinan Zhang, and Jun Wang. 2023. Alphazero-like tree-search can guide large language model decoding and training. arXiv preprint arXiv:2309.17179. [find](https://scholar.google.com/scholar?q=Xidong+Feng%2C+Ziyu+Wan%2C+Muning+Wen%2C+Stephen+Marcus+McAleer%2C+Ying+Wen%2C+Weinan+Zhang%2C+and+Jun+Wang%2E+2023%2E+Alphazero%2Dlike+tree%2Dsearch+can+guide+large+language+model+decoding+and+training%2E+arXiv+preprint+a)
8. Zitian Gao, Boye Niu, Xuzheng He, Haotian Xu, Hongzhang Liu, Aiwei Liu, Xuming Hu, and Lijie Wen. 2024. Interpretable contrastive monte carlo tree search reasoning. arXiv preprint arXiv:2410.01707. — [arXiv:2410.01707](https://arxiv.org/abs/2410.01707) [find](https://scholar.google.com/scholar?q=Zitian+Gao%2C+Boye+Niu%2C+Xuzheng+He%2C+Haotian+Xu%2C+Hongzhang+Liu%2C+Aiwei+Liu%2C+Xuming+Hu%2C+and+Lijie+Wen%2E+2024%2E+Interpretable+contrastive+monte+carlo+tree+search+reasoning%2E+arXiv+preprint+arXiv%3A2410%2E01707%2E+%E2%80%94+)
9. Kye Gomez. 2023. Tree of thoughts. [https://github.com/kyegomez/tree-of-thoughts](https://github.com/kyegomez/tree-of-thoughts). [↗](https://github.com/kyegomez/tree-of-thoughts)
10. Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhiting Hu. 2023. Reasoning with language model is planning with world model. arXiv preprint arXiv:2305.14992. [find](https://scholar.google.com/scholar?q=Shibo+Hao%2C+Yi+Gu%2C+Haodi+Ma%2C+Joshua+Jiahua+Hong%2C+Zhen+Wang%2C+Daisy+Zhe+Wang%2C+and+Zhiting+Hu%2E+2023%2E+Reasoning+with+language+model+is+planning+with+world+model%2E+arXiv+preprint+arXiv%3A2305%2E14992%2E)
11. Yang He, Xiao Ding, Bibo Cai, Yufei Zhang, Kai Xiong, Zhouhao Sun, Bing Qin, and Ting Liu. 2025. Self-route: Automatic mode switching via capability estimation for efficient reasoning. arXiv preprint arXiv:2505.20664. — [arXiv:2505.20664](https://arxiv.org/abs/2505.20664) [find](https://scholar.google.com/scholar?q=Yang+He%2C+Xiao+Ding%2C+Bibo+Cai%2C+Yufei+Zhang%2C+Kai+Xiong%2C+Zhouhao+Sun%2C+Bing+Qin%2C+and+Ting+Liu%2E+2025%2E+Self%2Droute%3A+Automatic+mode+switching+via+capability+estimation+for+efficient+reasoning%2E+arXiv+preprint+)
12. Guiyang Hou, Wenqi Zhang, Yongliang Shen, Linjuan Wu, and Weiming Lu. 2024. Timetom: Temporal space is the key to unlocking the door of large language models’ theory-of-mind. arXiv preprint arXiv:2407.01455. [find](https://scholar.google.com/scholar?q=Guiyang+Hou%2C+Wenqi+Zhang%2C+Yongliang+Shen%2C+Linjuan+Wu%2C+and+Weiming+Lu%2E+2024%2E+Timetom%3A+Temporal+space+is+the+key+to+unlocking+the+door+of+large+language+models%E2%80%99+theory%2Dof%2Dmind%2E+arXiv+preprint+arXiv%3A2407)
13. Jie Huang and Kevin Chen-Chuan Chang. 2022. [Towards reasoning in large language models: A survey](https://md.research.elamur.ai/free/en/papers/huang-2023-reasoning-large-language-models-survey/). arXiv preprint arXiv:2212.10403.
14. Hugging Face. 2024. Llama-3.1-8B-Instruct. [find](https://scholar.google.com/scholar?q=Hugging+Face%2E+2024%2E+Llama%2D3%2E1%2D8B%2DInstruct%2E)
15. Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, and 1 others. 2024. [Gpt-4o system card](https://md.research.elamur.ai/free/en/papers/openai-2024-gpt-4o-system-card/). arXiv preprint arXiv:2410.21276.
16. Ziqi Jin and Wei Lu. 2024. Self-harmonized chain of thought. arXiv preprint arXiv:2409.04057. [find](https://scholar.google.com/scholar?q=Ziqi+Jin+and+Wei+Lu%2E+2024%2E+Self%2Dharmonized+chain+of+thought%2E+arXiv+preprint+arXiv%3A2409%2E04057%2E)
17. Jaehun Jung, Lianhui Qin, Sean Welleck, Faeze Brahman, Chandra Bhagavatula, Ronan Le Bras, and Yejin Choi. 2022. [Maieutic prompting: Logically consistent reasoning with recursive explanations](https://md.research.elamur.ai/free/en/papers/jung-2022-maieutic-prompting-logically-consistent-reasoning/). arXiv preprint arXiv:2205.11822.
18. Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. [Large language models are zero-shot reasoners](https://md.research.elamur.ai/free/en/papers/kojima-2022-large-language-models-zero-shot/). Advances in neural information processing systems, 35:22199– 22213.
19. Suphakit Niwattanakul, Jatsada Singthongchai, Ekkachai Naenudorn, and Supachanun Wanapu. 2013. Using of jaccard coefficient for keywords similarity. In Proceedings of the international multiconference of engineers and computer scientists, volume 1, pages 380–384. [find](https://scholar.google.com/scholar?q=Suphakit+Niwattanakul%2C+Jatsada+Singthongchai%2C+Ekkachai+Naenudorn%2C+and+Supachanun+Wanapu%2E+2013%2E+Using+of+jaccard+coefficient+for+keywords+similarity%2E+In+Proceedings+of+the+international+multiconference)
20. OpenAI. 2023. Gpt-4. [https://openai.com/index/](https://openai.com/index/) gpt-4-research/. [↗](https://openai.com/index/)
21. OpenAI. 2024. GPT-4o-mini: Advancing Cost-Efficient Intelligence. Accessed: 2024-10-05. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2024%2E+GPT%2D4o%2Dmini%3A+Advancing+Cost%2DEfficient+Intelligence%2E+Accessed%3A+2024%2D10%2D05%2E)
22. Zhiyuan Li, Hong Liu, Denny Zhou, and Tengyu Ma. 2024. Chain of thought empowers transformers to solve inherently serial problems. arXiv preprint arXiv:2402.12875. [find](https://scholar.google.com/scholar?q=Zhiyuan+Li%2C+Hong+Liu%2C+Denny+Zhou%2C+and+Tengyu+Ma%2E+2024%2E+Chain+of+thought+empowers+transformers+to+solve+inherently+serial+problems%2E+arXiv+preprint+arXiv%3A2402%2E12875%2E)
23. Qianjun Pan, Wenkai Ji, Yuyang Ding, Junsong Li, Shilian Chen, Junyi Wang, Jie Zhou, Qin Chen, Min Zhang, Yulan Wu, and 1 others. 2025. A survey of slow thinking-based reasoning llms using reinforced learning and inference-time scaling law. arXiv preprint arXiv:2505.02665. [find](https://scholar.google.com/scholar?q=Qianjun+Pan%2C+Wenkai+Ji%2C+Yuyang+Ding%2C+Junsong+Li%2C+Shilian+Chen%2C+Junyi+Wang%2C+Jie+Zhou%2C+Qin+Chen%2C+Min+Zhang%2C+Yulan+Wu%2C+and+1+others%2E+2025%2E+A+survey+of+slow+thinking%2Dbased+reasoning+llms+using+reinforced+)
24. Xun Liang, Shichao Song, Zifan Zheng, Hanyu Wang, Qingchen Yu, Xunkai Li, Rong-Hua Li, Feiyu Xiong, and Zhiyu Li. 2024. Internal consistency and self-feedback in [large language models: A survey](https://md.research.elamur.ai/free/en/papers/minaee-2024-large-language-models-survey/). arXiv preprint arXiv:2407.14507. — [arXiv:2407.14507](https://arxiv.org/abs/2407.14507)
25. Deepak Pandita, Tharindu Cyril Weerasooriya, Ankit Parag Shah, Christopher M Homan, and Wei Wei. 2025. Prorefine: Inference-time prompt refinement with textual feedback. arXiv preprint arXiv:2506.05305. — [arXiv:2506.05305](https://arxiv.org/abs/2506.05305) [find](https://scholar.google.com/scholar?q=Deepak+Pandita%2C+Tharindu+Cyril+Weerasooriya%2C+Ankit+Parag+Shah%2C+Christopher+M+Homan%2C+and+Wei+Wei%2E+2025%2E+Prorefine%3A+Inference%2Dtime+prompt+refinement+with+textual+feedback%2E+arXiv+preprint+arXiv%3A2506%2E0530)
26. Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. 2023. [Let’s verify step by step](https://md.research.elamur.ai/free/en/papers/lightman-2023-let-s-verify-step-step/). In The Twelfth International Conference on Learning Representations.
27. David Patterson, Joseph Gonzalez, Urs Hölzle, Quoc Le, Chen Liang, Lluis-Miquel Munguia, Daniel Rothchild, David R So, Maud Texier, and Jeff Dean. 2022. The carbon footprint of machine learning training will plateau, then shrink. Computer, 55(7):18– 28. [find](https://scholar.google.com/scholar?q=David+Patterson%2C+Joseph+Gonzalez%2C+Urs+H%C3%B6lzle%2C+Quoc+Le%2C+Chen+Liang%2C+Lluis%2DMiquel+Munguia%2C+Daniel+Rothchild%2C+David+R+So%2C+Maud+Texier%2C+and+Jeff+Dean%2E+2022%2E+The+carbon+footprint+of+machine+learning+traini)
28. Ryan Liu, Jiayi Geng, Addison J. Wu, Ilia Sucholutsky, Tania Lombrozo, and Thomas L. Griffiths. 2025. Mind your step (by step): Chain-of-thought can reduce performance on tasks where thinking makes humans worse. Preprint, arXiv:2410.21333. — [arXiv:2410.21333](https://arxiv.org/abs/2410.21333) [find](https://scholar.google.com/scholar?q=Ryan+Liu%2C+Jiayi+Geng%2C+Addison+J%2E+Wu%2C+Ilia+Sucholutsky%2C+Tania+Lombrozo%2C+and+Thomas+L%2E+Griffiths%2E+2025%2E+Mind+your+step+%28by+step%29%3A+Chain%2Dof%2Dthought+can+reduce+performance+on+tasks+where+thinking+makes+hu)
29. Tongxuan Liu, Wenjiang Xu, Weizhe Huang, Xingyu Wang, Jiaxing Wang, Hailong Yang, and Jing Li. 2024. Logic-of-thought: Injecting logic into contexts for full reasoning in large language models. arXiv preprint arXiv:2409.17539. [find](https://scholar.google.com/scholar?q=Tongxuan+Liu%2C+Wenjiang+Xu%2C+Weizhe+Huang%2C+Xingyu+Wang%2C+Jiaxing+Wang%2C+Hailong+Yang%2C+and+Jing+Li%2E+2024%2E+Logic%2Dof%2Dthought%3A+Injecting+logic+into+contexts+for+full+reasoning+in+large+language+models%2E+arXiv+)
30. Jieyi Long. 2023. Large language model guided tree-of-thought. arXiv preprint arXiv:2305.08291. [find](https://scholar.google.com/scholar?q=Jieyi+Long%2E+2023%2E+Large+language+model+guided+tree%2Dof%2Dthought%2E+arXiv+preprint+arXiv%3A2305%2E08291%2E)
31. Kelong Mao, Zhicheng Dou, Fengran Mo, Jiewen Hou, Haonan Chen, and Hongjin Qian. 2023. Large language models know your contextual search intent: A prompting framework for conversational search. Preprint, arXiv:2303.06573. [find](https://scholar.google.com/scholar?q=Kelong+Mao%2C+Zhicheng+Dou%2C+Fengran+Mo%2C+Jiewen+Hou%2C+Haonan+Chen%2C+and+Hongjin+Qian%2E+2023%2E+Large+language+models+know+your+contextual+search+intent%3A+A+prompting+framework+for+conversational+search%2E+Prepri)
32. Math-AI. 2024. Aime 2024. [https://huggingface.co/datasets/math-ai/aime24](https://huggingface.co/datasets/math-ai/aime24). Accessed: 2025-10-06. [↗](https://huggingface.co/datasets/math-ai/aime24)
33. Math-AI. 2025. Aime 2025. [https://huggingface.co/datasets/math-ai/aime25](https://huggingface.co/datasets/math-ai/aime25). Accessed: 2025-10-06. [↗](https://huggingface.co/datasets/math-ai/aime25)
34. Shentong Mo and Miao Xin. 2024. Tree of uncertain thoughts reasoning for large language models. In ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 12742–12746. IEEE. [find](https://scholar.google.com/scholar?q=Shentong+Mo+and+Miao+Xin%2E+2024%2E+Tree+of+uncertain+thoughts+reasoning+for+large+language+models%2E+In+ICASSP+2024%2D2024+IEEE+International+Conference+on+Acoustics%2C+Speech+and+Signal+Processing+%28ICASSP%29%2C+p)
35. David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R Bowman. 2024. [Gpqa: A graduate-level google-proof q&a benchmark](https://md.research.elamur.ai/free/en/papers/rein-2023-gpqa-graduate-level-google-proof/). In First Conference on Language Modeling.
36. Sina J Semnani, Violet Z Yao, Heidi C Zhang, and Monica S Lam. 2023. Wikichat: Stopping the hallucination of large language model chatbots by few-shot grounding on wikipedia. arXiv preprint arXiv:2305.14292. [find](https://scholar.google.com/scholar?q=Sina+J+Semnani%2C+Violet+Z+Yao%2C+Heidi+C+Zhang%2C+and+Monica+S+Lam%2E+2023%2E+Wikichat%3A+Stopping+the+hallucination+of+large+language+model+chatbots+by+few%2Dshot+grounding+on+wikipedia%2E+arXiv+preprint+arXiv%3A2305)
37. Noah Shinn, Beck Labash, and Ashwin Gopinath. 2023. [Reflexion: an autonomous agent with dynamic memory and self-reflection](https://md.research.elamur.ai/free/en/papers/shinn-2023-reflexion-language-agents-verbal-reinforcement/). arXiv preprint arXiv:2303.11366, 2(5):9.
38. Zayne Sprague, Fangcong Yin, Juan Diego Rodriguez, Dongwei Jiang, Manya Wadhwa, Prasann Singhal, Xinyu Zhao, Xi Ye, Kyle Mahowald, and Greg Durrett. 2025. [To cot or not to cot? chain-of-thought helps mainly on math and symbolic reasoning](https://md.research.elamur.ai/free/en/papers/sprague-2024-cot-cot-chain-thought-helps/). Preprint, arXiv:2409.12183.
39. Kaya Stechly, Karthik Valmeekam, and Subbarao Kambhampati. 2024. Chain of thoughtlessness: An analysis of cot in planning. arXiv preprint arXiv:2405.04776. — [arXiv:2405.04776](https://arxiv.org/abs/2405.04776) [find](https://scholar.google.com/scholar?q=Kaya+Stechly%2C+Karthik+Valmeekam%2C+and+Subbarao+Kambhampati%2E+2024%2E+Chain+of+thoughtlessness%3A+An+analysis+of+cot+in+planning%2E+arXiv+preprint+arXiv%3A2405%2E04776%2E+%E2%80%94+%5BarXiv%3A2405%2E04776%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2)
40. Weikuan Wang and Ao Feng. 2021. Self-information loss compensation learning for machine-generated text detection. Mathematical Problems in Engineering, 2021(1):6669468. [find](https://scholar.google.com/scholar?q=Weikuan+Wang+and+Ao+Feng%2E+2021%2E+Self%2Dinformation+loss+compensation+learning+for+machine%2Dgenerated+text+detection%2E+Mathematical+Problems+in+Engineering%2C+2021%281%29%3A6669468%2E)
41. Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2022. [Self-consistency improves chain of thought reasoning in language models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/). arXiv preprint arXiv:2203.11171.
42. Xuezhi Wang and Denny Zhou. 2024. Chain-of-thought reasoning without prompting. arXiv preprint arXiv:2402.10200. [find](https://scholar.google.com/scholar?q=Xuezhi+Wang+and+Denny+Zhou%2E+2024%2E+Chain%2Dof%2Dthought+reasoning+without+prompting%2E+arXiv+preprint+arXiv%3A2402%2E10200%2E)
43. Yifan Zhang, Yang Yuan, and Andrew Chi-Chih Yao. 2024d. On the diagram of thought. arXiv preprint arXiv:2409.10038. — [arXiv:2409.10038](https://arxiv.org/abs/2409.10038) [find](https://scholar.google.com/scholar?q=Yifan+Zhang%2C+Yang+Yuan%2C+and+Andrew+Chi%2DChih+Yao%2E+2024d%2E+On+the+diagram+of+thought%2E+arXiv+preprint+arXiv%3A2409%2E10038%2E+%E2%80%94+%5BarXiv%3A2409%2E10038%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2409%2E10038%29)
44. Xinyu Zhu, Junjie Wang, Lin Zhang, Yuxiang Zhang, Yongfeng Huang, Ruyi Gan, Jiaxing Zhang, and Yujiu Yang. 2022. [Solving math word problems via cooperative reasoning induced language models](https://md.research.elamur.ai/free/en/papers/zhu-2023-solving-math-word-problems-cooperative/). arXiv preprint arXiv:2210.16257.
45. Yaoting Wang, Shengqiong Wu, Yuecheng Zhang, Shuicheng Yan, Ziwei Liu, Jiebo Luo, and Hao Fei. 2025. Multimodal chain-of-thought reasoning: A comprehensive survey. arXiv preprint arXiv:2503.12605. — [arXiv:2503.12605](https://arxiv.org/abs/2503.12605) [find](https://scholar.google.com/scholar?q=Yaoting+Wang%2C+Shengqiong+Wu%2C+Yuecheng+Zhang%2C+Shuicheng+Yan%2C+Ziwei+Liu%2C+Jiebo+Luo%2C+and+Hao+Fei%2E+2025%2E+Multimodal+chain%2Dof%2Dthought+reasoning%3A+A+comprehensive+survey%2E+arXiv+preprint+arXiv%3A2503%2E12605%2E+%E2%80%94+%5B)
46. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). Advances in neural information processing systems, 35:24824– 24837.
47. Yu Xia, Rui Wang, Xu Liu, Mingyan Li, Tong Yu, Xiang Chen, Julian McAuley, and Shuai Li. 2024. [Beyond chain-of-thought: A survey of chain-of-x paradigms for llms](https://md.research.elamur.ai/free/en/papers/xia-2025-beyond-chain-thought-survey-chain/). arXiv preprint arXiv:2404.15676.
48. An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, and 1 others. 2025. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/). arXiv preprint arXiv:2505.09388.
49. Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Tom Griffiths, Yuan Cao, and Karthik Narasimhan. 2023. Tree of thoughts: Deliberate problem solving with large language models. In Advances in Neural Information Processing Systems, volume 36, pages 11809–11822. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Shunyu+Yao%2C+Dian+Yu%2C+Jeffrey+Zhao%2C+Izhak+Shafran%2C+Tom+Griffiths%2C+Yuan+Cao%2C+and+Karthik+Narasimhan%2E+2023%2E+Tree+of+thoughts%3A+Deliberate+problem+solving+with+large+language+models%2E+In+Advances+in+Neural+)
50. Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Tom Griffiths, Yuan Cao, and Karthik Narasimhan. 2024. Tree of thoughts: Deliberate problem solving with large language models. Advances in Neural Information Processing Systems, 36. [find](https://scholar.google.com/scholar?q=Shunyu+Yao%2C+Dian+Yu%2C+Jeffrey+Zhao%2C+Izhak+Shafran%2C+Tom+Griffiths%2C+Yuan+Cao%2C+and+Karthik+Narasimhan%2E+2024%2E+Tree+of+thoughts%3A+Deliberate+problem+solving+with+large+language+models%2E+Advances+in+Neural+Inf)
51. Jinghan Zhang, Xiting Wang, Yiqiao Jin, Changyu Chen, Xinhao Zhang, and Kunpeng Liu. 2024a. Prototypical reward network for data-efficient rlhf. Preprint, arXiv:2406.06606. [find](https://scholar.google.com/scholar?q=Jinghan+Zhang%2C+Xiting+Wang%2C+Yiqiao+Jin%2C+Changyu+Chen%2C+Xinhao+Zhang%2C+and+Kunpeng+Liu%2E+2024a%2E+Prototypical+reward+network+for+data%2Defficient+rlhf%2E+Preprint%2C+arXiv%3A2406%2E06606%2E)
52. Jinghan Zhang, Xiting Wang, Fengran Mo, Yeyang Zhou, Wanfu Gao, and Kunpeng Liu. 2025. Entropy-based exploration conduction for multi-step reasoning. arXiv preprint arXiv:2503.15848. [find](https://scholar.google.com/scholar?q=Jinghan+Zhang%2C+Xiting+Wang%2C+Fengran+Mo%2C+Yeyang+Zhou%2C+Wanfu+Gao%2C+and+Kunpeng+Liu%2E+2025%2E+Entropy%2Dbased+exploration+conduction+for+multi%2Dstep+reasoning%2E+arXiv+preprint+arXiv%3A2503%2E15848%2E)
53. Jinghan Zhang, Xiting Wang, Weijieying Ren, Lu Jiang, Dongjie Wang, and Kunpeng Liu. 2024b. Ratt: Athought structure for coherent and correct llmrea-soning. arXiv preprint arXiv:2406.02746. — [arXiv:2406.02746](https://arxiv.org/abs/2406.02746) [find](https://scholar.google.com/scholar?q=Jinghan+Zhang%2C+Xiting+Wang%2C+Weijieying+Ren%2C+Lu+Jiang%2C+Dongjie+Wang%2C+and+Kunpeng+Liu%2E+2024b%2E+Ratt%3A+Athought+structure+for+coherent+and+correct+llmrea%2Dsoning%2E+arXiv+preprint+arXiv%3A2406%2E02746%2E+%E2%80%94+%5BarXiv%3A2)
54. Xuan Zhang, Chao Du, Tianyu Pang, Qian Liu, Wei Gao, and Min Lin. 2024c. Chain of preference optimization: Improving chain-of-thought reasoning in llms. arXiv preprint arXiv:2406.09136. — [arXiv:2406.09136](https://arxiv.org/abs/2406.09136) [find](https://scholar.google.com/scholar?q=Xuan+Zhang%2C+Chao+Du%2C+Tianyu+Pang%2C+Qian+Liu%2C+Wei+Gao%2C+and+Min+Lin%2E+2024c%2E+Chain+of+preference+optimization%3A+Improving+chain%2Dof%2Dthought+reasoning+in+llms%2E+arXiv+preprint+arXiv%3A2406%2E09136%2E+%E2%80%94+%5BarXiv%3A2406%2E)

*Updated 1 November 2026*