---
title: "Revisiting the Test-Time Scaling of o1-like Models: Do they Truly"
description: "Building on this, the paper proposes Shortest Majority Vote, which favours answer clusters that are… 47 references, cited by 32 papers here."
authors: ["Zhiyuan Zeng", "Qinyuan Cheng", "Zhangyue Yin", "Yunhua Zhou", "Xipeng Qiu"]
year: 2025
venue: "Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2025.acl-long.232/"
doi: "10.18653/v1/2025.acl-long.232"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zeng-2025-revisiting-test-time-scaling-o1/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zeng-2025-revisiting-test-time-scaling-o1/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/2/) / Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?

# Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?

**Authors:** [Zhiyuan Zeng](https://md.research.elamur.ai/free/en/authors/zhiyuan-zeng/), [Qinyuan Cheng](https://md.research.elamur.ai/free/en/authors/qinyuan-cheng/), [Zhangyue Yin](https://md.research.elamur.ai/free/en/authors/zhangyue-yin/), [Yunhua Zhou](https://md.research.elamur.ai/free/en/authors/yunhua-zhou/) and [Xipeng Qiu](https://md.research.elamur.ai/free/en/authors/xipeng-qiu/) · **Year:** 2025 · **Venue:** [Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2025](https://md.research.elamur.ai/free/en/venues/acl/2025/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2025.acl-long.232/) · [PDF](https://aclanthology.org/2025.acl-long.232.pdf) · [DOI 10.18653/v1/2025.acl-long.232](https://doi.org/10.18653/v1/2025.acl-long.232) · [OpenAlex](https://openalex.org/W4412886683)

**Citations:** 6 citations (OpenAlex, 2026-10-14) · [32](https://md.research.elamur.ai/free/en/papers/zeng-2025-revisiting-test-time-scaling-o1/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Open o1-style reasoning models such as QwQ, Deepseek-R1 (R1) and LIMO generate very long chains of thought (CoT). It is unclear whether spending more tokens on a single reasoning trace actually improves accuracy. The authors test this on MATH-500, AIME, Omini-MATH and GPQA. They sample several solutions per question and compare accuracy across groups ranked by length.

Longer traces turn out not to be reliably better. For the same question, correct answers are on average shorter than wrong ones. The authors trace this to weak self-revision. Long outputs contain more revision markers like "Wait" or "Alternatively". When prompted to revise further, models rarely fix wrong answers, and QwQ and R1-Distill-1.5b flip correct answers to incorrect more often than the reverse.

Drawing many samples in parallel achieves higher pass@k and scales better than lengthening one trace. Building on this, the paper proposes Shortest Majority Vote, which favours answer clusters that are both large and made of short solutions. It outperforms conventional majority voting, especially on AIME. The broader lesson is that these models gain more from parallel than from sequential test-time compute.

## Key points
- **Models and setup:** QwQ, LIMO, R1-671b, R1-Distill-32b, R1-Distill-14b and R1-Distill-1.5b were run with SGLang at temperature 0.7 and a 32k generation limit. Because of cost, R1-671b was evaluated only in the initial length analyses.
- **Benchmarks:** MATH-500; AIME (90 AIMO validation questions from AIME 22–24); a random 500-question sample of Omini-MATH (4.4K total); and the GPQA diamond subset (198 questions). Answers were counted correct if either the OpenCompass or the Qwen Math evaluator accepted them.
- **Effect of repeated self-revision:** QwQ and R1-Distill-1.5b degrade as revision continues. R1-Distill-14b, R1-Distill-32b and LIMO improve at first and then oscillate.
- **How Shortest Majority Vote works:** 16 solutions are sampled per question, and each cluster's vote count is divided by a function of solution length. A log weighting proved the most stable choice; linear and square weightings sometimes hurt, e.g. on GPQA.
- **Example gains with log weighting on AIME:**
  - R1-Distill-1.5b: 40.00% → 42.22%
  - LIMO: 68.89% → 70.00%
  - R1-Distill-32b: 72.89% → 73.78%

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Fudan University](https://md.research.elamur.ai/free/en/universities/fudan-university/) — University, Shanghai, China · 167 works · 20,987 citations
- [Shanghai Artificial Intelligence Laboratory](https://md.research.elamur.ai/free/en/labs/shanghai-artificial-intelligence-laboratory/) — Research institute, Shanghai, China · 117 works · 11,281 citations
- [Shanghai Innovation Institute](https://md.research.elamur.ai/free/en/universities/shanghai-innovation-institute/) — University, Shanghai, China · 24 works · 262 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

## Cite

Cite as: Zhiyuan Zeng, Qinyuan Cheng, Zhangyue Yin, Yunhua Zhou and Xipeng Qiu. 2025. Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zeng2025revisiting,
  title = {{Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?}},
  author = {Zhiyuan Zeng, Qinyuan Cheng, Zhangyue Yin, Yunhua Zhou and Xipeng Qiu},
  booktitle = {Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2025},
  doi = {10.18653/v1/2025.acl-long.232},
  url = {https://doi.org/10.18653/v1/2025.acl-long.232}
}
```

- [← previous Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models](https://md.research.elamur.ai/free/en/papers/blakeman-2025-nemotron-h-family-accurate-efficient/)
- [next → UFO: A UI-Focused Agent for Windows OS Interaction](https://md.research.elamur.ai/free/en/papers/zhang-2025-ufo-ui-focused-agent-windows/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/2/)

## References

47 references, 20 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. AIMO. 2018. Dataset card for aimo validation aime. [https://huggingface.co/datasets/](https://huggingface.co/datasets/) AI-MO/aimo-validation-aime. [↗](https://huggingface.co/datasets/)
2. Afra Amini, Tim Vieira, and Ryan Cotterell. 2024. Variational best-of-n alignment. CoRR, abs/2407.06057. — [arXiv:2407.06057](https://arxiv.org/abs/2407.06057) [find](https://scholar.google.com/scholar?q=Afra+Amini%2C+Tim+Vieira%2C+and+Ryan+Cotterell%2E+2024%2E+Variational+best%2Dof%2Dn+alignment%2E+CoRR%2C+abs%2F2407%2E06057%2E+%E2%80%94+%5BarXiv%3A2407%2E06057%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2407%2E06057%29)
3. Guoxin Chen, Minpeng Liao, Chengxi Li, and Kai Fan. 2024a. [Alphamath almost zero: process supervision without process](https://md.research.elamur.ai/free/en/papers/chen-2024-alphamath-almost-zero-process-supervision/). CoRR, abs/2405.03553.
4. Xinyun Chen, Maxwell Lin, Nathanael Schärli, and Denny Zhou. 2024b. Teaching large language models to self-debug. In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net. [find](https://scholar.google.com/scholar?q=Xinyun+Chen%2C+Maxwell+Lin%2C+Nathanael+Sch%C3%A4rli%2C+and+Denny+Zhou%2E+2024b%2E+Teaching+large+language+models+to+self%2Ddebug%2E+In+The+Twelfth+International+Conference+on+Learning+Representations%2C+ICLR+2024%2C+Vienna)
5. Ziru Chen, Michael White, Raymond J. Mooney, Ali Payani, Yu Su, and Huan Sun. 2024c. [When is tree search useful for LLM planning? it depends on the discriminator](https://md.research.elamur.ai/free/en/papers/chen-2024-when-is-tree-search-useful/). In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Th…
6. Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021. [Training verifiers to solve math word problems](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/). CoRR, abs/2110.14168.
7. OpenCompass Contributors. 2023. Opencompass: A universal evaluation platform for foundation models. [https://github.com/open-compass/](https://github.com/open-compass/) opencompass. [↗](https://github.com/open-compass/)
8. DeepSeek-AI, Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, Xiaokang Zhang, Xingkai Yu, Yu Wu, Z. F. Wu, Zhibin Gou, Zhihong Shao, Zhuoshu Li, Ziyi Gao, and 181 others. 2025. [Deepseek-r1: Incentivizing reasoning capability in ll…](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2025-deepseek-r1-incentivizing-reasoning-capability/)
9. Bofei Gao, Feifan Song, Zhe Yang, Zefan Cai, Yibo Miao, Qingxiu Dong, Lei Li, Chenghao Ma, Liang Chen, Runxin Xu, Zhengyang Tang, Benyou Wang, Daoguang Zan, Shanghaoran Quan, Ge Zhang, Lei Sha, Yichang Zhang, Xuancheng Ren, Tianyu Liu, and Baobao Chang. 2024. [Omni-math: A universal olympiad level ma…](https://md.research.elamur.ai/free/en/papers/gao-2024-omni-math-universal-olympiad-level/)
10. Zhibin Gou, Zhihong Shao, Yeyun Gong, Yelong Shen, Yujiu Yang, Nan Duan, and Weizhu Chen. 2024. [CRITIC: large language models can self-correct with tool-interactive critiquing](https://md.research.elamur.ai/free/en/papers/gou-2023-critic-large-language-models-self/). In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. Open-Revie…
11. Lin Gui, Cristina Gârbacea, and Victor Veitch. 2024. Bonbon alignment for large language models and the sweetness of best-of-n sampling. CoRR, abs/2406.00832. — [arXiv:2406.00832](https://arxiv.org/abs/2406.00832) [find](https://scholar.google.com/scholar?q=Lin+Gui%2C+Cristina+G%C3%A2rbacea%2C+and+Victor+Veitch%2E+2024%2E+Bonbon+alignment+for+large+language+models+and+the+sweetness+of+best%2Dof%2Dn+sampling%2E+CoRR%2C+abs%2F2406%2E00832%2E+%E2%80%94+%5BarXiv%3A2406%2E00832%5D%28https%3A%2F%2Farxiv%2Eorg%2Fab)
12. Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhiting Hu. 2023. Reasoning with language model is planning with world model. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023, pages 81… [find](https://scholar.google.com/scholar?q=Shibo+Hao%2C+Yi+Gu%2C+Haodi+Ma%2C+Joshua+Jiahua+Hong%2C+Zhen+Wang%2C+Daisy+Zhe+Wang%2C+and+Zhiting+Hu%2E+2023%2E+Reasoning+with+language+model+is+planning+with+world+model%2E+In+Proceedings+of+the+2023+Conference+on+Em)
13. Jie Huang, Xinyun Chen, Swaroop Mishra, Huaixiu Steven Zheng, Adams Wei Yu, Xinying Song, and Denny Zhou. 2024a. [Large language models cannot self-correct reasoning yet](https://md.research.elamur.ai/free/en/papers/huang-2023-large-language-models-cannot-self/). In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. OpenReview.net.
14. Zhen Huang, Haoyang Zou, Xuefeng Li, Yixiu Liu, Yuxiang Zheng, Ethan Chern, Shijie Xia, Yiwei Qin, Weizhe Yuan, and Pengfei Liu. 2024b. O1 replication journey – part 2: Surpassing o1-preview through simple distillation, big progress or bitter lesson? Preprint, arXiv:2411.16489. [find](https://scholar.google.com/scholar?q=Zhen+Huang%2C+Haoyang+Zou%2C+Xuefeng+Li%2C+Yixiu+Liu%2C+Yuxiang+Zheng%2C+Ethan+Chern%2C+Shijie+Xia%2C+Yiwei+Qin%2C+Weizhe+Yuan%2C+and+Pengfei+Liu%2E+2024b%2E+O1+replication+journey+%E2%80%93+part+2%3A+Surpassing+o1%2Dpreview+through+s)
15. Jinhao Jiang, Zhipeng Chen, Yingqian Min, Jie Chen, Xiaoxue Cheng, Jiapeng Wang, Yiru Tang, Haoxiang Sun, Jia Deng, Wayne Xin Zhao, and 1 others. 2024. Technical report: Enhancing llm reasoning with reward-guided tree search. arXiv preprint arXiv:2411.11694. — [arXiv:2411.11694](https://arxiv.org/abs/2411.11694) [find](https://scholar.google.com/scholar?q=Jinhao+Jiang%2C+Zhipeng+Chen%2C+Yingqian+Min%2C+Jie+Chen%2C+Xiaoxue+Cheng%2C+Jiapeng+Wang%2C+Yiru+Tang%2C+Haoxiang+Sun%2C+Jia+Deng%2C+Wayne+Xin+Zhao%2C+and+1+others%2E+2024%2E+Technical+report%3A+Enhancing+llm+reasoning+with+r)
16. Ryo Kamoi, Yusen Zhang, Nan Zhang, Jiawei Han, and Rui Zhang. 2024. [When can llms actually correct their own mistakes? A critical survey of self-correction of llms](https://md.research.elamur.ai/free/en/papers/kamoi-2024-when-can-llms-actually-correct/). CoRR, abs/2406.01297.
17. Wouter Kool, Herke van Hoof, and Max Welling. 2019. Stochastic beams and where to find them: The gumbel-top-k trick for sampling sequences without replacement. In Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA, volume 97 o… [find](https://scholar.google.com/scholar?q=Wouter+Kool%2C+Herke+van+Hoof%2C+and+Max+Welling%2E+2019%2E+Stochastic+beams+and+where+to+find+them%3A+The+gumbel%2Dtop%2Dk+trick+for+sampling+sequences+without+replacement%2E+In+Proceedings+of+the+36th+International)
18. Aviral Kumar, Vincent Zhuang, Rishabh Agarwal, Yi Su, John D. Co-Reyes, Avi Singh, Kate Baumli, Shariq Iqbal, Colton Bishop, Rebecca Roelofs, Lei M. Zhang, Kay McKinney, Disha Shrivastava, Cosmin Paduraru, George Tucker, Doina Precup, Feryal M. P. Behbahani, and Aleksandra Faust. 2024. [Training lang…](https://md.research.elamur.ai/free/en/papers/kumar-2024-training-language-models-self-correct/)
19. Jan Leike. 2022. Why i’m excited about ai-assisted human feedback. [find](https://scholar.google.com/scholar?q=Jan+Leike%2E+2022%2E+Why+i%E2%80%99m+excited+about+ai%2Dassisted+human+feedback%2E)
20. Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. 2024. [Let’s verify step by step](https://md.research.elamur.ai/free/en/papers/lightman-2023-let-s-verify-step-step/). In The Twelfth International Conference on Learning Representations, ICLR 2024, Vienna, Austria, May 7-11, 2024. Open-Rev…
21. Charlie Snell, Jaehoon Lee, Kelvin Xu, and Aviral Kumar. 2024. [Scaling LLM test-time compute optimally can be more effective than scaling model parameters](https://md.research.elamur.ai/free/en/papers/snell-2024-scaling-llm-test-time-compute/). CoRR, abs/2408.03314.
22. Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, and 1 others. 2024. Deepseek-v3 technical report. arXiv preprint arXiv:2412.19437. [find](https://scholar.google.com/scholar?q=Aixin+Liu%2C+Bei+Feng%2C+Bing+Xue%2C+Bingxuan+Wang%2C+Bochao+Wu%2C+Chengda+Lu%2C+Chenggang+Zhao%2C+Chengqi+Deng%2C+Chenyu+Zhang%2C+Chong+Ruan%2C+and+1+others%2E+2024%2E+Deepseek%2Dv3+technical+report%2E+arXiv+preprint+arXiv%3A2412)
23. Hanshi Sun, Momin Haider, Ruiqi Zhang, Huitao Yang, Jiahao Qiu, Ming Yin, Mengdi Wang, Peter L. Bartlett, and Andrea Zanette. 2024. Fast best-of-n decoding via speculative rejection. CoRR, abs/2410.20290. [find](https://scholar.google.com/scholar?q=Hanshi+Sun%2C+Momin+Haider%2C+Ruiqi+Zhang%2C+Huitao+Yang%2C+Jiahao+Qiu%2C+Ming+Yin%2C+Mengdi+Wang%2C+Peter+L%2E+Bartlett%2C+and+Andrea+Zanette%2E+2024%2E+Fast+best%2Dof%2Dn+decoding+via+speculative+rejection%2E+CoRR%2C+abs%2F2410%2E20)
24. Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark. 2023. Self-refine: Iterative refinement with… [find](https://scholar.google.com/scholar?q=Aman+Madaan%2C+Niket+Tandon%2C+Prakhar+Gupta%2C+Skyler+Hallinan%2C+Luyu+Gao%2C+Sarah+Wiegreffe%2C+Uri+Alon%2C+Nouha+Dziri%2C+Shrimai+Prabhumoye%2C+Yiming+Yang%2C+Shashank+Gupta%2C+Bodhisattwa+Prasad+Majumder%2C+Katherine+Her)
25. Yingqian Min, Zhipeng Chen, Jinhao Jiang, Jie Chen, Jia Deng, Yiwen Hu, Yiru Tang, Jiapeng Wang, Xiaoxue Cheng, Huatong Song, and 1 others. 2024. Imitate, explore, and self-improve: A reproduction report on slow-thinking reasoning systems. arXiv preprint arXiv:2412.09413. [find](https://scholar.google.com/scholar?q=Yingqian+Min%2C+Zhipeng+Chen%2C+Jinhao+Jiang%2C+Jie+Chen%2C+Jia+Deng%2C+Yiwen+Hu%2C+Yiru+Tang%2C+Jiapeng+Wang%2C+Xiaoxue+Cheng%2C+Huatong+Song%2C+and+1+others%2E+2024%2E+Imitate%2C+explore%2C+and+self%2Dimprove%3A+A+reproduction+rep)
26. Niklas Muennighoff, Zitong Yang, Weijia Shi, Xiang Lisa Li, Li Fei-Fei, Hannaneh Hajishirzi, Luke Zettlemoyer, Percy Liang, Emmanuel Candès, and Tatsunori Hashimoto. 2025. [s1: Simple test-time scaling](https://md.research.elamur.ai/free/en/papers/muennighoff-2025-s1-simple-test-time-scaling/). Preprint, arXiv:2501.19393.
27. OpenAI. 2024a. Learning to reason with llms. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2024a%2E+Learning+to+reason+with+llms%2E)
28. OpenAI. 2024b. [Openai o1 system card](https://md.research.elamur.ai/free/en/papers/openai-2024-openai-o1-system-card/).
29. Yiwei Qin, Xuefeng Li, Haoyang Zou, Yixiu Liu, Shijie Xia, Zhen Huang, Yixin Ye, Weizhe Yuan, Hector Liu, Yuanzhi Li, and Pengfei Liu. 2024. O1 replication journey: A strategic progress report - part 1. CoRR, abs/2410.18982. [find](https://scholar.google.com/scholar?q=Yiwei+Qin%2C+Xuefeng+Li%2C+Haoyang+Zou%2C+Yixiu+Liu%2C+Shijie+Xia%2C+Zhen+Huang%2C+Yixin+Ye%2C+Weizhe+Yuan%2C+Hector+Liu%2C+Yuanzhi+Li%2C+and+Pengfei+Liu%2E+2024%2E+O1+replication+journey%3A+A+strategic+progress+report+%2D+part+)
30. Jiahao Qiu, Yifu Lu, Yifan Zeng, Jiacheng Guo, Jiayi Geng, Huazheng Wang, Kaixuan Huang, Yue Wu, and Mengdi Wang. 2024. Treebon: Enhancing inference-time alignment with speculative tree-search and best-of-n sampling. CoRR, abs/2410.16033. [find](https://scholar.google.com/scholar?q=Jiahao+Qiu%2C+Yifu+Lu%2C+Yifan+Zeng%2C+Jiacheng+Guo%2C+Jiayi+Geng%2C+Huazheng+Wang%2C+Kaixuan+Huang%2C+Yue+Wu%2C+and+Mengdi+Wang%2E+2024%2E+Treebon%3A+Enhancing+inference%2Dtime+alignment+with+speculative+tree%2Dsearch+and+bes)
31. David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman. 2023. [GPQA: A graduate-level google-proof q&a benchmark](https://md.research.elamur.ai/free/en/papers/rein-2023-gpqa-graduate-level-google-proof/). CoRR, abs/2311.12022.
32. Pier Giuseppe Sessa, Robert Dadashi, Léonard Hussenot, Johan Ferret, Nino Vieillard, Alexandre Ramé, Bobak Shahriari, Sarah Perrin, Abe Friesen, Geoffrey Cideron, Sertan Girgin, Piotr Stanczyk, Andrea Michi, Danila Sinopalnikov, Sabela Ramos, Amélie Héliou, Aliaksei Severyn, Matt Hoffman, Nikola Mom… [find](https://scholar.google.com/scholar?q=Pier+Giuseppe+Sessa%2C+Robert+Dadashi%2C+L%C3%A9onard+Hussenot%2C+Johan+Ferret%2C+Nino+Vieillard%2C+Alexandre+Ram%C3%A9%2C+Bobak+Shahriari%2C+Sarah+Perrin%2C+Abe+Friesen%2C+Geoffrey+Cideron%2C+Sertan+Girgin%2C+Piotr+Stanczyk%2C+Andrea)
33. Qwen Team. 2024a. Qwen2.5 technical report. arXiv preprint arXiv:2412.15115. [find](https://scholar.google.com/scholar?q=Qwen+Team%2E+2024a%2E+Qwen2%2E5+technical+report%2E+arXiv+preprint+arXiv%3A2412%2E15115%2E)
34. Qwen Team. 2024b. Qwq: Reflect deeply on the boundaries of the unknown. [find](https://scholar.google.com/scholar?q=Qwen+Team%2E+2024b%2E+Qwq%3A+Reflect+deeply+on+the+boundaries+of+the+unknown%2E)
35. Ziyu Wan, Xidong Feng, Muning Wen, Stephen Marcus McAleer, Ying Wen, Weinan Zhang, and Jun Wang. 2024. Alphazero-like tree-search can guide large language model decoding and training. In Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. Open-Revi… [find](https://scholar.google.com/scholar?q=Ziyu+Wan%2C+Xidong+Feng%2C+Muning+Wen%2C+Stephen+Marcus+McAleer%2C+Ying+Wen%2C+Weinan+Zhang%2C+and+Jun+Wang%2E+2024%2E+Alphazero%2Dlike+tree%2Dsearch+can+guide+large+language+model+decoding+and+training%2E+In+Forty%2Dfirst+I)
36. Jun Wang, Meng Fang, Ziyu Wan, Muning Wen, Jiachen Zhu, Anjie Liu, Ziqin Gong, Yan Song, Lei Chen, Lionel M. Ni, Linyi Yang, Ying Wen, and Weinan Zhang. 2024. Openr: An open source framework for advanced reasoning with large language models. CoRR, abs/2410.09671. [find](https://scholar.google.com/scholar?q=Jun+Wang%2C+Meng+Fang%2C+Ziyu+Wan%2C+Muning+Wen%2C+Jiachen+Zhu%2C+Anjie+Liu%2C+Ziqin+Gong%2C+Yan+Song%2C+Lei+Chen%2C+Lionel+M%2E+Ni%2C+Linyi+Yang%2C+Ying+Wen%2C+and+Weinan+Zhang%2E+2024%2E+Openr%3A+An+open+source+framework+for+advan)
37. Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc V. Le, Ed H. Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2023. [Self-consistency improves chain of thought reasoning in language models](https://md.research.elamur.ai/free/en/papers/wang-2022-self-consistency-improves-chain-thought/). In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5,…
38. Yue Wang, Qiuzhi Liu, Jiahao Xu, Tian Liang, Xingyu Chen, Zhiwei He, Linfeng Song, Dian Yu, Juntao Li, Zhuosheng Zhang, Rui Wang, Zhaopeng Tu, Haitao Mi, and Dong Yu. 2025. Thoughts are all over the place: On the underthinking of o1-like llms. Preprint, arXiv:2501.18585. [find](https://scholar.google.com/scholar?q=Yue+Wang%2C+Qiuzhi+Liu%2C+Jiahao+Xu%2C+Tian+Liang%2C+Xingyu+Chen%2C+Zhiwei+He%2C+Linfeng+Song%2C+Dian+Yu%2C+Juntao+Li%2C+Zhuosheng+Zhang%2C+Rui+Wang%2C+Zhaopeng+Tu%2C+Haitao+Mi%2C+and+Dong+Yu%2E+2025%2E+Thoughts+are+all+over+the+p)
39. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H. Chi, Quoc V. Le, and Denny Zhou. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). In Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processi…
40. Yuxi Xie, Kenji Kawaguchi, Yiran Zhao, James Xu Zhao, Min-Yen Kan, Junxian He, and Michael Qizhe Xie. 2023. [Self-evaluation guided beam search for reasoning](https://md.research.elamur.ai/free/en/papers/xie-2023-self-evaluation-guided-beam-search/). In Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Or…
41. An Yang, Beichen Zhang, Binyuan Hui, Bofei Gao, Bowen Yu, Chengpeng Li, Dayiheng Liu, Jianhong Tu, Jingren Zhou, Junyang Lin, Keming Lu, Mingfeng Xue, Runji Lin, Tianyu Liu, Xingzhang Ren, and Zhenru Zhang. 2024. [Qwen2.5-math technical report: Toward mathematical expert model via self-improvement](https://md.research.elamur.ai/free/en/papers/yang-2024-qwen2-5-math-technical-report/). C…
42. Yixin Ye, Zhen Huang, Yang Xiao, Ethan Chern, Shijie Xia, and Pengfei Liu. 2025. [Limo: Less is more for reasoning](https://md.research.elamur.ai/free/en/papers/ye-2025-limo-less-more-reasoning/). Preprint, arXiv:2502.03387.
43. Fei Yu, Anningzhe Gao, and Benyou Wang. 2024. Ovm, outcome-supervised value models for planning in mathematical reasoning. In Findings of the Association for Computational Linguistics: NAACL 2024, Mexico City, Mexico, June 16-21, 2024, pages 858– 875. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Fei+Yu%2C+Anningzhe+Gao%2C+and+Benyou+Wang%2E+2024%2E+Ovm%2C+outcome%2Dsupervised+value+models+for+planning+in+mathematical+reasoning%2E+In+Findings+of+the+Association+for+Computational+Linguistics%3A+NAACL+2024%2C+Mex)
44. Zhiyuan Zeng, Qinyuan Cheng, Zhangyue Yin, Bo Wang, Shimin Li, Yunhua Zhou, Qipeng Guo, Xuanjing Huang, and Xipeng Qiu. 2024. Scaling of search and learning: A roadmap to reproduce o1 from reinforcement learning perspective. CoRR, abs/2412.14135. [find](https://scholar.google.com/scholar?q=Zhiyuan+Zeng%2C+Qinyuan+Cheng%2C+Zhangyue+Yin%2C+Bo+Wang%2C+Shimin+Li%2C+Yunhua+Zhou%2C+Qipeng+Guo%2C+Xuanjing+Huang%2C+and+Xipeng+Qiu%2E+2024%2E+Scaling+of+search+and+learning%3A+A+roadmap+to+reproduce+o1+from+reinforceme)
45. Shun Zhang, Zhenfang Chen, Yikang Shen, Mingyu Ding, Joshua B. Tenenbaum, and Chuang Gan. 2023. Planning with large language models for code generation. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net. [find](https://scholar.google.com/scholar?q=Shun+Zhang%2C+Zhenfang+Chen%2C+Yikang+Shen%2C+Mingyu+Ding%2C+Joshua+B%2E+Tenenbaum%2C+and+Chuang+Gan%2E+2023%2E+Planning+with+large+language+models+for+code+generation%2E+In+The+Eleventh+International+Conference+on+Lea)
46. Yunxiang Zhang, Muhammad Khalifa, Lajanugen Logeswaran, Jaekyeom Kim, Moontae Lee, Honglak Lee, and Lu Wang. 2024. Small language models need strong verifiers to self-correct reasoning. In Findings of the Association for Computational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, Aug… [find](https://scholar.google.com/scholar?q=Yunxiang+Zhang%2C+Muhammad+Khalifa%2C+Lajanugen+Logeswaran%2C+Jaekyeom+Kim%2C+Moontae+Lee%2C+Honglak+Lee%2C+and+Lu+Wang%2E+2024%2E+Small+language+models+need+strong+verifiers+to+self%2Dcorrect+reasoning%2E+In+Findings+of)
47. Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Chuyue Sun, Jeff Huang, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark W. Barrett, and Ying Sheng. 2024. [Sglang: Efficient execution of structured language model programs](https://md.research.elamur.ai/free/en/papers/zheng-2023-sglang-efficient-execution-structured-language/). In Advances in Neural Information Processing Sys…

*Updated 30 October 2026*