---
title: "Llama-Nemotron: Efficient Reasoning Models (2025)"
description: "NVIDIA presents Llama-Nemotron, an openly licensed family of reasoning models built from Llama… 54 references, cited by 74 papers here."
authors: ["Akhiad Bercovich", "Itay Levy", "Izik Golan", "Mohammad Dabbah", "Ran El-Yaniv", "Omri Puny", "Ido Galil", "Zach Moshe", "Tomer Ronen", "Najeeb Nabwani", "Ido Shahaf", "Oren Tropp", "Ehud Karpas", "Ran Zilberstein", "Jiaqi Zeng", "Soumye Singhal", "Alexander Bukharin", "Yian Zhang", "Tugrul Konuk", "Gerald Shen", "Ameya Sunil Mahabaleshwarkar", "Bilal Kartal", "Yoshi Suhara", "Olivier Delalleau", "Zijia Chen", "Zhilin Wang", "David Mosallanezhad", "Adi Renduchintala", "Haifeng Qian", "Dima Rekesh", "Fei Jia", "Somshubra Majumdar", "Vahid Noroozi", "Wasi Uddin Ahmad", "Sean Narenthiran", "Aleksander Ficek", "Mehrzad Samadi", "Jocelyn Huang", "Siddhartha Jain", "Igor Gitman", "Ivan Moshkov", "Wei Du", "Shubham Toshniwal", "George Armstrong", "Branislav Kisacanin", "Matvei Novikov", "Daria Gitman", "Evelina Bakhturina", "Prasoon Varshney", "Makesh Narsimhan", "Jane Polak Scowcroft", "John Kamalu", "Dan Su", "Kezhi Kong", "Markus Kliegl", "Rabeeh Karimi Mahabadi", "Ying Lin", "Sanjeev Satheesh", "Jupinder Parmar", "Pritam Gundecha", "Brandon Norick", "Joseph Jennings", "Shrimai Prabhumoye", "Syeda Nahida Akter", "Mostofa Patwary", "Abhinav Khattar", "Deepak Narayanan", "Roger Waleffe", "Jimmy Zhang", "Bor-Yiing Su", "Guyue Huang", "Terry Kong", "Parth Chadha", "Sahil Jain", "Christine Harvey", "Elad Segal", "Jining Huang", "Sergey Kashirsky", "Robert McQueen", "Izzy Putterman", "George Lam", "Arun Venkatesan", "Sherry Wu", "Vinh Nguyen", "Manoj Kilaru", "Andrew Wang", "Anna Warno", "Abhilash Somasamudramath", "Sandip Bhaskar", "Maka Dong", "Nave Assaf", "Shahar Mor", "Omer Ullman Argov", "Scot Junkin", "Oleksandr Romanenko", "Pedro Larroy", "Monika Katariya", "Marco Rovinelli", "Viji Balas", "Nicholas Edelman", "Anahita Bhiwandiwalla", "Muthu Subramaniam", "Smita Ithape", "Karthik Ramamoorthy", "Yuting Wu", "Suguna Varshini Velury", "Omri Almog", "Joyjit Daw", "Denys Fridman", "Erick Galinkin", "Michael Evans", "Shaona Ghosh", "Katherine Luna", "Leon Derczynski", "Nikki Pope", "Eileen Long", "Seth Schneider", "Guillermo Siman", "Tomasz Grzegorzek", "Pablo Ribalta", "Monika Katariya", "Chris Alexiuk", "Joey Conway", "Trisha Saar", "Ann Guan", "Krzysztof Pawelec", "Shyamala Prayaga", "Oleksii Kuchaiev", "Boris Ginsburg", "Oluwatobi Olabiyi", "Kari Briski", "Jonathan Cohen", "Bryan Catanzaro", "Jonah Alben", "Yonatan Geifman", "Eric Chung"]
year: 2025
venue: "arXiv:2505.00949"
source: "https://arxiv.org/abs/2505.00949"
doi: "10.48550/arxiv.2505.00949"
arxiv: "2505.00949"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/bercovich-2025-llama-nemotron-efficient-reasoning-models/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/bercovich-2025-llama-nemotron-efficient-reasoning-models/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/) / Llama-Nemotron: Efficient Reasoning Models

# Llama-Nemotron: Efficient Reasoning Models

**Authors:** Akhiad Bercovich, [Itay Levy](https://md.research.elamur.ai/free/en/authors/itay-levy/), Izik Golan, Mohammad Dabbah, Ran El-Yaniv, Omri Puny, Ido Galil, Zach Moshe, Tomer Ronen, Najeeb Nabwani, Ido Shahaf, Oren Tropp, Ehud Karpas, Ran Zilberstein, [Jiaqi Zeng](https://md.research.elamur.ai/free/en/authors/jiaqi-zeng/), Soumye Singhal, Alexander Bukharin, Yian Zhang, Tugrul Konuk, Gerald Shen, Ameya Sunil Mahabaleshwarkar, Bilal Kartal, Yoshi Suhara, Olivier Delalleau, Zijia Chen, [Zhilin Wang](https://md.research.elamur.ai/free/en/authors/zhilin-wang/), David Mosallanezhad, Adi Renduchintala, Haifeng Qian, Dima Rekesh, Fei Jia, Somshubra Majumdar, Vahid Noroozi, [Wasi Uddin Ahmad](https://md.research.elamur.ai/free/en/authors/wasi-uddin-ahmad/), Sean Narenthiran, Aleksander Ficek, Mehrzad Samadi, Jocelyn Huang, Siddhartha Jain, Igor Gitman, Ivan Moshkov, Wei Du, [Shubham Toshniwal](https://md.research.elamur.ai/free/en/authors/shubham-toshniwal/), George Armstrong, Branislav Kisacanin, Matvei Novikov, Daria Gitman, Evelina Bakhturina, Prasoon Varshney, Makesh Narsimhan, Jane Polak Scowcroft, John Kamalu, [Dan Su](https://md.research.elamur.ai/free/en/authors/dan-su/), Kezhi Kong, Markus Kliegl, [Rabeeh Karimi Mahabadi](https://md.research.elamur.ai/free/en/authors/rabeeh-karimi-mahabadi/), Ying Lin, [Sanjeev Satheesh](https://md.research.elamur.ai/free/en/authors/sanjeev-satheesh/), Jupinder Parmar, Pritam Gundecha, Brandon Norick, Joseph Jennings, [Shrimai Prabhumoye](https://md.research.elamur.ai/free/en/authors/shrimai-prabhumoye/), Syeda Nahida Akter, [Mostofa Patwary](https://md.research.elamur.ai/free/en/authors/mostofa-patwary/), Abhinav Khattar, Deepak Narayanan, Roger Waleffe, Jimmy Zhang, Bor-Yiing Su, Guyue Huang, Terry Kong, Parth Chadha, Sahil Jain, Christine Harvey, Elad Segal, Jining Huang, Sergey Kashirsky, Robert McQueen, Izzy Putterman, George Lam, Arun Venkatesan, Sherry Wu, Vinh Nguyen, Manoj Kilaru, Andrew Wang, Anna Warno, Abhilash Somasamudramath, Sandip Bhaskar, Maka Dong, Nave Assaf, Shahar Mor, Omer Ullman Argov, Scot Junkin, Oleksandr Romanenko, Pedro Larroy, Monika Katariya, Marco Rovinelli, Viji Balas, Nicholas Edelman, Anahita Bhiwandiwalla, Muthu Subramaniam, Smita Ithape, Karthik Ramamoorthy, Yuting Wu, Suguna Varshini Velury, Omri Almog, Joyjit Daw, Denys Fridman, Erick Galinkin, Michael Evans, Shaona Ghosh, Katherine Luna, [Leon Derczynski](https://md.research.elamur.ai/free/en/authors/leon-derczynski/), Nikki Pope, Eileen Long, Seth Schneider, Guillermo Siman, Tomasz Grzegorzek, Pablo Ribalta, Monika Katariya, Chris Alexiuk, Joey Conway, Trisha Saar, Ann Guan, Krzysztof Pawelec, Shyamala Prayaga, Oleksii Kuchaiev, [Boris Ginsburg](https://md.research.elamur.ai/free/en/authors/boris-ginsburg/), Oluwatobi Olabiyi, Kari Briski, Jonathan Cohen, [Bryan Catanzaro](https://md.research.elamur.ai/free/en/authors/bryan-catanzaro/), Jonah Alben, Yonatan Geifman and Eric Chung · **Year:** 2025 · **Venue:** arXiv:2505.00949 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2505.00949) · [PDF](https://arxiv.org/pdf/2505.00949) · [DOI 10.48550/arxiv.2505.00949](https://doi.org/10.48550/arxiv.2505.00949) · [arXiv 2505.00949](https://arxiv.org/abs/2505.00949) · [OpenAlex](https://openalex.org/W4416063600)

**Citations:** 1 citations (OpenAlex, 2026-10-14) · [74](https://md.research.elamur.ai/free/en/papers/bercovich-2025-llama-nemotron-efficient-reasoning-models/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
Reasoning-oriented language models write long chains of thought, so inference cost increasingly limits how useful they are. Also, not every request needs extended thinking. NVIDIA presents Llama-Nemotron, an openly licensed family of reasoning models built from Llama 3.1/3.3 in three sizes: LN-Nano (8B), LN-Super (49B) and LN-Ultra (253B). Training proceeds in five stages:
1. The Puzzle neural architecture search turns the parent networks into faster heterogeneous ones; LN-Ultra additionally uses FFN Fusion.
2. Knowledge distillation and continued pretraining recover lost quality.
3. Supervised fine-tuning on instruction data and reasoning traces from teachers such as DeepSeek-R1 teaches multi-step thinking.
4. Large-scale RL on math and STEM tasks lets the student exceed its teacher.
5. A short alignment phase targets instruction following and preferences.

A system-prompt switch turns reasoning on or off at inference time. LN-Ultra beats DeepSeek-R1 on GPQA-Diamond while fitting on a single 8xH100 node with higher throughput. Weights, post-training data and code are all published, a major open resource for reasoning research.

## Key points
- **Efficiency gains:** LN-Super gets about 5× the throughput of Llama 3.3-70B-Instruct on one H100 (batch 256, TP1). It still leads by ≥2.17× when the 70B model runs at TP4. LN-Ultra cuts latency 1.71× relative to Llama 3.1-405B-Instruct.
- **Recovery training budgets:** LN-Super used 40B tokens of distillation. LN-Ultra used 65B tokens of distillation plus 88B tokens of continued pretraining on Nemotron-H phase 4 data.
- **LN-Ultra benchmarks (reasoning on):** 76.0 on GPQA-Diamond (DeepSeek-R1: 71.5) and 72.5 on AIME25 (DeepSeek-R1: 70.0). The authors also found that starting RL from an earlier, lower-scoring SFT checkpoint gave better final results.
- **JudgeBench:** LN-Ultra scores 79.14 overall, the best among open models and second only to o3-mini(high).
- **Releases:**
  - Models: Llama-3.1-Nemotron-Nano-8B-v1, Llama-3.3-Nemotron-Super-49B-v1, Llama-3.1-Nemotron-Ultra-253B-v1 (plus a CPT checkpoint)
  - Data: Llama-Nemotron-Post-Training-Dataset
  - Code: NeMo, NeMo-Aligner, Megatron-LM
  - License: NVIDIA Open Model License; models support 128K context

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,085 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,888 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 1,282 works

🧭 Topics (1): [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 510 works

## Cite

Cite as: Akhiad Bercovich, Itay Levy, Izik Golan, Mohammad Dabbah, Ran El-Yaniv, Omri Puny, Ido Galil, Zach Moshe, Tomer Ronen, Najeeb Nabwani, Ido Shahaf, Oren Tropp, Ehud Karpas, Ran Zilberstein, Jiaqi Zeng, Soumye Singhal, Alexander Bukharin, Yian Zhang, Tugrul Konuk, Gerald Shen, Ameya Sunil Mahabaleshwarkar, Bilal Kartal, Yoshi Suhara, Olivier Delalleau, Zijia Chen, Zhilin Wang, David Mosallanezhad, Adi Renduchintala, Haifeng Qian, Dima Rekesh, Fei Jia, Somshubra Majumdar, Vahid Noroozi, Wasi Uddin Ahmad, Sean Narenthiran, Aleksander Ficek, Mehrzad Samadi, Jocelyn Huang, Siddhartha Jain, Igor Gitman, Ivan Moshkov, Wei Du, Shubham Toshniwal, George Armstrong, Branislav Kisacanin, Matvei Novikov, Daria Gitman, Evelina Bakhturina, Prasoon Varshney, Makesh Narsimhan, Jane Polak Scowcroft, John Kamalu, Dan Su, Kezhi Kong, Markus Kliegl, Rabeeh Karimi Mahabadi, Ying Lin, Sanjeev Satheesh, Jupinder Parmar, Pritam Gundecha, Brandon Norick, Joseph Jennings, Shrimai Prabhumoye, Syeda Nahida Akter, Mostofa Patwary, Abhinav Khattar, Deepak Narayanan, Roger Waleffe, Jimmy Zhang, Bor-Yiing Su, Guyue Huang, Terry Kong, Parth Chadha, Sahil Jain, Christine Harvey, Elad Segal, Jining Huang, Sergey Kashirsky, Robert McQueen, Izzy Putterman, George Lam, Arun Venkatesan, Sherry Wu, Vinh Nguyen, Manoj Kilaru, Andrew Wang, Anna Warno, Abhilash Somasamudramath, Sandip Bhaskar, Maka Dong, Nave Assaf, Shahar Mor, Omer Ullman Argov, Scot Junkin, Oleksandr Romanenko, Pedro Larroy, Monika Katariya, Marco Rovinelli, Viji Balas, Nicholas Edelman, Anahita Bhiwandiwalla, Muthu Subramaniam, Smita Ithape, Karthik Ramamoorthy, Yuting Wu, Suguna Varshini Velury, Omri Almog, Joyjit Daw, Denys Fridman, Erick Galinkin, Michael Evans, Shaona Ghosh, Katherine Luna, Leon Derczynski, Nikki Pope, Eileen Long, Seth Schneider, Guillermo Siman, Tomasz Grzegorzek, Pablo Ribalta, Monika Katariya, Chris Alexiuk, Joey Conway, Trisha Saar, Ann Guan, Krzysztof Pawelec, Shyamala Prayaga, Oleksii Kuchaiev, Boris Ginsburg, Oluwatobi Olabiyi, Kari Briski, Jonathan Cohen, Bryan Catanzaro, Jonah Alben, Yonatan Geifman and Eric Chung. 2025. Llama-Nemotron: Efficient Reasoning Models. arXiv:2505.00949.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{bercovich2025llama,
  title = {{Llama-Nemotron: Efficient Reasoning Models}},
  author = {Akhiad Bercovich, Itay Levy, Izik Golan, Mohammad Dabbah, Ran El-Yaniv, Omri Puny, Ido Galil, Zach Moshe, Tomer Ronen, Najeeb Nabwani, Ido Shahaf, Oren Tropp, Ehud Karpas, Ran Zilberstein, Jiaqi Zeng, Soumye Singhal, Alexander Bukharin, Yian Zhang, Tugrul Konuk, Gerald Shen, Ameya Sunil Mahabaleshwarkar, Bilal Kartal, Yoshi Suhara, Olivier Delalleau, Zijia Chen, Zhilin Wang, David Mosallanezhad, Adi Renduchintala, Haifeng Qian, Dima Rekesh, Fei Jia, Somshubra Majumdar, Vahid Noroozi, Wasi Uddin Ahmad, Sean Narenthiran, Aleksander Ficek, Mehrzad Samadi, Jocelyn Huang, Siddhartha Jain, Igor Gitman, Ivan Moshkov, Wei Du, Shubham Toshniwal, George Armstrong, Branislav Kisacanin, Matvei Novikov, Daria Gitman, Evelina Bakhturina, Prasoon Varshney, Makesh Narsimhan, Jane Polak Scowcroft, John Kamalu, Dan Su, Kezhi Kong, Markus Kliegl, Rabeeh Karimi Mahabadi, Ying Lin, Sanjeev Satheesh, Jupinder Parmar, Pritam Gundecha, Brandon Norick, Joseph Jennings, Shrimai Prabhumoye, Syeda Nahida Akter, Mostofa Patwary, Abhinav Khattar, Deepak Narayanan, Roger Waleffe, Jimmy Zhang, Bor-Yiing Su, Guyue Huang, Terry Kong, Parth Chadha, Sahil Jain, Christine Harvey, Elad Segal, Jining Huang, Sergey Kashirsky, Robert McQueen, Izzy Putterman, George Lam, Arun Venkatesan, Sherry Wu, Vinh Nguyen, Manoj Kilaru, Andrew Wang, Anna Warno, Abhilash Somasamudramath, Sandip Bhaskar, Maka Dong, Nave Assaf, Shahar Mor, Omer Ullman Argov, Scot Junkin, Oleksandr Romanenko, Pedro Larroy, Monika Katariya, Marco Rovinelli, Viji Balas, Nicholas Edelman, Anahita Bhiwandiwalla, Muthu Subramaniam, Smita Ithape, Karthik Ramamoorthy, Yuting Wu, Suguna Varshini Velury, Omri Almog, Joyjit Daw, Denys Fridman, Erick Galinkin, Michael Evans, Shaona Ghosh, Katherine Luna, Leon Derczynski, Nikki Pope, Eileen Long, Seth Schneider, Guillermo Siman, Tomasz Grzegorzek, Pablo Ribalta, Monika Katariya, Chris Alexiuk, Joey Conway, Trisha Saar, Ann Guan, Krzysztof Pawelec, Shyamala Prayaga, Oleksii Kuchaiev, Boris Ginsburg, Oluwatobi Olabiyi, Kari Briski, Jonathan Cohen, Bryan Catanzaro, Jonah Alben, Yonatan Geifman and Eric Chung},
  year = {2025},
  doi = {10.48550/arxiv.2505.00949},
  eprint = {2505.00949},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2505.00949}
}
```

- [← previous In-Context Learning with Long-Context Models: An In-Depth Exploration](https://md.research.elamur.ai/free/en/papers/bertsch-2025-context-learning-long-context-models/)
- [next → MoBA: Mixture of Block Attention for Long-Context LLMs](https://md.research.elamur.ai/free/en/papers/lu-2025-moba-mixture-block-attention/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/)

## References

54 references, 21 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Wasi Uddin Ahmad, Sean Narenthiran, Somshubra Majumdar, Aleksander Ficek, Siddhartha Jain, Jocelyn Huang, Vahid Noroozi, and Boris Ginsburg. OpenCodeReasoning: Advancing Data Distillation for Competitive Coding, 2025. URL https://arxiv.org/abs/2504.01943. [↗](https://arxiv.org/abs/2504.01943)
2. Arash Ahmadian, Chris Cremer, Matthias Gallé, Marzieh Fadaee, Julia Kreutzer, Olivier Pietquin, Ahmet Üstün, and Sara Hooker. Back to basics: Revisiting reinforce style optimization for learning from human feedback in llms. arXiv preprint arXiv:2402.14740, 2024. [find](https://scholar.google.com/scholar?q=Arash+Ahmadian%2C+Chris+Cremer%2C+Matthias+Gall%C3%A9%2C+Marzieh+Fadaee%2C+Julia+Kreutzer%2C+Olivier+Pietquin%2C+Ahmet+%C3%9Cst%C3%BCn%2C+and+Sara+Hooker%2E+Back+to+basics%3A+Revisiting+reinforce+style+optimization+for+learning+from+)
3. Joshua Ainslie, James Lee-Thorp, Michiel de Jong, Yury Zemlyanskiy, Federico Lebrón, and Sumit Sanghai. [GQA: training generalized multi-query transformer models from multi-head checkpoints](https://md.research.elamur.ai/free/en/papers/ainslie-2023-gqa-training-generalized-multi-query/). In Houda Bouamor, Juan Pino, and Kalika Bali (eds.), Proceedings of the 2023 Conference on Empirical Methods i…
4. Anthropic. Claude 3.7 sonnet and claude code. [https://www.anthropic.com/news/](https://www.anthropic.com/news/) claude-3-7-sonnet, February 2025. Accessed: 2025-04-26. [↗](https://www.anthropic.com/news/)
5. Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, and Charles Sutton. [Program Synthesis with Large Language Models](https://md.research.elamur.ai/free/en/papers/austin-2021-program-synthesis-large-language-models/), 2021. URL https://arxiv.org/abs/2108.07732. [↗](https://arxiv.org/abs/2108.07732)
6. Akhiad Bercovich, Tomer Ronen, Talor Abramovich, Nir Ailon, Nave Assaf, Mohammad Dabbah, Ido Galil, Amnon Geifman, Yonatan Geifman, Izhak Golan, Netanel Haber, Ehud Karpas, Roi Koren, Itay Levy, Pavlo Molchanov, Shahar Mor, Zach Moshe, Najeeb Nabwani, Omri Puny, Ran Rubin, Itamar Schen, Ido Shahaf,… [find](https://scholar.google.com/scholar?q=Akhiad+Bercovich%2C+Tomer+Ronen%2C+Talor+Abramovich%2C+Nir+Ailon%2C+Nave+Assaf%2C+Mohammad+Dabbah%2C+Ido+Galil%2C+Amnon+Geifman%2C+Yonatan+Geifman%2C+Izhak+Golan%2C+Netanel+Haber%2C+Ehud+Karpas%2C+Roi+Koren%2C+Itay+Levy%2C+Pavlo)
7. Akhiad Bercovich, Mohammad Dabbah, Omri Puny, Ido Galil, Amnon Geifman, Yonatan Geifman, Izhak Golan, Ehud Karpas, Itay Levy, Zach Moshe, Najeeb Nabwani, Tomer Ronen, Itamar Schen, Elad Segal, Ido Shahaf, Oren Tropp, Ran Zilberstein, and Ran El-Yaniv. Ffn fusion: Rethinking sequential computation in… [find](https://scholar.google.com/scholar?q=Akhiad+Bercovich%2C+Mohammad+Dabbah%2C+Omri+Puny%2C+Ido+Galil%2C+Amnon+Geifman%2C+Yonatan+Geifman%2C+Izhak+Golan%2C+Ehud+Karpas%2C+Itay+Levy%2C+Zach+Moshe%2C+Najeeb+Nabwani%2C+Tomer+Ronen%2C+Itamar+Schen%2C+Elad+Segal%2C+Ido+Sha)
8. BespokeLabs. Bespoke-stratos: The unreasonable effectiveness of reasoning distillation. www.bespokelabs.ai/blog/bespoke-stratos-the-unreasonable-effectiveness-of-reasoning-distillation, 2025. Accessed: 2025-01-22. [find](https://scholar.google.com/scholar?q=BespokeLabs%2E+Bespoke%2Dstratos%3A+The+unreasonable+effectiveness+of+reasoning+distillation%2E+www%2Ebespokelabs%2Eai%2Fblog%2Fbespoke%2Dstratos%2Dthe%2Dunreasonable%2Deffectiveness%2Dof%2Dreasoning%2Ddistillation%2C+2025%2E+Accessed)
9. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde De Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al. [Evaluating large language models trained on code](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/). arXiv preprint arXiv:2107.03374, 2021.
10. DeepSeek-AI, Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, Xiaokang Zhang, Xingkai Yu, Yu Wu, Z. F. Wu, Zhibin Gou, Zhihong Shao, Zhuoshu Li, Ziyi Gao, Aixin Liu, Bing Xue, Bingxuan Wang, Bochao Wu, Bei Feng, Chengda Lu, Chengg… — [DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2025-deepseek-r1-incentivizing-reasoning-capability/)
11. Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, et al. The llama 3 herd of models. arXiv preprint arXiv:2407.21783, 2024. [find](https://scholar.google.com/scholar?q=Aaron+Grattafiori%2C+Abhimanyu+Dubey%2C+Abhinav+Jauhri%2C+Abhinav+Pandey%2C+Abhishek+Kadian%2C+Ahmad+Al%2DDahle%2C+Aiesha+Letman%2C+Akhil+Mathur%2C+Alan+Schelten%2C+Alex+Vaughan%2C+et+al%2E+The+llama+3+herd+of+models%2E+arXiv+)
12. Dan Hendrycks, Steven Basart, Saurav Kadavath, Mantas Mazeika, Akul Arora, Ethan Guo, Collin Burns, Samir Puranik, Horace He, Dawn Song, and Jacob Steinhardt. [Measuring Coding Challenge Competence With APPS](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-coding-challenge-competence-apps/). NeurIPS, 2021a.
13. Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. [Measuring Massive Multitask Language Understanding](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/), 2021b. URL https://arxiv.org/abs/2009.03300. [↗](https://arxiv.org/abs/2009.03300)
14. Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. The curious case of neural text degeneration. In International Conference on Learning Representations, 2020. URL [https://openreview.net/forum?id=rygGQyrFvH](https://openreview.net/forum?id=rygGQyrFvH). [↗](https://openreview.net/forum?id=rygGQyrFvH)
15. HuggingFace. Open R1: A fully open reproduction of DeepSeek-R1, January 2025. URL [https://github.com/huggingface/open-r1](https://github.com/huggingface/open-r1). [↗](https://github.com/huggingface/open-r1)
16. Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar-Lezama, Koushik Sen, and Ion Stoica. [Livecodebench: Holistic and contamination free evaluation of large language models for code](https://md.research.elamur.ai/free/en/papers/jain-2024-livecodebench-holistic-contamination-free-evaluation/). arXiv preprint arXiv:2403.07974, 2024.
17. Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar-Lezama, Koushik Sen, and Ion Stoica. [Livecodebench: Holistic and contamination free evaluation of large language models for code](https://md.research.elamur.ai/free/en/papers/jain-2024-livecodebench-holistic-contamination-free-evaluation/). In The Thirteenth International Conference on Learning Representations, 20…
18. Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, and Ion Stoica. [Efficient Memory Management for Large Language Model Serving with PagedAttention](https://md.research.elamur.ai/free/en/papers/kwon-2023-efficient-memory-management-large-language/). In Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles, 2023.
19. Rongao Li, Jie Fu, Bo-Wen Zhang, Tao Huang, Zhihong Sun, Chen Lyu, Guang Liu, Zhi Jin, and Ge Li. TACO: Topics in Algorithmic COde generation dataset. arXiv preprint arXiv:2312.14852, 2023. [find](https://scholar.google.com/scholar?q=Rongao+Li%2C+Jie+Fu%2C+Bo%2DWen+Zhang%2C+Tao+Huang%2C+Zhihong+Sun%2C+Chen+Lyu%2C+Guang+Liu%2C+Zhi+Jin%2C+and+Ge+Li%2E+TACO%3A+Topics+in+Algorithmic+COde+generation+dataset%2E+arXiv+preprint+arXiv%3A2312%2E14852%2C+2023%2E)
20. Tianle Li, Wei-Lin Chiang, Evan Frick, Lisa Dunlap, Banghua Zhu, Joseph E. Gonzalez, and Ion Stoica. From Live Data to High-Quality Benchmarks: The Arena-Hard Pipeline, April 2024. URL [https://lmsys.org/blog/2024-04-19-arena-hard/](https://lmsys.org/blog/2024-04-19-arena-hard/). [↗](https://lmsys.org/blog/2024-04-19-arena-hard/)
21. Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, Thomas Hubert, Peter Choy, Cyprien de Masson d’Autume, Igor Babuschkin, Xinyun Chen, Po-Sen Huang, Johannes Welbl, Sven Gowal, Alexey Cherepanov, James M… — [Competition-Level Code Generation with AlphaCode](https://md.research.elamur.ai/free/en/papers/li-2022-competition-level-code-generation-alphacode/)
22. Hunter Lightman, Vineet Kosaraju, Yura Burda, Harri Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. Let’s Verify Step by Step. arXiv preprint arXiv:2305.[20050, 2023](https://md.research.elamur.ai/free/en/papers/lightman-2023-let-s-verify-step-step/).
23. Ivan Moshkov, Darragh Hanley, Ivan Sorokin, Shubham Toshniwal, Christof Henkel, Benedikt Schifferer, Wei Du, and Igor Gitman. AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning dataset, 2025. URL https://arxiv.org/abs/2504.16891. [↗](https://arxiv.org/abs/2504.16891)
24. Niklas Muennighoff, Zitong Yang, Weijia Shi, Xiang Lisa Li, Li Fei-Fei, Hannaneh Hajishirzi, Luke Zettlemoyer, Percy Liang, Emmanuel Candès, and Tatsunori Hashimoto. [s1: Simple test-time scaling](https://md.research.elamur.ai/free/en/papers/muennighoff-2025-s1-simple-test-time-scaling/), 2025. URL https://arxiv.org/abs/2501.19393. [↗](https://arxiv.org/abs/2501.19393)
25. NVIDIA. Llama-3.1-nemotron-70b-instruct. 1-Nemotron-70B-Instruct, 2024a. [https://huggingface.co/nvidia/Llama-3](https://huggingface.co/nvidia/Llama-3). [↗](https://huggingface.co/nvidia/Llama-3)
26. NVIDIA. Llama-3.1-nemotron-70b-reward. 1-Nemotron-70B-Reward-HF, 2024b. [https://huggingface.co/nvidia/Llama-3](https://huggingface.co/nvidia/Llama-3). [↗](https://huggingface.co/nvidia/Llama-3)
27. NVIDIA. [Nemotron-4 340B Technical Report](https://md.research.elamur.ai/free/en/papers/adler-2024-nemotron-4-340b-technical-report/), 2024c. URL https://arxiv.org/abs/2406.11704. [↗](https://arxiv.org/abs/2406.11704)
28. NVIDIA, Aaron Blakeman, Aarti Basant, Abhinav Khattar, Adithya Renduchintala, Akhiad Bercovich, Aleksander Ficek, Alexis Bjorlin, Ali Taghibakhshi, Amala Sanjay Deshmukh, Ameya Sunil Mahabaleshwarkar, Andrew Tao, Anna Shors, Ashwath Aithal, Ashwin Poojary, Ayush Dattagupta, Balaram Buddharaju, Bobby… [find](https://scholar.google.com/scholar?q=NVIDIA%2C+Aaron+Blakeman%2C+Aarti+Basant%2C+Abhinav+Khattar%2C+Adithya+Renduchintala%2C+Akhiad+Bercovich%2C+Aleksander+Ficek%2C+Alexis+Bjorlin%2C+Ali+Taghibakhshi%2C+Amala+Sanjay+Deshmukh%2C+Ameya+Sunil+Mahabaleshwarkar%2C)
29. OpenAI. Learning to Reason with LLMs, 2025. learning-to-reason-with-llms/. [find](https://scholar.google.com/scholar?q=OpenAI%2E+Learning+to+Reason+with+LLMs%2C+2025%2E+learning%2Dto%2Dreason%2Dwith%2Dllms%2F%2E)
30. URL [https://openai.com/index/OpenThoughts](https://openai.com/index/OpenThoughts). Open Thoughts. https://open-thoughts.ai, February 2025. [↗](https://openai.com/index/OpenThoughts)
31. Guilherme Penedo, Anton Lozhkov, Hynek Kydlíček, Loubna Ben Allal, Edward Beeching, Agustín Piqueres Lajarín, Quentin Gallouédec, Nathan Habib, Lewis Tunstall, and Leandro von Werra. CodeForces. [https://huggingface.co/datasets/open-r1/codeforces](https://huggingface.co/datasets/open-r1/codeforces), 2025a. [↗](https://huggingface.co/datasets/open-r1/codeforces)
32. Guilherme Penedo, Anton Lozhkov, Hynek Kydlíček, Loubna Ben Allal, Edward Beeching, Agustín Piqueres Lajarín, Quentin Gallouédec, Nathan Habib, Lewis Tunstall, and Leandro von Werra. IOI. [https://huggingface.co/datasets/open-r1/ioi](https://huggingface.co/datasets/open-r1/ioi), 2025b. [↗](https://huggingface.co/datasets/open-r1/ioi)
33. Qwen. Qwen2.5: A Party of Foundation Models, September 2024. URL [https://qwenlm.github.io/blog/qwen2.5/](https://qwenlm.github.io/blog/qwen2.5/). [↗](https://qwenlm.github.io/blog/qwen2.5/)
34. David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman. [Gpqa: A graduate-level google-proof q&a benchmark](https://md.research.elamur.ai/free/en/papers/rein-2023-gpqa-graduate-level-google-proof/), 2023.
35. David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman. [GPQA: A Graduate-Level Google-Proof Q&A Benchmark](https://md.research.elamur.ai/free/en/papers/rein-2023-gpqa-graduate-level-google-proof/). In COLM, 2024.
36. RyokoAI. RyokoAI/ShareGPT52K. [https://huggingface.co/datasets/RyokoAI/ShareGPT52K](https://huggingface.co/datasets/RyokoAI/ShareGPT52K), 2023. [↗](https://huggingface.co/datasets/RyokoAI/ShareGPT52K)
37. Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, Y. K. Li, Y. Wu, and Daya Guo. [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://md.research.elamur.ai/free/en/papers/shao-2024-deepseekmath-pushing-limits-mathematical-reasoning/), 2024. URL https://arxiv.org/abs/2402.03300. [↗](https://arxiv.org/abs/2402.03300)
38. Gerald Shen, Zhilin Wang, Olivier Delalleau, Jiaqi Zeng, Yi Dong, Daniel Egert, Shengyang Sun, Jimmy J. Zhang, Sahil Jain, Ali Taghibakhshi, Markel Sanz Ausin, Ashwath Aithal, and Oleksii Kuchaiev. NeMo-Aligner: Scalable toolkit for efficient model alignment. In First Conference on Language Modeling… [find](https://scholar.google.com/scholar?q=Gerald+Shen%2C+Zhilin+Wang%2C+Olivier+Delalleau%2C+Jiaqi+Zeng%2C+Yi+Dong%2C+Daniel+Egert%2C+Shengyang+Sun%2C+Jimmy+J%2E+Zhang%2C+Sahil+Jain%2C+Ali+Taghibakhshi%2C+Markel+Sanz+Ausin%2C+Ashwath+Aithal%2C+and+Oleksii+Kuchaiev%2E+Ne)
39. Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, and Bryan Catanzaro. Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism, 2020. URL https://arxiv.org/abs/1909.08053. [↗](https://arxiv.org/abs/1909.08053)
40. Stack Exchange Data. 20240402_bis, 2024. [find](https://scholar.google.com/scholar?q=Stack+Exchange+Data%2E+20240402%5Fbis%2C+2024%2E)
41. Dump 2024-04-02. [https://archive.org/details/stackexchange_](https://archive.org/details/stackexchange_) [↗](https://archive.org/details/stackexchange_)
42. Shengyang Sun, Yian Zhang, Alexander Bukharin, David Mosallanezhad, Jiaqi Zeng, Soumye Singhal, Gerald Shen, Adithya Renduchintala, Tugrul Konuk, Yi Dong, Zhilin Wang, Dmitry Chichkov, Olivier Delalleau, and Oleksii Kuchaiev. Reward-aware preference optimization: A unified mathematical framework for… — [arXiv:2502.00203](https://arxiv.org/abs/2502.00203) [find](https://scholar.google.com/scholar?q=Shengyang+Sun%2C+Yian+Zhang%2C+Alexander+Bukharin%2C+David+Mosallanezhad%2C+Jiaqi+Zeng%2C+Soumye+Singhal%2C+Gerald+Shen%2C+Adithya+Renduchintala%2C+Tugrul+Konuk%2C+Yi+Dong%2C+Zhilin+Wang%2C+Dmitry+Chichkov%2C+Olivier+Delalle)
43. Sijun Tan, Siyuan Zhuang, Kyle Montgomery, William Y Tang, Alejandro Cuadron, Chenguang Wang, Raluca Ada Popa, and Ion Stoica. JudgeBench: A Benchmark for Evaluating LLM-Based Judges. In ICLR, 2025. [find](https://scholar.google.com/scholar?q=Sijun+Tan%2C+Siyuan+Zhuang%2C+Kyle+Montgomery%2C+William+Y+Tang%2C+Alejandro+Cuadron%2C+Chenguang+Wang%2C+Raluca+Ada+Popa%2C+and+Ion+Stoica%2E+JudgeBench%3A+A+Benchmark+for+Evaluating+LLM%2DBased+Judges%2E+In+ICLR%2C+2025%2E)
44. Shubham Toshniwal, Wei Du, Ivan Moshkov, Branislav Kisacanin, Alexan Ayrapetyan, and Igor Gitman. OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data. In ICLR, 2025. [find](https://scholar.google.com/scholar?q=Shubham+Toshniwal%2C+Wei+Du%2C+Ivan+Moshkov%2C+Branislav+Kisacanin%2C+Alexan+Ayrapetyan%2C+and+Igor+Gitman%2E+OpenMathInstruct%2D2%3A+Accelerating+AI+for+Math+with+Massive+Open%2DSource+Instruction+Data%2E+In+ICLR%2C+2025%2E)
45. TreeSitter. Tree sitter. [https://github.com/tree-sitter/tree-sitter](https://github.com/tree-sitter/tree-sitter), 2013. [↗](https://github.com/tree-sitter/tree-sitter)
46. Yubo Wang, Xueguang Ma, Ge Zhang, Yuansheng Ni, Abhranil Chandra, Shiguang Guo, Weiming Ren, Aaran Arulraj, Xuan He, Ziyan Jiang, Tianle Li, Max Ku, Kai Wang, Alex Zhuang, Rongqi Fan, Xiang Yue, and Wenhu Chen. [MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark](https://md.research.elamur.ai/free/en/papers/wang-2024-mmlu-pro-more-robust-challenging/), 2024…
47. Zhilin Wang, Yi Dong, Olivier Delalleau, Jiaqi Zeng, Gerald Shen, Daniel Egert, Jimmy J Zhang, Makesh Narsimhan Sreedhar, and Oleksii Kuchaiev. HelpSteer2: Open-source dataset for training top-performing reward models. In ICLR, 2025a. [find](https://scholar.google.com/scholar?q=Zhilin+Wang%2C+Yi+Dong%2C+Olivier+Delalleau%2C+Jiaqi+Zeng%2C+Gerald+Shen%2C+Daniel+Egert%2C+Jimmy+J+Zhang%2C+Makesh+Narsimhan+Sreedhar%2C+and+Oleksii+Kuchaiev%2E+HelpSteer2%3A+Open%2Dsource+dataset+for+training+top%2Dperform)
48. Zhilin Wang, Jiaqi Zeng, Olivier Delalleau, Daniel Egert, Ellie Evans, Hoo-Chang Shin, Felipe Soares, Yi Dong, and Oleksii Kuchaiev. Dedicated feedback and edit models empower inference-time scaling for open-ended general-domain tasks, 2025b. URL https://arxiv.org/abs/2503.04378. — [arXiv:2503.04378](https://arxiv.org/abs/2503.04378) [↗](https://arxiv.org/abs/2503.04378)
49. Liang Wen, Yunke Cai, Fenrui Xiao, Xin He, Qi An, Zhenyu Duan, Yimin Du, Junchen Liu, Lifu Tang, Xiaowei Lv, Haosheng Zou, Yongchao Deng, Shousheng Jia, and Xiangzheng Zhang. Light-r1: Curriculum sft, dpo and rl for long cot from scratch and beyond, 2025. URL https://arxiv.org/abs/2503.10460. [↗](https://arxiv.org/abs/2503.10460)
50. Fanjia Yan, Huanzhi Mao, Charlie Cheng-Jie Ji, Tianjun Zhang, Shishir G. Patil, Ion Stoica, and Joseph E. Gonzalez. Berkeley Function Calling Leaderboard. 2024. [find](https://scholar.google.com/scholar?q=Fanjia+Yan%2C+Huanzhi+Mao%2C+Charlie+Cheng%2DJie+Ji%2C+Tianjun+Zhang%2C+Shishir+G%2E+Patil%2C+Ion+Stoica%2C+and+Joseph+E%2E+Gonzalez%2E+Berkeley+Function+Calling+Leaderboard%2E+2024%2E)
51. Shuo Yang, Wei-Lin Chiang, Lianmin Zheng, Joseph E. Gonzalez, and Ion Stoica. [Rethinking Benchmark and Contamination for Language Models with Rephrased Samples](https://md.research.elamur.ai/free/en/papers/yang-2023-rethinking-benchmark-contamination-language-models/). 2023.
52. Wenting Zhao, Xiang Ren, Jack Hessel, Claire Cardie, Yejin Choi, and Yuntian Deng. [Wildchat: 1m chatgpt interaction logs in the wild](https://md.research.elamur.ai/free/en/papers/zhao-2024-wildchat-1m-chatgpt-interaction-logs/), 2024. URL https://arxiv.org/abs/2405.01470. [↗](https://arxiv.org/abs/2405.01470)
53. Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, Chuyue Sun, Jeff Huang, Cody Hao Yu, Shiyi Cao, Christos Kozyrakis, Ion Stoica, Joseph E. Gonzalez, Clark Barrett, and Ying Sheng. [SGLang: Efficient execution of structured language model programs](https://md.research.elamur.ai/free/en/papers/zheng-2023-sglang-efficient-execution-structured-language/). In The Thirty-eighth Annual Conference on Neural Informat…
54. Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, and Le Hou. [Instruction-following evaluation for large language models](https://md.research.elamur.ai/free/en/papers/zhou-2023-instruction-following-evaluation-large-language/). arXiv preprint arXiv:2311.07911, 2023.

*Updated 24 October 2026*