---
title: "Nemotron 3 Nano — paper by Blakeman et al. (2025)"
description: "NVIDIA presents Nemotron 3 Nano 30B-A3B, an open language model for agentic use, reasoning… 91 references, cited by 27 papers here."
authors: ["NVIDIA: Aaron Blakeman", "Aaron Grattafiori", "Aarti Basant", "Abhibha Gupta", "Abhinav Khattar", "Adi Renduchintala", "Aditya Vavre", "Akanksha Shukla", "Akhiad Bercovich", "Aleksander Ficek", "Aleksandr Shaposhnikov", "Alex Kondratenko", "Alexander Bukharin", "Alexandre Milesi", "Ali Taghibakhshi", "Alisa Liu", "Amelia Barton", "Ameya Sunil Mahabaleshwarkar", "Amir Klein", "Amit Zuker", "Amnon Geifman", "Amy Shen", "Anahita Bhiwandiwalla", "Andrew Tao", "Ann Guan", "Anubhav Mandarwal", "Arham Mehta", "Ashwath Aithal", "Ashwin Poojary", "Asif Ahamed", "Asma Kuriparambil Thekkumpate", "Ayush Dattagupta", "Banghua Zhu", "Bardiya Sadeghi", "Barnaby Simkin", "Ben Lanir", "Benedikt Schifferer", "Besmira Nushi", "Bilal Kartal", "Bita Darvish Rouhani", "Boris Ginsburg", "Brandon Norick", "Brandon Soubasis", "Branislav Kisacanin", "Brian Yu", "Bryan Catanzaro", "Carlo del Mundo", "Chantal Hwang", "Charles Wang", "Cheng-Ping Hsieh", "Chenghao Zhang", "Chenhan Yu", "Chetan Mungekar", "Chintan Patel", "Chris Alexiuk", "Christopher Parisien", "Collin Neale", "Damon Mosk-Aoyama", "Dan Su", "Dane Corneil", "Daniel Afrimi", "Daniel Rohrer", "Daniel Serebrenik", "Daria Gitman", "Daria Levy", "Darko Stosic", "David Mosallanezhad", "Deepak Narayanan", "Dhruv Nathawani", "Dima Rekesh", "Dina Yared", "Divyanshu Kakwani", "Dong Ahn", "Duncan Riach", "Dusan Stosic", "Edgar Minasyan", "Edward Lin", "Eileen Long", "Eileen Peters Long", "Elena Lantz", "Ellie Evans", "Elliott Ning", "Eric Chung", "Eric Harper", "Eric Tramel", "Erick Galinkin", "Erik Pounds", "Evan Briones", "Evelina Bakhturina", "Faisal Ladhak", "Fay Wang", "Fei Jia", "Felipe Soares", "Feng Chen", "Ferenc Galko", "Frankie Siino", "Gal Hubara Agam", "Ganesh Ajjanagadde", "Gantavya Bhatt", "Gargi Prasad", "George Armstrong", "Gerald Shen", "Gorkem Batmaz", "Grigor Nalbandyan", "Haifeng Qian", "Harsh Sharma", "Hayley Ross", "Helen Ngo", "Herman Sahota", "Hexin Wang", "Himanshu Soni", "Hiren Upadhyay", "Huizi Mao", "Huy C Nguyen", "Huy Q Nguyen", "Iain Cunningham", "Ido Shahaf", "Igor Gitman", "Ilya Loshchilov", "Ivan Moshkov", "Izzy Putterman", "Jan Kautz", "Jane Polak Scowcroft", "Jared Casper", "Jatin Mitra", "Jeffrey Glick", "Jenny Chen", "Jesse Oliver", "Jian Zhang", "Jiaqi Zeng", "Jie Lou", "Jimmy Zhang", "Jining Huang", "Joey Conway", "Joey Guman", "John Kamalu", "Johnny Greco", "Jonathan Cohen", "Joseph Jennings", "Joyjit Daw", "Julien Veron Vialard", "Junkeun Yi", "Jupinder Parmar", "Kai Xu", "Kan Zhu", "Kari Briski", "Katherine Cheung", "Katherine Luna", "Keshav Santhanam", "Kevin Shih", "Kezhi Kong", "Khushi Bhardwaj", "Krishna C. Puvvada", "Krzysztof Pawelec", "Kumar Anik", "Lawrence McAfee", "Laya Sleiman", "Leon Derczynski", "Li Ding", "Lucas Liebenwein", "Luis Vega", "Maanu Grover", "Maarten Van Segbroeck", "Maer Rodrigues de Melo", "Makesh Narsimhan Sreedhar", "Manoj Kilaru", "Maor Ashkenazi", "Marc Romeijn", "Mark Cai", "Markus Kliegl", "Maryam Moosaei", "Matvei Novikov", "Mehrzad Samadi", "Melissa Corpuz", "Mengru Wang", "Meredith Price", "Michael Boone", "Michael Evans", "Miguel Martinez", "Mike Chrzanowski", "Mohammad Shoeybi", "Mostofa Patwary", "Nabin Mulepati", "Natalie Hereth", "Nave Assaf", "Negar Habibi", "Neta Zmora", "Netanel Haber", "Nicola Sessions", "Nidhi Bhatia", "Nikhil Jukar", "Nikki Pope", "Nikolai Ludwig", "Nima Tajbakhsh", "Nirmal Juluru", "Oleksii Hrinchuk", "Oleksii Kuchaiev", "Olivier Delalleau", "Oluwatobi Olabiyi", "Omer Ullman Argov", "Ouye Xie", "Parth Chadha", "Pasha Shamis", "Pavlo Molchanov", "Pawel Morkisz", "Peter Dykas", "Peter Jin", "Pinky Xu", "Piotr Januszewski", "Pranav Prashant Thombre", "Prasoon Varshney", "Pritam Gundecha", "Qing Miao", "Rabeeh Karimi Mahabadi", "Ran El-Yaniv", "Ran Zilberstein", "Rasoul Shafipour", "Rich Harang", "Rick Izzo", "Rima Shahbazyan", "Rishabh Garg", "Ritika Borkar", "Ritu Gala", "Riyad Islam", "Roger Waleffe", "Rohit Watve", "Roi Koren", "Ruoxi Zhang", "Russell J. Hewett", "Ryan Prenger", "Ryan Timbrook", "Sadegh Mahdavi", "Sahil Modi", "Samuel Kriman", "Sanjay Kariyappa", "Sanjeev Satheesh", "Saori Kaji", "Satish Pasumarthi", "Sean Narentharen", "Sean Narenthiran", "Seonmyeong Bak", "Sergey Kashirsky", "Seth Poulos", "Shahar Mor", "Shanmugam Ramasamy", "Shantanu Acharya", "Shaona Ghosh", "Sharath Turuvekere Sreenivas", "Shelby Thomas", "Shiqing Fan", "Shreya Gopal", "Shrimai Prabhumoye", "Shubham Pachori", "Shubham Toshniwal", "Shuoyang Ding", "Siddharth Singh", "Simeng Sun", "Smita Ithape", "Somshubra Majumdar", "Soumye Singhal", "Stefania Alborghetti", "Stephen Ge", "Sugam Dipak Devare", "Sumeet Kumar Barua", "Suseella Panguluri", "Suyog Gupta", "Sweta Priyadarshi", "Syeda Nahida Akter", "Tan Bui", "Teodor-Dumitru Ene", "Terry Kong", "Thanh Do", "Tijmen Blankevoort", "Tom Balough", "Tomer Asida", "Tomer Bar Natan", "Tugrul Konuk", "Twinkle Vashishth", "Udi Karpas", "Ushnish De", "Vahid Noorozi", "Vahid Noroozi", "Venkat Srinivasan", "Venmugil Elango", "Vijay Korthikanti", "Vitaly Kurin", "Vitaly Lavrukhin", "Wanli Jiang", "Wasi Uddin Ahmad", "Wei Du", "Wei Ping", "Wenfei Zhou", "Will Jennings", "William Zhang", "Wojciech Prazuch", "Xiaowei Ren", "Yashaswi Karnati", "Yejin Choi", "Yev Meyer", "Yi-Fu Wu", "Yian Zhang", "Ying Lin", "Yonatan Geifman", "Yonggan Fu", "Yoshi Subara", "Yoshi Suhara", "Yubo Gao", "Zach Moshe", "Zhen Dong", "Zihan Liu", "Zijia Chen", "Zijie Yan"]
year: 2025
venue: "arXiv:2512.20848"
source: "https://arxiv.org/abs/2512.20848"
doi: "10.48550/arxiv.2512.20848"
arxiv: "2512.20848"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/blakeman-2025-nemotron-3-nano-open-efficient/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/blakeman-2025-nemotron-3-nano-open-efficient/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/) / Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning

# Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning

**Authors:** [NVIDIA: Aaron Blakeman](https://md.research.elamur.ai/free/en/authors/nvidia-aaron-blakeman/), [Aaron Grattafiori](https://md.research.elamur.ai/free/en/authors/aaron-grattafiori/), [Aarti Basant](https://md.research.elamur.ai/free/en/authors/aarti-basant/), Abhibha Gupta, [Abhinav Khattar](https://md.research.elamur.ai/free/en/authors/abhinav-khattar/), Adi Renduchintala, Aditya Vavre, Akanksha Shukla, [Akhiad Bercovich](https://md.research.elamur.ai/free/en/authors/akhiad-bercovich/), [Aleksander Ficek](https://md.research.elamur.ai/free/en/authors/aleksander-ficek/), Aleksandr Shaposhnikov, [Alex Kondratenko](https://md.research.elamur.ai/free/en/authors/alex-kondratenko/), Alexander Bukharin, Alexandre Milesi, Ali Taghibakhshi, [Alisa Liu](https://md.research.elamur.ai/free/en/authors/alisa-liu/), Amelia Barton, [Ameya Sunil Mahabaleshwarkar](https://md.research.elamur.ai/free/en/authors/ameya-sunil-mahabaleshwarkar/), Amir Klein, Amit Zuker, Amnon Geifman, Amy Shen, Anahita Bhiwandiwalla, [Andrew Tao](https://md.research.elamur.ai/free/en/authors/andrew-tao/), Ann Guan, Anubhav Mandarwal, Arham Mehta, Ashwath Aithal, Ashwin Poojary, Asif Ahamed, Asma Kuriparambil Thekkumpate, [Ayush Dattagupta](https://md.research.elamur.ai/free/en/authors/ayush-dattagupta/), [Banghua Zhu](https://md.research.elamur.ai/free/en/authors/banghua-zhu/), Bardiya Sadeghi, Barnaby Simkin, Ben Lanir, Benedikt Schifferer, Besmira Nushi, Bilal Kartal, Bita Darvish Rouhani, [Boris Ginsburg](https://md.research.elamur.ai/free/en/authors/boris-ginsburg/), [Brandon Norick](https://md.research.elamur.ai/free/en/authors/brandon-norick/), Brandon Soubasis, Branislav Kisacanin, Brian Yu, [Bryan Catanzaro](https://md.research.elamur.ai/free/en/authors/bryan-catanzaro/), Carlo del Mundo, Chantal Hwang, Charles Wang, [Cheng-Ping Hsieh](https://md.research.elamur.ai/free/en/authors/cheng-ping-hsieh/), Chenghao Zhang, Chenhan Yu, Chetan Mungekar, Chintan Patel, Chris Alexiuk, Christopher Parisien, Collin Neale, Damon Mosk-Aoyama, [Dan Su](https://md.research.elamur.ai/free/en/authors/dan-su/), Dane Corneil, Daniel Afrimi, Daniel Rohrer, Daniel Serebrenik, Daria Gitman, Daria Levy, Darko Stosic, David Mosallanezhad, Deepak Narayanan, Dhruv Nathawani, Dima Rekesh, Dina Yared, [Divyanshu Kakwani](https://md.research.elamur.ai/free/en/authors/divyanshu-kakwani/), Dong Ahn, Duncan Riach, Dusan Stosic, Edgar Minasyan, Edward Lin, Eileen Long, Eileen Peters Long, Elena Lantz, Ellie Evans, Elliott Ning, Eric Chung, Eric Harper, Eric Tramel, Erick Galinkin, Erik Pounds, Evan Briones, [Evelina Bakhturina](https://md.research.elamur.ai/free/en/authors/evelina-bakhturina/), [Faisal Ladhak](https://md.research.elamur.ai/free/en/authors/faisal-ladhak/), Fay Wang, Fei Jia, Felipe Soares, [Feng Chen](https://md.research.elamur.ai/free/en/authors/feng-chen/), Ferenc Galko, Frankie Siino, Gal Hubara Agam, Ganesh Ajjanagadde, Gantavya Bhatt, Gargi Prasad, George Armstrong, Gerald Shen, Gorkem Batmaz, Grigor Nalbandyan, Haifeng Qian, Harsh Sharma, [Hayley Ross](https://md.research.elamur.ai/free/en/authors/hayley-ross/), Helen Ngo, Herman Sahota, Hexin Wang, Himanshu Soni, Hiren Upadhyay, Huizi Mao, Huy C Nguyen, Huy Q Nguyen, Iain Cunningham, Ido Shahaf, Igor Gitman, Ilya Loshchilov, Ivan Moshkov, Izzy Putterman, [Jan Kautz](https://md.research.elamur.ai/free/en/authors/jan-kautz/), Jane Polak Scowcroft, [Jared Casper](https://md.research.elamur.ai/free/en/authors/jared-casper/), Jatin Mitra, Jeffrey Glick, Jenny Chen, Jesse Oliver, [Jian Zhang](https://md.research.elamur.ai/free/en/authors/jian-zhang/), [Jiaqi Zeng](https://md.research.elamur.ai/free/en/authors/jiaqi-zeng/), Jie Lou, Jimmy Zhang, Jining Huang, Joey Conway, Joey Guman, John Kamalu, Johnny Greco, Jonathan Cohen, [Joseph Jennings](https://md.research.elamur.ai/free/en/authors/joseph-jennings/), Joyjit Daw, Julien Veron Vialard, Junkeun Yi, [Jupinder Parmar](https://md.research.elamur.ai/free/en/authors/jupinder-parmar/), Kai Xu, Kan Zhu, Kari Briski, Katherine Cheung, Katherine Luna, [Keshav Santhanam](https://md.research.elamur.ai/free/en/authors/keshav-santhanam/), Kevin Shih, [Kezhi Kong](https://md.research.elamur.ai/free/en/authors/kezhi-kong/), Khushi Bhardwaj, Krishna C. Puvvada, Krzysztof Pawelec, Kumar Anik, [Lawrence McAfee](https://md.research.elamur.ai/free/en/authors/lawrence-mcafee/), Laya Sleiman, [Leon Derczynski](https://md.research.elamur.ai/free/en/authors/leon-derczynski/), Li Ding, Lucas Liebenwein, Luis Vega, Maanu Grover, Maarten Van Segbroeck, Maer Rodrigues de Melo, [Makesh Narsimhan Sreedhar](https://md.research.elamur.ai/free/en/authors/makesh-narsimhan-sreedhar/), Manoj Kilaru, Maor Ashkenazi, Marc Romeijn, Mark Cai, Markus Kliegl, Maryam Moosaei, Matvei Novikov, Mehrzad Samadi, Melissa Corpuz, [Mengru Wang](https://md.research.elamur.ai/free/en/authors/mengru-wang/), Meredith Price, Michael Boone, Michael Evans, Miguel Martinez, Mike Chrzanowski, [Mohammad Shoeybi](https://md.research.elamur.ai/free/en/authors/mohammad-shoeybi/), [Mostofa Patwary](https://md.research.elamur.ai/free/en/authors/mostofa-patwary/), Nabin Mulepati, Natalie Hereth, Nave Assaf, Negar Habibi, Neta Zmora, Netanel Haber, Nicola Sessions, Nidhi Bhatia, Nikhil Jukar, Nikki Pope, Nikolai Ludwig, Nima Tajbakhsh, Nirmal Juluru, Oleksii Hrinchuk, Oleksii Kuchaiev, Olivier Delalleau, Oluwatobi Olabiyi, Omer Ullman Argov, Ouye Xie, Parth Chadha, Pasha Shamis, Pavlo Molchanov, Pawel Morkisz, Peter Dykas, Peter Jin, Pinky Xu, Piotr Januszewski, Pranav Prashant Thombre, Prasoon Varshney, Pritam Gundecha, Qing Miao, [Rabeeh Karimi Mahabadi](https://md.research.elamur.ai/free/en/authors/rabeeh-karimi-mahabadi/), Ran El-Yaniv, Ran Zilberstein, Rasoul Shafipour, Rich Harang, Rick Izzo, Rima Shahbazyan, Rishabh Garg, Ritika Borkar, Ritu Gala, Riyad Islam, Roger Waleffe, Rohit Watve, Roi Koren, Ruoxi Zhang, Russell J. Hewett, [Ryan Prenger](https://md.research.elamur.ai/free/en/authors/ryan-prenger/), Ryan Timbrook, Sadegh Mahdavi, Sahil Modi, Samuel Kriman, Sanjay Kariyappa, [Sanjeev Satheesh](https://md.research.elamur.ai/free/en/authors/sanjeev-satheesh/), Saori Kaji, Satish Pasumarthi, Sean Narentharen, [Sean Narenthiran](https://md.research.elamur.ai/free/en/authors/sean-narenthiran/), Seonmyeong Bak, Sergey Kashirsky, Seth Poulos, Shahar Mor, Shanmugam Ramasamy, Shantanu Acharya, Shaona Ghosh, Sharath Turuvekere Sreenivas, Shelby Thomas, Shiqing Fan, Shreya Gopal, [Shrimai Prabhumoye](https://md.research.elamur.ai/free/en/authors/shrimai-prabhumoye/), Shubham Pachori, [Shubham Toshniwal](https://md.research.elamur.ai/free/en/authors/shubham-toshniwal/), [Shuoyang Ding](https://md.research.elamur.ai/free/en/authors/shuoyang-ding/), Siddharth Singh, [Simeng Sun](https://md.research.elamur.ai/free/en/authors/simeng-sun/), Smita Ithape, [Somshubra Majumdar](https://md.research.elamur.ai/free/en/authors/somshubra-majumdar/), Soumye Singhal, Stefania Alborghetti, Stephen Ge, Sugam Dipak Devare, Sumeet Kumar Barua, Suseella Panguluri, Suyog Gupta, Sweta Priyadarshi, Syeda Nahida Akter, Tan Bui, Teodor-Dumitru Ene, Terry Kong, Thanh Do, Tijmen Blankevoort, Tom Balough, Tomer Asida, Tomer Bar Natan, Tugrul Konuk, Twinkle Vashishth, Udi Karpas, Ushnish De, Vahid Noorozi, [Vahid Noroozi](https://md.research.elamur.ai/free/en/authors/vahid-noroozi/), Venkat Srinivasan, Venmugil Elango, [Vijay Korthikanti](https://md.research.elamur.ai/free/en/authors/vijay-korthikanti/), Vitaly Kurin, [Vitaly Lavrukhin](https://md.research.elamur.ai/free/en/authors/vitaly-lavrukhin/), Wanli Jiang, [Wasi Uddin Ahmad](https://md.research.elamur.ai/free/en/authors/wasi-uddin-ahmad/), Wei Du, [Wei Ping](https://md.research.elamur.ai/free/en/authors/wei-ping/), Wenfei Zhou, Will Jennings, William Zhang, Wojciech Prazuch, Xiaowei Ren, Yashaswi Karnati, [Yejin Choi](https://md.research.elamur.ai/free/en/authors/yejin-choi/), Yev Meyer, Yi-Fu Wu, Yian Zhang, [Ying Lin](https://md.research.elamur.ai/free/en/authors/ying-lin/), Yonatan Geifman, [Yonggan Fu](https://md.research.elamur.ai/free/en/authors/yonggan-fu/), Yoshi Subara, [Yoshi Suhara](https://md.research.elamur.ai/free/en/authors/yoshi-suhara/), Yubo Gao, Zach Moshe, Zhen Dong, [Zihan Liu](https://md.research.elamur.ai/free/en/authors/zihan-liu/), [Zijia Chen](https://md.research.elamur.ai/free/en/authors/zijia-chen/) and Zijie Yan · **Year:** 2025 · **Venue:** arXiv:2512.20848 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2512.20848) · [PDF](https://arxiv.org/pdf/2512.20848) · [DOI 10.48550/arxiv.2512.20848](https://doi.org/10.48550/arxiv.2512.20848) · [arXiv 2512.20848](https://arxiv.org/abs/2512.20848) · [OpenAlex](https://openalex.org/W7117305506)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · [27](https://md.research.elamur.ai/free/en/papers/blakeman-2025-nemotron-3-nano-open-efficient/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
NVIDIA presents Nemotron 3 Nano 30B-A3B, an open language model for agentic use, reasoning and chat that aims for a better balance between accuracy and inference speed. It keeps the hybrid layout of earlier Nemotron models, mixing Mamba-2 blocks with Grouped-Query-Attention. However, it replaces dense feed-forward layers with fine-grained Mixture-of-Experts layers plus shared experts. The base model was pretrained on 25T tokens in two phases: a broad mix first, then a high-quality stage. More than 3T of these tokens are new relative to Nemotron 2. Post-training combined SFT, jointly trained multi-environment RLVR, and RLHF guided by a generative reward model, followed by FP8 quantization. The model outperforms Nemotron 2 Nano while using under half the active parameters. It also matches or beats GPT-OSS-20B and Qwen3-30B-A3B-Thinking-2507 on many benchmarks and handles contexts up to 1M tokens. Because the weights, recipes, code and most of the data are public, it offers a reproducible foundation for efficient open-model research.

## Key points
- **Size and architecture:** 31.6B total parameters, of which 3.2B are active per token (3.6B counting embeddings). The model has 52 layers, and each MoE layer routes to 6 of 128 experts plus 2 shared ones. It uses squared ReLU, sigmoid router gating, RMSNorm, and no positional embeddings.
- **Inference speed:** Measured on a single H200 with 8K input and 16K output tokens. Throughput is about 3.3× that of Qwen3-30B-A3B-Thinking-2507 and 2.2× that of GPT-OSS-20B, using FP8 for Nemotron and Qwen3.
- **Pretraining schedule:** Warmup-Stable-Decay, split into 23.5T tokens of diverse data and 1.5T tokens of high-quality data.
- **New data:**
  - Nemotron-CC-v2.1: about 2.5T English tokens, including 3 new Common Crawl snapshots, 2.1T rephrased Medium-High-Quality tokens, and text translated into English.
  - Nemotron-CC-Code-v1: about 428B code tokens, extracted with Lynx and cleaned with Phi-4.
  - Nemotron-Pretraining-Code-v2: GitHub code up to April 2025, plus Python rewriting and Python→C++ transpilation done with Qwen3 32B.
  - Nemotron-Pretraining-Specialized-v1: synthetic data for areas such as STEM reasoning and scientific coding.
- **Releases on Hugging Face:**
  - Checkpoints: FP8 and BF16 post-trained models, and the BF16 Base model.
  - Reward model: Qwen-3-Nemotron-235B-A22B-GenRM.
  - Data: Nemotron-SFT-Data and Nemotron-RL-Data.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,426 works

## Cite

Cite as: NVIDIA: Aaron Blakeman, Aaron Grattafiori, Aarti Basant, Abhibha Gupta, Abhinav Khattar, Adi Renduchintala, Aditya Vavre, Akanksha Shukla, Akhiad Bercovich, Aleksander Ficek, Aleksandr Shaposhnikov, Alex Kondratenko, Alexander Bukharin, Alexandre Milesi, Ali Taghibakhshi, Alisa Liu, Amelia Barton, Ameya Sunil Mahabaleshwarkar, Amir Klein, Amit Zuker, Amnon Geifman, Amy Shen, Anahita Bhiwandiwalla, Andrew Tao, Ann Guan, Anubhav Mandarwal, Arham Mehta, Ashwath Aithal, Ashwin Poojary, Asif Ahamed, Asma Kuriparambil Thekkumpate, Ayush Dattagupta, Banghua Zhu, Bardiya Sadeghi, Barnaby Simkin, Ben Lanir, Benedikt Schifferer, Besmira Nushi, Bilal Kartal, Bita Darvish Rouhani, Boris Ginsburg, Brandon Norick, Brandon Soubasis, Branislav Kisacanin, Brian Yu, Bryan Catanzaro, Carlo del Mundo, Chantal Hwang, Charles Wang, Cheng-Ping Hsieh, Chenghao Zhang, Chenhan Yu, Chetan Mungekar, Chintan Patel, Chris Alexiuk, Christopher Parisien, Collin Neale, Damon Mosk-Aoyama, Dan Su, Dane Corneil, Daniel Afrimi, Daniel Rohrer, Daniel Serebrenik, Daria Gitman, Daria Levy, Darko Stosic, David Mosallanezhad, Deepak Narayanan, Dhruv Nathawani, Dima Rekesh, Dina Yared, Divyanshu Kakwani, Dong Ahn, Duncan Riach, Dusan Stosic, Edgar Minasyan, Edward Lin, Eileen Long, Eileen Peters Long, Elena Lantz, Ellie Evans, Elliott Ning, Eric Chung, Eric Harper, Eric Tramel, Erick Galinkin, Erik Pounds, Evan Briones, Evelina Bakhturina, Faisal Ladhak, Fay Wang, Fei Jia, Felipe Soares, Feng Chen, Ferenc Galko, Frankie Siino, Gal Hubara Agam, Ganesh Ajjanagadde, Gantavya Bhatt, Gargi Prasad, George Armstrong, Gerald Shen, Gorkem Batmaz, Grigor Nalbandyan, Haifeng Qian, Harsh Sharma, Hayley Ross, Helen Ngo, Herman Sahota, Hexin Wang, Himanshu Soni, Hiren Upadhyay, Huizi Mao, Huy C Nguyen, Huy Q Nguyen, Iain Cunningham, Ido Shahaf, Igor Gitman, Ilya Loshchilov, Ivan Moshkov, Izzy Putterman, Jan Kautz, Jane Polak Scowcroft, Jared Casper, Jatin Mitra, Jeffrey Glick, Jenny Chen, Jesse Oliver, Jian Zhang, Jiaqi Zeng, Jie Lou, Jimmy Zhang, Jining Huang, Joey Conway, Joey Guman, John Kamalu, Johnny Greco, Jonathan Cohen, Joseph Jennings, Joyjit Daw, Julien Veron Vialard, Junkeun Yi, Jupinder Parmar, Kai Xu, Kan Zhu, Kari Briski, Katherine Cheung, Katherine Luna, Keshav Santhanam, Kevin Shih, Kezhi Kong, Khushi Bhardwaj, Krishna C. Puvvada, Krzysztof Pawelec, Kumar Anik, Lawrence McAfee, Laya Sleiman, Leon Derczynski, Li Ding, Lucas Liebenwein, Luis Vega, Maanu Grover, Maarten Van Segbroeck, Maer Rodrigues de Melo, Makesh Narsimhan Sreedhar, Manoj Kilaru, Maor Ashkenazi, Marc Romeijn, Mark Cai, Markus Kliegl, Maryam Moosaei, Matvei Novikov, Mehrzad Samadi, Melissa Corpuz, Mengru Wang, Meredith Price, Michael Boone, Michael Evans, Miguel Martinez, Mike Chrzanowski, Mohammad Shoeybi, Mostofa Patwary, Nabin Mulepati, Natalie Hereth, Nave Assaf, Negar Habibi, Neta Zmora, Netanel Haber, Nicola Sessions, Nidhi Bhatia, Nikhil Jukar, Nikki Pope, Nikolai Ludwig, Nima Tajbakhsh, Nirmal Juluru, Oleksii Hrinchuk, Oleksii Kuchaiev, Olivier Delalleau, Oluwatobi Olabiyi, Omer Ullman Argov, Ouye Xie, Parth Chadha, Pasha Shamis, Pavlo Molchanov, Pawel Morkisz, Peter Dykas, Peter Jin, Pinky Xu, Piotr Januszewski, Pranav Prashant Thombre, Prasoon Varshney, Pritam Gundecha, Qing Miao, Rabeeh Karimi Mahabadi, Ran El-Yaniv, Ran Zilberstein, Rasoul Shafipour, Rich Harang, Rick Izzo, Rima Shahbazyan, Rishabh Garg, Ritika Borkar, Ritu Gala, Riyad Islam, Roger Waleffe, Rohit Watve, Roi Koren, Ruoxi Zhang, Russell J. Hewett, Ryan Prenger, Ryan Timbrook, Sadegh Mahdavi, Sahil Modi, Samuel Kriman, Sanjay Kariyappa, Sanjeev Satheesh, Saori Kaji, Satish Pasumarthi, Sean Narentharen, Sean Narenthiran, Seonmyeong Bak, Sergey Kashirsky, Seth Poulos, Shahar Mor, Shanmugam Ramasamy, Shantanu Acharya, Shaona Ghosh, Sharath Turuvekere Sreenivas, Shelby Thomas, Shiqing Fan, Shreya Gopal, Shrimai Prabhumoye, Shubham Pachori, Shubham Toshniwal, Shuoyang Ding, Siddharth Singh, Simeng Sun, Smita Ithape, Somshubra Majumdar, Soumye Singhal, Stefania Alborghetti, Stephen Ge, Sugam Dipak Devare, Sumeet Kumar Barua, Suseella Panguluri, Suyog Gupta, Sweta Priyadarshi, Syeda Nahida Akter, Tan Bui, Teodor-Dumitru Ene, Terry Kong, Thanh Do, Tijmen Blankevoort, Tom Balough, Tomer Asida, Tomer Bar Natan, Tugrul Konuk, Twinkle Vashishth, Udi Karpas, Ushnish De, Vahid Noorozi, Vahid Noroozi, Venkat Srinivasan, Venmugil Elango, Vijay Korthikanti, Vitaly Kurin, Vitaly Lavrukhin, Wanli Jiang, Wasi Uddin Ahmad, Wei Du, Wei Ping, Wenfei Zhou, Will Jennings, William Zhang, Wojciech Prazuch, Xiaowei Ren, Yashaswi Karnati, Yejin Choi, Yev Meyer, Yi-Fu Wu, Yian Zhang, Ying Lin, Yonatan Geifman, Yonggan Fu, Yoshi Subara, Yoshi Suhara, Yubo Gao, Zach Moshe, Zhen Dong, Zihan Liu, Zijia Chen and Zijie Yan. 2025. Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning. arXiv:2512.20848.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{blakeman2025nemotron,
  title = {{Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning}},
  author = {NVIDIA: Aaron Blakeman, Aaron Grattafiori, Aarti Basant, Abhibha Gupta, Abhinav Khattar, Adi Renduchintala, Aditya Vavre, Akanksha Shukla, Akhiad Bercovich, Aleksander Ficek, Aleksandr Shaposhnikov, Alex Kondratenko, Alexander Bukharin, Alexandre Milesi, Ali Taghibakhshi, Alisa Liu, Amelia Barton, Ameya Sunil Mahabaleshwarkar, Amir Klein, Amit Zuker, Amnon Geifman, Amy Shen, Anahita Bhiwandiwalla, Andrew Tao, Ann Guan, Anubhav Mandarwal, Arham Mehta, Ashwath Aithal, Ashwin Poojary, Asif Ahamed, Asma Kuriparambil Thekkumpate, Ayush Dattagupta, Banghua Zhu, Bardiya Sadeghi, Barnaby Simkin, Ben Lanir, Benedikt Schifferer, Besmira Nushi, Bilal Kartal, Bita Darvish Rouhani, Boris Ginsburg, Brandon Norick, Brandon Soubasis, Branislav Kisacanin, Brian Yu, Bryan Catanzaro, Carlo {del Mundo}, Chantal Hwang, Charles Wang, Cheng-Ping Hsieh, Chenghao Zhang, Chenhan Yu, Chetan Mungekar, Chintan Patel, Chris Alexiuk, Christopher Parisien, Collin Neale, Damon Mosk-Aoyama, Dan Su, Dane Corneil, Daniel Afrimi, Daniel Rohrer, Daniel Serebrenik, Daria Gitman, Daria Levy, Darko Stosic, David Mosallanezhad, Deepak Narayanan, Dhruv Nathawani, Dima Rekesh, Dina Yared, Divyanshu Kakwani, Dong Ahn, Duncan Riach, Dusan Stosic, Edgar Minasyan, Edward Lin, Eileen Long, Eileen Peters Long, Elena Lantz, Ellie Evans, Elliott Ning, Eric Chung, Eric Harper, Eric Tramel, Erick Galinkin, Erik Pounds, Evan Briones, Evelina Bakhturina, Faisal Ladhak, Fay Wang, Fei Jia, Felipe Soares, Feng Chen, Ferenc Galko, Frankie Siino, Gal Hubara Agam, Ganesh Ajjanagadde, Gantavya Bhatt, Gargi Prasad, George Armstrong, Gerald Shen, Gorkem Batmaz, Grigor Nalbandyan, Haifeng Qian, Harsh Sharma, Hayley Ross, Helen Ngo, Herman Sahota, Hexin Wang, Himanshu Soni, Hiren Upadhyay, Huizi Mao, Huy C Nguyen, Huy Q Nguyen, Iain Cunningham, Ido Shahaf, Igor Gitman, Ilya Loshchilov, Ivan Moshkov, Izzy Putterman, Jan Kautz, Jane Polak Scowcroft, Jared Casper, Jatin Mitra, Jeffrey Glick, Jenny Chen, Jesse Oliver, Jian Zhang, Jiaqi Zeng, Jie Lou, Jimmy Zhang, Jining Huang, Joey Conway, Joey Guman, John Kamalu, Johnny Greco, Jonathan Cohen, Joseph Jennings, Joyjit Daw, Julien Veron Vialard, Junkeun Yi, Jupinder Parmar, Kai Xu, Kan Zhu, Kari Briski, Katherine Cheung, Katherine Luna, Keshav Santhanam, Kevin Shih, Kezhi Kong, Khushi Bhardwaj, Krishna C. Puvvada, Krzysztof Pawelec, Kumar Anik, Lawrence McAfee, Laya Sleiman, Leon Derczynski, Li Ding, Lucas Liebenwein, Luis Vega, Maanu Grover, Maarten {Van Segbroeck}, Maer Rodrigues {de Melo}, Makesh Narsimhan Sreedhar, Manoj Kilaru, Maor Ashkenazi, Marc Romeijn, Mark Cai, Markus Kliegl, Maryam Moosaei, Matvei Novikov, Mehrzad Samadi, Melissa Corpuz, Mengru Wang, Meredith Price, Michael Boone, Michael Evans, Miguel Martinez, Mike Chrzanowski, Mohammad Shoeybi, Mostofa Patwary, Nabin Mulepati, Natalie Hereth, Nave Assaf, Negar Habibi, Neta Zmora, Netanel Haber, Nicola Sessions, Nidhi Bhatia, Nikhil Jukar, Nikki Pope, Nikolai Ludwig, Nima Tajbakhsh, Nirmal Juluru, Oleksii Hrinchuk, Oleksii Kuchaiev, Olivier Delalleau, Oluwatobi Olabiyi, Omer Ullman Argov, Ouye Xie, Parth Chadha, Pasha Shamis, Pavlo Molchanov, Pawel Morkisz, Peter Dykas, Peter Jin, Pinky Xu, Piotr Januszewski, Pranav Prashant Thombre, Prasoon Varshney, Pritam Gundecha, Qing Miao, Rabeeh Karimi Mahabadi, Ran El-Yaniv, Ran Zilberstein, Rasoul Shafipour, Rich Harang, Rick Izzo, Rima Shahbazyan, Rishabh Garg, Ritika Borkar, Ritu Gala, Riyad Islam, Roger Waleffe, Rohit Watve, Roi Koren, Ruoxi Zhang, Russell J. Hewett, Ryan Prenger, Ryan Timbrook, Sadegh Mahdavi, Sahil Modi, Samuel Kriman, Sanjay Kariyappa, Sanjeev Satheesh, Saori Kaji, Satish Pasumarthi, Sean Narentharen, Sean Narenthiran, Seonmyeong Bak, Sergey Kashirsky, Seth Poulos, Shahar Mor, Shanmugam Ramasamy, Shantanu Acharya, Shaona Ghosh, Sharath Turuvekere Sreenivas, Shelby Thomas, Shiqing Fan, Shreya Gopal, Shrimai Prabhumoye, Shubham Pachori, Shubham Toshniwal, Shuoyang Ding, Siddharth Singh, Simeng Sun, Smita Ithape, Somshubra Majumdar, Soumye Singhal, Stefania Alborghetti, Stephen Ge, Sugam Dipak Devare, Sumeet Kumar Barua, Suseella Panguluri, Suyog Gupta, Sweta Priyadarshi, Syeda Nahida Akter, Tan Bui, Teodor-Dumitru Ene, Terry Kong, Thanh Do, Tijmen Blankevoort, Tom Balough, Tomer Asida, Tomer Bar Natan, Tugrul Konuk, Twinkle Vashishth, Udi Karpas, Ushnish De, Vahid Noorozi, Vahid Noroozi, Venkat Srinivasan, Venmugil Elango, Vijay Korthikanti, Vitaly Kurin, Vitaly Lavrukhin, Wanli Jiang, Wasi Uddin Ahmad, Wei Du, Wei Ping, Wenfei Zhou, Will Jennings, William Zhang, Wojciech Prazuch, Xiaowei Ren, Yashaswi Karnati, Yejin Choi, Yev Meyer, Yi-Fu Wu, Yian Zhang, Ying Lin, Yonatan Geifman, Yonggan Fu, Yoshi Subara, Yoshi Suhara, Yubo Gao, Zach Moshe, Zhen Dong, Zihan Liu, Zijia Chen and Zijie Yan},
  year = {2025},
  doi = {10.48550/arxiv.2512.20848},
  eprint = {2512.20848},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2512.20848}
}
```

- [← previous LocAgent: Graph-Guided LLM Agents for Code Localization](https://md.research.elamur.ai/free/en/papers/chen-2025-locagent-graph-guided-llm-agents/)
- [next → OmniFlatten: An End-to-end GPT Model for Seamless Voice Conversation](https://md.research.elamur.ai/free/en/papers/zhang-2025-omniflatten-end-end-gpt-model/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/)

## References

91 references, 45 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Wasi Uddin Ahmad, Aleksander Ficek, Mehrzad Samadi, Jocelyn Huang, Vahid Noroozi, Somshubra Majumdar, and Boris Ginsburg. OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMs. arXiv preprint arXiv:2504.04030, 2025a. — [arXiv:2504.04030](https://arxiv.org/abs/2504.04030) [find](https://scholar.google.com/scholar?q=Wasi+Uddin+Ahmad%2C+Aleksander+Ficek%2C+Mehrzad+Samadi%2C+Jocelyn+Huang%2C+Vahid+Noroozi%2C+Somshubra+Majumdar%2C+and+Boris+Ginsburg%2E+OpenCodeInstruct%3A+A+Large%2Dscale+Instruction+Tuning+Dataset+for+Code+LLMs%2E+arXi)
2. Wasi Uddin Ahmad, Sean Narenthiran, Somshubra Majumdar, Aleksander Ficek, Siddhartha Jain, Jocelyn Huang, Vahid Noroozi, and Boris Ginsburg. [OpenCodeReasoning: Advancing Data Distillation for Competitive Coding](https://md.research.elamur.ai/free/en/papers/ahmad-2025-opencodereasoning-advancing-data-distillation-competitive/). arXiv preprint arXiv:2504.01943, 2025b.
3. Joshua Ainslie, James Lee-Thorp, Michiel de Jong, Yury Zemlyanskiy, Federico Lebrón, and Sumit Sanghai. [GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints](https://md.research.elamur.ai/free/en/papers/ainslie-2023-gqa-training-generalized-multi-query/), 2023. URL https://arxiv.org/abs/2305.13245. [↗](https://arxiv.org/abs/2305.13245)
4. Syeda Nahida Akter, Shrimai Prabhumoye, Eric Nyberg, Mostofa Patwary, Mohammad Shoeybi, Yejin Choi, and Bryan Catanzaro. Front-Loading Reasoning: The Synergy Between Pretraining and Post-Training Data. arXiv preprint arXiv:2510.03264, 2025. [find](https://scholar.google.com/scholar?q=Syeda+Nahida+Akter%2C+Shrimai+Prabhumoye%2C+Eric+Nyberg%2C+Mostofa+Patwary%2C+Mohammad+Shoeybi%2C+Yejin+Choi%2C+and+Bryan+Catanzaro%2E+Front%2DLoading+Reasoning%3A+The+Synergy+Between+Pretraining+and+Post%2DTraining+Data)
5. Victor Barres, Honghua Dong, Soham Ray, Xujie Si, and Karthik Narasimhan. 𝜏 2 -Bench: Evaluating Conversational Agents in a Dual-Control Environment. arXiv preprint arXiv:2506.07982, 2025. [find](https://scholar.google.com/scholar?q=Victor+Barres%2C+Honghua+Dong%2C+Soham+Ray%2C+Xujie+Si%2C+and+Karthik+Narasimhan%2E+%F0%9D%9C%8F+2+%2DBench%3A+Evaluating+Conversational+Agents+in+a+Dual%2DControl+Environment%2E+arXiv+preprint+arXiv%3A2506%2E07982%2C+2025%2E)
6. Xiusi Chen, Gaotang Li, Ziqi Wang, Bowen Jin, Cheng Qian, Yu Wang, Hongru Wang, Yu Zhang, Denghui Zhang, Tong Zhang, et al. [RM-R1: Reward Modeling as Reasoning](https://md.research.elamur.ai/free/en/papers/chen-2025-rm-r1-reward-modeling-reasoning/). arXiv preprint arXiv:2505.02387, 2025.
7. Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios Nikolas Angelopoulos, Tianle Li, Dacheng Li, Hao Zhang, Banghua Zhu, Michael Jordan, Joseph E. Gonzalez, and Ion Stoica. [Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference](https://md.research.elamur.ai/free/en/papers/chiang-2024-chatbot-arena-open-platform-evaluating/), 2024.
8. Damai Dai, Chengqi Deng, Chenggang Zhao, RX Xu, Huazuo Gao, Deli Chen, Jiashi Li, Wangding Zeng, Xingkai Yu, Yu Wu, et al. DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models. arXiv preprint arXiv:2401.06066, 2024. [find](https://scholar.google.com/scholar?q=Damai+Dai%2C+Chengqi+Deng%2C+Chenggang+Zhao%2C+RX+Xu%2C+Huazuo+Gao%2C+Deli+Chen%2C+Jiashi+Li%2C+Wangding+Zeng%2C+Xingkai+Yu%2C+Yu+Wu%2C+et+al%2E+DeepSeekMoE%3A+Towards+Ultimate+Expert+Specialization+in+Mixture%2Dof%2DExperts+Lan)
9. Tri Dao and Albert Gu. Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality, 2024. URL https://arxiv.org/abs/2405.21060. [↗](https://arxiv.org/abs/2405.21060)
10. DeepSeek-AI. [DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2025-deepseek-r1-incentivizing-reasoning-capability/), 2025a. URL https://arxiv.org/abs/2501.12948. [↗](https://arxiv.org/abs/2501.12948)
11. DeepSeek-AI. DeepSeek-V3 Technical Report, 2025b. URL https://arxiv.org/abs/2412.19437. [↗](https://arxiv.org/abs/2412.19437)
12. Kaustubh Deshpande, Ved Sirdeshmukh, Johannes Baptist Mols, Lifeng Jin, Ed-Yeremai Hernandez-Cardona, Dean Lee, Jeremy Kritz, Willow E Primack, Summer Yue, and Chen Xing. MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs. In Findings of the Associa… [find](https://scholar.google.com/scholar?q=Kaustubh+Deshpande%2C+Ved+Sirdeshmukh%2C+Johannes+Baptist+Mols%2C+Lifeng+Jin%2C+Ed%2DYeremai+Hernandez%2DCardona%2C+Dean+Lee%2C+Jeremy+Kritz%2C+Willow+E+Primack%2C+Summer+Yue%2C+and+Chen+Xing%2E+MultiChallenge%3A+A+Realistic+M)
13. Daniel Deutsch, Eleftheria Briakou, Isaac Rayburn Caswell, Mara Finkelstein, Rebecca Galor, Juraj Juraska, Geza Kovacs, Alison Lui, Ricardo Rei, Jason Riesa, et al. [WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects](https://md.research.elamur.ai/free/en/papers/deutsch-2025-wmt24-expanding-language-coverage-wmt24/). In Findings of the Association for Computational Linguist…
14. Steven Feng, Shrimai Prabhumoye, Kezhi Kong, Dan Su, Mostofa Patwary, Mohammad Shoeybi, and Bryan Catanzaro. Maximize Your Data’s Potential: Enhancing LLM Accuracy with Two-Phase Pretraining, 2024. [URL https://arxiv.org/abs/2412.15285](https://md.research.elamur.ai/free/en/papers/feng-2024-maximize-data-s-potential-enhancing/). [↗](https://arxiv.org/abs/2412.15285)
15. Kazuki Fujii, Yukito Tajima, Sakae Mizuki, Hinari Shimada, Taihei Shiotani, Koshiro Saito, Masanari Ohi, Masaki Kawamura, Taishi Nakamura, Takumi Okamoto, et al. Rewriting Pre-Training Data Boosts LLM Performance in Math and Code. arXiv preprint arXiv:2505.02881, 2025. URL https://arxiv.org/abs/2505… [↗](https://arxiv.org/abs/2505…)
16. Shaona Ghosh, Prasoon Varshney, Makesh Narsimhan Sreedhar, Aishwarya Padmakumar, Traian Rebedea, Jibin Rajan Varghese, and Christopher Parisien. [AEGIS2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrails](https://md.research.elamur.ai/free/en/papers/ghosh-2025-aegis2-0-diverse-ai-safety/). In Luis Chiruzzo, Alan Ritter, and Lu Wang (eds.), Proceedings of…
17. Gretel. Gretel Synthetic Safety Alignment Dataset, 12 2024. URL [https://huggingface.co/](https://huggingface.co/) datasets/gretelai/gretel-safety-alignment-en-v1. [↗](https://huggingface.co/)
18. Adib Hasan, Ileana Rugina, and Alex Wang. Pruning for Protection: Increasing Jailbreak Resistance in Aligned LLMs Without Fine-Tuning. arXiv preprint arXiv:2401.10862, 2024. [find](https://scholar.google.com/scholar?q=Adib+Hasan%2C+Ileana+Rugina%2C+and+Alex+Wang%2E+Pruning+for+Protection%3A+Increasing+Jailbreak+Resistance+in+Aligned+LLMs+Without+Fine%2DTuning%2E+arXiv+preprint+arXiv%3A2401%2E10862%2C+2024%2E)
19. Jujie He, Jiacai Liu, Chris Yuhao Liu, Rui Yan, Chaojie Wang, Peng Cheng, Xiaoyu Zhang, Fuxiang Zhang, Jiacheng Xu, Wei Shen, et al. Skywork Open Reasoner 1 Technical Report. arXiv preprint arXiv:2505.22312, 2025. [find](https://scholar.google.com/scholar?q=Jujie+He%2C+Jiacai+Liu%2C+Chris+Yuhao+Liu%2C+Rui+Yan%2C+Chaojie+Wang%2C+Peng+Cheng%2C+Xiaoyu+Zhang%2C+Fuxiang+Zhang%2C+Jiacheng+Xu%2C+Wei+Shen%2C+et+al%2E+Skywork+Open+Reasoner+1+Technical+Report%2E+arXiv+preprint+arXiv%3A2505)
20. Dan Hendrycks, Steven Basart, Saurav Kadavath, Mantas Mazeika, Akul Arora, Ethan Guo, Collin Burns, Samir Puranik, Horace He, Dawn Song, and Jacob Steinhardt. [Measuring Coding Challenge Competence With APPS](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-coding-challenge-competence-apps/). NeurIPS, 2021.
21. Andrew Hojel, Michael Pust, Tim Romanski, Yash Vanjani, Ritvik Kapila, Mohit Parmar, Adarsh Chaluvaraju, Alok Tripathy, Anil Thomas, Ashish Tanwer, Darsh J Shah, Ishaan Shah, Karl Stratos, Khoi Nguyen, Kurt Smith, Michael Callahan, Peter Rushton, Philip Monk, Platon Mazarakis, Saad Jamal, Saurabh Sr… [find](https://scholar.google.com/scholar?q=Andrew+Hojel%2C+Michael+Pust%2C+Tim+Romanski%2C+Yash+Vanjani%2C+Ritvik+Kapila%2C+Mohit+Parmar%2C+Adarsh+Chaluvaraju%2C+Alok+Tripathy%2C+Anil+Thomas%2C+Ashish+Tanwer%2C+Darsh+J+Shah%2C+Ishaan+Shah%2C+Karl+Stratos%2C+Khoi+Nguyen)
22. Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, Shantanu Acharya, Dima Rekesh, Fei Jia, Yang Zhang, and Boris Ginsburg. RULER: What’s the Real Context Size of Your Long-Context Language Models? arXiv preprint arXiv:2404.[06654, 2024](https://md.research.elamur.ai/free/en/papers/hsieh-2024-ruler-s-real-context-size/).
23. Shengding Hu, Yuge Tu, Xu Han, Ganqu Cui, Chaoqun He, Weilin Zhao, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Xinrong Zhang, Zhen Leng Thai, Chongyi Wang, Yuan Yao, Chenyang Zhao, Jie Zhou, Jie Cai, Zhongwu Zhai, Ning Ding, Chao Jia, Guoyang Zeng, dahai li, Zhiyuan Liu, and Maosong Sun. MiniC… — [MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies](https://md.research.elamur.ai/free/en/papers/hu-2024-minicpm-unveiling-potential-small-language/)
24. Siming Huang, Tianhao Cheng, Jason Klein Liu, Jiaran Hao, Liuyihan Song, Yang Xu, J Yang, JH Liu, Chenchen Zhang, Linzheng Chai, et al. [Opencoder: The open cookbook for top-tier code large language models](https://md.research.elamur.ai/free/en/papers/huang-2025-opencoder-open-cookbook-top-tier/). arXiv preprint arXiv:2411.04905, 2024.
25. Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar-Lezama, Koushik Sen, and Ion Stoica. [Livecodebench: Holistic and contamination free evaluation of large language models for code](https://md.research.elamur.ai/free/en/papers/jain-2024-livecodebench-holistic-contamination-free-evaluation/). arXiv preprint arXiv:2403.07974, 2024.
26. Naman Jain, Jaskirat Singh, Manish Shetty, Liang Zheng, Koushik Sen, and Ion Stoica. R2E-Gym: Procedural Environments and Hybrid Verifiers for Scaling Open-Weights SWE Agents, 2025. URL https://arxiv.org/abs/2504.07164. — [arXiv:2504.07164](https://arxiv.org/abs/2504.07164) [↗](https://arxiv.org/abs/2504.07164)
27. Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan. [SWE-bench: Can Language Models Resolve Real-World GitHub Issues?](https://md.research.elamur.ai/free/en/papers/jimenez-2024-swe-bench-can-language-models/) arXiv preprint arXiv:2310.06770, 2023.
28. Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph E. Gonzalez, Hao Zhang, and Ion Stoica. [Efficient Memory Management for Large Language Model Serving with PagedAttention](https://md.research.elamur.ai/free/en/papers/kwon-2023-efficient-memory-management-large-language/). In Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles, 2023.
29. Nathan Lambert, Jacob Morrison, Valentina Pyatkin, Shengyi Huang, Hamish Ivison, Faeze Brahman, Lester James V. Miranda, Alisa Liu, Nouha Dziri, Shane Lyu, Yuling Gu, Saumya Malik, Victoria Graf, Jena D. Hwang, Jiangjiang Yang, Ronan Le Bras, Oyvind Tafjord, Chris Wilhelm, Luca Soldaini, Noah A. Smi… — [Tulu 3: Pushing Frontiers in Open Language Model Post-Training](https://md.research.elamur.ai/free/en/papers/lambert-2024-tulu-3-pushing-frontiers-open/)
30. Dmitry Lepikhin, HyoukJoong Lee, Yuanzhong Xu, Dehao Chen, Orhan Firat, Yanping Huang, Maxim Krikun, Noam Shazeer, and Zhifeng Chen. GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. arXiv preprint arXiv:2006.16668, 2020. [find](https://scholar.google.com/scholar?q=Dmitry+Lepikhin%2C+HyoukJoong+Lee%2C+Yuanzhong+Xu%2C+Dehao+Chen%2C+Orhan+Firat%2C+Yanping+Huang%2C+Maxim+Krikun%2C+Noam+Shazeer%2C+and+Zhifeng+Chen%2E+GShard%3A+Scaling+Giant+Models+with+Conditional+Computation+and+Autom)
31. Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Guha, Sedrick Scott Keh, Kushal Arora, et al. [DataComp-LM: In Search of the Next Generation of Training Sets for Language Models](https://md.research.elamur.ai/free/en/papers/li-2024-datacomp-lm-search-next-generation/). Advances in Neural Information Processing Systems, 37:14200–142…
32. Jia Li, Edward Beeching, Lewis Tunstall, Ben Lipkin, Roman Soletskyi, Shengyi Costa Huang, Kashif Rasul, Longhui Yu, Albert Jiang, Ziju Shen, Zihan Qin, Bin Dong, Li Zhou, Yann Fleureau, Guillaume Lample, and Stanislas Polu. NuminaMath. [https://huggingface.co/AI-MO/NuminaMath-CoT](https://github.co… [find](https://scholar.google.com/scholar?q=Jia+Li%2C+Edward+Beeching%2C+Lewis+Tunstall%2C+Ben+Lipkin%2C+Roman+Soletskyi%2C+Shengyi+Costa+Huang%2C+Kashif+Rasul%2C+Longhui+Yu%2C+Albert+Jiang%2C+Ziju+Shen%2C+Zihan+Qin%2C+Bin+Dong%2C+Li+Zhou%2C+Yann+Fleureau%2C+Guillaume+Lam)
33. Rongao Li, Jie Fu, Bo-Wen Zhang, Tao Huang, Zhihong Sun, Chen Lyu, Guang Liu, Zhi Jin, and Ge Li. TACO: Topics in Algorithmic COde generation dataset. arXiv preprint arXiv:2312.14852, 2023. [find](https://scholar.google.com/scholar?q=Rongao+Li%2C+Jie+Fu%2C+Bo%2DWen+Zhang%2C+Tao+Huang%2C+Zhihong+Sun%2C+Chen+Lyu%2C+Guang+Liu%2C+Zhi+Jin%2C+and+Ge+Li%2E+TACO%3A+Topics+in+Algorithmic+COde+generation+dataset%2E+arXiv+preprint+arXiv%3A2312%2E14852%2C+2023%2E)
34. Tianle Li, Wei-Lin Chiang, Evan Frick, Lisa Dunlap, Tianhao Wu, Banghua Zhu, Joseph E Gonzalez, and Ion Stoica. [From crowdsourced data to high-quality benchmarks: Arena-hard and benchbuilder pipeline](https://md.research.elamur.ai/free/en/papers/li-2024-crowdsourced-data-high-quality-benchmarks/). arXiv preprint arXiv:2406.11939, 2024c.
35. Xuehai Li, Zi Ye, Xiaoxin Zhang, Xinshi Lu, Yingqiang Xia, Bairu Wu, Shihan Dong, Qipeng Jin, Jialu Wang, Heng Ji, et al. [WildChat: 1M ChatGPT Interaction Logs in the Wild](https://md.research.elamur.ai/free/en/papers/zhao-2024-wildchat-1m-chatgpt-interaction-logs/). arXiv preprint arXiv:2405.01470, 2024d.
36. Opher Lieber, Barak Lenz, Hofit Bata, Gal Cohen, Jhonathan Osin, Itay Dalmedigos, Erez Safahi, Shaked Meirom, Yonatan Belinkov, Shai Shalev-Shwartz, Omri Abend, Raz Alon, Tomer Asida, Amir Bergman, Roman Glozman, Michael Gokhman, Avashalom Manevich, Nir Ratner, Noam Rozen, Erez Shwartz, Mor Zusman,… — [Jamba: A Hybrid Transformer-Mamba Language Model](https://md.research.elamur.ai/free/en/papers/lieber-2024-jamba-hybrid-transformer-mamba-language/)
37. Yantao Liu, Zijun Yao, Rui Min, Yixin Cao, Lei Hou, and Juanzi Li. [RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style](https://md.research.elamur.ai/free/en/papers/liu-2024-rm-bench-benchmarking-reward-models/) . arXiv preprint arXiv:2410.16184, 2024.
38. Zihan Liu, Zhuolin Yang, Yang Chen, Chankyu Lee, Mohammad Shoeybi, Bryan Catanzaro, and Wei Ping. [AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergy](https://md.research.elamur.ai/free/en/papers/liu-2025-acereason-nemotron-1-1-advancing/). arXiv preprint arXiv:2506.13284, 2025a.
39. Zijun Liu, Peiyi Wang, Runxin Xu, Shirong Ma, Chong Ruan, Peng Li, Yang Liu, and Yu Wu. [Inference-time scaling for generalist reward modeling](https://md.research.elamur.ai/free/en/papers/liu-2025-inference-time-scaling-generalist/). arXiv preprint arXiv:2504.02495, 2025b.
40. Ilya Loshchilov and Frank Hutter. Decoupled Weight Decay Regularization. arXiv preprint arXiv:1711.05101, 2017. [find](https://scholar.google.com/scholar?q=Ilya+Loshchilov+and+Frank+Hutter%2E+Decoupled+Weight+Decay+Regularization%2E+arXiv+preprint+arXiv%3A1711%2E05101%2C+2017%2E)
41. Weidi Luo, Siyuan Ma, Xiaogeng Liu, Xiaoyu Guo, and Chaowei Xiao. JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attacks, 2024. URL https://arxiv.org/abs/2404.03027. [↗](https://arxiv.org/abs/2404.03027)
42. Rabeeh Karimi Mahabadi, Sanjeev Satheesh, Shrimai Prabhumoye, Mostofa Patwary, Mohammad Shoeybi, and Bryan Catanzaro. Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset, 2025. URL https://arxiv.org/abs/2508.15096. [↗](https://arxiv.org/abs/2508.15096)
43. Somshubra Majumdar, Vahid Noroozi, Mehrzad Samadi, Sean Narenthiran, Aleksander Ficek, Wasi Uddin Ahmad, Jocelyn Huang, Jagadeesh Balam, and Boris Ginsburg. Genetic Instruct: Scaling up Synthetic Generation of Coding Instructions for Large Language Models. arXiv preprint arXiv:2407.21077, 2024. [find](https://scholar.google.com/scholar?q=Somshubra+Majumdar%2C+Vahid+Noroozi%2C+Mehrzad+Samadi%2C+Sean+Narenthiran%2C+Aleksander+Ficek%2C+Wasi+Uddin+Ahmad%2C+Jocelyn+Huang%2C+Jagadeesh+Balam%2C+and+Boris+Ginsburg%2E+Genetic+Instruct%3A+Scaling+up+Synthetic+Gene)
44. Yev Meyer and Dane Corneil. Nemotron-Personas-USA: Synthetic personas aligned to real-world distributions, June 2025. URL [https://huggingface.co/datasets/nvidia/](https://huggingface.co/datasets/nvidia/) Nemotron-Personas-USA. [↗](https://huggingface.co/datasets/nvidia/)
45. Arindam Mitra, Hamed Khanpour, Corby Rosset, and Ahmed Awadallah. [Orca-math: Unlocking the potential of slms in grade school math](https://md.research.elamur.ai/free/en/papers/mitra-2024-orca-math-unlocking-potential-slms/). arXiv preprint arXiv:2402.14830, 2024.
46. Ivan Moshkov, Darragh Hanley, Ivan Sorokin, Shubham Toshniwal, Christof Henkel, Benedikt Schifferer, Wei Du, and Igor Gitman. AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning dataset. arXiv preprint arXiv:2504.16891, 2025. [find](https://scholar.google.com/scholar?q=Ivan+Moshkov%2C+Darragh+Hanley%2C+Ivan+Sorokin%2C+Shubham+Toshniwal%2C+Christof+Henkel%2C+Benedikt+Schifferer%2C+Wei+Du%2C+and+Igor+Gitman%2E+AIMO%2D2+Winning+Solution%3A+Building+State%2Dof%2Dthe%2DArt+Mathematical+Reasoning+)
47. Grigor Nalbandyan, Rima Shahbazyan, and Evelina Bakhturina. SCORE: Systematic COnsistency and Robustness Evaluation for Large Language Models. arXiv preprint arXiv:2503.00137, 2025. [find](https://scholar.google.com/scholar?q=Grigor+Nalbandyan%2C+Rima+Shahbazyan%2C+and+Evelina+Bakhturina%2E+SCORE%3A+Systematic+COnsistency+and+Robustness+Evaluation+for+Large+Language+Models%2E+arXiv+preprint+arXiv%3A2503%2E00137%2C+2025%2E)
48. Tue Nguyen. IChO-IPhO-RL-v2-formated, 2025. II-Vietnam/IChO-IPhO-RL-v2-formated. [find](https://scholar.google.com/scholar?q=Tue+Nguyen%2E+IChO%2DIPhO%2DRL%2Dv2%2Dformated%2C+2025%2E+II%2DVietnam%2FIChO%2DIPhO%2DRL%2Dv2%2Dformated%2E)
49. URL [https://huggingface.co/datasets/](https://huggingface.co/datasets/) [↗](https://huggingface.co/datasets/)
50. NVIDIA. [Llama-Nemotron: Efficient Reasoning Models](https://md.research.elamur.ai/free/en/papers/bercovich-2025-llama-nemotron-efficient-reasoning-models/), 2025a. URL https://arxiv.org/abs/ 2505.00949. [↗](https://arxiv.org/abs/)
51. NVIDIA. NeMo Gym: An Open Source Framework for Scaling Reinforcement Learning Environments for LLM. [https://github.com/NVIDIA-NeMo/Gym](https://github.com/NVIDIA-NeMo/Gym), 2025b. GitHub repository. [↗](https://github.com/NVIDIA-NeMo/Gym)
52. NVIDIA. NeMo RL: A Scalable and Efficient Post-Training Library. [https://github.com/](https://github.com/) NVIDIA-NeMo/RL, 2025c. GitHub repository. [↗](https://github.com/)
53. NVIDIA. [NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model](https://md.research.elamur.ai/free/en/papers/basant-2025-nvidia-nemotron-nano-2-accurate/). arXiv preprint arXiv:2508.14444, 2025d.
54. NVIDIA. [Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models](https://md.research.elamur.ai/free/en/papers/blakeman-2025-nemotron-h-family-accurate-efficient/), 2025e. URL https://arxiv.org/abs/2504.03624. [↗](https://arxiv.org/abs/2504.03624)
55. OpenAI. [gpt-oss-120b & gpt-oss-20b model card](https://md.research.elamur.ai/free/en/papers/agarwal-2025-gpt-oss-120b-gpt-oss/), 2025. URL https://arxiv.org/abs/2508.10925. [↗](https://arxiv.org/abs/2508.10925)
56. Sahan Paliskara and Mark Saroufim. Kernelbook, 5 2025. URL [https://huggingface.co/](https://huggingface.co/) datasets/GPUMODE/KernelBook. [↗](https://huggingface.co/)
57. Jiayi Pan, Xingyao Wang, Graham Neubig, Navdeep Jaitly, Heng Ji, Alane Suhr, and Yizhe Zhang. Training Software Engineering Agents and Verifiers with SWE-Gym, 2025. URL https://arxiv.org/abs/2412.21139. [↗](https://arxiv.org/abs/2412.21139)
58. Shishir G. Patil, Huanzhi Mao, Charlie Cheng-Jie Ji, Fanjia Yan, Vishnu Suresh, Ion Stoica, and Joseph E. Gonzalez. The Berkeley Function Calling Leaderboard (BFCL): From Tool Use to Agentic Evaluation of Large Language Models. In Forty-second International Conference on Machine Learning, 2025. [find](https://scholar.google.com/scholar?q=Shishir+G%2E+Patil%2C+Huanzhi+Mao%2C+Charlie+Cheng%2DJie+Ji%2C+Fanjia+Yan%2C+Vishnu+Suresh%2C+Ion+Stoica%2C+and+Joseph+E%2E+Gonzalez%2E+The+Berkeley+Function+Calling+Leaderboard+%28BFCL%29%3A+From+Tool+Use+to+Agentic+Evaluatio)
59. Long Phan, Alice Gatti, Ziwen Han, Nathaniel Li, Josephina Hu, Hugh Zhang, Chen Bo Calvin Zhang, Mohamed Shaaban, John Ling, Sean Shi, et al. Humanity’s last exam, 2025. [URL https://arxiv.org/abs/2501.14249](https://md.research.elamur.ai/free/en/papers/phan-2025-humanity-s-last-exam/). [↗](https://arxiv.org/abs/2501.14249)
60. Valentina Pyatkin, Saumya Malik, Victoria Graf, Hamish Ivison, Shengyi Huang, Pradeep Dasigi, Nathan Lambert, and Hannaneh Hajishirzi. [Generalizing verifiable instruction following](https://md.research.elamur.ai/free/en/papers/pyatkin-2025-generalizing-verifiable-instruction-following/). arXiv preprint arXiv:2507.02833, 2025.
61. Qwen. Qwen2.5 Technical Report, 2025. URL https://arxiv.org/abs/2412.15115. [↗](https://arxiv.org/abs/2412.15115)
62. David Rein, Betty Li Hou, Asa Cooper Stickland, Jackson Petty, Richard Yuanzhe Pang, Julien Dirani, Julian Michael, and Samuel R. Bowman. [GPQA: A Graduate-Level Google-Proof Q&A Benchmark](https://md.research.elamur.ai/free/en/papers/rein-2023-gpqa-graduate-level-google-proof/), 2023.
63. Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, et al. [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://md.research.elamur.ai/free/en/papers/shao-2024-deepseekmath-pushing-limits-mathematical-reasoning/). arXiv preprint arXiv:2402.03300, 2024.
64. Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean. Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer. arXiv preprint arXiv:1701.06538, 2017. [find](https://scholar.google.com/scholar?q=Noam+Shazeer%2C+Azalia+Mirhoseini%2C+Krzysztof+Maziarz%2C+Andy+Davis%2C+Quoc+Le%2C+Geoffrey+Hinton%2C+and+Jeff+Dean%2E+Outrageously+Large+Neural+Networks%3A+The+Sparsely%2DGated+Mixture%2Dof%2DExperts+Layer%2E+arXiv+preprint)
65. Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, and Bryan Catanzaro. Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism, 2020. URL https://arxiv.org/abs/1909.08053. [↗](https://arxiv.org/abs/1909.08053)
66. Olly Styles, Sam Miller, Patricio Cerda-Mardini, Tanaya Guha, Victor Sanchez, and Bertie Vidgen. Workbench: a benchmark dataset for agents in a realistic workplace setting. arXiv preprint arXiv:2405.00823, 2024. doi: 10.48550/arXiv.2405.00823. — [doi:10.48550/arxiv.2405.00823](https://doi.org/10.48550/arxiv.2405.00823) [find](https://scholar.google.com/scholar?q=Olly+Styles%2C+Sam+Miller%2C+Patricio+Cerda%2DMardini%2C+Tanaya+Guha%2C+Victor+Sanchez%2C+and+Bertie+Vidgen%2E+Workbench%3A+a+benchmark+dataset+for+agents+in+a+realistic+workplace+setting%2E+arXiv+preprint+arXiv%3A2405%2E0)
67. Dan Su, Kezhi Kong, Ying Lin, Joseph Jennings, Brandon Norick, Markus Kliegl, Mostofa Patwary, Mohammad Shoeybi, and Bryan Catanzaro. [Nemotron-CC: Transforming Common Crawl into a refined long-horizon pretraining dataset](https://md.research.elamur.ai/free/en/papers/su-2025-nemotron-cc-transforming-common-crawl/). In Wanxiang Che, Joyce Nabende, Ekaterina Shutova, and Mohammad Taher Pilehvar…
68. Sijun Tan, Siyuan Zhuang, Kyle Montgomery, William Y Tang, Alejandro Cuadron, Chenguang Wang, Raluca Ada Popa, and Ion Stoica. JudgeBench: A Benchmark for Evaluating LLM-based Judges. arXiv preprint arXiv:2410.12784, 2024. [find](https://scholar.google.com/scholar?q=Sijun+Tan%2C+Siyuan+Zhuang%2C+Kyle+Montgomery%2C+William+Y+Tang%2C+Alejandro+Cuadron%2C+Chenguang+Wang%2C+Raluca+Ada+Popa%2C+and+Ion+Stoica%2E+JudgeBench%3A+A+Benchmark+for+Evaluating+LLM%2Dbased+Judges%2E+arXiv+preprint+a)
69. GLM-4.5 Team. [GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models](https://md.research.elamur.ai/free/en/papers/team-2025-4-glm-4-5-agentic/), 2025a. URL https://arxiv.org/abs/2508.06471. [↗](https://arxiv.org/abs/2508.06471)
70. Kimi Team. [Kimi K2: Open Agentic Intelligence](https://md.research.elamur.ai/free/en/papers/kimi-team-2025-kimi-k2-open-agentic/), 2025b. URL https://arxiv.org/abs/2507. 20534. [↗](https://arxiv.org/abs/2507)
71. Ling Team, Anqi Shen, Baihui Li, Bin Hu, Bin Jing, Cai Chen, Chao Huang, Chao Zhang, Chaokun Yang, Cheng Lin, et al. Every step evolves: Scaling reinforcement learning for trillion-scale thinking model. arXiv preprint arXiv:2510.18855, 2025. — [arXiv:2510.18855](https://arxiv.org/abs/2510.18855) [find](https://scholar.google.com/scholar?q=Ling+Team%2C+Anqi+Shen%2C+Baihui+Li%2C+Bin+Hu%2C+Bin+Jing%2C+Cai+Chen%2C+Chao+Huang%2C+Chao+Zhang%2C+Chaokun+Yang%2C+Cheng+Lin%2C+et+al%2E+Every+step+evolves%3A+Scaling+reinforcement+learning+for+trillion%2Dscale+thinking+mode)
72. The Terminal-Bench Team. Terminal-bench: A benchmark for ai agents in terminal environments, Apr 2025c. URL [https://github.com/laude-institute/terminal-bench](https://github.com/laude-institute/terminal-bench). [↗](https://github.com/laude-institute/terminal-bench)
73. NVIDIA The NeMo Data Designer Team. Nemo data designer: A framework for generating synthetic data from scratch or based on your own seed data. [https://github.com/NVIDIA-NeMo/](https://github.com/NVIDIA-NeMo/) DataDesigner, 2025. GitHub Repository. [↗](https://github.com/NVIDIA-NeMo/)
74. Minyang Tian, Luyu Gao, Shizhuo Dylan Zhang, Xinan Chen, Cunwei Fan, Xuefei Guo, Roland Haas, Pan Ji, Kittithat Krongchon, Yao Li, Shengyan Liu, Di Luo, Yutao Ma, Hao Tong, Kha Trinh, Chenyu Tian, Zihan Wang, Bohao Wu, Yanyu Xiong, Shengzhu Yin, Minhui Zhu, Kilian Lieret, Yanxin Lu, Genglin Liu, Yuf… [find](https://scholar.google.com/scholar?q=Minyang+Tian%2C+Luyu+Gao%2C+Shizhuo+Dylan+Zhang%2C+Xinan+Chen%2C+Cunwei+Fan%2C+Xuefei+Guo%2C+Roland+Haas%2C+Pan+Ji%2C+Kittithat+Krongchon%2C+Yao+Li%2C+Shengyan+Liu%2C+Di+Luo%2C+Yutao+Ma%2C+Hao+Tong%2C+Kha+Trinh%2C+Chenyu+Tian%2C+Zih)
75. Shubham Toshniwal, Wei Du, Ivan Moshkov, Branislav Kisacanin, Alexan Ayrapetyan, and Igor Gitman. OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data. arXiv preprint arXiv:2410.01560, 2024. [find](https://scholar.google.com/scholar?q=Shubham+Toshniwal%2C+Wei+Du%2C+Ivan+Moshkov%2C+Branislav+Kisacanin%2C+Alexan+Ayrapetyan%2C+and+Igor+Gitman%2E+OpenMathInstruct%2D2%3A+Accelerating+AI+for+Math+with+Massive+Open%2DSource+Instruction+Data%2E+arXiv+preprint)
76. Shubham Toshniwal, Ivan Sorokin, Aleksander Ficek, Ivan Moshkov, and Igor Gitman. GenSelect: A Generative Approach to Best-of-N, 2025. URL https://arxiv.org/abs/2507.17797. — [arXiv:2507.17797](https://arxiv.org/abs/2507.17797) [↗](https://arxiv.org/abs/2507.17797)
77. Lean Wang, Huazuo Gao, Chenggang Zhao, Xu Sun, and Damai Dai. Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts. arXiv preprint arXiv:2408.15664, 2024. — [arXiv:2408.15664](https://arxiv.org/abs/2408.15664) [find](https://scholar.google.com/scholar?q=Lean+Wang%2C+Huazuo+Gao%2C+Chenggang+Zhao%2C+Xu+Sun%2C+and+Damai+Dai%2E+Auxiliary%2DLoss%2DFree+Load+Balancing+Strategy+for+Mixture%2Dof%2DExperts%2E+arXiv+preprint+arXiv%3A2408%2E15664%2C+2024%2E+%E2%80%94+%5BarXiv%3A2408%2E15664%5D%28https%3A%2F%2Far)
78. Xingyao Wang, Boxuan Li, Yufan Song, Frank F. Xu, Xiangru Tang, Mingchen Zhuge, Jiayi Pan, Yueqi Song, Bowen Li, Jaskirat Singh, Hoang H. Tran, Fuqiang Li, Ren Ma, Mingzhang Zheng, Bill Qian, Yanjun Shao, Niklas Muennighoff, Yizhe Zhang, Binyuan Hui, Junyang Lin, Robert Brennan, Hao Peng, Heng Ji, a… — [OpenHands: An Open Platform for AI Software Developers as Generalist Agents](https://md.research.elamur.ai/free/en/papers/wang-2024-openhands-open-platform-ai/)
79. Zhilin Wang, Jiaqi Zeng, Olivier Delalleau, Hoo-Chang Shin, Felipe Soares, Alexander Bukharin, Ellie Evans, Yi Dong, and Oleksii Kuchaiev. HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages. arXiv preprint arXiv:2505.11475, 2025b. — [arXiv:2505.11475](https://arxiv.org/abs/2505.11475) [find](https://scholar.google.com/scholar?q=Zhilin+Wang%2C+Jiaqi+Zeng%2C+Olivier+Delalleau%2C+Hoo%2DChang+Shin%2C+Felipe+Soares%2C+Alexander+Bukharin%2C+Ellie+Evans%2C+Yi+Dong%2C+and+Oleksii+Kuchaiev%2E+HelpSteer3%2DPreference%3A+Open+Human%2DAnnotated+Preference+Data+a)
80. Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoe… — [Transformers: State-of-the-Art Natural Language Processing](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/)
81. Weihao Xuan, Rui Yang, Heli Qi, Qingcheng Zeng, Yunze Xiao, Aosong Feng, Dairui Liu, Yun Xing, Junjue Wang, Fan Gao, et al. [MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluation](https://md.research.elamur.ai/free/en/papers/xuan-2025-mmlu-prox-multilingual-benchmark-advanced/). arXiv preprint arXiv:2503.10497, 2025.
82. An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, et al. [Qwen3 technical report](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/), 2025a. URL https://arxiv.org/abs/2505.09388. [↗](https://arxiv.org/abs/2505.09388)
83. John Yang, Carlos E Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik R Narasimhan, and Ofir Press. [SWE-agent: Agent-computer interfaces enable automated software engineering](https://md.research.elamur.ai/free/en/papers/yang-2024-swe-agent-agent-computer-interfaces/). In The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024. URL [https://arxiv.org/abs…](https://arxiv.org/abs…) [↗](https://arxiv.org/abs…)
84. John Yang, Kilian Lieret, Carlos E Jimenez, Alexander Wettig, Kabir Khandpur, Yanzhe Zhang, Binyuan Hui, Ofir Press, Ludwig Schmidt, and Diyi Yang. SWE-smith: Scaling Data for Software Engineering Agents. arXiv preprint arXiv:2504.21798, 2025b. [find](https://scholar.google.com/scholar?q=John+Yang%2C+Kilian+Lieret%2C+Carlos+E+Jimenez%2C+Alexander+Wettig%2C+Kabir+Khandpur%2C+Yanzhe+Zhang%2C+Binyuan+Hui%2C+Ofir+Press%2C+Ludwig+Schmidt%2C+and+Diyi+Yang%2E+SWE%2Dsmith%3A+Scaling+Data+for+Software+Engineering+Age)
85. Feng Yao, Liyuan Liu, Dinghuai Zhang, Chengyu Dong, Jingbo Shang, and Jianfeng Gao. Your Efficient RL Framework Secretly Brings You Off-Policy RL Training, August 2025. URL [https://fengyao.notion.site/off-policy-rl](https://fengyao.notion.site/off-policy-rl). [↗](https://fengyao.notion.site/off-policy-rl)
86. Longhui Yu, Weisen Jiang, Han Shi, Jincheng Yu, Zhengying Liu, Yu Zhang, James T Kwok, Zhenguo Li, Adrian Weller, and Weiyang Liu. [MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models](https://md.research.elamur.ai/free/en/papers/yu-2023-metamath-bootstrap-your-own-mathematical/). arXiv preprint arXiv:2309.12284, 2023.
87. Qiying Yu, Zheng Zhang, Ruofei Zhu, Yufeng Yuan, Xiaochen Zuo, Yu Yue, Weinan Dai, Tiantian Fan, Gaohong Liu, Lingjun Liu, et al. [DAPO: An Open-Source LLM Reinforcement Learning System at Scale](https://md.research.elamur.ai/free/en/papers/yu-2025-dapo-open-source-llm-reinforcement/). arXiv preprint arXiv:2503.14476, 2025.
88. Xiang Yue, Xingwei Qu, Ge Zhang, Yao Fu, Wenhao Huang, Huan Sun, Yu Su, and Wenhu Chen. [MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning](https://md.research.elamur.ai/free/en/papers/yue-2023-mammoth-building-math-generalist-models/). arXiv preprint arXiv:2309.05653, 2023.
89. Timur Zaharov, Konstantin Korolev, and Aleksandr Nikolich. Physics Big, 2024. URL [https://huggingface.co/datasets/Vikhrmodels/physics_big](https://huggingface.co/datasets/Vikhrmodels/physics_big). [↗](https://huggingface.co/datasets/Vikhrmodels/physics_big)
90. Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Yonghao Li, Zhuohan Chen, Zhewei Wong, Siyuan Zhuang, Yakun Shao, Kai Xu, Zhenyu Zhang, et al. Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena. arXiv preprint arXiv:2309.[11998, 2023](https://md.research.elamur.ai/free/en/papers/zheng-2023-lmsys-chat-1m-large-scale/).
91. Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, and Le Hou. [Instruction-Following Evaluation for Large Language Models](https://md.research.elamur.ai/free/en/papers/zhou-2023-instruction-following-evaluation-large-language/). arXiv preprint arXiv:2311.07911, 2023.

*Updated 1 November 2026*