---
title: "Olmo 3 — Ettinger 2025"
description: "Most competitive language models publish only their final weights."
authors: ["Team Olmo: Allyson Ettinger", "Amanda Bertsch", "Bailey Kuehl", "David Graham", "David Heineman", "Dirk Groeneveld", "Faeze Brahman", "Finbarr Timbers", "Hamish Ivison", "Jacob Morrison", "Jake Poznanski", "Kyle Lo", "Luca Soldaini", "Matt Jordan", "Mayee Chen", "Michael Noukhovitch", "Nathan Lambert", "Pete Walsh", "Pradeep Dasigi", "Robert Berry", "Saumya Malik", "Saurabh Shah", "Scott Geng", "Shane Arora", "Shashank Gupta", "Taira Anderson", "Teng Xiao", "Tyler Murray", "Tyler Romero", "Victoria Graf", "Akari Asai", "Akshita Bhagia", "Alexander Wettig", "Alisa Liu", "Aman Rangapur", "Chloe Anastasiades", "Costa Huang", "Dustin Schwenk", "Harsh Trivedi", "Ian Magnusson", "Jaron Lochner", "Jiacheng Liu", "Lester James V. Miranda", "Maarten Sap", "Malia Morgan", "Michael Schmitz", "Michal Guerquin", "Michael Wilson", "Regan Huff", "Ronan Le Bras", "Rui Xin", "Rulin Shao", "Sam Skjonsberg", "Shannon Zejiang Shen", "Shuyue Stella Li", "Tucker Wilde", "Valentina Pyatkin", "Will Merrill", "Yapei Chang", "Yuling Gu", "Zhiyuan Zeng", "Ashish Sabharwal", "Luke Zettlemoyer", "Pang Wei Koh", "Ali Farhadi", "Noah A. Smith", "Hannaneh Hajishirzi"]
year: 2025
venue: "arXiv:2512.13961"
source: "https://arxiv.org/abs/2512.13961"
doi: "10.48550/arxiv.2512.13961"
arxiv: "2512.13961"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/ettinger-2025-olmo-3/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/ettinger-2025-olmo-3/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/) / Olmo 3

# Olmo 3

**Authors:** Team Olmo: Allyson Ettinger, [Amanda Bertsch](https://md.research.elamur.ai/free/en/authors/amanda-bertsch/), [Bailey Kuehl](https://md.research.elamur.ai/free/en/authors/bailey-kuehl/), David Graham, [David Heineman](https://md.research.elamur.ai/free/en/authors/david-heineman/), [Dirk Groeneveld](https://md.research.elamur.ai/free/en/authors/dirk-groeneveld/), [Faeze Brahman](https://md.research.elamur.ai/free/en/authors/faeze-brahman/), Finbarr Timbers, [Hamish Ivison](https://md.research.elamur.ai/free/en/authors/hamish-ivison/), [Jacob Morrison](https://md.research.elamur.ai/free/en/authors/jacob-morrison/), Jake Poznanski, [Kyle Lo](https://md.research.elamur.ai/free/en/authors/kyle-lo/) et al. (67 authors) · **Year:** 2025 · **Venue:** arXiv:2512.13961 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2512.13961) · [PDF](https://arxiv.org/pdf/2512.13961) · [DOI 10.48550/arxiv.2512.13961](https://doi.org/10.48550/arxiv.2512.13961) · [arXiv 2512.13961](https://arxiv.org/abs/2512.13961) · [OpenAlex](https://openalex.org/W4417465430)

**Citations:** 5 citations (openalex-snapshot · 2026-10-14) · [104](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
Most competitive language models publish only their final weights. This hides the data and intermediate steps that shaped them. Olmo 3 addresses this by releasing the complete "model flow" for 7B and 32B models: every training stage, checkpoint, dataset, code dependency and log. The base model is trained in three phases: broad pretraining, a midtraining stage aimed at reasoning, math and code, and a long-context extension built largely on science PDFs. From this base, several post-trained variants are derived:
- **Think**, which writes step-by-step reasoning traces.
- **Instruct**, which gives short, direct answers suited to chat and function calling.
- **RL-Zero**, which applies reinforcement learning directly to the base model.

The team also built new data (Dolma 3, Dolci) and tooling (OlmoBaseEval, OlmoRL). Olmo 3.1 Think 32B is reported as the best fully-open thinking model so far. It approaches Qwen 3 32B while using roughly six times fewer training tokens. Because everything is open, model reasoning can be traced back to the training data, which makes the release a reproducible research testbed.

## Key points
- **Base training budget:** up to 5.9T pretraining tokens, 100B midtraining tokens, and 50B (7B) or 100B (32B) long-context tokens.
- **Released data:**
  - Dolma 3 Mix for pretraining.
  - Dolma 3 Dolmino Mix for midtraining.
  - Dolma 3 Longmino Mix for long context.
  - The Dolci suite for post-training (SFT, DPO and RL sets for Think, Instruct and RL-Zero).
- **Base model results:** Olmo 3 Base 32B outperforms the fully-open baselines Stanford Marin, Apertus and LLM360 K2-V2.
- **Instruct results:** Olmo 3 Instruct beats Qwen 2.5, Gemma 3, IBM Granite 3.3 and Llama 3 at comparable sizes.
- **RL-Zero experiments:**
  - Training with random rewards gave no benchmark gains, which supports successful decontamination.
  - Active sampling in OlmoRL kept batches full and reduced loss variance.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/) · [AI & machine learning](https://md.research.elamur.ai/free/en/shelves/ai/)

## Cited by

Cited by

104 papers of our library cite it (of the 140884 whose bibliographies we read); 5 of them have a page here, 99 not yet.

- [Rethinking the Idiomaticity Decomposability Hypothesis: Evidence from Distributional Learning](https://md.research.elamur.ai/free/en/papers/mi-2026-rethinking-idiomaticity-decomposability-hypothesis-evidence/)
- [MUC-4 Revisited: Document-level Event Analysis beyond Span-based Arguments](https://md.research.elamur.ai/free/en/papers/olsen-2026-muc-4-revisited-document-level/)
- [BSC's Submission to the Instruction Following Track of IWSLT 2026](https://md.research.elamur.ai/free/en/papers/pareras-2026-bsc-s-submission-instruction-following/)
- [Why do Large Language Models Fail in Low-resource Translation? Unraveling the Token Dynamics of Large Language Models for Machine Translation](https://md.research.elamur.ai/free/en/papers/qian-2026-why-do-large-language-models/)
- [Language Models Learn Constructional Semantics, Not To Mention Syntax: Investigating LM Understanding of Paired-Focus Constructions](https://md.research.elamur.ai/free/en/papers/scivetti-2026-language-models-learn-constructional-semantics/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{ettinger2025olmo,
  title = {{Olmo 3}},
  author = {Ettinger, Team Olmo: Allyson and Bertsch, Amanda and Kuehl, Bailey and Graham, David and Heineman, David and Groeneveld, Dirk and Brahman, Faeze and Timbers, Finbarr and Ivison, Hamish and Morrison, Jacob and Poznanski, Jake and Lo, Kyle and Soldaini, Luca and Jordan, Matt and Chen, Mayee and Noukhovitch, Michael and Lambert, Nathan and Walsh, Pete and Dasigi, Pradeep and Berry, Robert and Malik, Saumya and Shah, Saurabh and Geng, Scott and Arora, Shane and Gupta, Shashank and Anderson, Taira and Xiao, Teng and Murray, Tyler and Romero, Tyler and Graf, Victoria and Asai, Akari and Bhagia, Akshita and Wettig, Alexander and Liu, Alisa and Rangapur, Aman and Anastasiades, Chloe and Huang, Costa and Schwenk, Dustin and Trivedi, Harsh and Magnusson, Ian and Lochner, Jaron and Liu, Jiacheng and Miranda, Lester James V. and Sap, Maarten and Morgan, Malia and Schmitz, Michael and Guerquin, Michal and Wilson, Michael and Huff, Regan and Bras, Ronan Le and Xin, Rui and Shao, Rulin and Skjonsberg, Sam and Shen, Shannon Zejiang and Li, Shuyue Stella and Wilde, Tucker and Pyatkin, Valentina and Merrill, Will and Chang, Yapei and Gu, Yuling and Zeng, Zhiyuan and Sabharwal, Ashish and Zettlemoyer, Luke and Koh, Pang Wei and Farhadi, Ali and Smith, Noah A. and Hajishirzi, Hannaneh},
  year = {2025},
  doi = {10.48550/arxiv.2512.13961},
  eprint = {2512.13961},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2512.13961}
}
```

- [← previous OASIS: A Multilingual and Multimodal Dataset for Culturally Grounded Spoken Visual QA](https://md.research.elamur.ai/free/en/papers/alam-2025-oasis-multilingual-multimodal-dataset-culturally/)
- [next → Open Automatic Speech Recognition Models for Classical and Modern Standard Arabic](https://md.research.elamur.ai/free/en/papers/grigoryan-2025-open-automatic-speech-recognition-models/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/)

## References

256 references, 85 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. M. Abdin, J. Aneja, H. S. Behl, S. Bubeck, R. Eldan, S. Gunasekar, M. Harrison, R. J. Hewett, M. Javaheripi, P. Kauffmann, J. R. Lee, Y. T. Lee, Y. Li, W. Liu, C. C. T. Mendes, A. Nguyen, E. Price, G. de Rosa, O. Saarikivi, A. Salim, S. Shah, X. Wang, R. Ward, Y. Wu, D. Yu, C. Zhang, and Y. Zhang. P… [find](https://scholar.google.com/scholar?q=M%2E+Abdin%2C+J%2E+Aneja%2C+H%2E+S%2E+Behl%2C+S%2E+Bubeck%2C+R%2E+Eldan%2C+S%2E+Gunasekar%2C+M%2E+Harrison%2C+R%2E+J%2E+Hewett%2C+M%2E+Javaheripi%2C+P%2E+Kauffmann%2C+J%2E+R%2E+Lee%2C+Y%2E+T%2E+Lee%2C+Y%2E+Li%2C+W%2E+Liu%2C+C%2E+C%2E+T%2E+Mendes%2C+A%2E+Nguyen%2C+E%2E+Price%2C+G%2E) [our card](https://md.research.elamur.ai/free/en/papers/abdin-2024-phi-4-technical-report/)
2. R. Ackerman and V. A. Thompson. Meta-reasoning: Monitoring and control of thinking and reasoning. Trends in Cognitive Sciences, 21(8):607–617, 2017. ISSN 1364-6613. doi: https://doi.org/10.1016/j.tics.2017.05.004. URL https://www.sciencedirect.com/science/article/pii/S1364661317301055. — [doi:10.1016/j.tics.2017.05.004](https://doi.org/10.1016/j.tics.2017.05.004) [↗](https://doi.org/10.1016/j.tics.2017.05.004)
3. B. Adler, N. Agarwal, A. Aithal, D. H. Anh, P. Bhattacharya, A. Brundyn, J. Casper, B. Catanzaro, S. Clay, J. Cohen, et al. Nemotron-4 340b technical report. arXiv preprint arXiv:2406.11704, 2024. [find](https://scholar.google.com/scholar?q=B%2E+Adler%2C+N%2E+Agarwal%2C+A%2E+Aithal%2C+D%2E+H%2E+Anh%2C+P%2E+Bhattacharya%2C+A%2E+Brundyn%2C+J%2E+Casper%2C+B%2E+Catanzaro%2C+S%2E+Clay%2C+J%2E+Cohen%2C+et+al%2E+Nemotron%2D4+340b+technical+report%2E+arXiv+preprint+arXiv%3A2406%2E11704%2C+2024%2E) [our card](https://md.research.elamur.ai/free/en/papers/adler-2024-nemotron-4-340b-technical-report/)
4. S. Agarwal, L. Ahmad, J. Ai, S. Altman, A. Applebaum, E. Arbus, R. K. Arora, Y. Bai, B. Baker, H. Bao, et al. gpt-oss-120b & gpt-oss-20b model card. arXiv preprint arXiv:2508.10925, 2025. [find](https://scholar.google.com/scholar?q=S%2E+Agarwal%2C+L%2E+Ahmad%2C+J%2E+Ai%2C+S%2E+Altman%2C+A%2E+Applebaum%2C+E%2E+Arbus%2C+R%2E+K%2E+Arora%2C+Y%2E+Bai%2C+B%2E+Baker%2C+H%2E+Bao%2C+et+al%2E+gpt%2Doss%2D120b+%26+gpt%2Doss%2D20b+model+card%2E+arXiv+preprint+arXiv%3A2508%2E10925%2C+2025%2E) [our card](https://md.research.elamur.ai/free/en/papers/agarwal-2025-gpt-oss-120b-gpt-oss/)
5. P. Aggarwal and S. Welleck. L1: Controlling how long a reasoning model thinks with reinforcement learning, 2025. URL https://arxiv.org/abs/2503.04697. [↗](https://arxiv.org/abs/2503.04697) [our card](https://md.research.elamur.ai/free/en/papers/aggarwal-2025-l1-controlling-long-reasoning-model/)
6. W. U. Ahmad, S. Narenthiran, S. Majumdar, A. Ficek, S. Jain, J. Huang, V. Noroozi, and B. Ginsburg. Opencodereasoning: Advancing data distillation for competitive coding. arXiv preprint arXiv:2504.01943, 2025. URL https://arxiv.org/abs/2504.01943. [↗](https://arxiv.org/abs/2504.01943)
7. J. Ainslie, J. Lee-Thorp, M. de Jong, Y. Zemlyanskiy, F. Lebrón, and S. Sanghai. Gqa: Training generalized multi-query transformer models from multi-head checkpoints, 2023. URL https://arxiv.org/abs/2305.13245. [↗](https://arxiv.org/abs/2305.13245) [our card](https://md.research.elamur.ai/free/en/papers/ainslie-2023-gqa-training-generalized-multi-query/)
8. S. N. Akter, S. Prabhumoye, J. Kamalu, S. Satheesh, E. Nyberg, M. Patwary, M. Shoeybi, and B. Catanzaro. Mind: Math informed synthetic dialogues for pretraining llms, 2024. URL https://arxiv.org/abs/2410.12881. [↗](https://arxiv.org/abs/2410.12881)
9. L. B. Allal, A. Lozhkov, E. Bakouch, G. M. Blázquez, G. Penedo, L. Tunstall, A. Marafioti, H. Kydlíček, A. P. Lajarín, V. Srivastav, J. Lochner, C. Fahlgren, X.-S. Nguyen, C. Fourrier, B. Burtenshaw, H. Larcher, H. Zhao, C. Zakka, M. Morlon, C. Raffel, L. von Werra, and T. Wolf. Smollm2: When smol g… [find](https://scholar.google.com/scholar?q=L%2E+B%2E+Allal%2C+A%2E+Lozhkov%2C+E%2E+Bakouch%2C+G%2E+M%2E+Bl%C3%A1zquez%2C+G%2E+Penedo%2C+L%2E+Tunstall%2C+A%2E+Marafioti%2C+H%2E+Kydl%C3%AD%C4%8Dek%2C+A%2E+P%2E+Lajar%C3%ADn%2C+V%2E+Srivastav%2C+J%2E+Lochner%2C+C%2E+Fahlgren%2C+X%2E%2DS%2E+Nguyen%2C+C%2E+Fourrier%2C+B%2E+Burtenshaw%2C+) [our card](https://md.research.elamur.ai/free/en/papers/allal-2025-smollm2-smol-goes-big-data/)
10. C. An, Z. Xie, X. Li, L. Li, J. Zhang, S. Gong, M. Zhong, J. Xu, X. Qiu, M. Wang, and L. Kong. Polaris: A post-training recipe for scaling reinforcement learning on advanced reasoning models, 2025. URL [https://hkunlp.github.io/blog/2025/Polaris](https://hkunlp.github.io/blog/2025/Polaris). [↗](https://hkunlp.github.io/blog/2025/Polaris)
11. Anthropic. System card: Claude opus 4 & claude sonnet 4. Technical report, Anthropic, 2025. Accessed: 2025-10-07. [find](https://scholar.google.com/scholar?q=Anthropic%2E+System+card%3A+Claude+opus+4+%26+claude+sonnet+4%2E+Technical+report%2C+Anthropic%2C+2025%2E+Accessed%3A+2025%2D10%2D07%2E)
12. Apertus Team. Apertus: Democratizing Open and Compliant LLMs for Global Language Environments. [https://huggingface.co/swiss-ai/Apertus-70B-2509](https://huggingface.co/swiss-ai/Apertus-70B-2509), 2025. [↗](https://huggingface.co/swiss-ai/Apertus-70B-2509)
13. A. Asai, J. He, R. Shao, W. Shi, A. Singh, J. C. Chang, K. Lo, L. Soldaini, S. Feldman, M. D’Arcy, D. Wadden, M. Latzke, M. Tian, P. Ji, S. Liu, H. Tong, B. Wu, Y. Xiong, L. S. Zettlemoyer, G. Neubig, D. Weld, D. Downey, W. tau Yih, P. W. Koh, and H. Hajishirzi. Openscholar: Synthesizing scientific… [find](https://scholar.google.com/scholar?q=A%2E+Asai%2C+J%2E+He%2C+R%2E+Shao%2C+W%2E+Shi%2C+A%2E+Singh%2C+J%2E+C%2E+Chang%2C+K%2E+Lo%2C+L%2E+Soldaini%2C+S%2E+Feldman%2C+M%2E+D%E2%80%99Arcy%2C+D%2E+Wadden%2C+M%2E+Latzke%2C+M%2E+Tian%2C+P%2E+Ji%2C+S%2E+Liu%2C+H%2E+Tong%2C+B%2E+Wu%2C+Y%2E+Xiong%2C+L%2E+S%2E+Zettlemoyer%2C+G%2E+Neubig%2C)
14. G. Attardi. Wikiextractor. [https://github.com/attardi/wikiextractor](https://github.com/attardi/wikiextractor), 2015. [↗](https://github.com/attardi/wikiextractor)
15. J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. Cai, M. Terry, Q. Le, et al. Program synthesis with large language models. arXiv preprint arXiv:2108.07732, 2021. [find](https://scholar.google.com/scholar?q=J%2E+Austin%2C+A%2E+Odena%2C+M%2E+Nye%2C+M%2E+Bosma%2C+H%2E+Michalewski%2C+D%2E+Dohan%2C+E%2E+Jiang%2C+C%2E+Cai%2C+M%2E+Terry%2C+Q%2E+Le%2C+et+al%2E+Program+synthesis+with+large+language+models%2E+arXiv+preprint+arXiv%3A2108%2E07732%2C+2021%2E) [our card](https://md.research.elamur.ai/free/en/papers/austin-2021-program-synthesis-large-language-models/)
16. M. G. Azar, M. Rowland, B. Piot, D. Guo, D. Calandriello, M. Valko, and R. Munos. A general theoretical paradigm to understand learning from human preferences, 2023. URL https://arxiv.org/abs/2310.12036. [↗](https://arxiv.org/abs/2310.12036) [our card](https://md.research.elamur.ai/free/en/papers/azar-2023-general-theoretical-paradigm-understand-learning/)
17. Z. Azerbayev, H. Schoelkopf, K. Paster, M. D. Santos, S. McAleer, A. Q. Jiang, J. Deng, S. Biderman, and S. Welleck. Llemma: An open language model for mathematics, 2023. [find](https://scholar.google.com/scholar?q=Z%2E+Azerbayev%2C+H%2E+Schoelkopf%2C+K%2E+Paster%2C+M%2E+D%2E+Santos%2C+S%2E+McAleer%2C+A%2E+Q%2E+Jiang%2C+J%2E+Deng%2C+S%2E+Biderman%2C+and+S%2E+Welleck%2E+Llemma%3A+An+open+language+model+for+mathematics%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/azerbayev-2023-llemma-open-language-model-mathematics/)
18. Y. Bai, X. Lv, J. Zhang, H. Lyu, J. Tang, Z. Huang, Z. Du, X. Liu, A. Zeng, L. Hou, Y. Dong, J. Tang, and J. Li. LongBench: A bilingual, multitask benchmark for long context understanding. In L.-W. Ku, A. Martins, and V. Srikumar, editors, Proceedings of the 62nd Annual Meeting of the Association fo… [find](https://scholar.google.com/scholar?q=Y%2E+Bai%2C+X%2E+Lv%2C+J%2E+Zhang%2C+H%2E+Lyu%2C+J%2E+Tang%2C+Z%2E+Huang%2C+Z%2E+Du%2C+X%2E+Liu%2C+A%2E+Zeng%2C+L%2E+Hou%2C+Y%2E+Dong%2C+J%2E+Tang%2C+and+J%2E+Li%2E+LongBench%3A+A+bilingual%2C+multitask+benchmark+for+long+context+understanding%2E+In+L%2E%2DW%2E+Ku) [our card](https://md.research.elamur.ai/free/en/papers/bai-2023-longbench-bilingual-multitask-benchmark/)
19. Y. Bai, S. Tu, J. Zhang, H. Peng, X. Wang, X. Lv, S. Cao, J. Xu, L. Hou, Y. Dong, J. Tang, and J. Li. LongBench v2: Towards deeper understanding and reasoning on realistic long-context multitasks. In W. Che, J. Nabende, E. Shutova, and M. T. Pilehvar, editors, Proceedings of the 63rd Annual Meeting… [find](https://scholar.google.com/scholar?q=Y%2E+Bai%2C+S%2E+Tu%2C+J%2E+Zhang%2C+H%2E+Peng%2C+X%2E+Wang%2C+X%2E+Lv%2C+S%2E+Cao%2C+J%2E+Xu%2C+L%2E+Hou%2C+Y%2E+Dong%2C+J%2E+Tang%2C+and+J%2E+Li%2E+LongBench+v2%3A+Towards+deeper+understanding+and+reasoning+on+realistic+long%2Dcontext+multitasks%2E+In+) [our card](https://md.research.elamur.ai/free/en/papers/bai-2024-longbench-v2-deeper-understanding/)
20. E. Bakouch, L. Ben Allal, A. Lozhkov, N. Tazi, L. Tunstall, C. M. Patiño, E. Beeching, A. Roucher, A. J. Reedi, Q. Gallouédec, K. Rasul, N. Habib, C. Fourrier, H. Kydlicek, G. Penedo, H. Larcher, M. Morlon, V. Srivastav, J. Lochner, X.-S. Nguyen, C. Raffel, L. von Werra, and T. Wolf. SmolLM3: smol,… [find](https://scholar.google.com/scholar?q=E%2E+Bakouch%2C+L%2E+Ben+Allal%2C+A%2E+Lozhkov%2C+N%2E+Tazi%2C+L%2E+Tunstall%2C+C%2E+M%2E+Pati%C3%B1o%2C+E%2E+Beeching%2C+A%2E+Roucher%2C+A%2E+J%2E+Reedi%2C+Q%2E+Gallou%C3%A9dec%2C+K%2E+Rasul%2C+N%2E+Habib%2C+C%2E+Fourrier%2C+H%2E+Kydlicek%2C+G%2E+Penedo%2C+H%2E+Larcher%2C+M%2E+M)
21. M. Bavarian, H. Jun, N. Tezak, J. Schulman, C. McLeavey, J. Tworek, and M. Chen. Efficient training of language models to fill in the middle. arXiv preprint arXiv:2207.14255, 2022. [find](https://scholar.google.com/scholar?q=M%2E+Bavarian%2C+H%2E+Jun%2C+N%2E+Tezak%2C+J%2E+Schulman%2C+C%2E+McLeavey%2C+J%2E+Tworek%2C+and+M%2E+Chen%2E+Efficient+training+of+language+models+to+fill+in+the+middle%2E+arXiv+preprint+arXiv%3A2207%2E14255%2C+2022%2E) [our card](https://md.research.elamur.ai/free/en/papers/bavarian-2022-efficient-training-language-models-fill/)
22. I. Beltagy, M. E. Peters, and A. Cohan. Longformer: The long-document transformer. arXiv preprint arXiv:2004.05150, 2020. [find](https://scholar.google.com/scholar?q=I%2E+Beltagy%2C+M%2E+E%2E+Peters%2C+and+A%2E+Cohan%2E+Longformer%3A+The+long%2Ddocument+transformer%2E+arXiv+preprint+arXiv%3A2004%2E05150%2C+2020%2E)
23. A. Bercovich, I. Levy, I. Golan, M. Dabbah, R. El-Yaniv, O. Puny, I. Galil, Z. Moshe, T. Ronen, N. Nabwani, I. Shahaf, O. Tropp, E. Karpas, R. Zilberstein, J. Zeng, S. Singhal, A. Bukharin, Y. Zhang, T. Konuk, G. Shen, A. S. Mahabaleshwarkar, B. Kartal, Y. Suhara, O. Delalleau, Z. Chen, Z. Wang, D.… [find](https://scholar.google.com/scholar?q=A%2E+Bercovich%2C+I%2E+Levy%2C+I%2E+Golan%2C+M%2E+Dabbah%2C+R%2E+El%2DYaniv%2C+O%2E+Puny%2C+I%2E+Galil%2C+Z%2E+Moshe%2C+T%2E+Ronen%2C+N%2E+Nabwani%2C+I%2E+Shahaf%2C+O%2E+Tropp%2C+E%2E+Karpas%2C+R%2E+Zilberstein%2C+J%2E+Zeng%2C+S%2E+Singhal%2C+A%2E+Bukharin%2C+Y%2E+Zhang%2C+)
24. A. Bertsch, L. Soldaini, M. Gormley, G. Neubig, H. Hajishirzi, K. Lo, and D. Groeneveld. Cracks in the foundation: Architectural choices impact long context extension, 2026. [find](https://scholar.google.com/scholar?q=A%2E+Bertsch%2C+L%2E+Soldaini%2C+M%2E+Gormley%2C+G%2E+Neubig%2C+H%2E+Hajishirzi%2C+K%2E+Lo%2C+and+D%2E+Groeneveld%2E+Cracks+in+the+foundation%3A+Architectural+choices+impact+long+context+extension%2C+2026%2E)
25. J. Bevendorff, B. Stein, M. Hagen, and M. Potthast. Elastic ChatNoir: Search Engine for the ClueWeb and the Common Crawl. In L. Azzopardi, A. Hanbury, G. Pasi, and B. Piwowarski, editors, Advances in Information Retrieval. 40th European Conference on IR Research (ECIR 2018), Lecture Notes in Compute… [find](https://scholar.google.com/scholar?q=J%2E+Bevendorff%2C+B%2E+Stein%2C+M%2E+Hagen%2C+and+M%2E+Potthast%2E+Elastic+ChatNoir%3A+Search+Engine+for+the+ClueWeb+and+the+Common+Crawl%2E+In+L%2E+Azzopardi%2C+A%2E+Hanbury%2C+G%2E+Pasi%2C+and+B%2E+Piwowarski%2C+editors%2C+Advances+in+)
26. A. Bhagia, J. Liu, A. Wettig, D. Heineman, O. Tafjord, A. H. Jha, L. Soldaini, N. A. Smith, D. Groeneveld, P. W. Koh, J. Dodge, and H. Hajishirzi. Establishing task scaling laws via compute-efficient model ladders, 2024. URL https://arxiv.org/abs/2412.04403. — [arXiv:2412.04403](https://arxiv.org/abs/2412.04403) [↗](https://arxiv.org/abs/2412.04403)
27. Y. Bisk, R. Zellers, R. Le bras, J. Gao, and Y. Choi. PIQA: Reasoning about physical commonsense in natural language. Proceedings of the AAAI Conference on Artificial Intelligence, 34(05):7432–7439, Apr. 2020. doi: 10.1609/aaai.v34i05.6239. URL [https://ojs.aaai.org/index.php/AAAI/article/view/6239](https://ojs.aaai.org/index.php/AAAI/article/view/6239). [↗](https://ojs.aaai.org/index.php/AAAI/article/view/6239) [our card](https://md.research.elamur.ai/free/en/papers/bisk-2019-piqa-reasoning-about-physical-commonsense/)
28. S. Bordt, S. Srinivas, V. Boreiko, and U. von Luxburg. How much can we forget about data contamination? ArXiv, abs/2410.03249, 2024. URL [https://api.semanticscholar.org/CorpusID:273163321](https://api.semanticscholar.org/CorpusID:273163321). — [arXiv:2410.03249](https://arxiv.org/abs/2410.03249) [↗](https://api.semanticscholar.org/CorpusID:273163321)
29. J. Bragg, M. D’Arcy, N. Balepur, D. Bareket, B. Dalvi, S. Feldman, D. Haddad, J. D. Hwang, P. Jansen, V. Kishore, et al. Astabench: Rigorous benchmarking of ai agents with a scientific research suite. arXiv preprint arXiv:2510.21652, 2025. [find](https://scholar.google.com/scholar?q=J%2E+Bragg%2C+M%2E+D%E2%80%99Arcy%2C+N%2E+Balepur%2C+D%2E+Bareket%2C+B%2E+Dalvi%2C+S%2E+Feldman%2C+D%2E+Haddad%2C+J%2E+D%2E+Hwang%2C+P%2E+Jansen%2C+V%2E+Kishore%2C+et+al%2E+Astabench%3A+Rigorous+benchmarking+of+ai+agents+with+a+scientific+research+suite%2E)
30. F. Brahman, S. Kumar, V. Balachandran, P. Dasigi, V. Pyatkin, A. Ravichander, S. Wiegreffe, N. Dziri, K. Chandu, J. Hessel, et al. The art of saying no: Contextual noncompliance in language models. arXiv preprint arXiv:2407.12043, 2024. [find](https://scholar.google.com/scholar?q=F%2E+Brahman%2C+S%2E+Kumar%2C+V%2E+Balachandran%2C+P%2E+Dasigi%2C+V%2E+Pyatkin%2C+A%2E+Ravichander%2C+S%2E+Wiegreffe%2C+N%2E+Dziri%2C+K%2E+Chandu%2C+J%2E+Hessel%2C+et+al%2E+The+art+of+saying+no%3A+Contextual+noncompliance+in+language+models%2E+ar)
31. Z. Cai, S. Shabihi, B. An, Z. Che, B. R. Bartoldson, B. Kailkhura, T. Goldstein, and F. Huang. Aegisllm: Scaling agentic systems for self-reflective defense in llm security. arXiv preprint arXiv:2504.20965, 2025. Preprint. — [arXiv:2504.20965](https://arxiv.org/abs/2504.20965) [find](https://scholar.google.com/scholar?q=Z%2E+Cai%2C+S%2E+Shabihi%2C+B%2E+An%2C+Z%2E+Che%2C+B%2E+R%2E+Bartoldson%2C+B%2E+Kailkhura%2C+T%2E+Goldstein%2C+and+F%2E+Huang%2E+Aegisllm%3A+Scaling+agentic+systems+for+self%2Dreflective+defense+in+llm+security%2E+arXiv+preprint+arXiv%3A2504%2E)
32. F. Callaway, B. {van Opheusden}, S. Gul, P. Das, P. Krueger, T. Griffiths, and F. Lieder. Rational use of cognitive resources in human planning. Nature Human Behaviour, 6(8):1112–1125, Aug. 2022. ISSN 2397-3374. doi: 10.1038/s41562-022-01332-8. Publisher Copyright: © 2022, The Author(s), under exclu… — [doi:10.1038/s41562-022-01332-8](https://doi.org/10.1038/s41562-022-01332-8) [find](https://scholar.google.com/scholar?q=F%2E+Callaway%2C+B%2E+%7Bvan+Opheusden%7D%2C+S%2E+Gul%2C+P%2E+Das%2C+P%2E+Krueger%2C+T%2E+Griffiths%2C+and+F%2E+Lieder%2E+Rational+use+of+cognitive+resources+in+human+planning%2E+Nature+Human+Behaviour%2C+6%288%29%3A1112%E2%80%931125%2C+Aug%2E+2022%2E+ISSN)
33. F. Cassano, J. Gouwar, D. Nguyen, S. Nguyen, L. Phipps-Costin, D. Pinckney, M.-H. Yee, Y. Zi, C. J. Anderson, M. Q. Feldman, et al. Multipl-e: A scalable and extensible approach to benchmarking neural code generation. arXiv preprint arXiv:2208.08227, 2022. [find](https://scholar.google.com/scholar?q=F%2E+Cassano%2C+J%2E+Gouwar%2C+D%2E+Nguyen%2C+S%2E+Nguyen%2C+L%2E+Phipps%2DCostin%2C+D%2E+Pinckney%2C+M%2E%2DH%2E+Yee%2C+Y%2E+Zi%2C+C%2E+J%2E+Anderson%2C+M%2E+Q%2E+Feldman%2C+et+al%2E+Multipl%2De%3A+A+scalable+and+extensible+approach+to+benchmarking+neural)
34. A. Chatterji, T. Cunningham, D. Deming, Z. Hitzig, C. Ong, C. Y. Shan, and K. Wadman. How people use ChatGPT. Technical Report w34255, National Bureau of Economic Research, Cambridge, MA, Sept. 2025. [find](https://scholar.google.com/scholar?q=A%2E+Chatterji%2C+T%2E+Cunningham%2C+D%2E+Deming%2C+Z%2E+Hitzig%2C+C%2E+Ong%2C+C%2E+Y%2E+Shan%2C+and+K%2E+Wadman%2E+How+people+use+ChatGPT%2E+Technical+Report+w34255%2C+National+Bureau+of+Economic+Research%2C+Cambridge%2C+MA%2C+Sept%2E+2025%2E)
35. M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. de Oliveira Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F. P. Such,… [find](https://scholar.google.com/scholar?q=M%2E+Chen%2C+J%2E+Tworek%2C+H%2E+Jun%2C+Q%2E+Yuan%2C+H%2E+P%2E+de+Oliveira+Pinto%2C+J%2E+Kaplan%2C+H%2E+Edwards%2C+Y%2E+Burda%2C+N%2E+Joseph%2C+G%2E+Brockman%2C+A%2E+Ray%2C+R%2E+Puri%2C+G%2E+Krueger%2C+M%2E+Petrov%2C+H%2E+Khlaaf%2C+G%2E+Sastry%2C+P%2E+Mishkin%2C+B%2E+Chan) [our card](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/)
36. M. F. Chen, T. Murray, D. Heineman, M. Jordan, H. Hajishirzi, C. Ré, L. Soldaini, and K. Lo. Olmix: Efficient mixture recomputation for evolving lm datasets, 2026. [find](https://scholar.google.com/scholar?q=M%2E+F%2E+Chen%2C+T%2E+Murray%2C+D%2E+Heineman%2C+M%2E+Jordan%2C+H%2E+Hajishirzi%2C+C%2E+R%C3%A9%2C+L%2E+Soldaini%2C+and+K%2E+Lo%2E+Olmix%3A+Efficient+mixture+recomputation+for+evolving+lm+datasets%2C+2026%2E)
37. S. Chen, S. Wong, L. Chen, and Y. Tian. Extending context window of large language models via positional interpolation, 2023. URL https://arxiv.org/abs/2306.15595. [↗](https://arxiv.org/abs/2306.15595)
38. Y. Chen, Z. Yang, Z. Liu, C. Lee, P. Xu, M. Shoeybi, B. Catanzaro, and W. Ping. Acereason-nemotron: Advancing math and code reasoning through reinforcement learning. arXiv preprint arXiv:2505.16400, 2025. [find](https://scholar.google.com/scholar?q=Y%2E+Chen%2C+Z%2E+Yang%2C+Z%2E+Liu%2C+C%2E+Lee%2C+P%2E+Xu%2C+M%2E+Shoeybi%2C+B%2E+Catanzaro%2C+and+W%2E+Ping%2E+Acereason%2Dnemotron%3A+Advancing+math+and+code+reasoning+through+reinforcement+learning%2E+arXiv+preprint+arXiv%3A2505%2E16400%2C+2)
39. Z. Cheng, S. Hao, T. Liu, F. Zhou, Y. Xie, F. Yao, Y. Bian, Y. Zhuang, N. Dey, Y. Zha, Y. Gu, K. Zhou, Y. Wang, Y. Li, R. Fan, J. She, C. Gao, A. Saparov, H. Li, T. W. Killian, M. Yurochkin, Z. Liu, E. P. Xing, and Z. Hu. Revisiting reinforcement learning for llm reasoning from a cross-domain perspe… — [arXiv:2506.14965](https://arxiv.org/abs/2506.14965) [find](https://scholar.google.com/scholar?q=Z%2E+Cheng%2C+S%2E+Hao%2C+T%2E+Liu%2C+F%2E+Zhou%2C+Y%2E+Xie%2C+F%2E+Yao%2C+Y%2E+Bian%2C+Y%2E+Zhuang%2C+N%2E+Dey%2C+Y%2E+Zha%2C+Y%2E+Gu%2C+K%2E+Zhou%2C+Y%2E+Wang%2C+Y%2E+Li%2C+R%2E+Fan%2C+J%2E+She%2C+C%2E+Gao%2C+A%2E+Saparov%2C+H%2E+Li%2C+T%2E+W%2E+Killian%2C+M%2E+Yurochkin%2C+Z%2E+Liu%2C+E)
40. W. Chu, X. Xie, J. Yu, J. Wang, A. Phanishayee, C. Tang, Y. Hao, J. Huang, M. Ozdal, J. Wang, V. Goswami, N. Goyal, A. Kadian, A. Gu, C. Cai, F. Tian, X. Wang, M. Si, P. Balaji, C.-H. Chu, and J. Park. Scaling llama 3 training with efficient parallelism strategies. In Proceedings of the 52nd Annual… — [doi:10.1145/3695053.3731410](https://doi.org/10.1145/3695053.3731410) [find](https://scholar.google.com/scholar?q=W%2E+Chu%2C+X%2E+Xie%2C+J%2E+Yu%2C+J%2E+Wang%2C+A%2E+Phanishayee%2C+C%2E+Tang%2C+Y%2E+Hao%2C+J%2E+Huang%2C+M%2E+Ozdal%2C+J%2E+Wang%2C+V%2E+Goswami%2C+N%2E+Goyal%2C+A%2E+Kadian%2C+A%2E+Gu%2C+C%2E+Cai%2C+F%2E+Tian%2C+X%2E+Wang%2C+M%2E+Si%2C+P%2E+Balaji%2C+C%2E%2DH%2E+Chu%2C+and+J%2E+Park)
41. C. Clark, K. Lee, M.-W. Chang, T. Kwiatkowski, M. Collins, and K. Toutanova. BoolQ: Exploring the surprising difficulty of natural yes/no questions. In J. Burstein, C. Doran, and T. Solorio, editors, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computationa… [find](https://scholar.google.com/scholar?q=C%2E+Clark%2C+K%2E+Lee%2C+M%2E%2DW%2E+Chang%2C+T%2E+Kwiatkowski%2C+M%2E+Collins%2C+and+K%2E+Toutanova%2E+BoolQ%3A+Exploring+the+surprising+difficulty+of+natural+yes%2Fno+questions%2E+In+J%2E+Burstein%2C+C%2E+Doran%2C+and+T%2E+Solorio%2C+editors%2C+) [our card](https://md.research.elamur.ai/free/en/papers/clark-2019-boolq-exploring-surprising-difficulty-natural/)
42. P. Clark, I. Cowhey, O. Etzioni, T. Khot, A. Sabharwal, C. Schoenick, and O. Tafjord. Think you have solved question answering? Try ARC, the AI2 reasoning challenge. CoRR, arXiv:1803.05457, 2018. [find](https://scholar.google.com/scholar?q=P%2E+Clark%2C+I%2E+Cowhey%2C+O%2E+Etzioni%2C+T%2E+Khot%2C+A%2E+Sabharwal%2C+C%2E+Schoenick%2C+and+O%2E+Tafjord%2E+Think+you+have+solved+question+answering%3F+Try+ARC%2C+the+AI2+reasoning+challenge%2E+CoRR%2C+arXiv%3A1803%2E05457%2C+2018%2E)
43. K. Cobbe, V. Kosaraju, M. Bavarian, M. Chen, H. Jun, L. Kaiser, M. Plappert, J. Tworek, J. Hilton, R. Nakano, C. Hesse, and J. Schulman. Training verifiers to solve math word problems. arXiv preprint arXiv:2110.14168, 2021. [find](https://scholar.google.com/scholar?q=K%2E+Cobbe%2C+V%2E+Kosaraju%2C+M%2E+Bavarian%2C+M%2E+Chen%2C+H%2E+Jun%2C+L%2E+Kaiser%2C+M%2E+Plappert%2C+J%2E+Tworek%2C+J%2E+Hilton%2C+R%2E+Nakano%2C+C%2E+Hesse%2C+and+J%2E+Schulman%2E+Training+verifiers+to+solve+math+word+problems%2E+arXiv+preprint+) [our card](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/)
44. Common Crawl Foundation. Common Crawl Dataset. [https://commoncrawl.org/](https://commoncrawl.org/). Accessed: December 31, 2024. [↗](https://commoncrawl.org/)
45. G. Cui, L. Yuan, N. Ding, G. Yao, W. Zhu, Y. Ni, G. Xie, Z. Liu, and M. Sun. UltraFeedback: Boosting language models with scaled ai feedback. arXiv preprint arXiv:2310.01377, 2023. [find](https://scholar.google.com/scholar?q=G%2E+Cui%2C+L%2E+Yuan%2C+N%2E+Ding%2C+G%2E+Yao%2C+W%2E+Zhu%2C+Y%2E+Ni%2C+G%2E+Xie%2C+Z%2E+Liu%2C+and+M%2E+Sun%2E+UltraFeedback%3A+Boosting+language+models+with+scaled+ai+feedback%2E+arXiv+preprint+arXiv%3A2310%2E01377%2C+2023%2E)
46. T. Dao. FlashAttention-2: Faster attention with better parallelism and work partitioning. In International Conference on Learning Representations (ICLR), 2024. [find](https://scholar.google.com/scholar?q=T%2E+Dao%2E+FlashAttention%2D2%3A+Faster+attention+with+better+parallelism+and+work+partitioning%2E+In+International+Conference+on+Learning+Representations+%28ICLR%29%2C+2024%2E)
47. P. Dasigi, K. Lo, I. Beltagy, A. Cohan, N. A. Smith, and M. Gardner. A dataset of information-seeking questions and answers anchored in research papers. arXiv preprint arXiv:2105.03011, 2021. [find](https://scholar.google.com/scholar?q=P%2E+Dasigi%2C+K%2E+Lo%2C+I%2E+Beltagy%2C+A%2E+Cohan%2C+N%2E+A%2E+Smith%2C+and+M%2E+Gardner%2E+A+dataset+of+information%2Dseeking+questions+and+answers+anchored+in+research+papers%2E+arXiv+preprint+arXiv%3A2105%2E03011%2C+2021%2E) [our card](https://md.research.elamur.ai/free/en/papers/dasigi-2021-dataset-information-seeking-questions-answers/)
48. DeepSeek-AI. DeepSeek-V3.1 release. [https://api-docs.deepseek.com/news/news250821](https://api-docs.deepseek.com/news/news250821), 2025. Accessed: 2025-11-10. [↗](https://api-docs.deepseek.com/news/news250821)
49. DeepSeek-AI, A. Liu, B. Feng, B. Xue, B. Wang, B. Wu, C. Lu, C. Zhao, C. Deng, C. Zhang, C. Ruan, D. Dai, D. Guo, D. Yang, D. Chen, D. Ji, E. Li, F. Lin, F. Dai, F. Luo, G. Hao, G. Chen, G. Li, H. Zhang, H. Bao, H. Xu, H. Wang, H. Zhang, H. Ding, H. Xin, H. Gao, H. Li, H. Qu, J. L. Cai, J. Liang, J.… [find](https://scholar.google.com/scholar?q=DeepSeek%2DAI%2C+A%2E+Liu%2C+B%2E+Feng%2C+B%2E+Xue%2C+B%2E+Wang%2C+B%2E+Wu%2C+C%2E+Lu%2C+C%2E+Zhao%2C+C%2E+Deng%2C+C%2E+Zhang%2C+C%2E+Ruan%2C+D%2E+Dai%2C+D%2E+Guo%2C+D%2E+Yang%2C+D%2E+Chen%2C+D%2E+Ji%2C+E%2E+Li%2C+F%2E+Lin%2C+F%2E+Dai%2C+F%2E+Luo%2C+G%2E+Hao%2C+G%2E+Chen%2C+G%2E+Li%2C+H%2E+Zha)
50. S. Diao, Y. Yang, Y. Fu, X. Dong, D. Su, M. Kliegl, Z. Chen, P. Belcak, Y. Suhara, H. Yin, M. Patwary, Yingyan, Lin, J. Kautz, and P. Molchanov. Climb: Clustering-based iterative data mixture bootstrapping for language model pre-training, 2025. URL https://arxiv.org/abs/2504.13161. — [arXiv:2504.13161](https://arxiv.org/abs/2504.13161) [↗](https://arxiv.org/abs/2504.13161)
51. H. Ding, Z. Wang, G. Paolini, V. Kumar, A. Deoras, D. Roth, and S. Soatto. Fewer truncations improve language modeling, 2024. URL https://arxiv.org/abs/2404.10830. — [arXiv:2404.10830](https://arxiv.org/abs/2404.10830) [↗](https://arxiv.org/abs/2404.10830)
52. N. Ding, Y. Chen, B. Xu, Y. Qin, S. Hu, Z. Liu, M. Sun, and B. Zhou. Enhancing chat language models by scaling high-quality instructional conversations. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 3029–3051, 2023. [find](https://scholar.google.com/scholar?q=N%2E+Ding%2C+Y%2E+Chen%2C+B%2E+Xu%2C+Y%2E+Qin%2C+S%2E+Hu%2C+Z%2E+Liu%2C+M%2E+Sun%2C+and+B%2E+Zhou%2E+Enhancing+chat+language+models+by+scaling+high%2Dquality+instructional+conversations%2E+In+Proceedings+of+the+2023+Conference+on+Empiri) [our card](https://md.research.elamur.ai/free/en/papers/ding-2023-enhancing-chat-language-models-scaling/)
53. K. D’Oosterlinck, W. Xu, C. Develder, T. Demeester, A. Singh, C. Potts, D. Kiela, and S. Mehri. Anchored preference optimization and contrastive revisions: Addressing underspecification in alignment. Transactions of the Association for Computational Linguistics, 13:442–460, 2025. [find](https://scholar.google.com/scholar?q=K%2E+D%E2%80%99Oosterlinck%2C+W%2E+Xu%2C+C%2E+Develder%2C+T%2E+Demeester%2C+A%2E+Singh%2C+C%2E+Potts%2C+D%2E+Kiela%2C+and+S%2E+Mehri%2E+Anchored+preference+optimization+and+contrastive+revisions%3A+Addressing+underspecification+in+alignment%2E+)
54. D. Dua, Y. Wang, P. Dasigi, G. Stanovsky, S. Singh, and M. Gardner. DROP: A reading comprehension benchmark requiring discrete reasoning over paragraphs. In J. Burstein, C. Doran, and T. Solorio, editors, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computa… [find](https://scholar.google.com/scholar?q=D%2E+Dua%2C+Y%2E+Wang%2C+P%2E+Dasigi%2C+G%2E+Stanovsky%2C+S%2E+Singh%2C+and+M%2E+Gardner%2E+DROP%3A+A+reading+comprehension+benchmark+requiring+discrete+reasoning+over+paragraphs%2E+In+J%2E+Burstein%2C+C%2E+Doran%2C+and+T%2E+Solorio%2C+edit) [our card](https://md.research.elamur.ai/free/en/papers/dua-2019-drop-reading-comprehension-benchmark-requiring/)
55. Y. Dubois, B. Galambosi, P. Liang, and T. B. Hashimoto. Length-controlled alpacaeval: A simple way to debias automatic evaluators. arXiv preprint arXiv:2404.04475, 2024. [find](https://scholar.google.com/scholar?q=Y%2E+Dubois%2C+B%2E+Galambosi%2C+P%2E+Liang%2C+and+T%2E+B%2E+Hashimoto%2E+Length%2Dcontrolled+alpacaeval%3A+A+simple+way+to+debias+automatic+evaluators%2E+arXiv+preprint+arXiv%3A2404%2E04475%2C+2024%2E)
56. A. Fan, Y. Jernite, E. Perez, D. Grangier, J. Weston, and M. Auli. Eli5: Long form question answering. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3558–3567, 2019. [find](https://scholar.google.com/scholar?q=A%2E+Fan%2C+Y%2E+Jernite%2C+E%2E+Perez%2C+D%2E+Grangier%2C+J%2E+Weston%2C+and+M%2E+Auli%2E+Eli5%3A+Long+form+question+answering%2E+In+Proceedings+of+the+57th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages) [our card](https://md.research.elamur.ai/free/en/papers/fan-2019-eli5-long-form-question-answering/)
57. A. Fang, H. Pouransari, M. Jordan, A. Toshev, V. Shankar, L. Schmidt, and T. Gunter. Datasets, documents, and repetitions: The practicalities of unequal data quality, 2025a. URL https://arxiv.org/abs/2503.07879. — [arXiv:2503.07879](https://arxiv.org/abs/2503.07879) [↗](https://arxiv.org/abs/2503.07879)
58. L. Fang, Y. Wang, Z. Liu, C. Zhang, S. Jegelka, J. Gao, B. Ding, and Y. Wang. What is wrong with perplexity for long-context language modeling?, 2025b. URL https://arxiv.org/abs/2410.23771. — [arXiv:2410.23771](https://arxiv.org/abs/2410.23771) [↗](https://arxiv.org/abs/2410.23771)
59. S. Fleming and N. Daw. Self-evaluation of decision-making: A general bayesian framework for metacognitive computation. Psychological Review, 124(1):91–114, 2017. doi: 10.1037/rev0000045. — [doi:10.1037/rev0000045](https://doi.org/10.1037/rev0000045) [find](https://scholar.google.com/scholar?q=S%2E+Fleming+and+N%2E+Daw%2E+Self%2Devaluation+of+decision%2Dmaking%3A+A+general+bayesian+framework+for+metacognitive+computation%2E+Psychological+Review%2C+124%281%29%3A91%E2%80%93114%2C+2017%2E+doi%3A+10%2E1037%2Frev0000045%2E+%E2%80%94+%5Bdoi%3A10%2E103)
60. K. Fujii, Y. Tajima, S. Mizuki, H. Shimada, T. Shiotani, K. Saito, M. Ohi, M. Kawamura, T. Nakamura, T. Okamoto, et al. Rewriting pre-training data boosts llm performance in math and code. arXiv preprint arXiv:2505.02881, 2025. [find](https://scholar.google.com/scholar?q=K%2E+Fujii%2C+Y%2E+Tajima%2C+S%2E+Mizuki%2C+H%2E+Shimada%2C+T%2E+Shiotani%2C+K%2E+Saito%2C+M%2E+Ohi%2C+M%2E+Kawamura%2C+T%2E+Nakamura%2C+T%2E+Okamoto%2C+et+al%2E+Rewriting+pre%2Dtraining+data+boosts+llm+performance+in+math+and+code%2E+arXiv+prepr)
61. K. Gandhi, A. Chakravarthy, A. Singh, N. Lile, and N. D. Goodman. Cognitive behaviors that enable self-improving reasoners, or, four habits of highly effective stars. arXiv preprint arXiv:2503.01307, 2025. [find](https://scholar.google.com/scholar?q=K%2E+Gandhi%2C+A%2E+Chakravarthy%2C+A%2E+Singh%2C+N%2E+Lile%2C+and+N%2E+D%2E+Goodman%2E+Cognitive+behaviors+that+enable+self%2Dimproving+reasoners%2C+or%2C+four+habits+of+highly+effective+stars%2E+arXiv+preprint+arXiv%3A2503%2E01307%2C+) [our card](https://md.research.elamur.ai/free/en/papers/gandhi-2025-cognitive-behaviors-that-enable-self/)
62. L. Gao, S. Biderman, S. Black, L. Golding, T. Hoppe, C. Foster, J. Phang, H. He, A. Thite, N. Nabeshima, et al. The pile: An 800gb dataset of diverse text for language modeling. arXiv preprint arXiv:2101.00027, 2020. [find](https://scholar.google.com/scholar?q=L%2E+Gao%2C+S%2E+Biderman%2C+S%2E+Black%2C+L%2E+Golding%2C+T%2E+Hoppe%2C+C%2E+Foster%2C+J%2E+Phang%2C+H%2E+He%2C+A%2E+Thite%2C+N%2E+Nabeshima%2C+et+al%2E+The+pile%3A+An+800gb+dataset+of+diverse+text+for+language+modeling%2E+arXiv+preprint+arXiv%3A2)
63. T. Gao, A. Wettig, H. Yen, and D. Chen. How to train long-context language models (effectively). In ACL, 2025. [find](https://scholar.google.com/scholar?q=T%2E+Gao%2C+A%2E+Wettig%2C+H%2E+Yen%2C+and+D%2E+Chen%2E+How+to+train+long%2Dcontext+language+models+%28effectively%29%2E+In+ACL%2C+2025%2E)
64. Gemma 3 Team. Gemma 3 technical report, 2025. URL https://arxiv.org/abs/2503.19786. [↗](https://arxiv.org/abs/2503.19786)
65. Gemma Team, T. Mesnard, C. Hardin, R. Dadashi, S. Bhupatiraju, S. Pathak, L. Sifre, M. Rivière, M. S. Kale, J. Love, et al. Gemma: Open models based on gemini research and technology. arXiv preprint arXiv:2403.08295, 2024. [find](https://scholar.google.com/scholar?q=Gemma+Team%2C+T%2E+Mesnard%2C+C%2E+Hardin%2C+R%2E+Dadashi%2C+S%2E+Bhupatiraju%2C+S%2E+Pathak%2C+L%2E+Sifre%2C+M%2E+Rivi%C3%A8re%2C+M%2E+S%2E+Kale%2C+J%2E+Love%2C+et+al%2E+Gemma%3A+Open+models+based+on+gemini+research+and+technology%2E+arXiv+preprint+a)
66. S. Geng, H. Ivison, C.-L. Li, M. Sap, J. Li, R. Krishna, and P. W. Koh. The delta learning hypothesis: Preference tuning on weak data can yield strong gains. arXiv preprint arXiv:2507.06187, 2025. — [arXiv:2507.06187](https://arxiv.org/abs/2507.06187) [find](https://scholar.google.com/scholar?q=S%2E+Geng%2C+H%2E+Ivison%2C+C%2E%2DL%2E+Li%2C+M%2E+Sap%2C+J%2E+Li%2C+R%2E+Krishna%2C+and+P%2E+W%2E+Koh%2E+The+delta+learning+hypothesis%3A+Preference+tuning+on+weak+data+can+yield+strong+gains%2E+arXiv+preprint+arXiv%3A2507%2E06187%2C+2025%2E+%E2%80%94+%5B)
67. GLM-4.5 Team, A. Zeng, X. Lv, Q. Zheng, Z. Hou, B. Chen, C. Xie, C. Wang, D. Yin, H. Zeng, J. Zhang, K. Wang, L. Zhong, M. Liu, R. Lu, S. Cao, X. Zhang, X. Huang, Y. Wei, Y. Cheng, Y. An, Y. Niu, Y. Wen, Y. Bai, Z. Du, Z. Wang, Z. Zhu, B. Zhang, B. Wen, B. Wu, B. Xu, C. Huang, C. Zhao, C. Cai, C. Yu… [find](https://scholar.google.com/scholar?q=GLM%2D4%2E5+Team%2C+A%2E+Zeng%2C+X%2E+Lv%2C+Q%2E+Zheng%2C+Z%2E+Hou%2C+B%2E+Chen%2C+C%2E+Xie%2C+C%2E+Wang%2C+D%2E+Yin%2C+H%2E+Zeng%2C+J%2E+Zhang%2C+K%2E+Wang%2C+L%2E+Zhong%2C+M%2E+Liu%2C+R%2E+Lu%2C+S%2E+Cao%2C+X%2E+Zhang%2C+X%2E+Huang%2C+Y%2E+Wei%2C+Y%2E+Cheng%2C+Y%2E+An%2C+Y%2E+Niu%2C+Y%2E+W) [our card](https://md.research.elamur.ai/free/en/papers/glm-2025-4-glm-4-5-agentic/)
68. C. Goddard. Extending AFM-4.5B to 64K context length. [https://www.arcee.ai/blog/](https://www.arcee.ai/blog/) extending-afm-4-5b-to-64k-context-length, June 2025. Accessed: 2025-11-10. [↗](https://www.arcee.ai/blog/)
69. C. Goddard, S. Siriwardhana, M. Ehghaghi, L. Meyers, V. Karpukhin, B. Benedict, M. McQuade, and J. Solawetz. Arcee’s MergeKit: A toolkit for merging large language models. In F. Dernoncourt, D. Preoţiuc-Pietro, and A. Shimorina, editors, Proceedings of the 2024 Conference on Empirical Methods in Nat… [find](https://scholar.google.com/scholar?q=C%2E+Goddard%2C+S%2E+Siriwardhana%2C+M%2E+Ehghaghi%2C+L%2E+Meyers%2C+V%2E+Karpukhin%2C+B%2E+Benedict%2C+M%2E+McQuade%2C+and+J%2E+Solawetz%2E+Arcee%E2%80%99s+MergeKit%3A+A+toolkit+for+merging+large+language+models%2E+In+F%2E+Dernoncourt%2C+D%2E+Preo%C5%A3i)
70. N. Godey, W. Antoun, R. Touchent, R. Bawden, Éric de la Clergerie, B. Sagot, and D. Seddah. Gaperon: A peppered english-french generative language model suite, 2025. URL https://arxiv.org/abs/2510.25771. [↗](https://arxiv.org/abs/2510.25771)
71. A. Grattafiori, A. Dubey, A. Jauhri, A. Pandey, A. Kadian, A. Al-Dahle, A. Letman, A. Mathurx, A. Schelten, A. Vaughan, A. Yang, A. Fan, A. Goyal, A. Hartshorn, A. Yang, A. Mitra, A. Sravankumar, A. Korenev, A. Hinsvark, A. Rao, A. Zhang, A. Rodriguez, A. Gregerson, A. Spataru, B. Roziere, B. Biron,… [find](https://scholar.google.com/scholar?q=A%2E+Grattafiori%2C+A%2E+Dubey%2C+A%2E+Jauhri%2C+A%2E+Pandey%2C+A%2E+Kadian%2C+A%2E+Al%2DDahle%2C+A%2E+Letman%2C+A%2E+Mathurx%2C+A%2E+Schelten%2C+A%2E+Vaughan%2C+A%2E+Yang%2C+A%2E+Fan%2C+A%2E+Goyal%2C+A%2E+Hartshorn%2C+A%2E+Yang%2C+A%2E+Mitra%2C+A%2E+Sravankumar%2C+A%2E+K)
72. T. L. Griffiths, F. Callaway, M. B. Chang, E. Grant, P. M. Krueger, and F. Lieder. Doing more with less: meta-reasoning and meta-learning in humans and machines. Current Opinion in Behavioral Sciences, 29:24–30, 2019. ISSN 2352-1546. doi: https://doi.org/10.1016/j.cobeha.2019.01.005. URL https://www… — [doi:10.1016/j.cobeha.2019.01.005](https://doi.org/10.1016/j.cobeha.2019.01.005) [↗](https://doi.org/10.1016/j.cobeha.2019.01.005)
73. A. Gu, B. Rozière, H. Leather, A. Solar-Lezama, G. Synnaeve, and S. I. Wang. Cruxeval: A benchmark for code reasoning, understanding and execution. arXiv preprint arXiv:2401.03065, 2024a. [find](https://scholar.google.com/scholar?q=A%2E+Gu%2C+B%2E+Rozi%C3%A8re%2C+H%2E+Leather%2C+A%2E+Solar%2DLezama%2C+G%2E+Synnaeve%2C+and+S%2E+I%2E+Wang%2E+Cruxeval%3A+A+benchmark+for+code+reasoning%2C+understanding+and+execution%2E+arXiv+preprint+arXiv%3A2401%2E03065%2C+2024a%2E) [our card](https://md.research.elamur.ai/free/en/papers/gu-2024-cruxeval-benchmark-code-reasoning-understanding/)
74. Y. Gu, O. Tafjord, B. Kuehl, D. Haddad, J. Dodge, and H. Hajishirzi. Olmes: A standard for language model evaluations. ArXiv, abs/2406.08446, 2024b. URL [https://api.semanticscholar.org/CorpusID:270391754](https://api.semanticscholar.org/CorpusID:270391754). [↗](https://api.semanticscholar.org/CorpusID:270391754)
75. E. Guha, R. Marten, S. Keh, N. Raoof, G. Smyrnis, H. Bansal, M. Nezhurina, J. Mercat, T. Vu, Z. Sprague, A. Suvarna, B. Feuer, L. Chen, Z. Khan, E. Frankel, S. Grover, C. Choi, N. Muennighoff, S. Su, W. Zhao, J. Yang, S. Pimpalgaonkar, K. Sharma, C. C.-J. Ji, Y. Deng, S. Pratt, V. Ramanujan, J. Saad… [find](https://scholar.google.com/scholar?q=E%2E+Guha%2C+R%2E+Marten%2C+S%2E+Keh%2C+N%2E+Raoof%2C+G%2E+Smyrnis%2C+H%2E+Bansal%2C+M%2E+Nezhurina%2C+J%2E+Mercat%2C+T%2E+Vu%2C+Z%2E+Sprague%2C+A%2E+Suvarna%2C+B%2E+Feuer%2C+L%2E+Chen%2C+Z%2E+Khan%2C+E%2E+Frankel%2C+S%2E+Grover%2C+C%2E+Choi%2C+N%2E+Muennighoff%2C+S%2E+Su%2C+) [our card](https://md.research.elamur.ai/free/en/papers/guha-2025-openthoughts-data-recipes-reasoning-models/)
76. E. Guha, R. Marten, S. Keh, N. Raoof, G. Smyrnis, H. Bansal, M. Nezhurina, J. Mercat, T. Vu, Z. Sprague, A. Suvarna, B. Feuer, L. Chen, Z. Khan, E. Frankel, S. Grover, C. Choi, N. Muennighoff, S. Su, W. Zhao, J. Yang, S. Pimpalgaonkar, K. Sharma, C. C.-J. Ji, Y. Deng, S. Pratt, V. Ramanujan, J. Saad… [find](https://scholar.google.com/scholar?q=E%2E+Guha%2C+R%2E+Marten%2C+S%2E+Keh%2C+N%2E+Raoof%2C+G%2E+Smyrnis%2C+H%2E+Bansal%2C+M%2E+Nezhurina%2C+J%2E+Mercat%2C+T%2E+Vu%2C+Z%2E+Sprague%2C+A%2E+Suvarna%2C+B%2E+Feuer%2C+L%2E+Chen%2C+Z%2E+Khan%2C+E%2E+Frankel%2C+S%2E+Grover%2C+C%2E+Choi%2C+N%2E+Muennighoff%2C+S%2E+Su%2C+) [our card](https://md.research.elamur.ai/free/en/papers/guha-2025-openthoughts-data-recipes-reasoning-models/)
77. D. Guo, Q. Zhu, D. Yang, Z. Xie, K. Dong, W. Zhang, G. Chen, X. Bi, Y. Wu, Y. Li, et al. Deepseek-coder: When the large language model meets programming–the rise of code intelligence. arXiv preprint arXiv:2401.14196, 2024. [find](https://scholar.google.com/scholar?q=D%2E+Guo%2C+Q%2E+Zhu%2C+D%2E+Yang%2C+Z%2E+Xie%2C+K%2E+Dong%2C+W%2E+Zhang%2C+G%2E+Chen%2C+X%2E+Bi%2C+Y%2E+Wu%2C+Y%2E+Li%2C+et+al%2E+Deepseek%2Dcoder%3A+When+the+large+language+model+meets+programming%E2%80%93the+rise+of+code+intelligence%2E+arXiv+preprint+a)
78. D. Guo, D. Yang, H. Zhang, J. Song, R. Zhang, R. Xu, Q. Zhu, S. Ma, P. Wang, X. Bi, et al. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948, 2025. [find](https://scholar.google.com/scholar?q=D%2E+Guo%2C+D%2E+Yang%2C+H%2E+Zhang%2C+J%2E+Song%2C+R%2E+Zhang%2C+R%2E+Xu%2C+Q%2E+Zhu%2C+S%2E+Ma%2C+P%2E+Wang%2C+X%2E+Bi%2C+et+al%2E+Deepseek%2Dr1%3A+Incentivizing+reasoning+capability+in+llms+via+reinforcement+learning%2E+arXiv+preprint+arXiv%3A2501) [our card](https://md.research.elamur.ai/free/en/papers/deepseek-2025-ai-deepseek-r1-incentivizing-reasoning-capability/)
79. D. Hall, C. Chou, A. Garg, N. Ravi, N. Liu, H. Shandilya, A. Ahmed, P. Liang, R. Kuditipudi, J38, T. Lee, R. Power, K. Salahi, W. Held, J. Wang, chiheem, J. Niklaus, Y. Mai, dependabot[bot], I. Zhou, K. X. Li, S. Yang, S. Karamcheti, R. Williams, C. Zhou, A. Ramaswami, whenwen, S. Kotha, G. Miguel,… [find](https://scholar.google.com/scholar?q=D%2E+Hall%2C+C%2E+Chou%2C+A%2E+Garg%2C+N%2E+Ravi%2C+N%2E+Liu%2C+H%2E+Shandilya%2C+A%2E+Ahmed%2C+P%2E+Liang%2C+R%2E+Kuditipudi%2C+J38%2C+T%2E+Lee%2C+R%2E+Power%2C+K%2E+Salahi%2C+W%2E+Held%2C+J%2E+Wang%2C+chiheem%2C+J%2E+Niklaus%2C+Y%2E+Mai%2C+dependabot%5Bbot%5D%2C+I%2E+Zhou%2C+)
80. S. Han, K. Rao, A. Ettinger, L. Jiang, B. Y. Lin, N. Lambert, Y. Choi, and N. Dziri. Wildguard: Open one-stop moderation tools for safety risks, jailbreaks, and refusals of llms. arXiv preprint arXiv:2406.18495, 2024. [find](https://scholar.google.com/scholar?q=S%2E+Han%2C+K%2E+Rao%2C+A%2E+Ettinger%2C+L%2E+Jiang%2C+B%2E+Y%2E+Lin%2C+N%2E+Lambert%2C+Y%2E+Choi%2C+and+N%2E+Dziri%2E+Wildguard%3A+Open+one%2Dstop+moderation+tools+for+safety+risks%2C+jailbreaks%2C+and+refusals+of+llms%2E+arXiv+preprint+arXiv%3A) [our card](https://md.research.elamur.ai/free/en/papers/han-2024-wildguard-open-one-stop-moderation/)
81. T. Hartvigsen, S. Gabriel, H. Palangi, M. Sap, D. Ray, and E. Kamar. Toxigen: A large-scale machine-generated dataset for adversarial and implicit hate speech detection. pages 3309–3326, 01 2022. doi: 10.18653/v1/2022.acl-long.234. [find](https://scholar.google.com/scholar?q=T%2E+Hartvigsen%2C+S%2E+Gabriel%2C+H%2E+Palangi%2C+M%2E+Sap%2C+D%2E+Ray%2C+and+E%2E+Kamar%2E+Toxigen%3A+A+large%2Dscale+machine%2Dgenerated+dataset+for+adversarial+and+implicit+hate+speech+detection%2E+pages+3309%E2%80%933326%2C+01+2022%2E+doi%3A) [our card](https://md.research.elamur.ai/free/en/papers/hartvigsen-2022-toxigen-large-scale-machine-generated/)
82. G. Haupt. Hierarchical thinking: a cognitive tool for guiding coherent decision making in design problem solving. International Journal of Technology and Design Education, 28(1):207–237, 2018. ISSN 1573-1804. doi: 10.1007/ s10798-016-9381-0. URL https://doi.org/10.1007/s10798-016-9381-0. — [doi:10.1007/s10798-016-9381-0](https://doi.org/10.1007/s10798-016-9381-0) [↗](https://doi.org/10.1007/s10798-016-9381-0)
83. D. Heineman, V. Hofmann, I. Magnusson, Y. Gu, N. A. Smith, H. Hajishirzi, K. Lo, and J. Dodge. Signal and noise: A framework for reducing uncertainty in language model evaluation, 2025. URL https://arxiv.org/abs/2508.13144. — [arXiv:2508.13144](https://arxiv.org/abs/2508.13144) [↗](https://arxiv.org/abs/2508.13144)
84. D. Hendrycks, S. Basart, S. Kadavath, M. Mazeika, A. Arora, E. Guo, C. Burns, S. Puranik, H. He, D. Song, and J. Steinhardt. Measuring coding challenge competence with apps. NeurIPS, 2021a. [find](https://scholar.google.com/scholar?q=D%2E+Hendrycks%2C+S%2E+Basart%2C+S%2E+Kadavath%2C+M%2E+Mazeika%2C+A%2E+Arora%2C+E%2E+Guo%2C+C%2E+Burns%2C+S%2E+Puranik%2C+H%2E+He%2C+D%2E+Song%2C+and+J%2E+Steinhardt%2E+Measuring+coding+challenge+competence+with+apps%2E+NeurIPS%2C+2021a%2E) [our card](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-coding-challenge-competence-apps/)
85. D. Hendrycks, C. Burns, S. Basart, A. Zou, M. Mazeika, D. Song, and J. Steinhardt. Measuring massive multitask language understanding. Proceedings of the International Conference on Learning Representations (ICLR), 2021b. [find](https://scholar.google.com/scholar?q=D%2E+Hendrycks%2C+C%2E+Burns%2C+S%2E+Basart%2C+A%2E+Zou%2C+M%2E+Mazeika%2C+D%2E+Song%2C+and+J%2E+Steinhardt%2E+Measuring+massive+multitask+language+understanding%2E+Proceedings+of+the+International+Conference+on+Learning+Represent) [our card](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/)
86. D. Hendrycks, C. Burns, S. Kadavath, A. Arora, S. Basart, E. Tang, D. Song, and J. Steinhardt. Measuring mathematical problem solving with the math dataset. NeurIPS, 2021c. [find](https://scholar.google.com/scholar?q=D%2E+Hendrycks%2C+C%2E+Burns%2C+S%2E+Kadavath%2C+A%2E+Arora%2C+S%2E+Basart%2C+E%2E+Tang%2C+D%2E+Song%2C+and+J%2E+Steinhardt%2E+Measuring+mathematical+problem+solving+with+the+math+dataset%2E+NeurIPS%2C+2021c%2E) [our card](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/)
87. D. Horgan, J. Quan, D. Budden, G. Barth-Maron, M. Hessel, H. Van Hasselt, and D. Silver. Distributed prioritized experience replay. arXiv preprint arXiv:1803.00933, 2018. — [arXiv:1803.00933](https://arxiv.org/abs/1803.00933) [find](https://scholar.google.com/scholar?q=D%2E+Horgan%2C+J%2E+Quan%2C+D%2E+Budden%2C+G%2E+Barth%2DMaron%2C+M%2E+Hessel%2C+H%2E+Van+Hasselt%2C+and+D%2E+Silver%2E+Distributed+prioritized+experience+replay%2E+arXiv+preprint+arXiv%3A1803%2E00933%2C+2018%2E+%E2%80%94+%5BarXiv%3A1803%2E00933%5D%28https%3A%2F%2F)
88. C.-P. Hsieh, S. Sun, S. Kriman, S. Acharya, D. Rekesh, F. Jia, Y. Zhang, and B. Ginsburg. Ruler: What’s the real context size of your long-context language models?, 2024. URL https://arxiv.org/abs/2404.06654. [↗](https://arxiv.org/abs/2404.06654) [our card](https://md.research.elamur.ai/free/en/papers/hsieh-2024-ruler-s-real-context-size/)
89. P.-L. Hsu, Y. Dai, V. Kothapalli, Q. Song, S. Tang, S. Zhu, S. Shimizu, S. Sahni, H. Ning, and Y. Chen. Liger kernel: Efficient triton kernels for llm training, 2025. URL https://arxiv.org/abs/2410.10989. [↗](https://arxiv.org/abs/2410.10989)
90. J. Hu, Y. Zhang, Q. Han, D. Jiang, X. Zhang, and H.-Y. Shum. Open-reasoner-zero: An open source approach to scaling up reinforcement learning on the base model. arXiv preprint arXiv:2503.24290, 2025. [find](https://scholar.google.com/scholar?q=J%2E+Hu%2C+Y%2E+Zhang%2C+Q%2E+Han%2C+D%2E+Jiang%2C+X%2E+Zhang%2C+and+H%2E%2DY%2E+Shum%2E+Open%2Dreasoner%2Dzero%3A+An+open+source+approach+to+scaling+up+reinforcement+learning+on+the+base+model%2E+arXiv+preprint+arXiv%3A2503%2E24290%2C+2025%2E) [our card](https://md.research.elamur.ai/free/en/papers/hu-2025-open-reasoner-zero-open-source/)
91. Y. Huang, L. Sun, H. Wang, S. Wu, Q. Zhang, Y. Li, C. Gao, Y. Huang, W. Lyu, Y. Zhang, et al. Trustllm: Trustworthiness in large language models. arXiv preprint arXiv:2401.05561, 2024a. [find](https://scholar.google.com/scholar?q=Y%2E+Huang%2C+L%2E+Sun%2C+H%2E+Wang%2C+S%2E+Wu%2C+Q%2E+Zhang%2C+Y%2E+Li%2C+C%2E+Gao%2C+Y%2E+Huang%2C+W%2E+Lyu%2C+Y%2E+Zhang%2C+et+al%2E+Trustllm%3A+Trustworthiness+in+large+language+models%2E+arXiv+preprint+arXiv%3A2401%2E05561%2C+2024a%2E) [our card](https://md.research.elamur.ai/free/en/papers/huang-2024-trustllm-trustworthiness-large-language-models/)
92. Y. Huang, J. Zhang, Z. Shan, and J. He. Compression represents intelligence linearly. arXiv preprint arXiv:2404.09937, 2024b. — [arXiv:2404.09937](https://arxiv.org/abs/2404.09937) [find](https://scholar.google.com/scholar?q=Y%2E+Huang%2C+J%2E+Zhang%2C+Z%2E+Shan%2C+and+J%2E+He%2E+Compression+represents+intelligence+linearly%2E+arXiv+preprint+arXiv%3A2404%2E09937%2C+2024b%2E+%E2%80%94+%5BarXiv%3A2404%2E09937%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2404%2E09937%29)
93. N. Jain, K. Han, A. Gu, W.-D. Li, F. Yan, T. Zhang, S. Wang, A. Solar-Lezama, K. Sen, and I. Stoica. Livecodebench: Holistic and contamination free evaluation of large language models for code. arXiv preprint arXiv:2403.07974, 2024. [find](https://scholar.google.com/scholar?q=N%2E+Jain%2C+K%2E+Han%2C+A%2E+Gu%2C+W%2E%2DD%2E+Li%2C+F%2E+Yan%2C+T%2E+Zhang%2C+S%2E+Wang%2C+A%2E+Solar%2DLezama%2C+K%2E+Sen%2C+and+I%2E+Stoica%2E+Livecodebench%3A+Holistic+and+contamination+free+evaluation+of+large+language+models+for+code%2E+arXiv+) [our card](https://md.research.elamur.ai/free/en/papers/jain-2024-livecodebench-holistic-contamination-free-evaluation/)
94. L. Jiang, K. Rao, S. Han, A. Ettinger, F. Brahman, S. Kumar, N. Mireshghallah, X. Lu, M. Sap, Y. Choi, and N. Dziri. Wildteaming at scale: From in-the-wild jailbreaks to (adversarially) safer language models. arXiv preprint arXiv:2406.18510, 2024. URL https://arxiv.org/abs/2406.18510. [↗](https://arxiv.org/abs/2406.18510)
95. Z. Jiang, M. Y. R. Yang, M. Tsirlin, R. Tang, and J. Lin. Less is more: Parameter-free text classification with gzip, 2022. URL https://arxiv.org/abs/2212.09410. — [arXiv:2212.09410](https://arxiv.org/abs/2212.09410) [↗](https://arxiv.org/abs/2212.09410)
96. D. Jin, E. Pan, N. Oufattole, W.-H. Weng, H. Fang, and P. Szolovits. What disease does this patient have? a large-scale open domain question answering dataset from medical exams. Applied Sciences, 11(14):6421, 2021. [find](https://scholar.google.com/scholar?q=D%2E+Jin%2C+E%2E+Pan%2C+N%2E+Oufattole%2C+W%2E%2DH%2E+Weng%2C+H%2E+Fang%2C+and+P%2E+Szolovits%2E+What+disease+does+this+patient+have%3F+a+large%2Dscale+open+domain+question+answering+dataset+from+medical+exams%2E+Applied+Sciences%2C+11%28) [our card](https://md.research.elamur.ai/free/en/papers/jin-2020-disease-this-patient-have-large/)
97. J. M. Joyce. Causal reasoning and backtracking. Philosophical Studies, 147(1):139–154, 2009. doi: 10.1007/ s11098-009-9454-y. [find](https://scholar.google.com/scholar?q=J%2E+M%2E+Joyce%2E+Causal+reasoning+and+backtracking%2E+Philosophical+Studies%2C+147%281%29%3A139%E2%80%93154%2C+2009%2E+doi%3A+10%2E1007%2F+s11098%2D009%2D9454%2Dy%2E)
98. F. Kaiyom, A. Ahmed, Y. Mai, K. Klyman, R. Bommasani, and P. Liang. HELM safety: Towards standardized safety evaluations of language models, 8 Nov. 2024. URL [https://crfm.stanford.edu/2024/11/08/helm-safety.html](https://crfm.stanford.edu/2024/11/08/helm-safety.html). [↗](https://crfm.stanford.edu/2024/11/08/helm-safety.html)
99. P. Kargupta, S. S. Li, H. Wang, J. Lee, S. Chen, O. Ahia, D. Light, T. L. Griffiths, M. Kleiman-Weiner, J. Han, A. Celikyilmaz, and Y. Tsvetkov. Cognitive foundations for reasoning and their manifestation in llms. arXiv, 2025. [find](https://scholar.google.com/scholar?q=P%2E+Kargupta%2C+S%2E+S%2E+Li%2C+H%2E+Wang%2C+J%2E+Lee%2C+S%2E+Chen%2C+O%2E+Ahia%2C+D%2E+Light%2C+T%2E+L%2E+Griffiths%2C+M%2E+Kleiman%2DWeiner%2C+J%2E+Han%2C+A%2E+Celikyilmaz%2C+and+Y%2E+Tsvetkov%2E+Cognitive+foundations+for+reasoning+and+their+manifesta)
100. K. Kavukcuoğlu and G. DeepMind. Gemini 2.5: Our most intelligent ai model. [https://blog.google/technology/](https://blog.google/technology/) google-deepmind/gemini-model-thinking-updates-march-2025/, Mar. 2025. Accessed: 2025-10-07. [↗](https://blog.google/technology/)
101. J. Kim, A. Goyal, A. Zhang, B. Xiong, R. Hou, M. Kambadur, D. Mahajan, H. Hajishirzi, and L. Tan. A systematic examination of preference learning through the lens of instruction-following. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computation… [find](https://scholar.google.com/scholar?q=J%2E+Kim%2C+A%2E+Goyal%2C+A%2E+Zhang%2C+B%2E+Xiong%2C+R%2E+Hou%2C+M%2E+Kambadur%2C+D%2E+Mahajan%2C+H%2E+Hajishirzi%2C+and+L%2E+Tan%2E+A+systematic+examination+of+preference+learning+through+the+lens+of+instruction%2Dfollowing%2E+In+Proceedi)
102. S. Kim, S. Bae, J. Shin, S. Kang, D. Kwak, K. Yoo, and M. Seo. Aligning large language models through synthetic feedback. In H. Bouamor, J. Pino, and K. Bali, editors, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 13677–13700, Singapore, Dec. 2023. Ass… [find](https://scholar.google.com/scholar?q=S%2E+Kim%2C+S%2E+Bae%2C+J%2E+Shin%2C+S%2E+Kang%2C+D%2E+Kwak%2C+K%2E+Yoo%2C+and+M%2E+Seo%2E+Aligning+large+language+models+through+synthetic+feedback%2E+In+H%2E+Bouamor%2C+J%2E+Pino%2C+and+K%2E+Bali%2C+editors%2C+Proceedings+of+the+2023+Conferen)
103. Kimi Team, Y. Bai, Y. Bao, G. Chen, J. Chen, N. Chen, R. Chen, Y. Chen, Y. Chen, Y. Chen, Z. Chen, J. Cui, H. Ding, M. Dong, A. Du, C. Du, D. Du, Y. Du, Y. Fan, Y. Feng, K. Fu, B. Gao, H. Gao, P. Gao, T. Gao, X. Gu, L. Guan, H. Guo, J. Guo, H. Hu, X. Hao, T. He, W. He, W. He, C. Hong, Y. Hu, Z. Hu,… [find](https://scholar.google.com/scholar?q=Kimi+Team%2C+Y%2E+Bai%2C+Y%2E+Bao%2C+G%2E+Chen%2C+J%2E+Chen%2C+N%2E+Chen%2C+R%2E+Chen%2C+Y%2E+Chen%2C+Y%2E+Chen%2C+Y%2E+Chen%2C+Z%2E+Chen%2C+J%2E+Cui%2C+H%2E+Ding%2C+M%2E+Dong%2C+A%2E+Du%2C+C%2E+Du%2C+D%2E+Du%2C+Y%2E+Du%2C+Y%2E+Fan%2C+Y%2E+Feng%2C+K%2E+Fu%2C+B%2E+Gao%2C+H%2E+Gao%2C+P%2E+Gao%2C) [our card](https://md.research.elamur.ai/free/en/papers/kimi-2025-team-kimi-k2-open-agentic/)
104. A. Köpf, Y. Kilcher, D. von Rütte, S. Anagnostidis, Z. R. Tam, K. Stevens, A. Barhoum, D. Nguyen, O. Stanley, R. Nagyfi, et al. Openassistant conversations-democratizing large language model alignment. Advances in Neural Information Processing Systems, 36, 2024. [find](https://scholar.google.com/scholar?q=A%2E+K%C3%B6pf%2C+Y%2E+Kilcher%2C+D%2E+von+R%C3%BCtte%2C+S%2E+Anagnostidis%2C+Z%2E+R%2E+Tam%2C+K%2E+Stevens%2C+A%2E+Barhoum%2C+D%2E+Nguyen%2C+O%2E+Stanley%2C+R%2E+Nagyfi%2C+et+al%2E+Openassistant+conversations%2Ddemocratizing+large+language+model+alignment) [our card](https://md.research.elamur.ai/free/en/papers/kopf-2023-openassistant-conversations-democratizing-large-language/)
105. S. Kudugunta, I. Caswell, B. Zhang, X. Garcia, C. A. Choquette-Choo, K. Lee, D. Xin, A. Kusupati, R. Stella, A. Bapna, and O. Firat. Madlad-400: A multilingual and document-level large audited dataset, 2023. URL https://arxiv.org/abs/2309.04662. [↗](https://arxiv.org/abs/2309.04662) [our card](https://md.research.elamur.ai/free/en/papers/kudugunta-2023-madlad-400-multilingual-document-level/)
106. T. Kwiatkowski, J. Palomaki, O. Redfield, M. Collins, A. Parikh, C. Alberti, D. Epstein, I. Polosukhin, J. Devlin, K. Lee, K. Toutanova, L. Jones, M. Kelcey, M.-W. Chang, A. M. Dai, J. Uszkoreit, Q. Le, and S. Petrov. Natural questions: A benchmark for question answering research. Transactions of th… [find](https://scholar.google.com/scholar?q=T%2E+Kwiatkowski%2C+J%2E+Palomaki%2C+O%2E+Redfield%2C+M%2E+Collins%2C+A%2E+Parikh%2C+C%2E+Alberti%2C+D%2E+Epstein%2C+I%2E+Polosukhin%2C+J%2E+Devlin%2C+K%2E+Lee%2C+K%2E+Toutanova%2C+L%2E+Jones%2C+M%2E+Kelcey%2C+M%2E%2DW%2E+Chang%2C+A%2E+M%2E+Dai%2C+J%2E+Uszkoreit%2C+Q%2E+L) [our card](https://md.research.elamur.ai/free/en/papers/kwiatkowski-2019-natural-questions-benchmark-question-answering/)
107. W. Kwon, Z. Li, S. Zhuang, Y. Sheng, L. Zheng, C. H. Yu, J. E. Gonzalez, H. Zhang, and I. Stoica. Efficient memory management for large language model serving with pagedattention. In Proceedings of the ACM SIGOPS 29th Symposium on Operating Systems Principles, 2023. [find](https://scholar.google.com/scholar?q=W%2E+Kwon%2C+Z%2E+Li%2C+S%2E+Zhuang%2C+Y%2E+Sheng%2C+L%2E+Zheng%2C+C%2E+H%2E+Yu%2C+J%2E+E%2E+Gonzalez%2C+H%2E+Zhang%2C+and+I%2E+Stoica%2E+Efficient+memory+management+for+large+language+model+serving+with+pagedattention%2E+In+Proceedings+of+th)
108. Y. Lai, C. Li, Y. Wang, T. Zhang, R. Zhong, L. Zettlemoyer, W.-T. Yih, D. Fried, S. Wang, and T. Yu. Ds-1000: A natural and reliable benchmark for data science code generation. ArXiv, abs/2211.11501, 2022. [find](https://scholar.google.com/scholar?q=Y%2E+Lai%2C+C%2E+Li%2C+Y%2E+Wang%2C+T%2E+Zhang%2C+R%2E+Zhong%2C+L%2E+Zettlemoyer%2C+W%2E%2DT%2E+Yih%2C+D%2E+Fried%2C+S%2E+Wang%2C+and+T%2E+Yu%2E+Ds%2D1000%3A+A+natural+and+reliable+benchmark+for+data+science+code+generation%2E+ArXiv%2C+abs%2F2211%2E11501%2C+)
109. N. Lambert. Reinforcement Learning from Human Feedback. Online, 2025. URL [https://rlhfbook.com](https://rlhfbook.com). [↗](https://rlhfbook.com)
110. N. Lambert, T. K. Gilbert, and T. Zick. Entangled preferences: The history and risks of reinforcement learning and human feedback. arXiv preprint arXiv:2310.13595, 2023. — [arXiv:2310.13595](https://arxiv.org/abs/2310.13595) [find](https://scholar.google.com/scholar?q=N%2E+Lambert%2C+T%2E+K%2E+Gilbert%2C+and+T%2E+Zick%2E+Entangled+preferences%3A+The+history+and+risks+of+reinforcement+learning+and+human+feedback%2E+arXiv+preprint+arXiv%3A2310%2E13595%2C+2023%2E+%E2%80%94+%5BarXiv%3A2310%2E13595%5D%28https%3A%2F%2Fa)
111. N. Lambert, J. D. Morrison, V. Pyatkin, S. Huang, H. Ivison, F. Brahman, L. J. V. Miranda, A. Liu, N. Dziri, S. Lyu, Y. Gu, S. Malik, V. Graf, J. D. Hwang, J. Yang, R. L. Bras, O. Tafjord, C. Wilhelm, L. Soldaini, N. A. Smith, Y. Wang, P. Dasigi, and H. Hajishirzi. Tulu 3: Pushing frontiers in open… [find](https://scholar.google.com/scholar?q=N%2E+Lambert%2C+J%2E+D%2E+Morrison%2C+V%2E+Pyatkin%2C+S%2E+Huang%2C+H%2E+Ivison%2C+F%2E+Brahman%2C+L%2E+J%2E+V%2E+Miranda%2C+A%2E+Liu%2C+N%2E+Dziri%2C+S%2E+Lyu%2C+Y%2E+Gu%2C+S%2E+Malik%2C+V%2E+Graf%2C+J%2E+D%2E+Hwang%2C+J%2E+Yang%2C+R%2E+L%2E+Bras%2C+O%2E+Tafjord%2C+C%2E+Wilhelm%2C) [our card](https://md.research.elamur.ai/free/en/papers/lambert-2024-tulu-3-pushing-frontiers-open/)
112. J. M. Laurent, J. D. Janizek, M. Ruzo, M. M. Hinks, M. J. Hammerling, S. Narayanan, M. Ponnapati, A. D. White, and S. G. Rodriques. Lab-bench: Measuring capabilities of language models for biology research. arXiv preprint arXiv:2407.10362, 2024. [find](https://scholar.google.com/scholar?q=J%2E+M%2E+Laurent%2C+J%2E+D%2E+Janizek%2C+M%2E+Ruzo%2C+M%2E+M%2E+Hinks%2C+M%2E+J%2E+Hammerling%2C+S%2E+Narayanan%2C+M%2E+Ponnapati%2C+A%2E+D%2E+White%2C+and+S%2E+G%2E+Rodriques%2E+Lab%2Dbench%3A+Measuring+capabilities+of+language+models+for+biology+res)
113. K. Lee, D. Ippolito, A. Nystrom, C. Zhang, D. Eck, C. Callison-Burch, and N. Carlini. Deduplicating training data makes language models better, 2022. URL https://arxiv.org/abs/2107.06499. [↗](https://arxiv.org/abs/2107.06499)
114. A. Lewkowycz, A. Andreassen, D. Dohan, E. Dyer, H. Michalewski, V. Ramasesh, A. Slone, C. Anil, I. Schlag, T. Gutman-Solo, et al. Solving quantitative reasoning problems with language models. Advances in neural information processing systems, 35:3843–3857, 2022. [find](https://scholar.google.com/scholar?q=A%2E+Lewkowycz%2C+A%2E+Andreassen%2C+D%2E+Dohan%2C+E%2E+Dyer%2C+H%2E+Michalewski%2C+V%2E+Ramasesh%2C+A%2E+Slone%2C+C%2E+Anil%2C+I%2E+Schlag%2C+T%2E+Gutman%2DSolo%2C+et+al%2E+Solving+quantitative+reasoning+problems+with+language+models%2E+Advances) [our card](https://md.research.elamur.ai/free/en/papers/lewkowycz-2022-solving-quantitative-reasoning-problems-language/)
115. J. Li, A. Fang, G. Smyrnis, M. Ivgi, M. Jordan, S. Gadre, H. Bansal, E. Guha, S. Keh, K. Arora, S. Garg, R. Xin, N. Muennighoff, R. Heckel, J. Mercat, M. Chen, S. Gururangan, M. Wortsman, A. Albalak, Y. Bitton, M. Nezhurina, A. Abbas, C.-Y. Hsieh, D. Ghosh, J. Gardner, M. Kilian, H. Zhang, R. Shao,… [find](https://scholar.google.com/scholar?q=J%2E+Li%2C+A%2E+Fang%2C+G%2E+Smyrnis%2C+M%2E+Ivgi%2C+M%2E+Jordan%2C+S%2E+Gadre%2C+H%2E+Bansal%2C+E%2E+Guha%2C+S%2E+Keh%2C+K%2E+Arora%2C+S%2E+Garg%2C+R%2E+Xin%2C+N%2E+Muennighoff%2C+R%2E+Heckel%2C+J%2E+Mercat%2C+M%2E+Chen%2C+S%2E+Gururangan%2C+M%2E+Wortsman%2C+A%2E+Albalak%2C+) [our card](https://md.research.elamur.ai/free/en/papers/li-2024-datacomp-lm-search-next-generation/)
116. N. Li, A. Pan, A. Gopal, S. Yue, D. Berrios, A. Gatti, J. D. Li, A.-K. Dombrowski, S. Goel, G. Mukobi, N. Helm-Burger, R. Lababidi, L. Justen, A. B. Liu, M. Chen, I. Barrass, O. Zhang, X. Zhu, R. Tamirisa, B. Bharathi, A. Herbert-Voss, C. B. Breuer, A. Zou, M. Mazeika, Z. Wang, P. Oswal, W. Lin, A.… [find](https://scholar.google.com/scholar?q=N%2E+Li%2C+A%2E+Pan%2C+A%2E+Gopal%2C+S%2E+Yue%2C+D%2E+Berrios%2C+A%2E+Gatti%2C+J%2E+D%2E+Li%2C+A%2E%2DK%2E+Dombrowski%2C+S%2E+Goel%2C+G%2E+Mukobi%2C+N%2E+Helm%2DBurger%2C+R%2E+Lababidi%2C+L%2E+Justen%2C+A%2E+B%2E+Liu%2C+M%2E+Chen%2C+I%2E+Barrass%2C+O%2E+Zhang%2C+X%2E+Zhu%2C+R%2E+Tami)
117. R. Li, J. Fu, B.-W. Zhang, T. Huang, Z. Sun, C. Lyu, G. Liu, Z. Jin, and G. Li. Taco: Topics in algorithmic code generation dataset. arXiv preprint arXiv:2312.14852, 2023a. [find](https://scholar.google.com/scholar?q=R%2E+Li%2C+J%2E+Fu%2C+B%2E%2DW%2E+Zhang%2C+T%2E+Huang%2C+Z%2E+Sun%2C+C%2E+Lyu%2C+G%2E+Liu%2C+Z%2E+Jin%2C+and+G%2E+Li%2E+Taco%3A+Topics+in+algorithmic+code+generation+dataset%2E+arXiv+preprint+arXiv%3A2312%2E14852%2C+2023a%2E)
118. T. Li, W.-L. Chiang, E. Frick, L. Dunlap, T. Wu, B. Zhu, J. E. Gonzalez, and I. Stoica. From crowdsourced data to high-quality benchmarks: Arena-hard and benchbuilder pipeline. arXiv preprint arXiv:2406.11939, 2024c. [find](https://scholar.google.com/scholar?q=T%2E+Li%2C+W%2E%2DL%2E+Chiang%2C+E%2E+Frick%2C+L%2E+Dunlap%2C+T%2E+Wu%2C+B%2E+Zhu%2C+J%2E+E%2E+Gonzalez%2C+and+I%2E+Stoica%2E+From+crowdsourced+data+to+high%2Dquality+benchmarks%3A+Arena%2Dhard+and+benchbuilder+pipeline%2E+arXiv+preprint+arXiv%3A24) [our card](https://md.research.elamur.ai/free/en/papers/li-2024-crowdsourced-data-high-quality-benchmarks/)
119. X. Li, T. Zhang, Y. Dubois, R. Taori, I. Gulrajani, C. Guestrin, P. Liang, and T. B. Hashimoto. Alpacaeval: An automatic evaluator of instruction-following models. [https://github.com/tatsu-lab/alpaca_eval](https://github.com/tatsu-lab/alpaca_eval), 5 2023b. [↗](https://github.com/tatsu-lab/alpaca_eval)
120. Y. Li, Y. Ma, S. Yan, C. Zhang, J. Liu, J. Lu, Z. Xu, M. Chen, M. Wang, S. Zhan, J. Ma, X. Lai, D. Liu, Y. Luo, X. Bin, H. Ren, M. Han, W. Hao, B. Yi, L. Liu, B. Ma, X. Jia, X. Zhou, S. Qiao, L. Xiang, and Y. Wu. Model merging in pre-training of large language models. ArXiv, abs/2505.12082, 2025. UR… — [arXiv:2505.12082](https://arxiv.org/abs/2505.12082) [find](https://scholar.google.com/scholar?q=Y%2E+Li%2C+Y%2E+Ma%2C+S%2E+Yan%2C+C%2E+Zhang%2C+J%2E+Liu%2C+J%2E+Lu%2C+Z%2E+Xu%2C+M%2E+Chen%2C+M%2E+Wang%2C+S%2E+Zhan%2C+J%2E+Ma%2C+X%2E+Lai%2C+D%2E+Liu%2C+Y%2E+Luo%2C+X%2E+Bin%2C+H%2E+Ren%2C+M%2E+Han%2C+W%2E+Hao%2C+B%2E+Yi%2C+L%2E+Liu%2C+B%2E+Ma%2C+X%2E+Jia%2C+X%2E+Zhou%2C+S%2E+Qiao%2C+L%2E+Xiang)
121. H. Lightman, V. Kosaraju, Y. Burda, H. Edwards, B. Baker, T. Lee, J. Leike, J. Schulman, I. Sutskever, and K. Cobbe. Let’s verify step by step. arXiv preprint arXiv:2305.20050, 2023. [find](https://scholar.google.com/scholar?q=H%2E+Lightman%2C+V%2E+Kosaraju%2C+Y%2E+Burda%2C+H%2E+Edwards%2C+B%2E+Baker%2C+T%2E+Lee%2C+J%2E+Leike%2C+J%2E+Schulman%2C+I%2E+Sutskever%2C+and+K%2E+Cobbe%2E+Let%E2%80%99s+verify+step+by+step%2E+arXiv+preprint+arXiv%3A2305%2E20050%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/lightman-2023-let-s-verify-step-step/)
122. B. Y. Lin, R. L. Bras, K. Richardson, A. Sabharwal, R. Poovendran, P. Clark, and Y. Choi. Zebralogic: On the scaling limits of llms for logical reasoning. arXiv preprint arXiv:2502.01100, 2025. [find](https://scholar.google.com/scholar?q=B%2E+Y%2E+Lin%2C+R%2E+L%2E+Bras%2C+K%2E+Richardson%2C+A%2E+Sabharwal%2C+R%2E+Poovendran%2C+P%2E+Clark%2C+and+Y%2E+Choi%2E+Zebralogic%3A+On+the+scaling+limits+of+llms+for+logical+reasoning%2E+arXiv+preprint+arXiv%3A2502%2E01100%2C+2025%2E)
123. B. Liu, S. Bubeck, R. Eldan, J. Kulkarni, Y. Li, A. Nguyen, R. Ward, and Y. Zhang. Tinygsm: achieving \>80 URL https://arxiv.org/abs/2312.09241. J. Liu, C. S. Xia, Y. Wang, and L. Zhang. Is your code generated by chatGPT really correct? rigorous evaluation of large language models for code generation… [↗](https://arxiv.org/abs/2312.09241)
124. M. Liu, S. Diao, X. Lu, J. Hu, X. Dong, Y. Choi, J. Kautz, and Y. Dong. Prorl: Prolonged reinforcement learning expands reasoning boundaries in large language models. arXiv preprint, 2025a. URL https://arxiv.org/abs/2505.24864. [↗](https://arxiv.org/abs/2505.24864)
125. Q. Liu, X. Zheng, N. Muennighoff, G. Zeng, L. Dou, T. Pang, J. Jiang, and M. Lin. Regmix: Data mixture as regression for language model pre-training. arXiv preprint arXiv:2407.01492, 2024a. [find](https://scholar.google.com/scholar?q=Q%2E+Liu%2C+X%2E+Zheng%2C+N%2E+Muennighoff%2C+G%2E+Zeng%2C+L%2E+Dou%2C+T%2E+Pang%2C+J%2E+Jiang%2C+and+M%2E+Lin%2E+Regmix%3A+Data+mixture+as+regression+for+language+model+pre%2Dtraining%2E+arXiv+preprint+arXiv%3A2407%2E01492%2C+2024a%2E)
126. W. Liu, X. Huang, X. Zeng, X. Hao, S. Yu, D. Li, S. Wang, W. Gan, Z. Liu, Y. Yu, Z. Wang, Y. Wang, W. Ning, Y. Hou, B. Wang, C. Wu, X. Wang, Y. Liu, Y. Wang, D. Tang, D. Tu, L. Shang, X. Jiang, R. Tang, D. Lian, Q. Liu, and E. Chen. Toolace: Winning the points of llm function calling. ArXiv, abs/240… [find](https://scholar.google.com/scholar?q=W%2E+Liu%2C+X%2E+Huang%2C+X%2E+Zeng%2C+X%2E+Hao%2C+S%2E+Yu%2C+D%2E+Li%2C+S%2E+Wang%2C+W%2E+Gan%2C+Z%2E+Liu%2C+Y%2E+Yu%2C+Z%2E+Wang%2C+Y%2E+Wang%2C+W%2E+Ning%2C+Y%2E+Hou%2C+B%2E+Wang%2C+C%2E+Wu%2C+X%2E+Wang%2C+Y%2E+Liu%2C+Y%2E+Wang%2C+D%2E+Tang%2C+D%2E+Tu%2C+L%2E+Shang%2C+X%2E+Jiang%2C+R%2E+Tan)
127. Z. Liu, A. Qiao, W. Neiswanger, H. Wang, B. Tan, T. Tao, J. Li, Y. Wang, S. Sun, O. Pangarkar, et al. Llm360: Towards fully transparent open-source llms. arXiv preprint arXiv:2312.06550, 2023c. [find](https://scholar.google.com/scholar?q=Z%2E+Liu%2C+A%2E+Qiao%2C+W%2E+Neiswanger%2C+H%2E+Wang%2C+B%2E+Tan%2C+T%2E+Tao%2C+J%2E+Li%2C+Y%2E+Wang%2C+S%2E+Sun%2C+O%2E+Pangarkar%2C+et+al%2E+Llm360%3A+Towards+fully+transparent+open%2Dsource+llms%2E+arXiv+preprint+arXiv%3A2312%2E06550%2C+2023c%2E)
128. Z. Liu, T. Hoang, J. Zhang, M. Zhu, T. Lan, S. Kokane, J. Tan, W. Yao, Z. Liu, Y. Feng, R. Murthy, L. Yang, S. Savarese, J. C. Niebles, H. Wang, S. Heinecke, and C. Xiong. Apigen: Automated pipeline for generating verifiable and diverse function-calling datasets. ArXiv, abs/2406.18518, 2024c. URL ht… — [arXiv:2406.18518](https://arxiv.org/abs/2406.18518) [find](https://scholar.google.com/scholar?q=Z%2E+Liu%2C+T%2E+Hoang%2C+J%2E+Zhang%2C+M%2E+Zhu%2C+T%2E+Lan%2C+S%2E+Kokane%2C+J%2E+Tan%2C+W%2E+Yao%2C+Z%2E+Liu%2C+Y%2E+Feng%2C+R%2E+Murthy%2C+L%2E+Yang%2C+S%2E+Savarese%2C+J%2E+C%2E+Niebles%2C+H%2E+Wang%2C+S%2E+Heinecke%2C+and+C%2E+Xiong%2E+Apigen%3A+Automated+pipeline+f)
129. Z. Liu, C. Chen, W. Li, P. Qi, T. Pang, C. Du, W. S. Lee, and M. Lin. Understanding r1-zero-like training: A critical perspective. In Conference on Language Modeling (COLM), 2025b. [find](https://scholar.google.com/scholar?q=Z%2E+Liu%2C+C%2E+Chen%2C+W%2E+Li%2C+P%2E+Qi%2C+T%2E+Pang%2C+C%2E+Du%2C+W%2E+S%2E+Lee%2C+and+M%2E+Lin%2E+Understanding+r1%2Dzero%2Dlike+training%3A+A+critical+perspective%2E+In+Conference+on+Language+Modeling+%28COLM%29%2C+2025b%2E) [our card](https://md.research.elamur.ai/free/en/papers/liu-2025-understanding-r1-zero-like-training/)
130. S. Longpre, L. Hou, T. Vu, A. Webson, H. W. Chung, Y. Tay, D. Zhou, Q. V. Le, B. Zoph, J. Wei, et al. The flan collection: Designing data and methods for effective instruction tuning. arXiv preprint arXiv:2301.13688, 2023. [find](https://scholar.google.com/scholar?q=S%2E+Longpre%2C+L%2E+Hou%2C+T%2E+Vu%2C+A%2E+Webson%2C+H%2E+W%2E+Chung%2C+Y%2E+Tay%2C+D%2E+Zhou%2C+Q%2E+V%2E+Le%2C+B%2E+Zoph%2C+J%2E+Wei%2C+et+al%2E+The+flan+collection%3A+Designing+data+and+methods+for+effective+instruction+tuning%2E+arXiv+preprint+a) [our card](https://md.research.elamur.ai/free/en/papers/longpre-2023-flan-collection-designing-data-methods/)
131. A. Lozhkov, R. Li, L. B. Allal, F. Cassano, J. Lamy-Poirier, N. Tazi, A. Tang, D. Pykhtar, J. Liu, Y. Wei, et al. Starcoder 2 and the stack v2: The next generation. arXiv preprint arXiv:2402.19173, 2024. [find](https://scholar.google.com/scholar?q=A%2E+Lozhkov%2C+R%2E+Li%2C+L%2E+B%2E+Allal%2C+F%2E+Cassano%2C+J%2E+Lamy%2DPoirier%2C+N%2E+Tazi%2C+A%2E+Tang%2C+D%2E+Pykhtar%2C+J%2E+Liu%2C+Y%2E+Wei%2C+et+al%2E+Starcoder+2+and+the+stack+v2%3A+The+next+generation%2E+arXiv+preprint+arXiv%3A2402%2E19173%2C+20)
132. M. Luo, S. Tan, J. Wong, X. Shi, W. Y. Tang, M. Roongta, C. Cai, J. Luo, L. E. Li, R. A. Popa, and I. Stoica. Deepscaler: Surpassing o1-preview with a 1.5b model by scaling rl. [https://pretty-radio-b75.notion.site/](https://pretty-radio-b75.notion.site/) DeepScaleR-Surpassing-O1-Preview-with-a-1-5B-Model-by-Scaling-RL-19681902c1468005bed8… [↗](https://pretty-radio-b75.notion.site/)
133. M. Luo, S. Tan, J. Wong, X. Shi, W. Y. Tang, M. Roongta, C. Cai, J. Luo, T. Zhang, L. E. Li, et al. Deepscaler: Surpassing o1-preview with a 1.5 b model by scaling rl. Notion Blog, 2025b. [find](https://scholar.google.com/scholar?q=M%2E+Luo%2C+S%2E+Tan%2C+J%2E+Wong%2C+X%2E+Shi%2C+W%2E+Y%2E+Tang%2C+M%2E+Roongta%2C+C%2E+Cai%2C+J%2E+Luo%2C+T%2E+Zhang%2C+L%2E+E%2E+Li%2C+et+al%2E+Deepscaler%3A+Surpassing+o1%2Dpreview+with+a+1%2E5+b+model+by+scaling+rl%2E+Notion+Blog%2C+2025b%2E)
134. Z. Luo, C. Xu, P. Zhao, Q. Sun, X. Geng, W. Hu, C. Tao, J. Ma, Q. Lin, and D. Jiang. Wizardcoder: Empowering code large language models with evol-instruct, 2023. [find](https://scholar.google.com/scholar?q=Z%2E+Luo%2C+C%2E+Xu%2C+P%2E+Zhao%2C+Q%2E+Sun%2C+X%2E+Geng%2C+W%2E+Hu%2C+C%2E+Tao%2C+J%2E+Ma%2C+Q%2E+Lin%2C+and+D%2E+Jiang%2E+Wizardcoder%3A+Empowering+code+large+language+models+with+evol%2Dinstruct%2C+2023%2E)
135. I. Magar and R. Schwartz. Data contamination: From memorization to exploitation. ArXiv, abs/2203.08242, 2022. URL [https://api.semanticscholar.org/CorpusID:247475929](https://api.semanticscholar.org/CorpusID:247475929). [↗](https://api.semanticscholar.org/CorpusID:247475929)
136. I. Magnusson, A. Bhagia, V. Hofmann, L. Soldaini, A. H. Jha, O. Tafjord, D. Schwenk, E. P. Walsh, Y. Elazar, K. Lo, D. Groeneveld, I. Beltagy, H. Hajishirzi, N. A. Smith, K. Richardson, and J. Dodge. Paloma: A benchmark for evaluating language model fit, 2024. URL https://arxiv.org/abs/2312.10523. [↗](https://arxiv.org/abs/2312.10523)
137. I. Magnusson, N. Tai, B. Bogin, D. Heineman, J. D. Hwang, L. Soldaini, A. Bhagia, J. Liu, D. Groeneveld, O. Tafjord, N. A. Smith, P. W. Koh, and J. Dodge. Datadecide: How to predict best pretraining data with small experiments, 2025. URL https://arxiv.org/abs/2504.11393. — [arXiv:2504.11393](https://arxiv.org/abs/2504.11393) [↗](https://arxiv.org/abs/2504.11393)
138. A. Mallen, A. Asai, V. Zhong, R. Das, H. Hajishirzi, and D. Khashabi. When not to trust language models: Investigating effectiveness and limitations of parametric and non-parametric memories. arXiv preprint, 2022. [find](https://scholar.google.com/scholar?q=A%2E+Mallen%2C+A%2E+Asai%2C+V%2E+Zhong%2C+R%2E+Das%2C+H%2E+Hajishirzi%2C+and+D%2E+Khashabi%2E+When+not+to+trust+language+models%3A+Investigating+effectiveness+and+limitations+of+parametric+and+non%2Dparametric+memories%2E+arXiv+pr)
139. S. V. Marjanović, A. Patel, V. Adlakha, M. Aghajohari, P. BehnamGhader, M. Bhatia, A. Khandelwal, A. Kraft, B. Krojer, X. H. Lù, N. Meade, D. Shin, A. Kazemnejad, G. Kamath, M. Mosbach, K. Stańczak, and S. Reddy. Deepseek-r1 thoughtology: Let’s think about llm reasoning, 2025. URL [https://arxiv.org/…](https://arxiv.org/…) [↗](https://arxiv.org/…)
140. H. Markovits, V. A. Thompson, and J. Brisson. Metacognition and abstract reasoning. Memory & Cognition, 43(4):681– 693, 2015. ISSN 1532-5946. doi: 10.3758/s13421-014-0488-9. URL https://doi.org/10.3758/s13421-014-0488-9. — [doi:10.3758/s13421-014-0488-9](https://doi.org/10.3758/s13421-014-0488-9) [↗](https://doi.org/10.3758/s13421-014-0488-9)
141. A. Matton, T. Sherborne, D. Aumiller, E. Tommasone, M. Alizadeh, J. He, R. Ma, M. Voisin, E. Gilsenan-McMahon, and M. Gallé. On leakage of code generation evaluation datasets. In Y. Al-Onaizan, M. Bansal, and Y.-N. Chen, editors, Findings of the Association for Computational Linguistics: EMNLP 2024,… [find](https://scholar.google.com/scholar?q=A%2E+Matton%2C+T%2E+Sherborne%2C+D%2E+Aumiller%2C+E%2E+Tommasone%2C+M%2E+Alizadeh%2C+J%2E+He%2C+R%2E+Ma%2C+M%2E+Voisin%2C+E%2E+Gilsenan%2DMcMahon%2C+and+M%2E+Gall%C3%A9%2E+On+leakage+of+code+generation+evaluation+datasets%2E+In+Y%2E+Al%2DOnaizan%2C+M%2E+Ban)
142. M. Mazeika, L. Phan, X. Yin, A. Zou, Z. Wang, N. Mu, E. Sakhaee, N. Li, S. Basart, B. Li, et al. Harmbench: A standardized evaluation framework for automated red teaming and robust refusal. arXiv preprint arXiv:2402.04249, 2024. [find](https://scholar.google.com/scholar?q=M%2E+Mazeika%2C+L%2E+Phan%2C+X%2E+Yin%2C+A%2E+Zou%2C+Z%2E+Wang%2C+N%2E+Mu%2C+E%2E+Sakhaee%2C+N%2E+Li%2C+S%2E+Basart%2C+B%2E+Li%2C+et+al%2E+Harmbench%3A+A+standardized+evaluation+framework+for+automated+red+teaming+and+robust+refusal%2E+arXiv+prep) [our card](https://md.research.elamur.ai/free/en/papers/mazeika-2024-harmbench-standardized-evaluation-framework-automated/)
143. Y. Meyer and D. Corneil. Nemotron-Personas-USA: Synthetic personas aligned to real-world distributions, June 2025. URL [https://huggingface.co/datasets/nvidia/Nemotron-Personas-USA](https://huggingface.co/datasets/nvidia/Nemotron-Personas-USA). [↗](https://huggingface.co/datasets/nvidia/Nemotron-Personas-USA)
144. S. Mindermann, J. M. Brauner, M. T. Razzak, M. Sharma, A. Kirsch, W. Xu, B. Höltgen, A. N. Gomez, A. Morisot, S. Farquhar, et al. Prioritized training on points that are learnable, worth learning, and not yet learnt. In International Conference on Machine Learning, pages 15630–15649. PMLR, 2022. [find](https://scholar.google.com/scholar?q=S%2E+Mindermann%2C+J%2E+M%2E+Brauner%2C+M%2E+T%2E+Razzak%2C+M%2E+Sharma%2C+A%2E+Kirsch%2C+W%2E+Xu%2C+B%2E+H%C3%B6ltgen%2C+A%2E+N%2E+Gomez%2C+A%2E+Morisot%2C+S%2E+Farquhar%2C+et+al%2E+Prioritized+training+on+points+that+are+learnable%2C+worth+learning%2C+and)
145. M. Miroyan, T.-H. Wu, L. King, T. Li, J. Pan, X. Hu, W.-L. Chiang, A. N. Angelopoulos, T. Darrell, N. Norouzi, and J. Gonzalez. Search arena: Analyzing search-augmented llms. ArXiv, abs/2506.05334, 2025. URL [https://api.semanticscholar.org/CorpusID:279243096](https://api.semanticscholar.org/CorpusID:279243096). — [arXiv:2506.05334](https://arxiv.org/abs/2506.05334) [↗](https://api.semanticscholar.org/CorpusID:279243096)
146. I. Mirzadeh, K. Alizadeh, H. Shahrokhi, O. Tuzel, S. Bengio, and M. Farajtabar. Gsm-symbolic: Understanding the limitations of mathematical reasoning in large language models, 2024. URL https://arxiv.org/abs/2410.05229. [↗](https://arxiv.org/abs/2410.05229) [our card](https://md.research.elamur.ai/free/en/papers/mirzadeh-2024-gsm-symbolic-understanding-limitations-mathematical/)
147. J. Morrison, N. A. Smith, H. Hajishirzi, P. W. Koh, J. Dodge, and P. Dasigi. Merge to learn: Efficiently adding skills to language models with model merging, 2024. URL https://arxiv.org/abs/2410.12937. [↗](https://arxiv.org/abs/2410.12937)
148. MosaicML. Llm foundry - jeopardy dataset. [https://github.com/mosaicml/llm-foundry/blob/main/scripts/eval/](https://github.com/mosaicml/llm-foundry/blob/main/scripts/eval/) local_data/world_knowledge/jeopardy_all.jsonl, 2024. Accessed: 2024-11-10. [↗](https://github.com/mosaicml/llm-foundry/blob/main/scripts/eval/)
149. I. Moshkov, D. Hanley, I. Sorokin, S. Toshniwal, C. Henkel, B. Schifferer, W. Du, and I. Gitman. AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning dataset. arXiv preprint arXiv:2504.16891, 2025. [find](https://scholar.google.com/scholar?q=I%2E+Moshkov%2C+D%2E+Hanley%2C+I%2E+Sorokin%2C+S%2E+Toshniwal%2C+C%2E+Henkel%2C+B%2E+Schifferer%2C+W%2E+Du%2C+and+I%2E+Gitman%2E+AIMO%2D2+Winning+Solution%3A+Building+State%2Dof%2Dthe%2DArt+Mathematical+Reasoning+Models+with+OpenMathReasoning)
150. N. Muennighoff, A. M. Rush, B. Barak, T. L. Scao, A. Piktus, N. Tazi, S. Pyysalo, T. Wolf, and C. Raffel. Scaling data-constrained language models, 2025a. URL https://arxiv.org/abs/2305.16264. [↗](https://arxiv.org/abs/2305.16264)
151. N. Muennighoff, Z. Yang, W. Shi, X. L. Li, L. Fei-Fei, H. Hajishirzi, L. Zettlemoyer, P. Liang, E. Candès, and T. Hashimoto. s1: Simple test-time scaling, 2025b. URL https://arxiv.org/abs/2501.19393. [↗](https://arxiv.org/abs/2501.19393) [our card](https://md.research.elamur.ai/free/en/papers/muennighoff-2025-s1-simple-test-time-scaling/)
152. D. Nathawani, I. Gitman, S. Majumdar, E. Bakhturina, A. Sunil Mahabaleshwarkar, , J. Zhang, and J. Polak Scowcroft. Nemotron-Post-Training-Dataset-v1, 2025. URL [https://huggingface.co/datasets/nvidia/](https://huggingface.co/datasets/nvidia/) Nemotron-Post-Training-Dataset-v1. [↗](https://huggingface.co/datasets/nvidia/)
153. E. Nelson, G. Kollias, P. Das, S. Chaudhury, and S. Dan. Needle in the haystack for memory based large language models, 2024. URL https://arxiv.org/abs/2407.01437. [↗](https://arxiv.org/abs/2407.01437)
154. M. Noukhovitch, S. Huang, S. Xhonneux, A. Hosseini, R. Agarwal, and A. Courville. Asynchronous rlhf: Faster and more efficient off-policy rl for language models, 2024. URL https://arxiv.org/abs/2410.18252. — [arXiv:2410.18252](https://arxiv.org/abs/2410.18252) [↗](https://arxiv.org/abs/2410.18252)
155. NVIDIA, , A. Basant, A. Khairnar, A. Paithankar, A. Khattar, A. Renduchintala, A. Malte, A. Bercovich, A. Hazare, A. Rico, A. Ficek, A. Kondratenko, A. Shaposhnikov, A. Bukharin, A. Taghibakhshi, A. Barton, A. S. Mahabaleshwarkar, A. Shen, A. Tao, A. Guan, A. Shors, A. Mandarwal, A. Mehta, A. Venkat… [find](https://scholar.google.com/scholar?q=NVIDIA%2C+%2C+A%2E+Basant%2C+A%2E+Khairnar%2C+A%2E+Paithankar%2C+A%2E+Khattar%2C+A%2E+Renduchintala%2C+A%2E+Malte%2C+A%2E+Bercovich%2C+A%2E+Hazare%2C+A%2E+Rico%2C+A%2E+Ficek%2C+A%2E+Kondratenko%2C+A%2E+Shaposhnikov%2C+A%2E+Bukharin%2C+A%2E+Taghibakhshi%2C+A%2E+B)
156. NVIDIA AI. Nemotron-post-training-dataset-v1. Nemotron-Post-Training-Dataset-v1, 2025. Dataset. [https://huggingface.co/datasets/nvidia/](https://huggingface.co/datasets/nvidia/) [↗](https://huggingface.co/datasets/nvidia/)
157. J. Olieslagers, Z. Bnaya, Y. Li, and W. Ma. Backward reasoning through and/or trees to solve problems. In Proceedings of the Annual Meeting of the Cognitive Science Society, volume 46. Cognitive Science Society, 2024. URL [https://escholarship.org/uc/item/9h4863xm](https://escholarship.org/uc/item/9h4863xm). Retrieved from https://escholarship… [↗](https://escholarship.org/uc/item/9h4863xm)
158. T. OLMo, P. Walsh, L. Soldaini, D. Groeneveld, K. Lo, S. Arora, A. Bhagia, Y. Gu, S. Huang, M. Jordan, N. Lambert, D. Schwenk, O. Tafjord, T. Anderson, D. Atkinson, F. Brahman, C. Clark, P. Dasigi, N. Dziri, M. Guerquin, H. Ivison, P. W. Koh, J. Liu, S. Malik, W. Merrill, L. J. V. Miranda, J. Morris… [find](https://scholar.google.com/scholar?q=T%2E+OLMo%2C+P%2E+Walsh%2C+L%2E+Soldaini%2C+D%2E+Groeneveld%2C+K%2E+Lo%2C+S%2E+Arora%2C+A%2E+Bhagia%2C+Y%2E+Gu%2C+S%2E+Huang%2C+M%2E+Jordan%2C+N%2E+Lambert%2C+D%2E+Schwenk%2C+O%2E+Tafjord%2C+T%2E+Anderson%2C+D%2E+Atkinson%2C+F%2E+Brahman%2C+C%2E+Clark%2C+P%2E+Dasigi%2C+N%2E)
159. OpenAI. GPT-3.5 turbo, 2023a. URL [https://platform.openai.com/docs/models/gp\#gpt-3-5-turbo](https://platform.openai.com/docs/models/gp\#gpt-3-5-turbo). [↗](https://platform.openai.com/docs/models/gp\#gpt-3-5-turbo)
160. OpenAI. GPT-4 technical report. ArXiv, abs/2303.08774, 2023b. URL [https://api.semanticscholar.org/CorpusID:](https://api.semanticscholar.org/CorpusID:) 257532815. [↗](https://api.semanticscholar.org/CorpusID:) [our card](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/)
161. OpenAI. Gpt-5 system card. Technical report, OpenAI, Aug. 2025. Accessed: 2025-10-07. [find](https://scholar.google.com/scholar?q=OpenAI%2E+Gpt%2D5+system+card%2E+Technical+report%2C+OpenAI%2C+Aug%2E+2025%2E+Accessed%3A+2025%2D10%2D07%2E) [our card](https://md.research.elamur.ai/free/en/papers/singh-2025-openai-gpt-5-system-card/)
162. A. Pal, L. K. Umapathi, and M. Sankarasubbu. Medmcqa: A large-scale multi-subject multi-choice dataset for medical domain question answering. In G. Flores, G. H. Chen, T. Pollard, J. C. Ho, and T. Naumann, editors, Proceedings of the Conference on Health, Inference, and Learning, volume 174 of Proce… [find](https://scholar.google.com/scholar?q=A%2E+Pal%2C+L%2E+K%2E+Umapathi%2C+and+M%2E+Sankarasubbu%2E+Medmcqa%3A+A+large%2Dscale+multi%2Dsubject+multi%2Dchoice+dataset+for+medical+domain+question+answering%2E+In+G%2E+Flores%2C+G%2E+H%2E+Chen%2C+T%2E+Pollard%2C+J%2E+C%2E+Ho%2C+and+T%2E+Nau) [our card](https://md.research.elamur.ai/free/en/papers/pal-2022-medmcqa-large-scale-multi-subject/)
163. R. Pandey. gzip predicts data-dependent scaling laws, 2024. URL https://arxiv.org/abs/2405.16684. — [arXiv:2405.16684](https://arxiv.org/abs/2405.16684) [↗](https://arxiv.org/abs/2405.16684)
164. D. Paperno, G. Kruszewski, A. Lazaridou, Q. N. Pham, R. Bernardi, S. Pezzelle, M. Baroni, G. Boleda, and R. Fernández. The lambada dataset: Word prediction requiring a broad discourse context. arXiv preprint arXiv:1606.06031, 2016. [find](https://scholar.google.com/scholar?q=D%2E+Paperno%2C+G%2E+Kruszewski%2C+A%2E+Lazaridou%2C+Q%2E+N%2E+Pham%2C+R%2E+Bernardi%2C+S%2E+Pezzelle%2C+M%2E+Baroni%2C+G%2E+Boleda%2C+and+R%2E+Fern%C3%A1ndez%2E+The+lambada+dataset%3A+Word+prediction+requiring+a+broad+discourse+context%2E+arXiv+p) [our card](https://md.research.elamur.ai/free/en/papers/paperno-2016-lambada-dataset-word-prediction-requiring/)
165. A. Parrish, A. Chen, N. Nangia, V. Padmakumar, J. Phang, J. Thompson, P. M. Htut, and S. Bowman. BBQ: A hand-built bias benchmark for question answering. In S. Muresan, P. Nakov, and A. Villavicencio, editors, Findings of the Association for Computational Linguistics: ACL 2022, pages 2086–2105, Dubl… [find](https://scholar.google.com/scholar?q=A%2E+Parrish%2C+A%2E+Chen%2C+N%2E+Nangia%2C+V%2E+Padmakumar%2C+J%2E+Phang%2C+J%2E+Thompson%2C+P%2E+M%2E+Htut%2C+and+S%2E+Bowman%2E+BBQ%3A+A+hand%2Dbuilt+bias+benchmark+for+question+answering%2E+In+S%2E+Muresan%2C+P%2E+Nakov%2C+and+A%2E+Villavicencio%2C) [our card](https://md.research.elamur.ai/free/en/papers/parrish-2022-bbq-hand-built-bias-benchmark/)
166. K. Paster, M. D. Santos, Z. Azerbayev, and J. Ba. Openwebmath: An open dataset of high-quality mathematical web text, 2023. [find](https://scholar.google.com/scholar?q=K%2E+Paster%2C+M%2E+D%2E+Santos%2C+Z%2E+Azerbayev%2C+and+J%2E+Ba%2E+Openwebmath%3A+An+open+dataset+of+high%2Dquality+mathematical+web+text%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/paster-2023-openwebmath-open-dataset-high-quality/)
167. S. G. Patil, H. Mao, C. Cheng-Jie Ji, F. Yan, V. Suresh, I. Stoica, and J. E. Gonzalez. The berkeley function calling leaderboard (bfcl): From tool use to agentic evaluation of large language models. In Forty-second International Conference on Machine Learning, 2025. [find](https://scholar.google.com/scholar?q=S%2E+G%2E+Patil%2C+H%2E+Mao%2C+C%2E+Cheng%2DJie+Ji%2C+F%2E+Yan%2C+V%2E+Suresh%2C+I%2E+Stoica%2C+and+J%2E+E%2E+Gonzalez%2E+The+berkeley+function+calling+leaderboard+%28bfcl%29%3A+From+tool+use+to+agentic+evaluation+of+large+language+models%2E+)
168. G. Penedo, Q. Malartic, D. Hesslow, R. Cojocaru, A. Cappelli, H. Alobeidli, B. Pannier, E. Almazrouei, and J. Launay. The refinedweb dataset for falcon llm: Outperforming curated corpora with web data, and web data only, 2023. URL https://arxiv.org/abs/2306.01116. [↗](https://arxiv.org/abs/2306.01116)
169. G. Penedo, H. Kydlíček, A. Lozhkov, M. Mitchell, C. Raffel, L. Von Werra, T. Wolf, et al. The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale. In The Thirty-eight Conference on Neural Information Processing Systems; Datasets and Benchmarks Track, 2024. [find](https://scholar.google.com/scholar?q=G%2E+Penedo%2C+H%2E+Kydl%C3%AD%C4%8Dek%2C+A%2E+Lozhkov%2C+M%2E+Mitchell%2C+C%2E+Raffel%2C+L%2E+Von+Werra%2C+T%2E+Wolf%2C+et+al%2E+The+FineWeb+Datasets%3A+Decanting+the+Web+for+the+Finest+Text+Data+at+Scale%2E+In+The+Thirty%2Deight+Conference+on+N) [our card](https://md.research.elamur.ai/free/en/papers/penedo-2024-fineweb-datasets-decanting-web-finest/)
170. B. Peng, J. Quesnelle, H. Fan, and E. Shippole. Yarn: Efficient context window extension of large language models, 2023. URL https://arxiv.org/abs/2309.00071. [↗](https://arxiv.org/abs/2309.00071)
171. C. M. Pham, Y. Chang, and M. Iyyer. Clipper: Compression enables long-context synthetic data generation, 2025. URL https://arxiv.org/abs/2502.14854. — [arXiv:2502.14854](https://arxiv.org/abs/2502.14854) [↗](https://arxiv.org/abs/2502.14854)
172. A. Piché, E. Kamaloo, R. Pardinas, and D. Bahdanau. Pipelinerl: Faster on-policy reinforcement learning for long sequence generatio. arXiv preprint arXiv:2509.19128, 2025. [find](https://scholar.google.com/scholar?q=A%2E+Pich%C3%A9%2C+E%2E+Kamaloo%2C+R%2E+Pardinas%2C+and+D%2E+Bahdanau%2E+Pipelinerl%3A+Faster+on%2Dpolicy+reinforcement+learning+for+long+sequence+generatio%2E+arXiv+preprint+arXiv%3A2509%2E19128%2C+2025%2E)
173. J. Poznanski, A. Rangapur, J. Borchardt, J. Dunkelberger, R. Huff, D. Lin, C. Wilhelm, K. Lo, and L. Soldaini. olmOCR: Unlocking trillions of tokens in pdfs with vision language models. arXiv preprint arXiv:2502.18443, 2025a. [find](https://scholar.google.com/scholar?q=J%2E+Poznanski%2C+A%2E+Rangapur%2C+J%2E+Borchardt%2C+J%2E+Dunkelberger%2C+R%2E+Huff%2C+D%2E+Lin%2C+C%2E+Wilhelm%2C+K%2E+Lo%2C+and+L%2E+Soldaini%2E+olmOCR%3A+Unlocking+trillions+of+tokens+in+pdfs+with+vision+language+models%2E+arXiv+preprint)
174. J. Poznanski, L. Soldaini, and K. Lo. olmOCR 2: Unit Test Rewards for Document OCR, 2025b. URL https://arxiv.org/abs/2510.19817. — [arXiv:2510.19817](https://arxiv.org/abs/2510.19817) [↗](https://arxiv.org/abs/2510.19817)
175. PrimeIntellect. Synthetic-2. [https://huggingface.co/datasets/PrimeIntellect/SYNTHETIC-2](https://huggingface.co/datasets/PrimeIntellect/SYNTHETIC-2), 2025. Dataset. [↗](https://huggingface.co/datasets/PrimeIntellect/SYNTHETIC-2)
176. V. Pyatkin, S. Malik, V. Graf, H. Ivison, S. Huang, P. Dasigi, N. Lambert, and H. Hajishirzi. Generalizing verifiable instruction following. arXiv preprint arXiv:2507.02833, 2025. [find](https://scholar.google.com/scholar?q=V%2E+Pyatkin%2C+S%2E+Malik%2C+V%2E+Graf%2C+H%2E+Ivison%2C+S%2E+Huang%2C+P%2E+Dasigi%2C+N%2E+Lambert%2C+and+H%2E+Hajishirzi%2E+Generalizing+verifiable+instruction+following%2E+arXiv+preprint+arXiv%3A2507%2E02833%2C+2025%2E)
177. Qwen, :, A. Yang, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Li, D. Liu, F. Huang, H. Wei, H. Lin, J. Yang, J. Tu, J. Zhang, J. Yang, J. Yang, J. Zhou, J. Lin, K. Dang, K. Lu, K. Bao, K. Yang, L. Yu, M. Li, M. Xue, P. Zhang, Q. Zhu, R. Men, R. Lin, T. Li, T. Xia, X. Ren, X. Ren, Y. Fan, Y. Su, Y… [find](https://scholar.google.com/scholar?q=Qwen%2C+%3A%2C+A%2E+Yang%2C+B%2E+Yang%2C+B%2E+Zhang%2C+B%2E+Hui%2C+B%2E+Zheng%2C+B%2E+Yu%2C+C%2E+Li%2C+D%2E+Liu%2C+F%2E+Huang%2C+H%2E+Wei%2C+H%2E+Lin%2C+J%2E+Yang%2C+J%2E+Tu%2C+J%2E+Zhang%2C+J%2E+Yang%2C+J%2E+Yang%2C+J%2E+Zhou%2C+J%2E+Lin%2C+K%2E+Dang%2C+K%2E+Lu%2C+K%2E+Bao%2C+K%2E+Yang%2C+L%2E+)
178. Qwen Team. Qwq-32b: Embracing the power of reinforcement learning. [https://qwenlm.github.io/blog/qwq-32b/](https://qwenlm.github.io/blog/qwq-32b/), Mar. 2025. Model release blog. [↗](https://qwenlm.github.io/blog/qwq-32b/)
179. R. Rafailov, A. Sharma, E. Mitchell, C. D. Manning, S. Ermon, and C. Finn. Direct preference optimization: Your language model is secretly a reward model. Advances in Neural Information Processing Systems, 36, 2024. [find](https://scholar.google.com/scholar?q=R%2E+Rafailov%2C+A%2E+Sharma%2C+E%2E+Mitchell%2C+C%2E+D%2E+Manning%2C+S%2E+Ermon%2C+and+C%2E+Finn%2E+Direct+preference+optimization%3A+Your+language+model+is+secretly+a+reward+model%2E+Advances+in+Neural+Information+Processing+Sys)
180. P. Rajpurkar, J. Zhang, K. Lopyrev, and P. Liang. SQuAD: 100,000+ questions for machine comprehension of text. In J. Su, K. Duh, and X. Carreras, editors, Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 2383–2392, Austin, Texas, Nov. 2016. Association fo… [find](https://scholar.google.com/scholar?q=P%2E+Rajpurkar%2C+J%2E+Zhang%2C+K%2E+Lopyrev%2C+and+P%2E+Liang%2E+SQuAD%3A+100%2C000%2B+questions+for+machine+comprehension+of+text%2E+In+J%2E+Su%2C+K%2E+Duh%2C+and+X%2E+Carreras%2C+editors%2C+Proceedings+of+the+2016+Conference+on+Empiric) [our card](https://md.research.elamur.ai/free/en/papers/rajpurkar-2016-squad-100-000-questions-machine/)
181. J. Rasley, S. Rajbhandari, O. Ruwase, and Y. He. Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters. In Proceedings of the 26th ACM SIGKDD international conference on knowledge discovery & data mining, pages 3505–3506, 2020. [find](https://scholar.google.com/scholar?q=J%2E+Rasley%2C+S%2E+Rajbhandari%2C+O%2E+Ruwase%2C+and+Y%2E+He%2E+Deepspeed%3A+System+optimizations+enable+training+deep+learning+models+with+over+100+billion+parameters%2E+In+Proceedings+of+the+26th+ACM+SIGKDD+internatio)
182. S. Reddy, D. Chen, and C. D. Manning. CoQA: A conversational question answering challenge. Transactions of the Association for Computational Linguistics, 7:249–266, 2019. doi: 10.1162/tacl_a_00266. URL https://aclanthology.org/Q19-1016. [↗](https://aclanthology.org/Q19-1016) [our card](https://md.research.elamur.ai/free/en/papers/reddy-2019-coqa-conversational-question-answering-challenge/)
183. D. Rein, B. L. Hou, A. C. Stickland, J. Petty, R. Y. Pang, J. Dirani, J. Michael, and S. R. Bowman. GPQA: A graduate-level google-proof q&a benchmark. In First Conference on Language Modeling, 2024. URL [https://openreview.net/forum?id=Ti67584b98](https://openreview.net/forum?id=Ti67584b98). [↗](https://openreview.net/forum?id=Ti67584b98) [our card](https://md.research.elamur.ai/free/en/papers/rein-2023-gpqa-graduate-level-google-proof/)
184. P. Röttger, H. R. Kirk, B. Vidgen, G. Attanasio, F. Bianchi, and D. Hovy. Xstest: A test suite for identifying exaggerated safety behaviours in large language models. arXiv preprint arXiv:2308.01263, 2023. [find](https://scholar.google.com/scholar?q=P%2E+R%C3%B6ttger%2C+H%2E+R%2E+Kirk%2C+B%2E+Vidgen%2C+G%2E+Attanasio%2C+F%2E+Bianchi%2C+and+D%2E+Hovy%2E+Xstest%3A+A+test+suite+for+identifying+exaggerated+safety+behaviours+in+large+language+models%2E+arXiv+preprint+arXiv%3A2308%2E01263%2C+) [our card](https://md.research.elamur.ai/free/en/papers/rottger-2023-xstest-test-suite-identifying-exaggerated/)
185. B. Rozière, J. Gehring, F. Gloeckle, S. Sootla, I. Gat, X. E. Tan, Y. Adi, J. Liu, R. Sauvestre, T. Remez, J. Rapin, A. Kozhevnikov, I. Evtimov, J. Bitton, M. Bhatt, C. C. Ferrer, A. Grattafiori, W. Xiong, A. Défossez, J. Copet, F. Azhar, H. Touvron, L. Martin, N. Usunier, T. Scialom, and G. Synnaev… [find](https://scholar.google.com/scholar?q=B%2E+Rozi%C3%A8re%2C+J%2E+Gehring%2C+F%2E+Gloeckle%2C+S%2E+Sootla%2C+I%2E+Gat%2C+X%2E+E%2E+Tan%2C+Y%2E+Adi%2C+J%2E+Liu%2C+R%2E+Sauvestre%2C+T%2E+Remez%2C+J%2E+Rapin%2C+A%2E+Kozhevnikov%2C+I%2E+Evtimov%2C+J%2E+Bitton%2C+M%2E+Bhatt%2C+C%2E+C%2E+Ferrer%2C+A%2E+Grattafiori%2C+W%2E+X) [our card](https://md.research.elamur.ai/free/en/papers/roziere-2024-code-llama-open-foundation-models/)
186. K. Sakaguchi, R. Le Bras, C. Bhagavatula, and Y. Choi. WinoGrande: An adversarial winograd schema challenge at scale. Proceedings of the AAAI Conference on Artificial Intelligence, 34(05):8732–8740, Apr. 2020. doi: 10.1609/ aaai.v34i05.6399. URL [https://ojs.aaai.org/index.php/AAAI/article/view/6399](https://ojs.aaai.org/index.php/AAAI/article/view/6399). [↗](https://ojs.aaai.org/index.php/AAAI/article/view/6399)
187. M. Sap, H. Rashkin, D. Chen, R. Le Bras, and Y. Choi. Social IQa: Commonsense reasoning about social interactions. In K. Inui, J. Jiang, V. Ng, and X. Wan, editors, Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Na… [find](https://scholar.google.com/scholar?q=M%2E+Sap%2C+H%2E+Rashkin%2C+D%2E+Chen%2C+R%2E+Le+Bras%2C+and+Y%2E+Choi%2E+Social+IQa%3A+Commonsense+reasoning+about+social+interactions%2E+In+K%2E+Inui%2C+J%2E+Jiang%2C+V%2E+Ng%2C+and+X%2E+Wan%2C+editors%2C+Proceedings+of+the+2019+Conference+)
188. D. Saxton, E. Grefenstette, F. Hill, and P. Kohli. Analysing mathematical reasoning abilities of neural models. arXiv preprint arXiv:1904.01557, 2019. [find](https://scholar.google.com/scholar?q=D%2E+Saxton%2C+E%2E+Grefenstette%2C+F%2E+Hill%2C+and+P%2E+Kohli%2E+Analysing+mathematical+reasoning+abilities+of+neural+models%2E+arXiv+preprint+arXiv%3A1904%2E01557%2C+2019%2E) [our card](https://md.research.elamur.ai/free/en/papers/saxton-2019-analysing-mathematical-reasoning-abilities-neural/)
189. R. Schaeffer, B. Miranda, and S. Koyejo. Are emergent abilities of large language models a mirage? Advances in neural information processing systems, 36:55565–55581, 2023. [find](https://scholar.google.com/scholar?q=R%2E+Schaeffer%2C+B%2E+Miranda%2C+and+S%2E+Koyejo%2E+Are+emergent+abilities+of+large+language+models+a+mirage%3F+Advances+in+neural+information+processing+systems%2C+36%3A55565%E2%80%9355581%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/schaeffer-2023-emergent-abilities-large-language-models/)
190. R. Shao, A. Asai, S. Z. Shen, H. Ivison, V. Kishore, J. Zhuo, X. Zhao, M. Park, S. G. Finlayson, D. Sontag, T. Murray, S. Min, P. Dasigi, L. Soldaini, F. Brahman, W. tau Yih, T. Wu, L. Zettlemoyer, Y. Kim, H. Hajishirzi, and P. W. Koh. DR Tulu: Reinforcement learning with evolving rubrics for deep r… [find](https://scholar.google.com/scholar?q=R%2E+Shao%2C+A%2E+Asai%2C+S%2E+Z%2E+Shen%2C+H%2E+Ivison%2C+V%2E+Kishore%2C+J%2E+Zhuo%2C+X%2E+Zhao%2C+M%2E+Park%2C+S%2E+G%2E+Finlayson%2C+D%2E+Sontag%2C+T%2E+Murray%2C+S%2E+Min%2C+P%2E+Dasigi%2C+L%2E+Soldaini%2C+F%2E+Brahman%2C+W%2E+tau+Yih%2C+T%2E+Wu%2C+L%2E+Zettlemoyer%2C+Y%2E)
191. R. Shao, S. S. Li, R. Xin, S. Geng, Y. Wang, S. Oh, S. S. Du, N. Lambert, S. Min, R. Krishna, Y. Tsvetkov, H. Hajishirzi, P. W. Koh, and L. Zettlemoyer. Spurious rewards: Rethinking training signals in rlvr, 2025b. URL https://arxiv.org/abs/2506.10947. [↗](https://arxiv.org/abs/2506.10947)
192. Z. Shao, P. Wang, Q. Zhu, R. Xu, J. Song, X. Bi, H. Zhang, M. Zhang, Y. Li, Y. Wu, et al. Deepseekmath: Pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300, 2024. [find](https://scholar.google.com/scholar?q=Z%2E+Shao%2C+P%2E+Wang%2C+Q%2E+Zhu%2C+R%2E+Xu%2C+J%2E+Song%2C+X%2E+Bi%2C+H%2E+Zhang%2C+M%2E+Zhang%2C+Y%2E+Li%2C+Y%2E+Wu%2C+et+al%2E+Deepseekmath%3A+Pushing+the+limits+of+mathematical+reasoning+in+open+language+models%2E+arXiv+preprint+arXiv%3A2402%2E) [our card](https://md.research.elamur.ai/free/en/papers/shao-2024-deepseekmath-pushing-limits-mathematical-reasoning/)
193. X. Shen, Z. Chen, M. Backes, Y. Shen, and Y. Zhang. " do anything now": Characterizing and evaluating in-the-wild jailbreak prompts on large language models. In Proceedings of the 2024 on ACM SIGSAC Conference on Computer and Communications Security, pages 1671–1685, 2024. [find](https://scholar.google.com/scholar?q=X%2E+Shen%2C+Z%2E+Chen%2C+M%2E+Backes%2C+Y%2E+Shen%2C+and+Y%2E+Zhang%2E+%22+do+anything+now%22%3A+Characterizing+and+evaluating+in%2Dthe%2Dwild+jailbreak+prompts+on+large+language+models%2E+In+Proceedings+of+the+2024+on+ACM+SIGSAC+C) [our card](https://md.research.elamur.ai/free/en/papers/shen-2023-anything-now-characterizing-evaluating-wild/)
194. D. Shi, J. Cao, Q. Chen, W. Sun, W. Li, H. Lu, F. Dong, T. Qin, K. Zhu, M. Liu, J. Yang, G. Zhang, J. Liu, C. Zhang, J. Wang, Y. E. Jiang, and W. Zhou. Taskcraft: Automated generation of agentic tasks. ArXiv, abs/2506.10055, 2025. URL [https://api.semanticscholar.org/CorpusID:279318561](https://api.semanticscholar.org/CorpusID:279318561). — [arXiv:2506.10055](https://arxiv.org/abs/2506.10055) [↗](https://api.semanticscholar.org/CorpusID:279318561)
195. D. Silver, T. Hubert, J. Schrittwieser, I. Antonoglou, M. Lai, A. Guez, M. Lanctot, L. Sifre, D. Kumaran, T. Graepel, et al. Mastering chess and shogi by self-play with a general reinforcement learning algorithm. arXiv preprint arXiv:1712.01815, 2017. [find](https://scholar.google.com/scholar?q=D%2E+Silver%2C+T%2E+Hubert%2C+J%2E+Schrittwieser%2C+I%2E+Antonoglou%2C+M%2E+Lai%2C+A%2E+Guez%2C+M%2E+Lanctot%2C+L%2E+Sifre%2C+D%2E+Kumaran%2C+T%2E+Graepel%2C+et+al%2E+Mastering+chess+and+shogi+by+self%2Dplay+with+a+general+reinforcement+learnin) [our card](https://md.research.elamur.ai/free/en/papers/al-2017-mastering-chess-shogi-self-play/)
196. S. Singh, F. Vargus, D. Dsouza, B. F. Karlsson, A. Mahendiran, W.-Y. Ko, H. Shandilya, J. Patel, D. Mataciunas, L. O’Mahony, M. Zhang, R. Hettiarachchi, J. Wilson, M. Machado, L. S. Moura, D. Krzemiński, H. Fadaei, I. Ergün, I. Okoh, A. Alaagib, O. Mudannayake, Z. Alyafeai, V. M. Chien, S. Ruder, S.… [find](https://scholar.google.com/scholar?q=S%2E+Singh%2C+F%2E+Vargus%2C+D%2E+Dsouza%2C+B%2E+F%2E+Karlsson%2C+A%2E+Mahendiran%2C+W%2E%2DY%2E+Ko%2C+H%2E+Shandilya%2C+J%2E+Patel%2C+D%2E+Mataciunas%2C+L%2E+O%E2%80%99Mahony%2C+M%2E+Zhang%2C+R%2E+Hettiarachchi%2C+J%2E+Wilson%2C+M%2E+Machado%2C+L%2E+S%2E+Moura%2C+D%2E+Krzemi%C5%84s) [our card](https://md.research.elamur.ai/free/en/papers/singh-2024-aya-dataset-open-access-collection/)
197. M. D. Skarlinski, S. Cox, J. M. Laurent, J. D. Braza, M. Hinks, M. J. Hammerling, M. Ponnapati, S. G. Rodriques, and A. D. White. Language agents achieve superhuman synthesis of scientific knowledge. arXiv preprint arXiv:2409.13740, 2024. [find](https://scholar.google.com/scholar?q=M%2E+D%2E+Skarlinski%2C+S%2E+Cox%2C+J%2E+M%2E+Laurent%2C+J%2E+D%2E+Braza%2C+M%2E+Hinks%2C+M%2E+J%2E+Hammerling%2C+M%2E+Ponnapati%2C+S%2E+G%2E+Rodriques%2C+and+A%2E+D%2E+White%2E+Language+agents+achieve+superhuman+synthesis+of+scientific+knowledge%2E+)
198. L. Soldaini and K. Lo. peS2o (Pretraining Efficiently on S2ORC) Dataset, 2023. URL [https://github.com/allenai/](https://github.com/allenai/) pes2o. [↗](https://github.com/allenai/)
199. L. Soldaini, R. Kinney, A. Bhagia, D. Schwenk, D. Atkinson, R. Authur, B. Bogin, K. Chandu, J. Dumas, Y. Elazar, V. Hofmann, A. H. Jha, S. Kumar, L. Lucy, X. Lyu, N. Lambert, I. Magnusson, J. Morrison, N. Muennighoff, A. Naik, C. Nam, M. E. Peters, A. Ravichander, K. Richardson, Z. Shen, E. Strubell… [find](https://scholar.google.com/scholar?q=L%2E+Soldaini%2C+R%2E+Kinney%2C+A%2E+Bhagia%2C+D%2E+Schwenk%2C+D%2E+Atkinson%2C+R%2E+Authur%2C+B%2E+Bogin%2C+K%2E+Chandu%2C+J%2E+Dumas%2C+Y%2E+Elazar%2C+V%2E+Hofmann%2C+A%2E+H%2E+Jha%2C+S%2E+Kumar%2C+L%2E+Lucy%2C+X%2E+Lyu%2C+N%2E+Lambert%2C+I%2E+Magnusson%2C+J%2E+Morrison)
200. K. Soule and D. Bergmann. IBM Granite 3.3: Speech recognition, refined reasoning, and RAG LoRAs, Apr. 2025. URL [https://www.ibm.com/new/announcements/](https://www.ibm.com/new/announcements/) ibm-granite-3-3-speech-recognition-refined-reasoning-rag-loras. Blog post. [↗](https://www.ibm.com/new/announcements/)
201. A. Souly, Q. Lu, D. Bowen, T. Trinh, E. Hsieh, S. Pandey, P. Abbeel, J. Svegliato, S. Emmons, O. Watkins, and S. Toyer. A strongreject for empty jailbreaks. In A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, and C. Zhang, editors, Advances in Neural Information Processing System… [find](https://scholar.google.com/scholar?q=A%2E+Souly%2C+Q%2E+Lu%2C+D%2E+Bowen%2C+T%2E+Trinh%2C+E%2E+Hsieh%2C+S%2E+Pandey%2C+P%2E+Abbeel%2C+J%2E+Svegliato%2C+S%2E+Emmons%2C+O%2E+Watkins%2C+and+S%2E+Toyer%2E+A+strongreject+for+empty+jailbreaks%2E+In+A%2E+Globerson%2C+L%2E+Mackey%2C+D%2E+Belgrave%2C+A%2E)
202. N. Stiennon, L. Ouyang, J. Wu, D. Ziegler, R. Lowe, C. Voss, A. Radford, D. Amodei, and P. F. Christiano. Learning to summarize with human feedback. Advances in Neural Information Processing Systems, 33:3008–3021, 2020. [find](https://scholar.google.com/scholar?q=N%2E+Stiennon%2C+L%2E+Ouyang%2C+J%2E+Wu%2C+D%2E+Ziegler%2C+R%2E+Lowe%2C+C%2E+Voss%2C+A%2E+Radford%2C+D%2E+Amodei%2C+and+P%2E+F%2E+Christiano%2E+Learning+to+summarize+with+human+feedback%2E+Advances+in+Neural+Information+Processing+Systems%2C+)
203. D. Su, K. Kong, Y. Lin, J. Jennings, B. Norick, M. Kliegl, M. Patwary, M. Shoeybi, and B. Catanzaro. Nemotron-cc: Transforming common crawl into a refined long-horizon pretraining dataset, 2025a. URL https://arxiv.org/abs/ 2412.02595. [↗](https://arxiv.org/abs/)
204. J. Su, M. Ahmed, Y. Lu, S. Pan, W. Bo, and Y. Liu. Roformer: Enhanced transformer with rotary position embedding. Neurocomputing, 568:127063, 2024. [find](https://scholar.google.com/scholar?q=J%2E+Su%2C+M%2E+Ahmed%2C+Y%2E+Lu%2C+S%2E+Pan%2C+W%2E+Bo%2C+and+Y%2E+Liu%2E+Roformer%3A+Enhanced+transformer+with+rotary+position+embedding%2E+Neurocomputing%2C+568%3A127063%2C+2024%2E)
205. Y. Su, D. Yu, L. Song, J. Li, H. Mi, Z. Tu, M. Zhang, and D. Yu. Expanding rl with verifiable rewards across diverse domains. arXiv preprint arXiv:2503.23829, 2025b. — [arXiv:2503.23829](https://arxiv.org/abs/2503.23829) [find](https://scholar.google.com/scholar?q=Y%2E+Su%2C+D%2E+Yu%2C+L%2E+Song%2C+J%2E+Li%2C+H%2E+Mi%2C+Z%2E+Tu%2C+M%2E+Zhang%2C+and+D%2E+Yu%2E+Expanding+rl+with+verifiable+rewards+across+diverse+domains%2E+arXiv+preprint+arXiv%3A2503%2E23829%2C+2025b%2E+%E2%80%94+%5BarXiv%3A2503%2E23829%5D%28https%3A%2F%2Farxiv)
206. Z. Su, L. Pan, X. Bai, D. Liu, G. Dong, J. Huang, W. Hu, F. Zhang, K. Gai, and G. Zhou. Klear-reasoner: Advancing reasoning capability via gradient-preserving clipping policy optimization. arXiv preprint arXiv:2508.07629, 2025c. — [arXiv:2508.07629](https://arxiv.org/abs/2508.07629) [find](https://scholar.google.com/scholar?q=Z%2E+Su%2C+L%2E+Pan%2C+X%2E+Bai%2C+D%2E+Liu%2C+G%2E+Dong%2C+J%2E+Huang%2C+W%2E+Hu%2C+F%2E+Zhang%2C+K%2E+Gai%2C+and+G%2E+Zhou%2E+Klear%2Dreasoner%3A+Advancing+reasoning+capability+via+gradient%2Dpreserving+clipping+policy+optimization%2E+arXiv+prepr)
207. Y. Sun, S. Hu, G. Zhou, K. Zheng, H. Hajishirzi, N. Dziri, and D. X. Song. Omega: Can llms reason outside the box in math? evaluating exploratory, compositional, and transformative generalization. ArXiv, abs/2506.18880, 2025. URL [https://api.semanticscholar.org/CorpusID:280000246](https://api.semanticscholar.org/CorpusID:280000246). — [arXiv:2506.18880](https://arxiv.org/abs/2506.18880) [↗](https://api.semanticscholar.org/CorpusID:280000246)
208. M. Suzgun, N. Scales, N. Schärli, S. Gehrmann, Y. Tay, H. W. Chung, A. Chowdhery, Q. V. Le, E. H. Chi, D. Zhou, et al. Challenging big-bench tasks and whether chain-of-thought can solve them. arXiv preprint arXiv:2210.09261, 2022. [find](https://scholar.google.com/scholar?q=M%2E+Suzgun%2C+N%2E+Scales%2C+N%2E+Sch%C3%A4rli%2C+S%2E+Gehrmann%2C+Y%2E+Tay%2C+H%2E+W%2E+Chung%2C+A%2E+Chowdhery%2C+Q%2E+V%2E+Le%2C+E%2E+H%2E+Chi%2C+D%2E+Zhou%2C+et+al%2E+Challenging+big%2Dbench+tasks+and+whether+chain%2Dof%2Dthought+can+solve+them%2E+arXiv+pr) [our card](https://md.research.elamur.ai/free/en/papers/suzgun-2023-challenging-big-bench-tasks-whether/)
209. A. Talmor, J. Herzig, N. Lourie, and J. Berant. CommonsenseQA: A question answering challenge targeting commonsense knowledge. In J. Burstein, C. Doran, and T. Solorio, editors, Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human L… [find](https://scholar.google.com/scholar?q=A%2E+Talmor%2C+J%2E+Herzig%2C+N%2E+Lourie%2C+and+J%2E+Berant%2E+CommonsenseQA%3A+A+question+answering+challenge+targeting+commonsense+knowledge%2E+In+J%2E+Burstein%2C+C%2E+Doran%2C+and+T%2E+Solorio%2C+editors%2C+Proceedings+of+the+201)
210. K. Team, Z. Liu, L. Tang, L. Jin, H. Li, N. Ranjan, D. Fan, S. Rohatgi, R. Fan, O. Pangarkar, H. Wang, Z. Cheng, S. Sun, S. Han, B. Tan, G. Gosal, X. Han, V. Pimpalkhute, S. Hao, M. S. Hee, J. Hestness, H. Jia, L. Ma, A. Singh, D. Soboleva, N. Vassilieva, R. Wang, Y. Wu, Y. Sun, T. Killian, A. Moren… — [arXiv:2512.06201](https://arxiv.org/abs/2512.06201) [find](https://scholar.google.com/scholar?q=K%2E+Team%2C+Z%2E+Liu%2C+L%2E+Tang%2C+L%2E+Jin%2C+H%2E+Li%2C+N%2E+Ranjan%2C+D%2E+Fan%2C+S%2E+Rohatgi%2C+R%2E+Fan%2C+O%2E+Pangarkar%2C+H%2E+Wang%2C+Z%2E+Cheng%2C+S%2E+Sun%2C+S%2E+Han%2C+B%2E+Tan%2C+G%2E+Gosal%2C+X%2E+Han%2C+V%2E+Pimpalkhute%2C+S%2E+Hao%2C+M%2E+S%2E+Hee%2C+J%2E+Hestnes)
211. Teknium. Openhermes 2.5: An open dataset of synthetic data for generalist llm assistants, 2023. URL [https://huggingface.co/datasets/teknium/OpenHermes-2.5](https://huggingface.co/datasets/teknium/OpenHermes-2.5). [↗](https://huggingface.co/datasets/teknium/OpenHermes-2.5)
212. The Algorithms. The algorithms – python. [https://github.com/TheAlgorithms/Python](https://github.com/TheAlgorithms/Python), 2025. GitHub repository, MIT License. [↗](https://github.com/TheAlgorithms/Python)
213. Together AI. RedPajama: An open source recipe to reproduce LLaMA training dataset, 2023. URL [https://github.com/togethercomputer/RedPajama-Data](https://github.com/togethercomputer/RedPajama-Data). [↗](https://github.com/togethercomputer/RedPajama-Data)
214. S. Toshniwal, W. Du, I. Moshkov, B. Kisacanin, A. Ayrapetyan, and I. Gitman. Openmathinstruct-2: Accelerating ai for math with massive open-source instruction data. arXiv preprint arXiv:2410.01560, 2024. [find](https://scholar.google.com/scholar?q=S%2E+Toshniwal%2C+W%2E+Du%2C+I%2E+Moshkov%2C+B%2E+Kisacanin%2C+A%2E+Ayrapetyan%2C+and+I%2E+Gitman%2E+Openmathinstruct%2D2%3A+Accelerating+ai+for+math+with+massive+open%2Dsource+instruction+data%2E+arXiv+preprint+arXiv%3A2410%2E01560%2C+20)
215. J. Toy, J. MacAdam, and P. Tabor. Metacognition is all you need? using introspection in generative agents to improve goal-directed behavior, 2024. URL https://arxiv.org/abs/2401.10910. — [arXiv:2401.10910](https://arxiv.org/abs/2401.10910) [↗](https://arxiv.org/abs/2401.10910)
216. H. Van Hasselt, Y. Doron, F. Strub, M. Hessel, N. Sonnerat, and J. Modayil. Deep reinforcement learning and the deadly triad. arXiv preprint arXiv:1812.02648, 2018. — [arXiv:1812.02648](https://arxiv.org/abs/1812.02648) [find](https://scholar.google.com/scholar?q=H%2E+Van+Hasselt%2C+Y%2E+Doron%2C+F%2E+Strub%2C+M%2E+Hessel%2C+N%2E+Sonnerat%2C+and+J%2E+Modayil%2E+Deep+reinforcement+learning+and+the+deadly+triad%2E+arXiv+preprint+arXiv%3A1812%2E02648%2C+2018%2E+%E2%80%94+%5BarXiv%3A1812%2E02648%5D%28https%3A%2F%2Farxiv%2E)
217. A. Vaswani. Announcing rnj-1: Building instruments of intelligence, Dec. 2025. URL [https://essential.ai/](https://essential.ai/) research/rnj-1. Blog post. [↗](https://essential.ai/)
218. A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. u. Kaiser, and I. Polosukhin. Attention is all you need. In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Systems, volume 30. Cu… [find](https://scholar.google.com/scholar?q=A%2E+Vaswani%2C+N%2E+Shazeer%2C+N%2E+Parmar%2C+J%2E+Uszkoreit%2C+L%2E+Jones%2C+A%2E+N%2E+Gomez%2C+L%2E+u%2E+Kaiser%2C+and+I%2E+Polosukhin%2E+Attention+is+all+you+need%2E+In+I%2E+Guyon%2C+U%2E+V%2E+Luxburg%2C+S%2E+Bengio%2C+H%2E+Wallach%2C+R%2E+Fergus%2C+S%2E+Vis)
219. J. Vendrow, E. Vendrow, S. Beery, and A. Madry. Do large language model benchmarks test reliability? arXiv preprint arXiv:2502.03461, 2025. [find](https://scholar.google.com/scholar?q=J%2E+Vendrow%2C+E%2E+Vendrow%2C+S%2E+Beery%2C+and+A%2E+Madry%2E+Do+large+language+model+benchmarks+test+reliability%3F+arXiv+preprint+arXiv%3A2502%2E03461%2C+2025%2E)
220. D. Wadden, K. Shi, J. Morrison, A. Naik, S. Singh, N. Barzilay, K. Lo, T. Hope, L. Soldaini, S. Z. Shen, et al. Sciriff: A resource to enhance language model instruction-following over scientific literature. arXiv preprint arXiv:2406.07835, 2024. [find](https://scholar.google.com/scholar?q=D%2E+Wadden%2C+K%2E+Shi%2C+J%2E+Morrison%2C+A%2E+Naik%2C+S%2E+Singh%2C+N%2E+Barzilay%2C+K%2E+Lo%2C+T%2E+Hope%2C+L%2E+Soldaini%2C+S%2E+Z%2E+Shen%2C+et+al%2E+Sciriff%3A+A+resource+to+enhance+language+model+instruction%2Dfollowing+over+scientific+lite)
221. Y. Wang, X. Ma, G. Zhang, Y. Ni, A. Chandra, S. Guo, W. Ren, A. Arulraj, X. He, Z. Jiang, et al. Mmlu-pro: A more robust and challenging multi-task language understanding benchmark. arXiv preprint arXiv:2406.01574, 2024a. [find](https://scholar.google.com/scholar?q=Y%2E+Wang%2C+X%2E+Ma%2C+G%2E+Zhang%2C+Y%2E+Ni%2C+A%2E+Chandra%2C+S%2E+Guo%2C+W%2E+Ren%2C+A%2E+Arulraj%2C+X%2E+He%2C+Z%2E+Jiang%2C+et+al%2E+Mmlu%2Dpro%3A+A+more+robust+and+challenging+multi%2Dtask+language+understanding+benchmark%2E+arXiv+preprint+arX) [our card](https://md.research.elamur.ai/free/en/papers/wang-2024-mmlu-pro-more-robust-challenging/)
222. Z. Wang, Y. Dong, O. Delalleau, J. Zeng, G. Shen, D. Egert, J. J. Zhang, M. N. Sreedhar, and O. Kuchaiev. Helpsteer2: Open-source dataset for training top-performing reward models. arXiv preprint arXiv:2406.08673, 2024b. [find](https://scholar.google.com/scholar?q=Z%2E+Wang%2C+Y%2E+Dong%2C+O%2E+Delalleau%2C+J%2E+Zeng%2C+G%2E+Shen%2C+D%2E+Egert%2C+J%2E+J%2E+Zhang%2C+M%2E+N%2E+Sreedhar%2C+and+O%2E+Kuchaiev%2E+Helpsteer2%3A+Open%2Dsource+dataset+for+training+top%2Dperforming+reward+models%2E+arXiv+preprint+arXi)
223. Z. Wang, F. Zhou, X. Li, and P. Liu. Octothinker: Mid-training incentivizes reinforcement learning scaling. arXiv preprint arXiv:2506.20512, 2025. — [arXiv:2506.20512](https://arxiv.org/abs/2506.20512) [find](https://scholar.google.com/scholar?q=Z%2E+Wang%2C+F%2E+Zhou%2C+X%2E+Li%2C+and+P%2E+Liu%2E+Octothinker%3A+Mid%2Dtraining+incentivizes+reinforcement+learning+scaling%2E+arXiv+preprint+arXiv%3A2506%2E20512%2C+2025%2E+%E2%80%94+%5BarXiv%3A2506%2E20512%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2506%2E20512)
224. J. H. Ward Jr. Hierarchical grouping to optimize an objective function. Journal of the American statistical association, 58(301):236–244, 1963. [find](https://scholar.google.com/scholar?q=J%2E+H%2E+Ward+Jr%2E+Hierarchical+grouping+to+optimize+an+objective+function%2E+Journal+of+the+American+statistical+association%2C+58%28301%29%3A236%E2%80%93244%2C+1963%2E)
225. J. Wei, M. Bosma, V. Zhao, K. Guu, A. W. Yu, B. Lester, N. Du, A. M. Dai, and Q. V. Le. Finetuned language models are zero-shot learners. In International Conference on Learning Representations, 2021. [find](https://scholar.google.com/scholar?q=J%2E+Wei%2C+M%2E+Bosma%2C+V%2E+Zhao%2C+K%2E+Guu%2C+A%2E+W%2E+Yu%2C+B%2E+Lester%2C+N%2E+Du%2C+A%2E+M%2E+Dai%2C+and+Q%2E+V%2E+Le%2E+Finetuned+language+models+are+zero%2Dshot+learners%2E+In+International+Conference+on+Learning+Representations%2C+2021%2E)
226. J. Wei, Y. Tay, R. Bommasani, C. Raffel, B. Zoph, S. Borgeaud, D. Yogatama, M. Bosma, D. Zhou, D. Metzler, et al. Emergent abilities of large language models. arXiv preprint arXiv:2206.07682, 2022. [find](https://scholar.google.com/scholar?q=J%2E+Wei%2C+Y%2E+Tay%2C+R%2E+Bommasani%2C+C%2E+Raffel%2C+B%2E+Zoph%2C+S%2E+Borgeaud%2C+D%2E+Yogatama%2C+M%2E+Bosma%2C+D%2E+Zhou%2C+D%2E+Metzler%2C+et+al%2E+Emergent+abilities+of+large+language+models%2E+arXiv+preprint+arXiv%3A2206%2E07682%2C+2022%2E) [our card](https://md.research.elamur.ai/free/en/papers/wei-2022-emergent-abilities-large-language-models/)
227. J. Wei, N. Karina, H. W. Chung, Y. J. Jiao, S. Papay, A. Glaese, J. Schulman, and W. Fedus. Measuring short-form factuality in large language models. arXiv preprint arXiv:2411.04368, 2024. [find](https://scholar.google.com/scholar?q=J%2E+Wei%2C+N%2E+Karina%2C+H%2E+W%2E+Chung%2C+Y%2E+J%2E+Jiao%2C+S%2E+Papay%2C+A%2E+Glaese%2C+J%2E+Schulman%2C+and+W%2E+Fedus%2E+Measuring+short%2Dform+factuality+in+large+language+models%2E+arXiv+preprint+arXiv%3A2411%2E04368%2C+2024%2E) [our card](https://md.research.elamur.ai/free/en/papers/wei-2024-measuring-short-form-factuality-large/)
228. J. Welbl, N. F. Liu, and M. Gardner. Crowdsourcing multiple choice science questions. In L. Derczynski, W. Xu, A. Ritter, and T. Baldwin, editors, Proceedings of the 3rd Workshop on Noisy User-generated Text, pages 94–106, Copenhagen, Denmark, Sept. 2017. Association for Computational Linguistics. d… [find](https://scholar.google.com/scholar?q=J%2E+Welbl%2C+N%2E+F%2E+Liu%2C+and+M%2E+Gardner%2E+Crowdsourcing+multiple+choice+science+questions%2E+In+L%2E+Derczynski%2C+W%2E+Xu%2C+A%2E+Ritter%2C+and+T%2E+Baldwin%2C+editors%2C+Proceedings+of+the+3rd+Workshop+on+Noisy+User%2Dgenerat) [our card](https://md.research.elamur.ai/free/en/papers/welbl-2017-crowdsourcing-multiple-choice-science-questions/)
229. A. Wettig, K. Lo, S. Min, H. Hajishirzi, D. Chen, and L. Soldaini. Organize the web: Constructing domains enhances pre-training data curation, 2025. URL https://arxiv.org/abs/2502.10341. [↗](https://arxiv.org/abs/2502.10341)
230. M. Wortsman, G. Ilharco, S. Y. Gadre, R. Roelofs, R. Gontijo-Lopes, A. S. Morcos, H. Namkoong, A. Farhadi, Y. Carmon, S. Kornblith, et al. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time. In International conference on machine learning… [find](https://scholar.google.com/scholar?q=M%2E+Wortsman%2C+G%2E+Ilharco%2C+S%2E+Y%2E+Gadre%2C+R%2E+Roelofs%2C+R%2E+Gontijo%2DLopes%2C+A%2E+S%2E+Morcos%2C+H%2E+Namkoong%2C+A%2E+Farhadi%2C+Y%2E+Carmon%2C+S%2E+Kornblith%2C+et+al%2E+Model+soups%3A+averaging+weights+of+multiple+fine%2Dtuned+models+) [our card](https://md.research.elamur.ai/free/en/papers/wortsman-2022-model-soups-averaging-weights-multiple/)
231. J. Wu, W. Yin, Y. Jiang, Z. Wang, Z. Xi, R. Fang, L. Zhang, Y. He, D. Zhou, P. Xie, and F. Huang. WebWalker: Benchmarking LLMs in web traversal. In W. Che, J. Nabende, E. Shutova, and M. T. Pilehvar, editors, Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Vo… [find](https://scholar.google.com/scholar?q=J%2E+Wu%2C+W%2E+Yin%2C+Y%2E+Jiang%2C+Z%2E+Wang%2C+Z%2E+Xi%2C+R%2E+Fang%2C+L%2E+Zhang%2C+Y%2E+He%2C+D%2E+Zhou%2C+P%2E+Xie%2C+and+F%2E+Huang%2E+WebWalker%3A+Benchmarking+LLMs+in+web+traversal%2E+In+W%2E+Che%2C+J%2E+Nabende%2C+E%2E+Shutova%2C+and+M%2E+T%2E+Pilehvar%2C+)
232. L. Wu, D. Zhu, G. Zhao, Z. Yu, J. Ran, X. Wong, L. Sun, and S. Li. LongAttn: Selecting long-context training data via token-level attention, 2025b. URL https://arxiv.org/abs/2502.16860. [↗](https://arxiv.org/abs/2502.16860)
233. M. Wu, Z. Zhang, Q. Dong, Z. Xi, J. Zhao, S. Jin, X. Fan, Y. Zhou, H. Lv, M. Zhang, et al. Reasoning or memorization? unreliable results of reinforcement learning due to data contamination. arXiv preprint arXiv:2507.10532, 2025c. — [arXiv:2507.10532](https://arxiv.org/abs/2507.10532) [find](https://scholar.google.com/scholar?q=M%2E+Wu%2C+Z%2E+Zhang%2C+Q%2E+Dong%2C+Z%2E+Xi%2C+J%2E+Zhao%2C+S%2E+Jin%2C+X%2E+Fan%2C+Y%2E+Zhou%2C+H%2E+Lv%2C+M%2E+Zhang%2C+et+al%2E+Reasoning+or+memorization%3F+unreliable+results+of+reinforcement+learning+due+to+data+contamination%2E+arXiv+prep)
234. L.-C. Xiaomi, :, B. Xia, B. Shen, Cici, D. Zhu, D. Zhang, G. Wang, H. Zhang, H. Liu, J. Xiao, J. Dong, L. Zhao, P. Li, P. Wang, S. Yu, S. Chen, W. Wang, W. Ma, X. Deng, Y. Huang, Y. Song, Z. Jiang, B. Ye, C. Cai, C. He, D. Zhang, D. Zhang, G. Wang, H. Tian, H. Zhao, H. Qu, H. Xu, J. Shi, K. Bao, K.… [find](https://scholar.google.com/scholar?q=L%2E%2DC%2E+Xiaomi%2C+%3A%2C+B%2E+Xia%2C+B%2E+Shen%2C+Cici%2C+D%2E+Zhu%2C+D%2E+Zhang%2C+G%2E+Wang%2C+H%2E+Zhang%2C+H%2E+Liu%2C+J%2E+Xiao%2C+J%2E+Dong%2C+L%2E+Zhao%2C+P%2E+Li%2C+P%2E+Wang%2C+S%2E+Yu%2C+S%2E+Chen%2C+W%2E+Wang%2C+W%2E+Ma%2C+X%2E+Deng%2C+Y%2E+Huang%2C+Y%2E+Song%2C+Z%2E+Jiang%2C+B%2E)
235. W. Xiong, J. Liu, I. Molybog, H. Zhang, P. Bhargava, R. Hou, L. Martin, R. Rungta, K. A. Sankararaman, B. Oguz, M. Khabsa, H. Fang, Y. Mehdad, S. Narang, K. Malik, A. Fan, S. Bhosale, S. Edunov, M. Lewis, S. Wang, and H. Ma. Effective long-context scaling of foundation models, 2023. URL https://arxi… [find](https://scholar.google.com/scholar?q=W%2E+Xiong%2C+J%2E+Liu%2C+I%2E+Molybog%2C+H%2E+Zhang%2C+P%2E+Bhargava%2C+R%2E+Hou%2C+L%2E+Martin%2C+R%2E+Rungta%2C+K%2E+A%2E+Sankararaman%2C+B%2E+Oguz%2C+M%2E+Khabsa%2C+H%2E+Fang%2C+Y%2E+Mehdad%2C+S%2E+Narang%2C+K%2E+Malik%2C+A%2E+Fan%2C+S%2E+Bhosale%2C+S%2E+Edunov%2C+M%2E+Le) [our card](https://md.research.elamur.ai/free/en/papers/xiong-2023-effective-long-context-scaling-foundation/)
236. A. Yang, A. Li, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Gao, C. Huang, C. Lv, et al. Qwen3 technical report. arXiv preprint arXiv:2505.09388, 2025a. [find](https://scholar.google.com/scholar?q=A%2E+Yang%2C+A%2E+Li%2C+B%2E+Yang%2C+B%2E+Zhang%2C+B%2E+Hui%2C+B%2E+Zheng%2C+B%2E+Yu%2C+C%2E+Gao%2C+C%2E+Huang%2C+C%2E+Lv%2C+et+al%2E+Qwen3+technical+report%2E+arXiv+preprint+arXiv%3A2505%2E09388%2C+2025a%2E) [our card](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen3-technical-report/)
237. A. Yang, B. Yu, C. Li, D. Liu, F. Huang, H. Huang, J. Jiang, J. Tu, J. Zhang, J. Zhou, J. Lin, K. Dang, K. Yang, L. Yu, M. Li, M. Sun, Q. Zhu, R. Men, T. He, W. Xu, W. Yin, W. Yu, X. Qiu, X. Ren, X. Yang, Y. Li, Z. Xu, and Z. Zhang. Qwen2.5-1M Technical Report, 2025b. URL https://arxiv.org/abs/2501.… [↗](https://arxiv.org/abs/2501.…) [our card](https://md.research.elamur.ai/free/en/papers/yang-2025-qwen2-5-1m-technical/)
238. Z. Yang, P. Qi, S. Zhang, Y. Bengio, W. W. Cohen, R. Salakhutdinov, and C. D. Manning. Hotpotqa: A dataset for diverse, explainable multi-hop question answering. In Conference on Empirical Methods in Natural Language Processing, 2018. URL [https://api.semanticscholar.org/CorpusID:52822214](https://api.semanticscholar.org/CorpusID:52822214). [↗](https://api.semanticscholar.org/CorpusID:52822214) [our card](https://md.research.elamur.ai/free/en/papers/yang-2018-hotpotqa-dataset-diverse-explainable-multi/)
239. F. Yao, L. Liu, D. Zhang, C. Dong, J. Shang, and J. Gao. Your efficient rl framework secretly brings you off-policy rl training, Aug. 2025. URL [https://fengyao.notion.site/off-policy-rl](https://fengyao.notion.site/off-policy-rl). [↗](https://fengyao.notion.site/off-policy-rl)
240. J. Ye, P. Liu, T. Sun, J. Zhan, Y. Zhou, and X. Qiu. Data mixing laws: Optimizing data mixtures by predicting language modeling performance, 2025. URL https://arxiv.org/abs/2403.16952. [↗](https://arxiv.org/abs/2403.16952)
241. H. Yen, T. Gao, M. Hou, K. Ding, D. Fleischer, P. Izsak, M. Wasserblat, and D. Chen. HELMET: How to evaluate long-context models effectively and thoroughly. In The Thirteenth International Conference on Learning Representations, 2025. URL [https://openreview.net/forum?id=293V3bJbmE](https://openreview.net/forum?id=293V3bJbmE). [↗](https://openreview.net/forum?id=293V3bJbmE)
242. A. Young, B. Chen, C. Li, C. Huang, G. Zhang, G. Zhang, H. Li, J. Zhu, J. Chen, J. Chang, et al. Yi: Open foundation models by 01. ai. arXiv preprint arXiv:2403.04652, 2024. [find](https://scholar.google.com/scholar?q=A%2E+Young%2C+B%2E+Chen%2C+C%2E+Li%2C+C%2E+Huang%2C+G%2E+Zhang%2C+G%2E+Zhang%2C+H%2E+Li%2C+J%2E+Zhu%2C+J%2E+Chen%2C+J%2E+Chang%2C+et+al%2E+Yi%3A+Open+foundation+models+by+01%2E+ai%2E+arXiv+preprint+arXiv%3A2403%2E04652%2C+2024%2E) [our card](https://md.research.elamur.ai/free/en/papers/ai-2024-yi-open-foundation-models-01/)
243. Q. Yu, Z. Zhang, R. Zhu, Y. Yuan, X. Zuo, Y. Yue, W. Dai, T. Fan, G. Liu, L. Liu, et al. Dapo: An open-source llm reinforcement learning system at scale. arXiv preprint arXiv:2503.14476, 2025. [find](https://scholar.google.com/scholar?q=Q%2E+Yu%2C+Z%2E+Zhang%2C+R%2E+Zhu%2C+Y%2E+Yuan%2C+X%2E+Zuo%2C+Y%2E+Yue%2C+W%2E+Dai%2C+T%2E+Fan%2C+G%2E+Liu%2C+L%2E+Liu%2C+et+al%2E+Dapo%3A+An+open%2Dsource+llm+reinforcement+learning+system+at+scale%2E+arXiv+preprint+arXiv%3A2503%2E14476%2C+2025%2E) [our card](https://md.research.elamur.ai/free/en/papers/yu-2025-dapo-open-source-llm-reinforcement/)
244. Y. Yue, Z. Chen, R. Lu, A. Zhao, Z. Wang, Y. Yue, S. Song, and G. Huang. Does reinforcement learning really incentivize reasoning capacity in llms beyond the base model? arXiv preprint arXiv:2504.13837, 2025. [find](https://scholar.google.com/scholar?q=Y%2E+Yue%2C+Z%2E+Chen%2C+R%2E+Lu%2C+A%2E+Zhao%2C+Z%2E+Wang%2C+Y%2E+Yue%2C+S%2E+Song%2C+and+G%2E+Huang%2E+Does+reinforcement+learning+really+incentivize+reasoning+capacity+in+llms+beyond+the+base+model%3F+arXiv+preprint+arXiv%3A2504%2E1383) [our card](https://md.research.elamur.ai/free/en/papers/yue-2025-reinforcement-learning-really-incentivize-reasoning/)
245. R. Zellers, A. Holtzman, Y. Bisk, A. Farhadi, and Y. Choi. HellaSwag: Can a machine really finish your sentence? In A. Korhonen, D. Traum, and L. Màrquez, editors, Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 4791–4800, Florence, Italy, July 2019. As… [find](https://scholar.google.com/scholar?q=R%2E+Zellers%2C+A%2E+Holtzman%2C+Y%2E+Bisk%2C+A%2E+Farhadi%2C+and+Y%2E+Choi%2E+HellaSwag%3A+Can+a+machine+really+finish+your+sentence%3F+In+A%2E+Korhonen%2C+D%2E+Traum%2C+and+L%2E+M%C3%A0rquez%2C+editors%2C+Proceedings+of+the+57th+Annual+Meeti)
246. H. Zeng, J. Yang, Y. Zhang, B. Yu, S. Wang, Z. Liu, M. Sun, and T. Liu. Acecoder: Acing coder rl via automated test-case synthesis. arXiv preprint arXiv:2502.01718, 2025a. URL https://arxiv.org/abs/2502.01718. [↗](https://arxiv.org/abs/2502.01718)
247. Z. Zeng, H. Ivison, Y. Wang, L. Yuan, S. S. Li, Z. Ye, S. Li, J. He, R. Zhou, T. Chen, C. Zhao, Y. Tsvetkov, S. S. Du, N. Jaques, H. Peng, P. W. Koh, and H. Hajishirzi. Rlve: Scaling up reinforcement learning for language models with adaptive verifiable environments. arXiv preprint 2511.07317, 2025b… — [arXiv:2511.07317](https://arxiv.org/abs/2511.07317) [find](https://scholar.google.com/scholar?q=Z%2E+Zeng%2C+H%2E+Ivison%2C+Y%2E+Wang%2C+L%2E+Yuan%2C+S%2E+S%2E+Li%2C+Z%2E+Ye%2C+S%2E+Li%2C+J%2E+He%2C+R%2E+Zhou%2C+T%2E+Chen%2C+C%2E+Zhao%2C+Y%2E+Tsvetkov%2C+S%2E+S%2E+Du%2C+N%2E+Jaques%2C+H%2E+Peng%2C+P%2E+W%2E+Koh%2C+and+H%2E+Hajishirzi%2E+Rlve%3A+Scaling+up+reinforcement+)
248. L. Zha, J. Zhou, L. Li, R. Wang, Q. Huang, S. Yang, J. Yuan, C. Su, X. Li, A. Su, T. Zhang, C. Zhou, K. Shou, M. Wang, W. Zhu, G. Lu, C. Ye, Y. Ye, W. Ye, Y. Zhang, X. Deng, J. Xu, H. Wang, G. Chen, and J. Zhao. Tablegpt: Towards unifying tables, natural language and commands into one gpt. arXiv pre… — [arXiv:2307.08674](https://arxiv.org/abs/2307.08674) [find](https://scholar.google.com/scholar?q=L%2E+Zha%2C+J%2E+Zhou%2C+L%2E+Li%2C+R%2E+Wang%2C+Q%2E+Huang%2C+S%2E+Yang%2C+J%2E+Yuan%2C+C%2E+Su%2C+X%2E+Li%2C+A%2E+Su%2C+T%2E+Zhang%2C+C%2E+Zhou%2C+K%2E+Shou%2C+M%2E+Wang%2C+W%2E+Zhu%2C+G%2E+Lu%2C+C%2E+Ye%2C+Y%2E+Ye%2C+W%2E+Ye%2C+Y%2E+Zhang%2C+X%2E+Deng%2C+J%2E+Xu%2C+H%2E+Wang%2C+G%2E+Chen%2C+a)
249. W. Zhao, X. Ren, J. Hessel, C. Cardie, Y. Choi, and Y. Deng. Wildchat: 1m chatgpt interaction logs in the wild. arXiv preprint arXiv:2405.01470, 2024a. [find](https://scholar.google.com/scholar?q=W%2E+Zhao%2C+X%2E+Ren%2C+J%2E+Hessel%2C+C%2E+Cardie%2C+Y%2E+Choi%2C+and+Y%2E+Deng%2E+Wildchat%3A+1m+chatgpt+interaction+logs+in+the+wild%2E+arXiv+preprint+arXiv%3A2405%2E01470%2C+2024a%2E) [our card](https://md.research.elamur.ai/free/en/papers/zhao-2024-wildchat-1m-chatgpt-interaction-logs/)
250. Y. Zhao, A. Gu, R. Varma, L. Luo, C.-C. Huang, M. Xu, L. Wright, H. Shojanazeri, M. Ott, S. Shleifer, A. Desmaison, C. Balioglu, P. Damania, B. Nguyen, G. Chauhan, Y. Hao, A. Mathews, and S. Li. Pytorch fsdp: Experiences on scaling fully sharded data parallel, 2023. URL https://arxiv.org/abs/2304.11… [↗](https://arxiv.org/abs/2304.11…)
251. Y. Zhao, Y. Qu, K. Staniszewski, S. Tworkowski, W. Liu, P. Miłoś, Y. Wu, and P. Minervini. Analysing the impact of sequence composition on language model pre-training. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), page 7897–7912.… [find](https://scholar.google.com/scholar?q=Y%2E+Zhao%2C+Y%2E+Qu%2C+K%2E+Staniszewski%2C+S%2E+Tworkowski%2C+W%2E+Liu%2C+P%2E+Mi%C5%82o%C5%9B%2C+Y%2E+Wu%2C+and+P%2E+Minervini%2E+Analysing+the+impact+of+sequence+composition+on+language+model+pre%2Dtraining%2E+In+Proceedings+of+the+62nd+Annua)
252. L. Zheng, W.-L. Chiang, Y. Sheng, S. Zhuang, Z. Wu, Y. Zhuang, Z. Lin, Z. Li, D. Li, E. Xing, et al. Judging llm-asa-judge with mt-bench and chatbot arena. Advances in Neural Information Processing Systems, 36:46595–46623, 2023. [find](https://scholar.google.com/scholar?q=L%2E+Zheng%2C+W%2E%2DL%2E+Chiang%2C+Y%2E+Sheng%2C+S%2E+Zhuang%2C+Z%2E+Wu%2C+Y%2E+Zhuang%2C+Z%2E+Lin%2C+Z%2E+Li%2C+D%2E+Li%2C+E%2E+Xing%2C+et+al%2E+Judging+llm%2Dasa%2Djudge+with+mt%2Dbench+and+chatbot+arena%2E+Advances+in+Neural+Information+Processing+Sy)
253. W. Zhong, R. Cui, Y. Guo, Y. Liang, S. Lu, Y. Wang, A. Saied, W. Chen, and N. Duan. Agieval: A human-centric benchmark for evaluating foundation models. arXiv preprint arXiv:2304.06364, 2023. [find](https://scholar.google.com/scholar?q=W%2E+Zhong%2C+R%2E+Cui%2C+Y%2E+Guo%2C+Y%2E+Liang%2C+S%2E+Lu%2C+Y%2E+Wang%2C+A%2E+Saied%2C+W%2E+Chen%2C+and+N%2E+Duan%2E+Agieval%3A+A+human%2Dcentric+benchmark+for+evaluating+foundation+models%2E+arXiv+preprint+arXiv%3A2304%2E06364%2C+2023%2E) [our card](https://md.research.elamur.ai/free/en/papers/zhong-2024-agieval-human-centric-benchmark-evaluating/)
254. F. Zhou, Z. Wang, N. Ranjan, Z. Cheng, L. Tang, G. He, Z. Liu, and E. P. Xing. Megamath: Pushing the limits of open math corpora. arXiv preprint arXiv:2504.02807, 2025. [find](https://scholar.google.com/scholar?q=F%2E+Zhou%2C+Z%2E+Wang%2C+N%2E+Ranjan%2C+Z%2E+Cheng%2C+L%2E+Tang%2C+G%2E+He%2C+Z%2E+Liu%2C+and+E%2E+P%2E+Xing%2E+Megamath%3A+Pushing+the+limits+of+open+math+corpora%2E+arXiv+preprint+arXiv%3A2504%2E02807%2C+2025%2E)
255. J. Zhou, T. Lu, S. Mishra, S. Brahma, S. Basu, Y. Luan, D. Zhou, and L. Hou. Instruction-following evaluation for large language models, 2023. URL https://arxiv.org/abs/2311.07911. [↗](https://arxiv.org/abs/2311.07911) [our card](https://md.research.elamur.ai/free/en/papers/zhou-2023-instruction-following-evaluation-large-language/)
256. T. Y. Zhuo, M. C. Vu, J. Chim, H. Hu, W. Yu, R. Widyasari, I. N. B. Yusuf, H. Zhan, J. He, I. Paul, et al. Bigcodebench: Benchmarking code generation with diverse function calls and complex instructions. arXiv preprint arXiv:2406.15877, 2024. [find](https://scholar.google.com/scholar?q=T%2E+Y%2E+Zhuo%2C+M%2E+C%2E+Vu%2C+J%2E+Chim%2C+H%2E+Hu%2C+W%2E+Yu%2C+R%2E+Widyasari%2C+I%2E+N%2E+B%2E+Yusuf%2C+H%2E+Zhan%2C+J%2E+He%2C+I%2E+Paul%2C+et+al%2E+Bigcodebench%3A+Benchmarking+code+generation+with+diverse+function+calls+and+complex+instructio) [our card](https://md.research.elamur.ai/free/en/papers/zhuo-2024-bigcodebench-benchmarking-code-generation-diverse/)