---
title: "Who cites Scaling Laws for Neural — 1,823 citing papers"
description: "1,823 papers of the Elamur Research library cite «Scaling Laws for Neural Language Models», found in their bibliographies · page 1 of 3…"
canonical: "https://research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [Scaling Laws for Neural Language Models](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/) / cited by

# Who cites «Scaling Laws for Neural Language Models»

1,823 papers of our library cite it (of the 141,840 whose bibliographies we read) · 203 with a page here, the most cited first · page 1 of 3 · 1–100 · [← back to «Scaling Laws for Neural Language Models»](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/)

**1** [2](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/cited-by/page/2/) [3](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/cited-by/page/3/) [next →](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/cited-by/page/2/)

1. [**Language Models are Few-Shot Learners arXiv:2005.14165**Tom B. Brown, Benjamin Mann, Nick Ryder, et al.*2020 · 13,703 citations*](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
2. [**Chain-of-Thought Prompting Elicits Reasoning in Large Language Models arXiv:2201.11903**Jason Wei, Xuezhi Wang, Dale Schuurmans, et al.*2022 · 11,308 citations*](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/)
3. [**LLaMA: Open and Efficient Foundation Language Models arXiv:2302.13971**Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.*2023 · 9,472 citations*](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/)
4. [**Learning Transferable Visual Models From Natural Language Supervision arXiv:2103.00020**Alec Radford, Jong Wook Kim, Chris Hallacy, et al.*2021 · 8,328 citations*](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/)
5. [**PaLM: Scaling Language Modeling with Pathways arXiv:2204.02311**Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.*2022 · 4,680 citations*](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)
6. **[DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2025-deepseek-r1-incentivizing-reasoning-capability/) [Nature](https://md.research.elamur.ai/free/en/venues/nature/)**DeepSeek-AI, Daya Guo, Dejian Yang, et al.*2025 · 4,593 citations*
7. [**Training Verifiers to Solve Math Word Problems arXiv:2110.14168**Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, et al.*2021 · 3,680 citations*](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/)
8. [**Measuring Massive Multitask Language Understanding arXiv:2009.03300**Dan Hendrycks, Collin Burns, Steven Basart, et al.*2020 · 3,495 citations*](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/)
9. [**On the Opportunities and Risks of Foundation Models arXiv:2108.07258**Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.*2021 · 3,056 citations*](https://md.research.elamur.ai/free/en/papers/bommasani-2021-opportunities-risks-foundation-models/)
10. **[A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/) [Frontiers of Computer Science](https://md.research.elamur.ai/free/en/venues/frontiers-of-computer-science/)**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,863 citations*
11. [**Evaluating Large Language Models Trained on Code arXiv:2107.03374**Mark Chen, Jerry Tworek, Heewoo Jun, et al.*2021 · 2,548 citations*](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/)
12. [**Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding arXiv:2205.11487**Chitwan Saharia, William Chan, Saurabh Saxena, et al.*2022 · 2,423 citations*](https://md.research.elamur.ai/free/en/papers/saharia-2022-photorealistic-text-image-diffusion-models/)
13. [**Measuring Mathematical Problem Solving With the MATH Dataset arXiv:2103.03874**Dan Hendrycks, Collin Burns, Saurav Kadavath, et al.*2021 · 2,320 citations*](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/)
14. [**Emergent Abilities of Large Language Models arXiv:2206.07682**Jason Wei, Yi Tay, Rishi Bommasani, et al.*2022 · 2,229 citations*](https://md.research.elamur.ai/free/en/papers/wei-2022-emergent-abilities-large-language-models/)
15. [**Flamingo: a Visual Language Model for Few-Shot Learning arXiv:2204.14198**Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.*2022 · 2,118 citations*](https://md.research.elamur.ai/free/en/papers/alayrac-2022-flamingo-visual-language-model-few/)
16. **[TruthfulQA: Measuring How Models Mimic Human Falsehoods](https://md.research.elamur.ai/free/en/papers/lin-2022-truthfulqa-measuring-how-models-mimic/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Stephanie Lin, Jacob Hilton, Owain Evans*2022 · 2,052 citations*
17. **[Training Compute-Optimal Large Language Models](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.*2022 · 1,950 citations*
18. [**Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models arXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5Bvosj**Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.*2022 · 1,703 citations*](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)
19. [**Retrieval-Augmented Generation for Large Language Models: A Survey arXiv:2312.10997**Yunfan Gao, Yun Xiong, Xinyu Gao, et al.*2023 · 1,648 citations*](https://md.research.elamur.ai/free/en/papers/gao-2023-retrieval-augmented-generation-large-language/)
20. **[Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey](https://md.research.elamur.ai/free/en/papers/min-2021-recent-advances-natural-language-processing/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Bonan Min, Hayley Ross, Elior Sulem, et al.*2021 · 1,552 citations*
21. [**Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context arXiv:2403.05530**Gemini Team, Petko Georgiev, Ving Ian Lei, et al.*2024 · 1,522 citations*](https://md.research.elamur.ai/free/en/papers/gemini-team-2024-gemini-1-5-unlocking-multimodal/)
22. [**LAION-5B: An open large-scale dataset for training next generation image-text models arXiv:2210.08402**Christoph Schuhmann, Romain Beaumont, Richard Vencu, et al.*2022 · 1,403 citations*](https://md.research.elamur.ai/free/en/papers/schuhmann-2022-laion-5b-open-large-scale/)
23. [**LaMDA: Language Models for Dialog Applications arXiv:2201.08239**Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.*2022 · 1,326 citations*](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/)
24. **[A Comprehensive Overview of Large Language Models](https://md.research.elamur.ai/free/en/papers/naveed-2023-comprehensive-overview-large-language-models/) [ACM Transactions on Intelligent Systems and Technology](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-intelligent-systems-and-technology/)**Humza Naveed, Asad Ullah Khan, Shi Qiu, et al.*2023 · 1,286 citations*
25. **[The Rise and Potential of Large Language Model Based Agents: A Survey](https://md.research.elamur.ai/free/en/papers/xi-2023-rise-potential-large-language/) [Science China Information Sciences](https://md.research.elamur.ai/free/en/venues/science-china-information-sciences/)**Zhiheng Xi, Wenxiang Chen, Xin Guo, et al.*2023 · 1,264 citations*
26. **[Recipes for Building an Open-Domain Chatbot](https://md.research.elamur.ai/free/en/papers/roller-2021-recipes-building-open-domain-chatbot/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Stephen Roller, Emily Dinan, Naman Goyal, et al.*2021 · 1,208 citations*
27. [**Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone arXiv:2404.14219**Marah Abdin, Jyoti Aneja, Hany Awadalla, et al.*2024 · 1,113 citations*](https://md.research.elamur.ai/free/en/papers/abdin-2024-phi-3-technical-report-highly/)
28. **[Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them](https://md.research.elamur.ai/free/en/papers/suzgun-2023-challenging-big-bench-tasks-whether/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Mirac Suzgun, Nathan Scales, Nathanael Schärli, et al.*2023 · 1,096 citations*
29. [**PaLM 2 Technical Report arXiv:2305.10403**Rohan Anil, Andrew M. Dai, Orhan Firat, et al.*2023 · 977 citations*](https://md.research.elamur.ai/free/en/papers/anil-2023-palm-2-technical-report/)
30. [**Extracting Training Data from Large Language Models arXiv:2012.07805**Nicholas Carlini, Florian Tramer, Eric Wallace, et al.*2020 · 911 citations*](https://md.research.elamur.ai/free/en/papers/carlini-2020-extracting-training-data-large-language/)
31. [**Segment Anything arXiv:2304.02643**Alexander Kirillov, Eric Mintun, Nikhila Ravi, et al.*2023 · 868 citations*](https://md.research.elamur.ai/free/en/papers/kirillov-2023-segment-anything/)
32. **[GPT-NeoX-20B: An Open-Source Autoregressive Language Model](https://md.research.elamur.ai/free/en/papers/black-2022-gpt-neox-20b-open-source/) [BigScience Episode – Workshop on Challenges & Perspectives in Creating Large Language Models](https://md.research.elamur.ai/free/en/venues/bigscience/)**Sidney Black, Stella Biderman, Eric Hallahan, et al.*2022 · 821 citations*
33. [**Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond arXiv:2304.13712**Jingfeng Yang, Hongye Jin, Ruixiang Tang, et al.*2023 · 811 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-harnessing-power-llms-practice-survey/)
34. **[Can Large Language Models Transform Computational Social Science?](https://md.research.elamur.ai/free/en/papers/ziems-2023-large-language-models-transform-computational/) [Computational Linguistics](https://md.research.elamur.ai/free/en/venues/cl/)**Caleb Ziems, William Held, Omar Shaikh, et al.*2023 · 777 citations*
35. **[Reproducible scaling laws for contrastive language-image learning](https://md.research.elamur.ai/free/en/papers/cherti-2022-reproducible-scaling-laws-contrastive-language/) [IEEE Computer Society Conference on Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/venues/ieee-computer-society-conference-on-computer-vision-and-pattern-recognition/)**Mehdi Cherti, Romain Beaumont, Ross Wightman, et al.*2022 · 751 citations*
36. **[AdapterHub: A Framework for Adapting Transformers](https://md.research.elamur.ai/free/en/papers/pfeiffer-2020-adapterhub-framework-adapting-transformers/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, et al.*2020 · 748 citations*
37. **[Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning](https://md.research.elamur.ai/free/en/papers/liu-2022-few-shot-parameter-efficient-fine/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Haokun Liu, Derek Tam, Mohammed Muqeeth, et al.*2022 · 736 citations*
38. [**Capabilities of GPT-4 on Medical Challenge Problems arXiv:2303.13375**Harsha Nori, Nicholas King, Scott Mayer McKinney, et al.*2023 · 711 citations*](https://md.research.elamur.ai/free/en/papers/nori-2023-capabilities-gpt-4-medical-challenge/)
39. [**Large Language Models Are Human-Level Prompt Engineers arXiv:2211.01910**Yongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, et al.*2022 · 678 citations*](https://md.research.elamur.ai/free/en/papers/zhou-2022-large-language-models-human-level/)
40. [**BloombergGPT: A Large Language Model for Finance arXiv:2303.17564**Shijie Wu, Ozan Irsoy, Steven Lu, et al.*2023 · 612 citations*](https://md.research.elamur.ai/free/en/papers/wu-2023-bloomberggpt-large-language-model-finance/)
41. **[s1: Simple test-time scaling](https://md.research.elamur.ai/free/en/papers/muennighoff-2025-s1-simple-test-time-scaling/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Niklas Muennighoff, Zitong Yang, Weijia Shi, et al.*2025 · 584 citations*
42. **[Document Ranking with a Pretrained Sequence-to-Sequence Model](https://md.research.elamur.ai/free/en/papers/nogueira-2020-document-ranking-pretrained-sequence-sequence/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Rodrigo Nogueira, Zhiying Jiang, Ronak Pradeep, et al.*2020 · 540 citations*
43. [**LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs arXiv:2111.02114**Christoph Schuhmann, Richard Vencu, Romain Beaumont, et al.*2021 · 530 citations*](https://md.research.elamur.ai/free/en/papers/schuhmann-2021-laion-400m-open-dataset-clip/)
44. [**Baichuan 2: Open Large-scale Language Models arXiv:2309.10305**Aiyuan Yang, Bin Xiao, Bingning Wang, et al.*2023 · 513 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-baichuan-2-open-large-scale/)
45. **[Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis](https://md.research.elamur.ai/free/en/papers/zhu-2024-multilingual-machine-translation-large-language/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Wenhao Zhu, Hongyi Liu, Qingxiu Dong, et al.*2024 · 503 citations*
46. [**GLaM: Efficient Scaling of Language Models with Mixture-of-Experts arXiv:2112.06905**Nan Du, Yanping Huang, Andrew M. Dai, et al.*2021 · 479 citations*](https://md.research.elamur.ai/free/en/papers/du-2021-glam-efficient-scaling-language-models/)
47. [**Large Language Models: A Survey arXiv:2402.06196**Shervin Minaee, Tomas Mikolov, Narjes Nikzad, et al.*2024 · 468 citations*](https://md.research.elamur.ai/free/en/papers/minaee-2024-large-language-models-survey/)
48. **[XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning](https://md.research.elamur.ai/free/en/papers/ponti-2020-xcopa-multilingual-dataset-causal-commonsense/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Edoardo Maria Ponti, Goran Glavaš, Olga Majewska, et al.*2020 · 465 citations*
49. **[OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems](https://md.research.elamur.ai/free/en/papers/he-2024-olympiadbench-challenging-benchmark-promoting-agi/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Chaoqun He, Renjie Luo, Yuzhuo Bai, et al.*2024 · 448 citations*
50. [**The Falcon Series of Open Language Models arXiv:2311.16867**Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.*2023 · 436 citations*](https://md.research.elamur.ai/free/en/papers/almazrouei-2023-falcon-series-open-language-models/)
51. [**Kimi k1.5: Scaling Reinforcement Learning with LLMs arXiv:2501.12599**Kimi Team, Angang Du, Bofei Gao, et al.*2025 · 413 citations*](https://md.research.elamur.ai/free/en/papers/kimi-team-2025-kimi-k1-5-scaling-reinforcement/)
52. [**Yi: Open Foundation Models by 01.AI arXiv:2403.04652**Alex Young, Bei Chen, Chao Li, et al.*2024 · 402 citations*](https://md.research.elamur.ai/free/en/papers/ai-2024-yi-open-foundation-models-01/)
53. **[LongT5: Efficient Text-To-Text Transformer for Long Sequences](https://md.research.elamur.ai/free/en/papers/guo-2022-longt5-efficient-text-text-transformer/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Mandy Guo, Joshua Ainslie, David Uthus, et al.*2022 · 398 citations*
54. **[A Survey on Model Compression for Large Language Models](https://md.research.elamur.ai/free/en/papers/zhu-2024-survey-model-compression-large-language/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Xunyu Zhu, Jian Li, Yong Liu, et al.*2024 · 381 citations*
55. [**ChatDev: Communicative Agents for Software Development arXiv:2307.07924**Chen Qian, Wei Liu, Hongzhang Liu, et al.*2023 · 373 citations*](https://md.research.elamur.ai/free/en/papers/qian-2023-chatdev-communicative-agents-software/)
56. [**A Survey on Large Language Models for Code Generation arXiv:2406.00515**Juyong Jiang, Fan Wang, Jiasi Shen, et al.*2024 · 366 citations*](https://md.research.elamur.ai/free/en/papers/jiang-2024-survey-large-language-models-code/)
57. [**TinyLlama: An Open-Source Small Language Model arXiv:2401.02385**Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.*2024 · 351 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2024-tinyllama-open-source-small-language/)
58. [**Reformulating Unsupervised Style Transfer as Paraphrase Generation**Kalpesh Krishna, John Wieting, Mohit Iyyer*2020 · 348 citations*](https://md.research.elamur.ai/free/en/papers/krishna-2020-reformulating-unsupervised-style-transfer-as/)
59. **[Toxicity in chatgpt: Analyzing persona-assigned language models](https://md.research.elamur.ai/free/en/papers/deshpande-2023-toxicity-chatgpt-analyzing-persona-assigned/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Ameet Deshpande, Vishvak Murahari, Tanmay Rajpurohit, et al.*2023 · 346 citations*
60. [**Complexity-Based Prompting for Multi-Step Reasoning arXiv:2210.00720**Yao Fu, Hao Peng, Ashish Sabharwal, et al.*2022 · 343 citations*](https://md.research.elamur.ai/free/en/papers/fu-2022-complexity-based-prompting-multi-step/)
61. [**PaLI: A Jointly-Scaled Multilingual Language-Image Model arXiv:2209.06794**Xi Chen, Xiao Wang, Soravit Changpinyo, et al.*2022 · 341 citations*](https://md.research.elamur.ai/free/en/papers/chen-2022-pali-jointly-scaled-multilingual-language/)
62. **[Large Language Models for Information Retrieval: A Survey](https://md.research.elamur.ai/free/en/papers/zhu-2023-large-language-models-information-retrieval/) [ACM Transactions on Information Systems](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-information-systems/)**Yutao Zhu; Huaying Yuan; Shuting Wang; Jiongnan Liu; Wenhan Liu; Chenlong Deng; Haonan Chen; Zheng Liu; Zhicheng Dou;, Ji-Rong Wen*2023 · 335 citations*
63. [**UL2: Unifying Language Learning Paradigms arXiv:2205.05131**Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.*2022 · 335 citations*](https://md.research.elamur.ai/free/en/papers/tay-2022-ul2-unifying-language-learning-paradigms/)
64. [**ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation arXiv:2107.02137**Yu Sun, Shuohuan Wang, Shikun Feng, et al.*2021 · 328 citations*](https://md.research.elamur.ai/free/en/papers/sun-2021-ernie-3-0-large/)
65. **[Are Emergent Abilities of Large Language Models a Mirage?](https://md.research.elamur.ai/free/en/papers/schaeffer-2023-emergent-abilities-large-language-models/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Rylan Schaeffer, Brando Miranda, Sanmi Koyejo*2023 · 323 citations*
66. **[Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding](https://md.research.elamur.ai/free/en/papers/leng-2023-mitigating-object-hallucinations-large-vision/) [IEEE Computer Society Conference on Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/venues/ieee-computer-society-conference-on-computer-vision-and-pattern-recognition/)**Sicong Leng, Hang Zhang, Guanzheng Chen, et al.*2023 · 317 citations*
67. **[Faith and Fate: Limits of Transformers on Compositionality](https://md.research.elamur.ai/free/en/papers/dziri-2023-faith-fate-limits-transformers-compositionality/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Nouha Dziri, Ximing Lu, Melanie Sclar, et al.*2023 · 313 citations*
68. [**MEDITRON-70B: Scaling Medical Pretraining for Large Language Models arXiv:2311.16079**Zeming Chen, Alejandro Hernandez Cano, Angelika Romanou, et al.*2023 · 311 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-meditron-70b-scaling-medical-pretraining/)
69. [**Discovering Language Model Behaviors with Model-Written Evaluations arXiv:2212.09251**Ethan Perez, Sam Ringer, Kamilė Lukošiūtė, et al.*2022 · 307 citations*](https://md.research.elamur.ai/free/en/papers/perez-2022-discovering-language-model-behaviors-model/)
70. [**Carbon Emissions and Large Neural Network Training arXiv:2104.10350**David Patterson, Joseph Gonzalez, Quoc Le, et al.*2021 · 305 citations*](https://md.research.elamur.ai/free/en/papers/patterson-2021-carbon-emissions-large-neural-network/)
71. [**ZeRO-Offload: Democratizing Billion-Scale Model Training arXiv:2101.06840**Jie Ren, Samyam Rajbhandari, Reza Yazdani Aminabadi, et al.*2021 · 303 citations*](https://md.research.elamur.ai/free/en/papers/ren-2021-zero-offload-democratizing-billion-scale/)
72. [**Scaling Laws for Reward Model Overoptimization arXiv:2210.10760**Leo Gao, John Schulman, Jacob Hilton*2022 · 302 citations*](https://md.research.elamur.ai/free/en/papers/gao-2022-scaling-laws-reward-model-overoptimization/)
73. [**Challenges and Applications of Large Language Models arXiv:2307.10169**Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.*2023 · 300 citations*](https://md.research.elamur.ai/free/en/papers/kaddour-2023-challenges-applications-large-language-models/)
74. [**Prompting Large Language Model for Machine Translation: A Case Study arXiv:2301.07069**Biao Zhang, Barry Haddow, Alexandra Birch*2023 · 293 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2023-prompting-large-language-model-machine/)
75. **[Can language models learn from explanations in context?](https://md.research.elamur.ai/free/en/papers/lampinen-2022-can-language-models-learn-explanations/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Andrew Lampinen, Ishita Dasgupta, Stephanie Chan, et al.*2022 · 290 citations*
76. [**On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes arXiv:2306.13649**Rishabh Agarwal, Nino Vieillard, Yongchao Zhou, et al.*2023 · 288 citations*](https://md.research.elamur.ai/free/en/papers/agarwal-2023-policy-distillation-language-models-learning/)
77. [**Generate rather than Retrieve: Large Language Models are Strong Context Generators arXiv:2209.10063**Wenhao Yu, Dan Iter, Shuohang Wang, et al.*2022 · 280 citations*](https://md.research.elamur.ai/free/en/papers/yu-2022-generate-rather-than-retrieve-large/)
78. [**Llemma: An Open Language Model For Mathematics arXiv:2310.10631**Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.*2023 · 276 citations*](https://md.research.elamur.ai/free/en/papers/azerbayev-2023-llemma-open-language-model-mathematics/)
79. **[The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants](https://md.research.elamur.ai/free/en/papers/bandarkar-2023-belebele-benchmark-parallel-reading-comprehension/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Lucas Bandarkar, Davis Liang, Benjamin Muller, et al.*2023 · 259 citations*
80. [**MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies arXiv:2404.06395**Shengding Hu, Yuge Tu, Xu Han, et al.*2024 · 258 citations*](https://md.research.elamur.ai/free/en/papers/hu-2024-minicpm-unveiling-potential-small-language/)
81. [**Scaling Laws for Autoregressive Generative Modeling arXiv:2010.14701**Tom Henighan, Jared Kaplan, Mor Katz, et al.*2020 · 257 citations*](https://md.research.elamur.ai/free/en/papers/henighan-2020-scaling-laws-autoregressive-generative-modeling/)
82. [**DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale arXiv:2201.05596**Samyam Rajbhandari, Conglong Li, Zhewei Yao, et al.*2022 · 255 citations*](https://md.research.elamur.ai/free/en/papers/rajbhandari-2022-deepspeed-moe-advancing-mixture-experts/)
83. [**LexGLUE: A Benchmark Dataset for Legal Language Understanding in English arXiv:2110.00976**Ilias Chalkidis; Abhik Jana; Dirk Hartung; Michael Bommarito; Ion Androutsopoulos; Daniel Martin Katz;, Nikolaos Aletras*2021 · 254 citations*](https://md.research.elamur.ai/free/en/papers/chalkidis-2021-lexglue-benchmark-dataset-legal-language/)
84. [**Scaling Relationship on Learning Mathematical Reasoning with Large Language Models arXiv:2308.01825**Zheng Yuan, Hongyi Yuan, Chengpeng Li, et al.*2023 · 252 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2023-scaling-relationship-learning-mathematical-reasoning/)
85. [**Personality Traits in Large Language Models arXiv:2307.00184**Greg Serapio-Garcia, Mustafa Safdari, Clement Crepy, et al.*2023 · 251 citations*](https://md.research.elamur.ai/free/en/papers/serapio-garcia-2023-personality-traits-large-language-models/)
86. [**Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicity arXiv:2301.12867**Terry Yue Zhuo, Yujin Huang, Chunyang Chen, et al.*2023 · 246 citations*](https://md.research.elamur.ai/free/en/papers/zhuo-2023-red-teaming-chatgpt-jailbreaking-bias/)
87. **[NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark](https://md.research.elamur.ai/free/en/papers/sainz-2023-nlp-evaluation-trouble-need-measure/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Oscar Sainz, Jon Campos, Iker García-Ferrero, et al.*2023 · 245 citations*
88. [**Perceiver: General Perception with Iterative Attention arXiv:2103.03206**Andrew Jaegle, Felix Gimeno, Andrew Brock, et al.*2021 · 242 citations*](https://md.research.elamur.ai/free/en/papers/jaegle-2021-perceiver-general-perception-iterative-attention/)
89. [**Large Language Monkeys: Scaling Inference Compute with Repeated Sampling arXiv:2407.21787**Bradley Brown, Jordan Juravsky, Ryan Ehrlich, et al.*2024 · 241 citations*](https://md.research.elamur.ai/free/en/papers/brown-2024-large-language-monkeys-scaling-inference/)
90. **[Translation between Molecules and Natural Language](https://md.research.elamur.ai/free/en/papers/edwards-2022-translation-between-molecules-natural-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Carl Edwards, Tuan Lai, Kevin Ros, et al.*2022 · 236 citations*
91. [**TrustLLM: Trustworthiness in Large Language Models arXiv:2401.05561**Yue Huang, Lichao Sun, Haoran Wang, et al.*2024 · 226 citations*](https://md.research.elamur.ai/free/en/papers/huang-2024-trustllm-trustworthiness-large-language-models/)
92. [**Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting arXiv:2305.07004**Haoyang Huang, Tianyi Tang, Dongdong Zhang, et al.*2023 · 224 citations*](https://md.research.elamur.ai/free/en/papers/huang-2023-all-languages-created-equal-llms/)
93. **[GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical Information](https://md.research.elamur.ai/free/en/papers/jin-2023-genegpt-augmenting-large-language-models/) [Bioinformatics](https://md.research.elamur.ai/free/en/venues/bioinformatics/)**Qiao Jin, Yifan Yang, Qingyu Chen, et al.*2023 · 222 citations*
94. [**Specializing Smaller Language Models towards Multi-Step Reasoning arXiv:2301.12726**Yao Fu, Hao Peng, Litu Ou, et al.*2023 · 222 citations*](https://md.research.elamur.ai/free/en/papers/fu-2023-specializing-smaller-language-models-towards/)
95. **[Beyond neural scaling laws: beating power law scaling via data pruning](https://md.research.elamur.ai/free/en/papers/sorscher-2022-neural-scaling-laws-beating-power/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Ben Sorscher, Robert Geirhos, Shashank Shekhar, et al.*2022 · 220 citations*
96. **[Transformer Memory as a Differentiable Search Index](https://md.research.elamur.ai/free/en/papers/tay-2022-transformer-memory-differentiable-search-index/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Yi Tay, Vinh Q. Tran, Mostafa Dehghani, et al.*2022 · 220 citations*
97. [**Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Models arXiv:2308.16149**Neha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.*2023 · 217 citations*](https://md.research.elamur.ai/free/en/papers/sengupta-2023-jais-jais-chat-arabic-centric/)
98. [**Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch arXiv:2311.03099**Le Yu, Bowen Yu, Haiyang Yu, et al.*2023 · 210 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-language-models-super-mario-absorbing/)
99. [**Prompting GPT-3 To Be Reliable arXiv:2210.09150**Chenglei Si, Zhe Gan, Zhengyuan Yang, et al.*2022 · 207 citations*](https://md.research.elamur.ai/free/en/papers/si-2022-prompting-gpt-3-reliable/)
100. [**LIMO: Less is More for Reasoning arXiv:2502.03387**Yixin Ye, Zhen Huang, Yang Xiao, et al.*2025 · 204 citations*](https://md.research.elamur.ai/free/en/papers/ye-2025-limo-less-more-reasoning/)

**1** [2](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/cited-by/page/2/) [3](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/cited-by/page/3/) [next →](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/cited-by/page/2/)

- [← back to](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/) — Scaling Laws for Neural Language Models