---
title: "Who cites Training Compute-Optimal Large Language Models"
description: "1,110 papers of the Elamur Research library cite «Training Compute-Optimal Large Language Models», found in their bibliographies · page 1 of 2 · 1–100…"
canonical: "https://research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [Training Compute-Optimal Large Language Models](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/) / cited by

# Who cites «Training Compute-Optimal Large Language Models»

1,110 papers of our library cite it (of the 140,884 whose bibliographies we read) · 150 with a page here, the most cited first · page 1 of 2 · 1–100 · [← the paper](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/)

**1** [2](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/cited-by/page/2/) [next →](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/cited-by/page/2/)

1. [**LLaMA: Open and Efficient Foundation Language Models**Hugo Touvron, Thibaut Lavril, Gautier Izacard, et al.*2023 · 5,609 citations*](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/)
2. [**Gemini: A Family of Highly Capable Multimodal Models**Gemini Team, Rohan Anil, Sebastian Borgeaud, et al.*2023 · 2,951 citations*](https://md.research.elamur.ai/free/en/papers/gemini-team-2023-gemini-family-highly-capable-multimodal/)
3. [**A Survey of Large Language Models**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,847 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/)
4. [**PaLM: Scaling Language Modeling with Pathways**Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.*2022 · 2,603 citations*](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)
5. [**Emergent Abilities of Large Language Models**Jason Wei, Yi Tay, Rishi Bommasani, et al.*2022 · 2,215 citations*](https://md.research.elamur.ai/free/en/papers/wei-2022-emergent-abilities-large-language-models/)
6. [**Scaling Instruction-Finetuned Language Models**Hyung Won Chung, Le Hou, Shayne Longpre, et al.*2022 · 2,176 citations*](https://md.research.elamur.ai/free/en/papers/chung-2022-scaling-instruction-finetuned-language-models/)
7. [**BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models**Junnan Li, Dongxu Li, Silvio Savarese, et al.*2023 · 2,114 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-blip-2-bootstrapping-language-image/)
8. [**Flamingo: a Visual Language Model for Few-Shot Learning**Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, et al.*2022 · 2,108 citations*](https://md.research.elamur.ai/free/en/papers/alayrac-2022-flamingo-visual-language-model-few/)
9. [**OPT: Open Pre-trained Transformer Language Models**Susan Zhang, Stephen Roller, Naman Goyal, et al.*2022 · 1,709 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2022-opt-open-pre-trained-transformer/)
10. [**Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models**Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.*2022 · 1,695 citations*](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)
11. [**Qwen Technical Report**Jinze Bai, Shuai Bai, Yunfei Chu, et al.*2023 · 1,643 citations*](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/)
12. [**Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context**Gemini Team, Petko Georgiev, Ving Ian Lei, et al.*2024 · 1,522 citations*](https://md.research.elamur.ai/free/en/papers/gemini-team-2024-gemini-1-5-unlocking-multimodal/)
13. [**DINOv2: Learning Robust Visual Features without Supervision**Maxime Oquab, Timothee Darcet, Theo Moutakanni, et al.*2023 · 1,425 citations*](https://md.research.elamur.ai/free/en/papers/oquab-2023-dinov2-learning-robust-visual-features/)
14. [**Code Llama: Open Foundation Models for Code**Baptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.*2024 · 1,399 citations*](https://md.research.elamur.ai/free/en/papers/roziere-2024-code-llama-open-foundation-models/)
15. [**A Comprehensive Overview of Large Language Models**Humza Naveed, Asad Ullah Khan, Shi Qiu, et al.*2023 · 1,286 citations*](https://md.research.elamur.ai/free/en/papers/naveed-2023-comprehensive-overview-large-language-models/)
16. [**Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone**Marah Abdin, Jyoti Aneja, Hany Awadalla, et al.*2024 · 1,113 citations*](https://md.research.elamur.ai/free/en/papers/abdin-2024-phi-3-technical-report-highly/)
17. [**MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models**Deyao Zhu, Jun Chen, Xiaoqian Shen, et al.*2023 · 1,105 citations*](https://md.research.elamur.ai/free/en/papers/zhu-2023-minigpt-4-enhancing-vision-language/)
18. [**Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them**Mirac Suzgun, Nathan Scales, Nathanael Schärli, et al.*2023 · 1,094 citations*](https://md.research.elamur.ai/free/en/papers/suzgun-2023-challenging-big-bench-tasks-whether/)
19. [**Solving Quantitative Reasoning Problems with Language Models**Aitor Lewkowycz, Anders Andreassen, David Dohan, et al.*2022 · 973 citations*](https://md.research.elamur.ai/free/en/papers/lewkowycz-2022-solving-quantitative-reasoning-problems-language/)
20. [**PaLM 2 Technical Report**Rohan Anil, Andrew M. Dai, Orhan Firat, et al.*2023 · 971 citations*](https://md.research.elamur.ai/free/en/papers/anil-2023-palm-2-technical-report/)
21. [**C-Pack: Packed Resources For General Chinese Embeddings**Shitao Xiao, Zheng Liu, Peitian Zhang, et al.*2023 · 920 citations*](https://md.research.elamur.ai/free/en/papers/xiao-2023-c-pack-packed-resources/)
22. [**A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity**Yejin Bang, Samuel Cahyawijaya, Nayeon Lee, et al.*2023 · 866 citations*](https://md.research.elamur.ai/free/en/papers/bang-2023-multitask-multilingual-multimodal-evaluation-chatgpt/)
23. [**Segment Anything**Alexander Kirillov, Eric Mintun, Nikhila Ravi, et al.*2023 · 865 citations*](https://md.research.elamur.ai/free/en/papers/kirillov-2023-segment-anything/)
24. [**Is ChatGPT a General-Purpose Natural Language Processing Task Solver?**Chengwei Qin, Aston Zhang, Zhuosheng Zhang, et al.*2023 · 818 citations*](https://md.research.elamur.ai/free/en/papers/qin-2023-chatgpt-general-purpose-natural-language/)
25. [**GPT-NeoX-20B: An Open-Source Autoregressive Language Model**Sidney Black, Stella Biderman, Eric Hallahan, et al.*2022 · 818 citations*](https://md.research.elamur.ai/free/en/papers/black-2022-gpt-neox-20b-open-source/)
26. [**Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond**Jingfeng Yang, Hongye Jin, Ruixiang Tang, et al.*2023 · 806 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-harnessing-power-llms-practice-survey/)
27. [**Can Large Language Models Transform Computational Social Science?**Caleb Ziems, William Held, Omar Shaikh, et al.*2023 · 776 citations*](https://md.research.elamur.ai/free/en/papers/ziems-2023-large-language-models-transform-computational/)
28. [**GLM-130B: An Open Bilingual Pre-trained Model**Aohan Zeng, Xiao Liu, Zhengxiao Du, et al.*2022 · 775 citations*](https://md.research.elamur.ai/free/en/papers/zeng-2022-glm-130b-open-bilingual-pre/)
29. [**Reproducible scaling laws for contrastive language-image learning**Mehdi Cherti, Romain Beaumont, Ross Wightman, et al.*2022 · 750 citations*](https://md.research.elamur.ai/free/en/papers/cherti-2022-reproducible-scaling-laws-contrastive-language/)
30. [**Crosslingual Generalization through Multitask Finetuning**Niklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.*2022 · 692 citations*](https://md.research.elamur.ai/free/en/papers/muennighoff-2022-crosslingual-generalization-through-multitask-finetuning/)
31. [**CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society**Guohao Li, Hasan Abed Al Kader Hammoud, Hani Itani, et al.*2023 · 689 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-camel-communicative-agents-mind/)
32. [**Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes**Cheng-Yu Hsieh, Chun-Liang Li, Chih-kuan Yeh, et al.*2023 · 684 citations*](https://md.research.elamur.ai/free/en/papers/hsieh-2023-distilling-step-step-outperforming-larger/)
33. [**The Flan Collection: Designing Data and Methods for Effective Instruction Tuning**Shayne Longpre, Le Hou, Tu Vu, et al.*2023 · 590 citations*](https://md.research.elamur.ai/free/en/papers/longpre-2023-flan-collection-designing-data-methods/)
34. [**s1: Simple test-time scaling**Niklas Muennighoff, Zitong Yang, Weijia Shi, et al.*2025 · 584 citations*](https://md.research.elamur.ai/free/en/papers/muennighoff-2025-s1-simple-test-time-scaling/)
35. [**Galactica: A Large Language Model for Science**Ross Taylor, Marcin Kardas, Guillem Cucurull, et al.*2022 · 558 citations*](https://md.research.elamur.ai/free/en/papers/taylor-2022-galactica-large-language-model-science/)
36. [**Precise Zero-Shot Dense Retrieval without Relevance Labels**Luyu Gao, Xueguang Ma, Jimmy Lin, et al.*2022 · 545 citations*](https://md.research.elamur.ai/free/en/papers/gao-2022-precise-zero-shot-dense-retrieval/)
37. [**Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters**Charlie Snell, Jaehoon Lee, Kelvin Xu, et al.*2024 · 524 citations*](https://md.research.elamur.ai/free/en/papers/snell-2024-scaling-llm-test-time-compute/)
38. [**Baichuan 2: Open Large-scale Language Models**Aiyuan Yang, Bin Xiao, Bingning Wang, et al.*2023 · 512 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-baichuan-2-open-large-scale/)
39. [**REPLUG: Retrieval-Augmented Black-Box Language Models**Weijia Shi, Sewon Min, Michihiro Yasunaga, et al.*2023 · 482 citations*](https://md.research.elamur.ai/free/en/papers/shi-2023-replug-retrieval-augmented-black-box/)
40. [**LLM-Pruner: On the Structural Pruning of Large Language Models**Xinyin Ma, Gongfan Fang, Xinchao Wang*2023 · 447 citations*](https://md.research.elamur.ai/free/en/papers/ma-2023-llm-pruner-structural-pruning-large/)
41. [**GPT-NER: Named Entity Recognition via Large Language Models**Shuhe Wang, Xiaofei Sun, Xiaoya Li, et al.*2025 · 436 citations*](https://md.research.elamur.ai/free/en/papers/wang-2025-gpt-ner-named-entity-recognition/)
42. [**The Falcon Series of Open Language Models**Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.*2023 · 436 citations*](https://md.research.elamur.ai/free/en/papers/almazrouei-2023-falcon-series-open-language-models/)
43. [**C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models**Yuzhen Huang, Yuzhuo Bai, Zhihao Zhu, et al.*2023 · 427 citations*](https://md.research.elamur.ai/free/en/papers/huang-2023-c-eval-multi-level-multi/)
44. [**Kimi k1.5: Scaling Reinforcement Learning with LLMs**Kimi Team, Angang Du, Bofei Gao, et al.*2025 · 413 citations*](https://md.research.elamur.ai/free/en/papers/kimi-team-2025-kimi-k1-5-scaling-reinforcement/)
45. [**The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale**Guilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.*2024 · 404 citations*](https://md.research.elamur.ai/free/en/papers/penedo-2024-fineweb-datasets-decanting-web-finest/)
46. [**AgentBench: Evaluating LLMs as Agents**Xiao Liu, Hao Yu, Hanchen Zhang, et al.*2023 · 404 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-agentbench-evaluating-llms-agents/)
47. [**Yi: Open Foundation Models by 01.AI**Alex Young, Bei Chen, Chao Li, et al.*2024 · 402 citations*](https://md.research.elamur.ai/free/en/papers/ai-2024-yi-open-foundation-models-01/)
48. [**Editing Models with Task Arithmetic**Gabriel Ilharco, Marco Tulio Ribeiro, Mitchell Wortsman, et al.*2022 · 374 citations*](https://md.research.elamur.ai/free/en/papers/ilharco-2022-editing-models-task-arithmetic/)
49. [**Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations**Hakan Inan, Kartikeya Upasani, Jianfeng Chi, et al.*2023 · 369 citations*](https://md.research.elamur.ai/free/en/papers/inan-2023-llama-guard-llm-based-input/)
50. [**VILA: On Pre-training for Visual Language Models**Ji Lin, Hongxu Yin, Wei Ping, et al.*2023 · 367 citations*](https://md.research.elamur.ai/free/en/papers/lin-2023-vila-pre-training-visual-language/)
51. [**A Survey on Large Language Models for Code Generation**Juyong Jiang, Fan Wang, Jiasi Shen, et al.*2024 · 366 citations*](https://md.research.elamur.ai/free/en/papers/jiang-2024-survey-large-language-models-code/)
52. [**Augmented Language Models: a Survey**Grégoire Mialon, Roberto Dessì, Maria Lomeli, et al.*2023 · 362 citations*](https://md.research.elamur.ai/free/en/papers/mialon-2023-augmented-language-models-survey/)
53. [**TinyLlama: An Open-Source Small Language Model**Peiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.*2024 · 350 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2024-tinyllama-open-source-small-language/)
54. [**Improving alignment of dialogue agents via targeted human judgements**Amelia Glaese, Nat McAleese, Maja Trębacz, et al.*2022 · 346 citations*](https://md.research.elamur.ai/free/en/papers/glaese-2022-improving-alignment-dialogue-agents-targeted/)
55. [**PaLI: A Jointly-Scaled Multilingual Language-Image Model**Xi Chen, Xiao Wang, Soravit Changpinyo, et al.*2022 · 339 citations*](https://md.research.elamur.ai/free/en/papers/chen-2022-pali-jointly-scaled-multilingual-language/)
56. [**Solving math word problems with process- and outcome-based feedback**Jonathan Uesato, Nate Kushman, Ramana Kumar, et al.*2022 · 334 citations*](https://md.research.elamur.ai/free/en/papers/uesato-2022-solving-math-word-problems-process/)
57. [**MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities**Weihao Yu, Zhengyuan Yang, Linjie Li, et al.*2023 · 328 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-mm-vet-evaluating-large-multimodal/)
58. [**Are Emergent Abilities of Large Language Models a Mirage?**Rylan Schaeffer, Brando Miranda, Sanmi Koyejo*2023 · 323 citations*](https://md.research.elamur.ai/free/en/papers/schaeffer-2023-emergent-abilities-large-language-models/)
59. [**MEDITRON-70B: Scaling Medical Pretraining for Large Language Models**Zeming Chen, Alejandro Hernandez Cano, Angelika Romanou, et al.*2023 · 307 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-meditron-70b-scaling-medical-pretraining/)
60. [**The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)**Zhengyuan Yang, Linjie Li, Kevin Lin, et al.*2023 · 303 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-dawn-lmms-preliminary-explorations-gpt/)
61. [**PromptRobust: Towards Evaluating the Robustness of Large Language Models on Adversarial Prompts**Kaijie Zhu, Jindong Wang, Jiaheng Zhou, et al.*2023 · 301 citations*](https://md.research.elamur.ai/free/en/papers/zhu-2023-promptrobust-towards-evaluating-robustness-large/)
62. [**Can language models learn from explanations in context?**Andrew Lampinen, Ishita Dasgupta, Stephanie Chan, et al.*2022 · 288 citations*](https://md.research.elamur.ai/free/en/papers/lampinen-2022-can-language-models-learn-explanations/)
63. [**Generate rather than Retrieve: Large Language Models are Strong Context Generators**Wenhao Yu, Dan Iter, Shuohang Wang, et al.*2022 · 280 citations*](https://md.research.elamur.ai/free/en/papers/yu-2022-generate-rather-than-retrieve-large/)
64. [**LLM-QAT: Data-Free Quantization Aware Training for Large Language Models**Zechun Liu, Barlas Oguz, Changsheng Zhao, et al.*2024 · 275 citations*](https://md.research.elamur.ai/free/en/papers/liu-2024-llm-qat-data-free-quantization/)
65. [**Llemma: An Open Language Model For Mathematics**Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.*2023 · 275 citations*](https://md.research.elamur.ai/free/en/papers/azerbayev-2023-llemma-open-language-model-mathematics/)
66. [**Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads**Tianle Cai, Yuhong Li, Zhengyang Geng, et al.*2024 · 271 citations*](https://md.research.elamur.ai/free/en/papers/cai-2024-medusa-simple-llm-inference-acceleration/)
67. [**MiniCPM-V: A GPT-4V Level MLLM on Your Phone**Yuan Yao, Tianyu Yu, Ao Zhang, et al.*2024 · 267 citations*](https://md.research.elamur.ai/free/en/papers/yao-2024-minicpm-v-gpt-4v/)
68. [**MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies**Shengding Hu, Yuge Tu, Xu Han, et al.*2024 · 258 citations*](https://md.research.elamur.ai/free/en/papers/hu-2024-minicpm-unveiling-potential-small-language/)
69. [**GPT-RE: In-context Learning for Relation Extraction using Large Language Models**Zhen Wan, Fei Cheng, Zhuoyuan Mao, et al.*2023 · 252 citations*](https://md.research.elamur.ai/free/en/papers/wan-2023-gpt-re-context-learning-relation/)
70. [**Scaling Relationship on Learning Mathematical Reasoning with Large Language Models**Zheng Yuan, Hongyi Yuan, Chengpeng Li, et al.*2023 · 252 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2023-scaling-relationship-learning-mathematical-reasoning/)
71. [**Large Language Monkeys: Scaling Inference Compute with Repeated Sampling**Bradley Brown, Jordan Juravsky, Ryan Ehrlich, et al.*2024 · 241 citations*](https://md.research.elamur.ai/free/en/papers/brown-2024-large-language-monkeys-scaling-inference/)
72. [**RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment**Hanze Dong, Wei Xiong, Deepanshu Goyal, et al.*2023 · 239 citations*](https://md.research.elamur.ai/free/en/papers/dong-2023-raft-reward-ranked-finetuning-generative/)
73. [**TrustLLM: Trustworthiness in Large Language Models**Yue Huang, Lichao Sun, Haoran Wang, et al.*2024 · 226 citations*](https://md.research.elamur.ai/free/en/papers/huang-2024-trustllm-trustworthiness-large-language-models/)
74. [**Specializing Smaller Language Models towards Multi-Step Reasoning**Yao Fu, Hao Peng, Litu Ou, et al.*2023 · 222 citations*](https://md.research.elamur.ai/free/en/papers/fu-2023-specializing-smaller-language-models-towards/)
75. [**Beyond neural scaling laws: beating power law scaling via data pruning**Ben Sorscher, Robert Geirhos, Shashank Shekhar, et al.*2022 · 220 citations*](https://md.research.elamur.ai/free/en/papers/sorscher-2022-neural-scaling-laws-beating-power/)
76. [**Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Models**Neha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.*2023 · 217 citations*](https://md.research.elamur.ai/free/en/papers/sengupta-2023-jais-jais-chat-arabic-centric/)
77. [**Distilling Reasoning Capabilities into Smaller Language Models**Kumar Shridhar, Alessandro Stolfo, Mrinmaya Sachan*2023 · 216 citations*](https://md.research.elamur.ai/free/en/papers/shridhar-2023-distilling-reasoning-capabilities-into-smaller/)
78. [**Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch**Le Yu, Bowen Yu, Haiyang Yu, et al.*2023 · 209 citations*](https://md.research.elamur.ai/free/en/papers/yu-2023-language-models-super-mario-absorbing/)
79. [**PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Change**Karthik Valmeekam, Matthew Marquez, Alberto Olmo, et al.*2022 · 209 citations*](https://md.research.elamur.ai/free/en/papers/valmeekam-2022-planbench-extensible-benchmark-evaluating-large/)
80. [**mGPT: Few-Shot Learners Go Multilingual**Oleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.*2022 · 203 citations*](https://md.research.elamur.ai/free/en/papers/shliazhko-2022-mgpt-few-shot-learners-go/)
81. [**TinyStories: How Small Can Language Models Be and Still Speak Coherent English?**Ronen Eldan, Yuanzhi Li*2023 · 202 citations*](https://md.research.elamur.ai/free/en/papers/eldan-2023-tinystories-small-language-models-still/)
82. [**Autoformalization with Large Language Models**Yuhuai Wu, Albert Q. Jiang, Wenda Li, et al.*2022 · 202 citations*](https://md.research.elamur.ai/free/en/papers/wu-2022-autoformalization-large-language-models/)
83. [**A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets**Md Tahmid Rahman Laskar, M Saiful Bari, Mizanur Rahman, et al.*2023 · 198 citations*](https://md.research.elamur.ai/free/en/papers/laskar-2023-systematic-study-comprehensive-evaluation-chatgpt/)
84. [**Scalable Extraction of Training Data from (Production) Language Models**Milad Nasr, Nicholas Carlini, Jonathan Hayase, et al.*2023 · 197 citations*](https://md.research.elamur.ai/free/en/papers/nasr-2023-scalable-extraction-training-data-production/)
85. [**RRHF: Rank Responses to Align Language Models with Human Feedback without tears**Zheng Yuan, Hongyi Yuan, Chuanqi Tan, et al.*2023 · 194 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2023-rrhf-rank-responses-align-language/)
86. [**MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning**Jun Chen, Deyao Zhu, Xiaoqian Shen, et al.*2023 · 192 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-minigpt-v2-large-language-model/)
87. [**RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval**Parth Sarthi, Salman Abdullah, Aditi Tuli, et al.*2024 · 191 citations*](https://md.research.elamur.ai/free/en/papers/sarthi-2024-raptor-recursive-abstractive-processing-tree/)
88. [**OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents**Hugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.*2023 · 183 citations*](https://md.research.elamur.ai/free/en/papers/lauren-ccon-2023-obelics-open-web-scale-filtered/)
89. [**Knowledge Conflicts for LLMs: A Survey**Rongwu Xu, Zehan Qi, Zhijiang Guo, et al.*2024 · 179 citations*](https://md.research.elamur.ai/free/en/papers/xu-2024-knowledge-conflicts-llms-survey/)
90. [**Effective Long-Context Scaling of Foundation Models**Wenhan Xiong, Jingyu Liu, Igor Molybog, et al.*2023 · 177 citations*](https://md.research.elamur.ai/free/en/papers/xiong-2023-effective-long-context-scaling-foundation/)
91. [**Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs**Shengbang Tong, Ellis Brown, Penghao Wu, et al.*2024 · 173 citations*](https://md.research.elamur.ai/free/en/papers/tong-2024-cambrian-1-fully-open-vision/)
92. [**SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language Model**Loubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.*2025 · 171 citations*](https://md.research.elamur.ai/free/en/papers/allal-2025-smollm2-smol-goes-big-data/)
93. [**OpenChat: Advancing Open-source Language Models with Mixed-Quality Data**Guan Wang, Sijie Cheng, Xianyuan Zhan, et al.*2023 · 171 citations*](https://md.research.elamur.ai/free/en/papers/wang-2023-openchat-advancing-open-source-language/)
94. [**Learning to Compress Prompts with Gist Tokens**Jesse Mu, Xiang Lisa Li, Noah Goodman*2023 · 170 citations*](https://md.research.elamur.ai/free/en/papers/mu-2023-learning-compress-prompts-gist-tokens/)
95. [**SqueezeLLM: Dense-and-Sparse Quantization**Sehoon Kim, Coleman Hooper, Amir Gholami, et al.*2023 · 168 citations*](https://md.research.elamur.ai/free/en/papers/kim-2023-squeezellm-dense-sparse-quantization/)
96. [**ShortGPT: Layers in Large Language Models are More Redundant Than You Expect**Xin Men, Mingyu Xu, Qingyu Zhang, et al.*2024 · 167 citations*](https://md.research.elamur.ai/free/en/papers/men-2024-shortgpt-layers-large-language-models/)
97. [**Binding Language Models in Symbolic Languages**Zhoujun Cheng, Tianbao Xie, Peng Shi, et al.*2022 · 165 citations*](https://md.research.elamur.ai/free/en/papers/cheng-2022-binding-language-models-symbolic-languages/)
98. [**Large Language Diffusion Models**Shen Nie, Fengqi Zhu, Zebin You, et al.*2025 · 164 citations*](https://md.research.elamur.ai/free/en/papers/nie-2025-large-language-diffusion-models/)
99. [**DataComp-LM: In search of the next generation of training sets for language models**Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.*2024 · 156 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-datacomp-lm-search-next-generation/)
100. [**HunyuanVideo: A Systematic Framework For Large Video Generative Models**Weijie Kong, Qi Tian, Zijian Zhang, et al.*2024 · 155 citations*](https://md.research.elamur.ai/free/en/papers/kong-2024-hunyuanvideo-systematic-framework-large/)

**1** [2](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/cited-by/page/2/) [next →](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/cited-by/page/2/)

- [← back to](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/) — Training Compute-Optimal Large Language Models