---
title: "Who cites ZeRO-Infinity: Breaking the GPU — 200 citing papers"
description: "200 papers of the Elamur Research library cite «ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning», found in their…"
canonical: "https://research.elamur.ai/free/en/papers/rajbhandari-2021-zero-infinity-breaking-gpu-memory/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/rajbhandari-2021-zero-infinity-breaking-gpu-memory/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [ZeRO-Infinity: Breaking the GPU Memory Wall for…](https://md.research.elamur.ai/free/en/papers/rajbhandari-2021-zero-infinity-breaking-gpu-memory/) / cited by

# Who cites «ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning»

200 papers of our library cite it (of the 149,439 whose bibliographies we read) · 25 with a page here, the most cited first · [← back to «ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning»](https://md.research.elamur.ai/free/en/papers/rajbhandari-2021-zero-infinity-breaking-gpu-memory/)

1. [**PaLM: Scaling Language Modeling with Pathways arXiv:2204.02311**Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.*2022 · 4,753 citations*](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)
2. [**On the Opportunities and Risks of Foundation Models arXiv:2108.07258**Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.*2021 · 3,160 citations*](https://md.research.elamur.ai/free/en/papers/bommasani-2021-opportunities-risks-foundation-models/)
3. **[A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/) [Frontiers of Computer Science](https://md.research.elamur.ai/free/en/venues/frontiers-of-computer-science/)**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,875 citations*
4. **[XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale](https://md.research.elamur.ai/free/en/papers/babu-2021-xls-r-self-supervised-cross/) [Interspeech](https://md.research.elamur.ai/free/en/venues/interspeech-usb/)**Arun Babu, Changhan Wang, Andros Tjandra, et al.*2021 · 807 citations*
5. [**Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model arXiv:2201.11990**Shaden Smith, Mostofa Patwary, Brandon Norick, et al.*2022 · 615 citations*](https://md.research.elamur.ai/free/en/papers/smith-2022-using-deepspeed-megatron-train-megatron/)
6. [**FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU arXiv:2303.06865**Ying Sheng, Lianmin Zheng, Binhang Yuan, et al.*2023 · 402 citations*](https://md.research.elamur.ai/free/en/papers/sheng-2023-flexgen-high-throughput-generative-inference/)
7. [**Scaling Speech Technology to 1,000+ Languages arXiv:2305.13516**Vineel Pratap, Andros Tjandra, Bowen Shi, et al.*2023 · 334 citations*](https://md.research.elamur.ai/free/en/papers/pratap-2023-scaling-speech-technology-1-000/)
8. [**Challenges and Applications of Large Language Models arXiv:2307.10169**Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.*2023 · 301 citations*](https://md.research.elamur.ai/free/en/papers/kaddour-2023-challenges-applications-large-language-models/)
9. [**Reducing Activation Recomputation in Large Transformer Models arXiv:2205.05198**Vijay Korthikanti, Jared Casper, Sangkug Lym, et al.*2022 · 273 citations*](https://md.research.elamur.ai/free/en/papers/korthikanti-2022-reducing-activation-recomputation-large-transformer/)
10. [**ToRA: A Tool-Integrated Reasoning Agent for Mathematical Problem Solving arXiv:2309.17452**Zhibin Gou, Zhihong Shao, Yeyun Gong, et al.*2023 · 225 citations*](https://md.research.elamur.ai/free/en/papers/gou-2023-tora-tool-integrated-reasoning-agent/)
11. **[LLM in a flash: Efficient Large Language Model Inference with Limited Memory](https://md.research.elamur.ai/free/en/papers/alizadeh-2024-llm-flash-efficient-large-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, et al.*2024 · 193 citations*
12. [**8-bit Optimizers via Block-wise Quantization arXiv:2110.02861**Tim Dettmers, Mike Lewis, Sam Shleifer, et al.*2021 · 181 citations*](https://md.research.elamur.ai/free/en/papers/dettmers-2021-8-bit-optimizers-block-wise/)
13. [**DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models arXiv:2309.14509**Sam Ade Jacobs, Masahiro Tanaka, Chengming Zhang, et al.*2023 · 162 citations*](https://md.research.elamur.ai/free/en/papers/jacobs-2023-deepspeed-ulysses-system-optimizations-enabling/)
14. **[Full Parameter Fine-tuning for Large Language Models with Limited Resources](https://md.research.elamur.ai/free/en/papers/lv-2024-full-parameter-fine-tuning-large/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Kai Lv, Yuqing Yang, Tengxiao Liu, et al.*2024 · 143 citations*
15. **[Sequence Parallelism: Long Sequence Training from System Perspective](https://md.research.elamur.ai/free/en/papers/li-2023-sequence-parallelism-long-sequence-training/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Shenggui Li, Fuzhao Xue, Chaitanya Baranwal, et al.*2023 · 129 citations*
16. **[AlphaMath Almost Zero: Process Supervision without Process](https://md.research.elamur.ai/free/en/papers/chen-2024-alphamath-almost-zero-process-supervision/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Guoxin Chen, Minpeng Liao, Chengxi Li, et al.*2024 · 120 citations*
17. [**Efficient Large Language Models: A Survey arXiv:2312.03863**Zhongwei Wan, Xin Wang, Che Liu, et al.*2023 · 110 citations*](https://md.research.elamur.ai/free/en/papers/wan-2023-efficient-large-language-models-survey/)
18. [**Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention USENIX ATC 2024**Bin Gao, Zhuomin He, Puru Sharma, et al.*2024 · 105 citations*](https://md.research.elamur.ai/free/en/papers/gao-2024-cost-efficient-large-language-model/)
19. [**FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion arXiv:2406.06858**Li-Wen Chang, Wenlei Bao, Qi Hou, et al.*2024 · 67 citations*](https://md.research.elamur.ai/free/en/papers/chang-2024-flux-fast-software-based-communication/)
20. **[Small LLMs Are Weak Tool Learners: A Multi-LLM Agent](https://md.research.elamur.ai/free/en/papers/shen-2024-small-llms-are-weak-tool/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Weizhou Shen, Chenliang Li, Hongzhan Chen, et al.*2024 · 65 citations*
21. **[MARIO: MAth Reasoning with code Interpreter Output - A Reproducible Pipeline](https://md.research.elamur.ai/free/en/papers/liao-2024-mario-math-reasoning-code-interpreter/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Minpeng Liao, Chengxi Li, Wei Luo, et al.*2024 · 64 citations*
22. **[SciAgent: Tool-augmented Language Models for Scientific Reasoning](https://md.research.elamur.ai/free/en/papers/ma-2024-sciagent-tool-augmented-language-models/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Yubo Ma, Zhibin Gou, Junheng Hao, et al.*2024 · 55 citations*
23. **[Rationale-Guided Distillation for E-Commerce Relevance Classification: Bridging Large Language Models and Lightweight Cross-Encoders](https://md.research.elamur.ai/free/en/papers/agrawal-2025-rationale-guided-distillation-e-commerce/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Sanjay Agrawal, Faizan Ahemad, Vivek Varadarajan Sembium*2025 · 1 citation*
24. **[Joint Optimization of Training Data and Policy in RLHF](https://md.research.elamur.ai/free/en/papers/yu-2026-joint-optimization-training-data-policy/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Zhuohao Yu, Jiali Zeng, Weizheng Gu, et al.*2026*
25. **[Survey on Key Technologies for Large Language Model Pre-training Systems (大语言模型预训练系统关键技术综述)](https://md.research.elamur.ai/free/en/papers/gao-2025-key-technologies-large/) [Journal of Software](https://md.research.elamur.ai/free/en/venues/journal-of-software/)**Yanjie Gao (高彦杰), Yueguo Chen (陈跃国)*2025*

175 more papers of our library cite it; they have no page here yet.

- [← back to](https://md.research.elamur.ai/free/en/papers/rajbhandari-2021-zero-infinity-breaking-gpu-memory/) — ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning