---
title: "Who cites Sophia: A Scalable Stochastic — 42 citing papers"
description: "42 papers of the Elamur Research library cite «Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training»…"
canonical: "https://research.elamur.ai/free/en/papers/liu-2023-sophia-scalable-stochastic-second-order/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liu-2023-sophia-scalable-stochastic-second-order/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [Sophia: A Scalable Stochastic Second-order…](https://md.research.elamur.ai/free/en/papers/liu-2023-sophia-scalable-stochastic-second-order/) / cited by

# Who cites «Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training»

42 papers of our library cite it (of the 149,439 whose bibliographies we read) · 7 with a page here, the most cited first · [← back to «Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training»](https://md.research.elamur.ai/free/en/papers/liu-2023-sophia-scalable-stochastic-second-order/)

1. [**Efficient Large Language Models: A Survey arXiv:2312.03863**Zhongwei Wan, Xin Wang, Che Liu, et al.*2023 · 110 citations*](https://md.research.elamur.ai/free/en/papers/wan-2023-efficient-large-language-models-survey/)
2. [**Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security arXiv:2401.05459**Yuanchun Li, Hao Wen, Weijun Wang, et al.*2024 · 100 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-personal-llm-agents-insights-survey/)
3. **[SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning](https://md.research.elamur.ai/free/en/papers/jia-2024-soul-unlocking-power-second-order/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jinghan Jia, Yihua Zhang, Yimeng Zhang, et al.*2024 · 46 citations*
4. [**A Survey of Small Language Models arXiv:2410.20011**Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.*2024 · 31 citations*](https://md.research.elamur.ai/free/en/papers/nguyen-2024-survey-small-language-models/)
5. [**No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models arXiv:2307.06440**Jean Kaddour, Oscar Key, Piotr Nawrot, et al.*2023 · 30 citations*](https://md.research.elamur.ai/free/en/papers/kaddour-2023-no-train-no-gain-revisiting/)
6. [**MiniPLM: Knowledge Distillation for Pre-Training Language Models arXiv:2410.17215**Yuxian Gu, Hao Zhou, Fandong Meng, et al.*2024 · 12 citations*](https://md.research.elamur.ai/free/en/papers/gu-2024-miniplm-knowledge-distillation-pre-training/)
7. **[HTMuon: Improving Muon via Heavy-Tailed Spectral Correction](https://md.research.elamur.ai/free/en/papers/pang-2026-htmuon-improving-muon-heavy-tailed/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Tianyu Pang, Yujie Fang, Zihang Liu, et al.*2026 · 2 citations*

35 more papers of our library cite it; they have no page here yet.

- [← back to](https://md.research.elamur.ai/free/en/papers/liu-2023-sophia-scalable-stochastic-second-order/) — Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training