---
title: "Who cites Zhao Song — 276 papers of our library"
description: "276 papers of the Elamur Research library cite the works of Zhao Song, found in their bibliographies; the most cited first."
canonical: "https://research.elamur.ai/free/en/authors/zhao-song/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/zhao-song/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Zhao Song](https://md.research.elamur.ai/free/en/authors/zhao-song/) / cited by

# Who cites Zhao Song

289 citations of their works from 276 papers of our library (of the 149,439 whose bibliographies we read) · 45 with a page here, the most cited first · [← Zhao Song](https://md.research.elamur.ai/free/en/authors/zhao-song/)

1. [**A Survey on In-context Learning arXiv:2301.00234**Qingxiu Dong, Lei Li, Damai Dai, et al.*2023 · 978 citations*](https://md.research.elamur.ai/free/en/papers/dong-2023-survey-context-learning/)
2. [**Splitwise: Efficient generative LLM inference using phase splitting ISCA 2024**Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.*2023 · 379 citations*](https://md.research.elamur.ai/free/en/papers/patel-2023-splitwise-efficient-generative-llm-inference/)
3. **[KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization](https://md.research.elamur.ai/free/en/papers/hooper-2024-kvquant-towards-10-million-context/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, et al.*2024 · 294 citations*
4. [**Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads arXiv:2401.10774**Tianle Cai, Yuhong Li, Zhengyang Geng, et al.*2024 · 278 citations*](https://md.research.elamur.ai/free/en/papers/cai-2024-medusa-simple-llm-inference-acceleration/)
5. **[PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU](https://md.research.elamur.ai/free/en/papers/song-2023-powerinfer-fast-large-language-model/) [ACM SIGOPS Symposium on Operating Systems Principles (SOSP)](https://md.research.elamur.ai/free/en/venues/acm-sigops-symposium-on-operating-systems-principles-sosp/)**Yixin Song, Zeyu Mi, Haotong Xie, et al.*2023 · 272 citations*
6. [**KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache arXiv:2402.02750**Zirui Liu, Jiayi Yuan, Hongye Jin, et al.*2024 · 244 citations*](https://md.research.elamur.ai/free/en/papers/liu-2024-kivi-tuning-free-asymmetric-2bit/)
7. [**Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference arXiv:2406.10774**Jiaming Tang, Yilong Zhao, Kan Zhu, et al.*2024 · 203 citations*](https://md.research.elamur.ai/free/en/papers/tang-2024-quest-query-aware-sparsity-efficient/)
8. **[MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse Attention](https://md.research.elamur.ai/free/en/papers/jiang-2024-minference-1-0-accelerating-pre/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.*2024 · 202 citations*
9. [**Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs arXiv:2310.01801**Suyu Ge, Yunan Zhang, Liyuan Liu, et al.*2023 · 202 citations*](https://md.research.elamur.ai/free/en/papers/ge-2023-model-tells-discard-adaptive-kv/)
10. [**OmniQuant: Omnidirectionally Calibrated Quantization for Large Language Models arXiv:2308.13137**Wenqi Shao, Mengzhao Chen, Zhaoyang Zhang, et al.*2023 · 195 citations*](https://md.research.elamur.ai/free/en/papers/shao-2023-omniquant-omnidirectionally-calibrated-quantization-large/)
11. **[LLM in a flash: Efficient Large Language Model Inference with Limited Memory](https://md.research.elamur.ai/free/en/papers/alizadeh-2024-llm-flash-efficient-large-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Keivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, et al.*2024 · 193 citations*
12. [**Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving FAST 2025**Ruoyu Qin, Zheming Li, Weiran He, et al.*2024 · 161 citations*](https://md.research.elamur.ai/free/en/papers/qin-2024-mooncake-kvcache-centric-disaggregated-architecture/)
13. [**Atom: Low-bit Quantization for Efficient and Accurate LLM Serving MLSys 2024**Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.*2023 · 156 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2023-atom-low-bit-quantization-efficient/)
14. **[Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding](https://md.research.elamur.ai/free/en/papers/zhang-2024-draft-verify-lossless-large-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Jun Zhang, Jue Wang, Huan Li, et al.*2024 · 148 citations*
15. **[EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees](https://md.research.elamur.ai/free/en/papers/li-2024-eagle-2-faster-inference-language/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Yuhui Li, Fangyun Wei, Chao Zhang, et al.*2024 · 133 citations*
16. **[InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory](https://md.research.elamur.ai/free/en/papers/xiao-2024-infllm-training-free-long-context/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Chaojun Xiao, Pengle Zhang, Xu Han, et al.*2024 · 126 citations*
17. [**DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads arXiv:2410.10819**Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.*2024 · 114 citations*](https://md.research.elamur.ai/free/en/papers/xiao-2024-duoattention-efficient-long-context-llm/)
18. [**Efficient Large Language Models: A Survey arXiv:2312.03863**Zhongwei Wan, Xin Wang, Che Liu, et al.*2023 · 110 citations*](https://md.research.elamur.ai/free/en/papers/wan-2023-efficient-large-language-models-survey/)
19. **[Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems](https://md.research.elamur.ai/free/en/papers/miao-2023-towards-efficient-generative-large-language/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.*2023 · 110 citations*
20. [**Prompt Cache: Modular Attention Reuse for Low-Latency Inference MLSys 2024**In Gim, Guojun Chen, Seung-seob Lee, et al.*2023 · 109 citations*](https://md.research.elamur.ai/free/en/papers/gim-2023-prompt-cache-modular-attention-reuse/)
21. [**Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention USENIX ATC 2024**Bin Gao, Zhuomin He, Puru Sharma, et al.*2024 · 105 citations*](https://md.research.elamur.ai/free/en/papers/gao-2024-cost-efficient-large-language-model/)
22. [**Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security arXiv:2401.05459**Yuanchun Li, Hao Wen, Weijun Wang, et al.*2024 · 100 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-personal-llm-agents-insights-survey/)
23. [**Small Language Models are the Future of Agentic AI arXiv:2506.02153**Peter Belcak, Greg Heinrich, Shizhe Diao, et al.*2025 · 92 citations*](https://md.research.elamur.ai/free/en/papers/belcak-2025-small-language-models-future-agentic/)
24. [**LLM Inference Unveiled: Survey and Roofline Model Insights arXiv 2024**Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.*2024 · 91 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2024-llm-inference-unveiled-survey-roofline/)
25. **[PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference](https://md.research.elamur.ai/free/en/papers/yang-2024-pyramidinfer-pyramid-kv-cache-compression/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Dongjie Yang, Xiaodong Han, Yan Gao, et al.*2024 · 91 citations*
26. **[D4: Improving LLM Pretraining via Document De-Duplication and Diversification](https://md.research.elamur.ai/free/en/papers/tirumala-2023-d4-improving-llm-pretraining-document/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Kushal Tirumala, Daniel Simig, Armen Aghajanyan, et al.*2023 · 81 citations*
27. [**Punica: Multi-Tenant LoRA Serving MLSys 2024**Lequn Chen, Zihao Ye, Yongji Wu, et al.*2023 · 81 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-punica-multi-tenant-lora-serving/)
28. [**S-LoRA: Serving Thousands of Concurrent LoRA Adapters MLSys 2024**Ying Sheng, Shiyi Cao, Dacheng Li, et al.*2023 · 80 citations*](https://md.research.elamur.ai/free/en/papers/sheng-2023-s-lora-serving-thousands-concurrent/)
29. [**The Unreasonable Ineffectiveness of the Deeper Layers arXiv:2403.17887**Andrey Gromov, Kushal Tirumala, Hassan Shapourian, et al.*2024 · 71 citations*](https://md.research.elamur.ai/free/en/papers/gromov-2024-unreasonable-ineffectiveness-deeper-layers/)
30. [**XAttention: Block Sparse Attention with Antidiagonal Scoring arXiv:2503.16428**Ruyi Xu, Guangxuan Xiao, Haofeng Huang, et al.*2025 · 59 citations*](https://md.research.elamur.ai/free/en/papers/xu-2025-xattention-block-sparse-attention-antidiagonal/)
31. [**From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models arXiv:2406.16838**Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.*2024 · 51 citations*](https://md.research.elamur.ai/free/en/papers/welleck-2024-decoding-meta-generation-inference-time/)
32. [**A Survey of Small Language Models arXiv:2410.20011**Chien Van Nguyen, Xuan Shen, Ryan Aponte, et al.*2024 · 31 citations*](https://md.research.elamur.ai/free/en/papers/nguyen-2024-survey-small-language-models/)
33. **[Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models](https://md.research.elamur.ai/free/en/papers/liu-2025-modality-aware-neuron-pruning-unlearning/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Zheyuan Liu, Guangyao Dou, Xiangchi Yuan, et al.*2025 · 12 citations*
34. **[Let's Focus on Neuron: Neuron-Level Supervised Fine-tuning for Large Language Model](https://md.research.elamur.ai/free/en/papers/xu-2025-let-s-focus-neuron-neuron/) [International Conference on Computational Linguistics (COLING)](https://md.research.elamur.ai/free/en/venues/coling/)**Haoyun Xu, Runzhe Zhan, Yingpeng Ma, et al.*2025 · 10 citations*
35. **[From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms](https://md.research.elamur.ai/free/en/papers/luo-2026-storage-experience-survey-evolution-llm/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Jinghao Luo, Yuchen Tian, Chuxue Cao, et al.*2026 · 3 citations*
36. **[Sparse Brains are Also Adaptive Brains: Cognitive-Load-Aware Dynamic Activation for LLMs](https://md.research.elamur.ai/free/en/papers/yang-2026-sparse-brains-are-also-adaptive/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yiheng Yang, Yujie Wang, Chi Ma, et al.*2026 · 3 citations*
37. **[Cross-layer Attention Sharing for Pre-trained Large Language Models](https://md.research.elamur.ai/free/en/papers/mu-2026-cross-layer-attention-sharing-pre/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Yongyu Mu, Yuzhang Wu, Yuchun Fan, et al.*2026 · 2 citations*
38. **[Do LLMs Encode Functional Importance of Reasoning Tokens ?](https://md.research.elamur.ai/free/en/papers/singh-2026-do-llms-encode-functional-importance/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Janvijay Singh, Dilek Hakkani-Tür*2026 · 2 citations*
39. **[Analytical FFN-to-MoE Restructuring via Activation Pattern Analysis](https://md.research.elamur.ai/free/en/papers/pei-2026-analytical-ffn-moe-restructuring-activation/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Zehua Pei, Hui-Ling Zhen, Lancheng Zou, et al.*2026 · 1 citation*
40. **[Deputy: Accelerating Large Language Model Inference with Dynamic Low-Rank Substitution](https://md.research.elamur.ai/free/en/papers/zhou-2026-deputy-accelerating-large-language-model/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yuhua Zhou, Shichao Weng, Changhai Zhou, et al.*2026 · 1 citation*
41. **[Context-Conditioned Masked LoRA: Dynamic Rank Routing for Compute-Efficient Parameter-Efficient Fine-Tuning](https://md.research.elamur.ai/free/en/papers/rafiuddin-2026-context-conditioned-masked-lora-dynamic/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Rifat Rafiuddin, Rafae Abdullah*2026*
42. **[Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache Compression](https://md.research.elamur.ai/free/en/papers/zhao-2026-question-tells-you-where-answer/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Liang Zhao, Xiaocheng Feng, Weihong Zhong, et al.*2026*
43. **[RoBSA: RoPE-based Blockwise Sparse Multi-head Latent Attention](https://md.research.elamur.ai/free/en/papers/shi-2026-robsa-rope-based-blockwise-sparse/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Xinyu Shi, Kairong Luo, Zhen Zheng, et al.*2026*
44. **[SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language Models](https://md.research.elamur.ai/free/en/papers/liu-2026-semtoken-semantic-aware-tokenization-efficient/) [Joint Conference on Lexical and Computational Semantics (*SEM)](https://md.research.elamur.ai/free/en/venues/starsem/)**Dong Liu, Yanxuan Yu*2026*
45. **[ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value Retrieval](https://md.research.elamur.ai/free/en/papers/yang-2026-zoomr-memory-efficient-reasoning-through/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**David H. Yang, Yuxuan Zhu, Mohammad Mohammadi Amiri, et al.*2026*

231 more citing papers of our library have no page here yet.

- [← back to](https://md.research.elamur.ai/free/en/authors/zhao-song/) — Zhao Song