--- title: "Who cites H2O: Heavy-Hitter Oracle for — 124 citing papers" description: "124 papers of the Elamur Research library cite «H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models»…" canonical: "https://research.elamur.ai/free/en/papers/zhang-2023-h-2-o-heavy-hitter/cited-by/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhang-2023-h-2-o-heavy-hitter/cited-by/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [H2O: Heavy-Hitter Oracle for Efficient Generative…](https://md.research.elamur.ai/free/en/papers/zhang-2023-h-2-o-heavy-hitter/) / cited by # Who cites «H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models» 124 papers of our library cite it (of the 149,439 whose bibliographies we read) · 25 with a page here, the most cited first · [← back to «H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models»](https://md.research.elamur.ai/free/en/papers/zhang-2023-h-2-o-heavy-hitter/) 1. **[KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization](https://md.research.elamur.ai/free/en/papers/hooper-2024-kvquant-towards-10-million-context/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Coleman Hooper, Sehoon Kim, Hiva Mohammadzadeh, et al.*2024 · 294 citations* 2. [**Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Heads arXiv:2401.10774**Tianle Cai, Yuhong Li, Zhengyang Geng, et al.*2024 · 278 citations*](https://md.research.elamur.ai/free/en/papers/cai-2024-medusa-simple-llm-inference-acceleration/) 3. [**KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache arXiv:2402.02750**Zirui Liu, Jiayi Yuan, Hongye Jin, et al.*2024 · 244 citations*](https://md.research.elamur.ai/free/en/papers/liu-2024-kivi-tuning-free-asymmetric-2bit/) 4. [**Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference arXiv:2406.10774**Jiaming Tang, Yilong Zhao, Kan Zhu, et al.*2024 · 203 citations*](https://md.research.elamur.ai/free/en/papers/tang-2024-quest-query-aware-sparsity-efficient/) 5. [**Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs arXiv:2310.01801**Suyu Ge, Yunan Zhang, Liyuan Liu, et al.*2023 · 202 citations*](https://md.research.elamur.ai/free/en/papers/ge-2023-model-tells-discard-adaptive-kv/) 6. [**Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving FAST 2025**Ruoyu Qin, Zheming Li, Weiran He, et al.*2024 · 161 citations*](https://md.research.elamur.ai/free/en/papers/qin-2024-mooncake-kvcache-centric-disaggregated-architecture/) 7. [**Atom: Low-bit Quantization for Efficient and Accurate LLM Serving MLSys 2024**Yilong Zhao, Chien-Yu Lin, Kan Zhu, et al.*2023 · 156 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2023-atom-low-bit-quantization-efficient/) 8. **[InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory](https://md.research.elamur.ai/free/en/papers/xiao-2024-infllm-training-free-long-context/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Chaojun Xiao, Pengle Zhang, Xu Han, et al.*2024 · 126 citations* 9. [**DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads arXiv:2410.10819**Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.*2024 · 114 citations*](https://md.research.elamur.ai/free/en/papers/xiao-2024-duoattention-efficient-long-context-llm/) 10. [**Efficient Large Language Models: A Survey arXiv:2312.03863**Zhongwei Wan, Xin Wang, Che Liu, et al.*2023 · 110 citations*](https://md.research.elamur.ai/free/en/papers/wan-2023-efficient-large-language-models-survey/) 11. **[Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems](https://md.research.elamur.ai/free/en/papers/miao-2023-towards-efficient-generative-large-language/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.*2023 · 110 citations* 12. [**Prompt Cache: Modular Attention Reuse for Low-Latency Inference MLSys 2024**In Gim, Guojun Chen, Seung-seob Lee, et al.*2023 · 109 citations*](https://md.research.elamur.ai/free/en/papers/gim-2023-prompt-cache-modular-attention-reuse/) 13. [**Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention USENIX ATC 2024**Bin Gao, Zhuomin He, Puru Sharma, et al.*2024 · 105 citations*](https://md.research.elamur.ai/free/en/papers/gao-2024-cost-efficient-large-language-model/) 14. [**Personal LLM Agents: Insights and Survey about the Capability, Efficiency and Security arXiv:2401.05459**Yuanchun Li, Hao Wen, Weijun Wang, et al.*2024 · 100 citations*](https://md.research.elamur.ai/free/en/papers/li-2024-personal-llm-agents-insights-survey/) 15. **[PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM Inference](https://md.research.elamur.ai/free/en/papers/yang-2024-pyramidinfer-pyramid-kv-cache-compression/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Dongjie Yang, Xiaodong Han, Yan Gao, et al.*2024 · 91 citations* 16. [**Punica: Multi-Tenant LoRA Serving MLSys 2024**Lequn Chen, Zihao Ye, Yongji Wu, et al.*2023 · 81 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-punica-multi-tenant-lora-serving/) 17. [**S-LoRA: Serving Thousands of Concurrent LoRA Adapters MLSys 2024**Ying Sheng, Shiyi Cao, Dacheng Li, et al.*2023 · 80 citations*](https://md.research.elamur.ai/free/en/papers/sheng-2023-s-lora-serving-thousands-concurrent/) 18. [**XAttention: Block Sparse Attention with Antidiagonal Scoring arXiv:2503.16428**Ruyi Xu, Guangxuan Xiao, Haofeng Huang, et al.*2025 · 59 citations*](https://md.research.elamur.ai/free/en/papers/xu-2025-xattention-block-sparse-attention-antidiagonal/) 19. [**From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models arXiv:2406.16838**Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.*2024 · 51 citations*](https://md.research.elamur.ai/free/en/papers/welleck-2024-decoding-meta-generation-inference-time/) 20. **[From Storage to Experience: A Survey on the Evolution of LLM Agent Memory Mechanisms](https://md.research.elamur.ai/free/en/papers/luo-2026-storage-experience-survey-evolution-llm/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Jinghao Luo, Yuchen Tian, Chuxue Cao, et al.*2026 · 3 citations* 21. **[Do LLMs Encode Functional Importance of Reasoning Tokens ?](https://md.research.elamur.ai/free/en/papers/singh-2026-do-llms-encode-functional-importance/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Janvijay Singh, Dilek Hakkani-Tür*2026 · 2 citations* 22. **[Question Tells You Where the Answer Is: Intention-aware Long-Context KV Cache Compression](https://md.research.elamur.ai/free/en/papers/zhao-2026-question-tells-you-where-answer/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Liang Zhao, Xiaocheng Feng, Weihong Zhong, et al.*2026* 23. **[RoBSA: RoPE-based Blockwise Sparse Multi-head Latent Attention](https://md.research.elamur.ai/free/en/papers/shi-2026-robsa-rope-based-blockwise-sparse/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Xinyu Shi, Kairong Luo, Zhen Zheng, et al.*2026* 24. **[SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language Models](https://md.research.elamur.ai/free/en/papers/liu-2026-semtoken-semantic-aware-tokenization-efficient/) [Joint Conference on Lexical and Computational Semantics (*SEM)](https://md.research.elamur.ai/free/en/venues/starsem/)**Dong Liu, Yanxuan Yu*2026* 25. **[ZoomR: Memory Efficient Reasoning through Multi-Granularity Key Value Retrieval](https://md.research.elamur.ai/free/en/papers/yang-2026-zoomr-memory-efficient-reasoning-through/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**David H. Yang, Yuxuan Zhu, Mohammad Mohammadi Amiri, et al.*2026* 99 more papers of our library cite it; they have no page here yet. - [← back to](https://md.research.elamur.ai/free/en/papers/zhang-2023-h-2-o-heavy-hitter/) — H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models