--- title: "Who cites SARATHI: Efficient LLM — 128 citing papers" description: "128 papers of the Elamur Research library cite «SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills», found in…" canonical: "https://research.elamur.ai/free/en/papers/agrawal-2023-sarathi-efficient-llm-inference-piggybacking/cited-by/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/agrawal-2023-sarathi-efficient-llm-inference-piggybacking/cited-by/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [SARATHI: Efficient LLM Inference by Piggybacking…](https://md.research.elamur.ai/free/en/papers/agrawal-2023-sarathi-efficient-llm-inference-piggybacking/) / cited by # Who cites «SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills» 128 papers of our library cite it (of the 149,439 whose bibliographies we read) · 15 with a page here, the most cited first · [← back to «SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills»](https://md.research.elamur.ai/free/en/papers/agrawal-2023-sarathi-efficient-llm-inference-piggybacking/) 1. [**HybridFlow: A Flexible and Efficient RLHF Framework arXiv:2409.19256**Guangming Sheng, Chi Zhang, Zilingfeng Ye, et al.*2024 · 624 citations*](https://md.research.elamur.ai/free/en/papers/sheng-2024-hybridflow-flexible-efficient-rlhf-framework/) 2. [**DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving OSDI 2024**Yinmin Zhong, Shengyu Liu, Junda Chen, et al.*2024 · 409 citations*](https://md.research.elamur.ai/free/en/papers/zhong-2024-distserve-disaggregating-prefill-decoding-goodput/) 3. [**Splitwise: Efficient generative LLM inference using phase splitting ISCA 2024**Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.*2023 · 379 citations*](https://md.research.elamur.ai/free/en/papers/patel-2023-splitwise-efficient-generative-llm-inference/) 4. [**Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve OSDI 2024**Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.*2024 · 369 citations*](https://md.research.elamur.ai/free/en/papers/agrawal-2024-taming-throughput-latency-tradeoff-llm/) 5. **[DynamoLLM: Designing LLM Inference Clusters for Performance and Energy Efficiency](https://md.research.elamur.ai/free/en/papers/stojkovic-2024-dynamollm-designing-llm-inference-clusters/) [Proceedings - International Symposium on High-Performance Computer Architecture/Proceedings](https://md.research.elamur.ai/free/en/venues/proceedings-international-symposium-on-high-performance-computer-architecture/)**Jovan Stojkovic, Chaojie Zhang, Inigo Goiri, et al.*2024 · 218 citations* 6. **[LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism](https://md.research.elamur.ai/free/en/papers/wu-2024-loongserve-efficiently-serving-long-context/) [ACM SIGOPS Symposium on Operating Systems Principles (SOSP)](https://md.research.elamur.ai/free/en/venues/acm-sigops-symposium-on-operating-systems-principles-sosp/)**Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.*2024 · 131 citations* 7. [**DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads arXiv:2410.10819**Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, et al.*2024 · 114 citations*](https://md.research.elamur.ai/free/en/papers/xiao-2024-duoattention-efficient-long-context-llm/) 8. [**A Survey on Efficient Inference for Large Language Models arXiv:2404.14294**Zixuan Zhou, Xuefei Ning, Ke Hong, et al.*2024 · 113 citations*](https://md.research.elamur.ai/free/en/papers/zhou-2024-survey-efficient-inference-large-language/) 9. [**Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention USENIX ATC 2024**Bin Gao, Zhuomin He, Puru Sharma, et al.*2024 · 105 citations*](https://md.research.elamur.ai/free/en/papers/gao-2024-cost-efficient-large-language-model/) 10. [**LLM Inference Unveiled: Survey and Roofline Model Insights arXiv 2024**Zhihang Yuan, Yuzhang Shang, Yang Zhou, et al.*2024 · 91 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2024-llm-inference-unveiled-survey-roofline/) 11. [**Vidur: A Large-Scale Simulation Framework For LLM Inference arXiv:2405.05465**Amey Agrawal, Nitin Kedia, Jayashree Mohan, et al.*2024 · 90 citations*](https://md.research.elamur.ai/free/en/papers/agrawal-2024-vidur-large-scale-simulation-framework/) 12. [**NanoFlow: Towards Optimal Large Language Model Serving Throughput OSDI 2025**Kan Zhu, Yufei Gao, Yilong Zhao, et al.*2024 · 80 citations*](https://md.research.elamur.ai/free/en/papers/zhu-2024-nanoflow-optimal-large-language-model/) 13. [**DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference arXiv 2024 (Microsoft DeepSpeed)**Connor Holmes, Masahiro Tanaka, Michael Wyatt, et al.*2024 · 78 citations*](https://md.research.elamur.ai/free/en/papers/holmes-2024-deepspeed-fastgen-high-throughput-text/) 14. **[Salute the Classic: Revisiting Challenges of Machine Translation in the Age of Large Language Models](https://md.research.elamur.ai/free/en/papers/pang-2025-salute-classic-revisiting-challenges-machine/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Jianhui Pang, Fanghua Ye, Derek Fai Wong, et al.*2025 · 65 citations* 15. **[Rectified Sparse Attention for Efficient Long-Sequence Generation](https://md.research.elamur.ai/free/en/papers/sun-2026-rectified-sparse-attention-efficient-long/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yutao Sun, Tianzhu Ye, Li Dong, et al.*2026 · 1 citation* 113 more papers of our library cite it; they have no page here yet. - [← back to](https://md.research.elamur.ai/free/en/papers/agrawal-2023-sarathi-efficient-llm-inference-piggybacking/) — SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills