---
title: "Who cites Fast Distributed Inference — 101 citing papers"
description: "101 papers of the Elamur Research library cite «Fast Distributed Inference Serving for Large Language Models», found in their bibliographies…"
canonical: "https://research.elamur.ai/free/en/papers/wu-2023-fast-distributed-inference-serving-large/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wu-2023-fast-distributed-inference-serving-large/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [Fast Distributed Inference Serving for Large…](https://md.research.elamur.ai/free/en/papers/wu-2023-fast-distributed-inference-serving-large/) / cited by

# Who cites «Fast Distributed Inference Serving for Large Language Models»

101 papers of our library cite it (of the 149,439 whose bibliographies we read) · 11 with a page here, the most cited first · [← back to «Fast Distributed Inference Serving for Large Language Models»](https://md.research.elamur.ai/free/en/papers/wu-2023-fast-distributed-inference-serving-large/)

1. [**DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving OSDI 2024**Yinmin Zhong, Shengyu Liu, Junda Chen, et al.*2024 · 409 citations*](https://md.research.elamur.ai/free/en/papers/zhong-2024-distserve-disaggregating-prefill-decoding-goodput/)
2. [**Splitwise: Efficient generative LLM inference using phase splitting ISCA 2024**Pratyush Patel, Esha Choukse, Chaojie Zhang, et al.*2023 · 379 citations*](https://md.research.elamur.ai/free/en/papers/patel-2023-splitwise-efficient-generative-llm-inference/)
3. [**Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve OSDI 2024**Amey Agrawal, Nitin Kedia, Ashish Panwar, et al.*2024 · 369 citations*](https://md.research.elamur.ai/free/en/papers/agrawal-2024-taming-throughput-latency-tradeoff-llm/)
4. [**Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving FAST 2025**Ruoyu Qin, Zheming Li, Weiran He, et al.*2024 · 161 citations*](https://md.research.elamur.ai/free/en/papers/qin-2024-mooncake-kvcache-centric-disaggregated-architecture/)
5. [**SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefills arXiv 2023**Amey Agrawal, Ashish Panwar, Jayashree Mohan, et al.*2023 · 144 citations*](https://md.research.elamur.ai/free/en/papers/agrawal-2023-sarathi-efficient-llm-inference-piggybacking/)
6. **[LoongServe: Efficiently Serving Long-Context Large Language Models with Elastic Sequence Parallelism](https://md.research.elamur.ai/free/en/papers/wu-2024-loongserve-efficiently-serving-long-context/) [ACM SIGOPS Symposium on Operating Systems Principles (SOSP)](https://md.research.elamur.ai/free/en/venues/acm-sigops-symposium-on-operating-systems-principles-sosp/)**Bingyang Wu, Shengyu Liu, Yinmin Zhong, et al.*2024 · 131 citations*
7. [**Llumnix: Dynamic Scheduling for Large Language Model Serving OSDI 2024**Biao Sun, Ziming Huang, Hanyu Zhao, et al.*2024 · 119 citations*](https://md.research.elamur.ai/free/en/papers/sun-2024-llumnix-dynamic-scheduling-large-language/)
8. [**A Survey on Efficient Inference for Large Language Models arXiv:2404.14294**Zixuan Zhou, Xuefei Ning, Ke Hong, et al.*2024 · 113 citations*](https://md.research.elamur.ai/free/en/papers/zhou-2024-survey-efficient-inference-large-language/)
9. **[Towards Efficient Generative Large Language Model Serving: A Survey from Algorithms to Systems](https://md.research.elamur.ai/free/en/papers/miao-2023-towards-efficient-generative-large-language/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Xupeng Miao, Gabriele Oliaro, Zhihao Zhang, et al.*2023 · 110 citations*
10. [**Cost-Efficient Large Language Model Serving for Multi-turn Conversations with CachedAttention USENIX ATC 2024**Bin Gao, Zhuomin He, Puru Sharma, et al.*2024 · 105 citations*](https://md.research.elamur.ai/free/en/papers/gao-2024-cost-efficient-large-language-model/)
11. [**ServerlessLLM: Low-Latency Serverless Inference for Large Language Models arXiv:2401.14351**Yao Fu, Leyang Xue, Yeqi Huang, et al.*2024 · 105 citations*](https://md.research.elamur.ai/free/en/papers/fu-2024-serverlessllm-low-latency-serverless-inference/)

90 more papers of our library cite it; they have no page here yet.

- [← back to](https://md.research.elamur.ai/free/en/papers/wu-2023-fast-distributed-inference-serving-large/) — Fast Distributed Inference Serving for Large Language Models