--- title: "Cody Hao Yu — author profile and papers" description: "Cody Hao Yu: 2 papers on Elamur Research (2023) — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/cody-hao-yu/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/cody-hao-yu/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Cody Hao Yu # Cody Hao Yu Cody Hao Yu works on systems for running large language models efficiently. Their papers here, both from 2023, focus on making inference faster and less wasteful. The work examines how GPU memory is spent on the key-value cache and how applications that chain many generation calls can be executed with less redundant computation. The approach borrows from operating systems and programming languages, pairing new abstractions with runtime designs. These papers fall under [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) and [Efficient models & compression](https://md.research.elamur.ai/free/en/topics/efficient-models/). The most cited of these papers is [Efficient Memory Management for Large Language Model Serving with PagedAttention](https://md.research.elamur.ai/free/en/papers/kwon-2023-efficient-memory-management-large-language/). It starts from the observation that serving systems set aside a large contiguous block of memory for every request. Because cache size varies unpredictably, much of that space is lost to fragmentation, and shared portions end up stored more than once. The paper adapts paged virtual memory to this setting, so the cache can be held in non-contiguous blocks and batches can grow larger. The second paper, [SGLang: Efficient Execution of Structured Language Model Programs](https://md.research.elamur.ai/free/en/papers/zheng-2023-sglang-efficient-execution-structured-language/), targets "LM programs" that combine branching logic with output in fixed formats. Its frontend is a small language embedded in Python, offering operations for generating text, choosing among options, and splitting work into parallel branches and merging it back. A runtime then keeps cached state between calls instead of discarding it and speeds up constrained decoding. Both papers are also the newest here. Read together, they span low-level memory management for serving and end-to-end support for structured LLM workloads. Yu's collaborators on this work include [Lianmin Zheng](https://md.research.elamur.ai/free/en/authors/lianmin-zheng/), [Ying Sheng](https://md.research.elamur.ai/free/en/authors/ying-sheng/), [Ion Stoica](https://md.research.elamur.ai/free/en/authors/ion-stoica/) and [Joseph E. Gonzalez](https://md.research.elamur.ai/free/en/authors/joseph-e-gonzalez/), each of whom appears on both papers. Cody Hao Yu has 2 papers in our library, in 2023, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Efficient models & compression](https://md.research.elamur.ai/free/en/topics/efficient-models/); often with [Ion Stoica](https://md.research.elamur.ai/free/en/authors/ion-stoica/), [Joseph E. Gonzalez](https://md.research.elamur.ai/free/en/authors/joseph-e-gonzalez/), [Lianmin Zheng](https://md.research.elamur.ai/free/en/authors/lianmin-zheng/). 2 papers in our library · 2023 No OpenAlex profile matched yet. [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/cody-hao-yu/#papers) · [🔗 3,316 citations in our library](https://md.research.elamur.ai/free/en/authors/cody-hao-yu/cited-by/) · [⭐ Paper Star rank #743](https://md.research.elamur.ai/free/en/paper-stars/page/8/#star-743) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Cody+Hao+Yu) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Cody+Hao+Yu) · [dblp](https://dblp.org/search?q=Cody+Hao+Yu) · [ACL Anthology](https://aclanthology.org/search/?q=Cody+Hao+Yu) ## Topics [Language models & pretraining (2)](https://md.research.elamur.ai/free/en/topics/language-models/) · [Efficient models & compression (1)](https://md.research.elamur.ai/free/en/topics/efficient-models/) ## Works by year ### 2020s [**2023** 2 papers](https://md.research.elamur.ai/free/en/authors/cody-hao-yu/year/2023/) ## Papers The most cited first (OpenAlex and our library). 1. **[Efficient Memory Management for Large Language Model Serving with PagedAttention](https://md.research.elamur.ai/free/en/papers/kwon-2023-efficient-memory-management-large-language/)** *(2023 · 2,738 citations)* To make a large language model run fast, requests are processed in batches. The batch size is limited by GPU memory, specifically by the KV cache: for each request it grows and shrinks unpredictably. Existing systems, including FasterTransformer and Orca, reserve in advance a contiguous chunk of memory for each… 2. **[SGLang: Efficient Execution of Structured Language Model Programs](https://md.research.elamur.ai/free/en/papers/zheng-2023-sglang-efficient-execution-structured-language/)** *(2023 · 710 citations)* LLM applications increasingly chain many generation calls with branching logic and expect output in fixed formats. ## Co-authors here 9 co-authors with a page, the most papers together first. - [Ion Stoica](https://md.research.elamur.ai/free/en/authors/ion-stoica/) ×2 - [Joseph E. Gonzalez](https://md.research.elamur.ai/free/en/authors/joseph-e-gonzalez/) ×2 - [Lianmin Zheng](https://md.research.elamur.ai/free/en/authors/lianmin-zheng/) ×2 - [Ying Sheng](https://md.research.elamur.ai/free/en/authors/ying-sheng/) ×2 - [Clark Barrett](https://md.research.elamur.ai/free/en/authors/clark-barrett/) - [Hao Zhang](https://md.research.elamur.ai/free/en/authors/hao-zhang/) - [Siyuan Zhuang](https://md.research.elamur.ai/free/en/authors/siyuan-zhuang/) - [Zhiqiang Xie](https://md.research.elamur.ai/free/en/authors/zhiqiang-xie/) - [Zhuohan Li](https://md.research.elamur.ai/free/en/authors/zhuohan-li/) ## Cited by Papers of our library cite their works 3,316 times (of the 140,884 papers whose bibliographies we read); [73 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/cody-hao-yu/cited-by/).