---
title: "Shiyi Cao — author profile and papers — Elamur Research"
description: "Shiyi Cao, University of California, Berkeley: 3 papers on Elamur Research (2023–2024), h-index 27 — affiliations, topics, co-authors and…"
canonical: "https://research.elamur.ai/free/en/authors/shiyi-cao/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/shiyi-cao/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Shiyi Cao

# Shiyi Cao

Shiyi Cao has 3 papers in our library, in 2023–2024, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/); often with [Joseph E. Gonzalez](https://md.research.elamur.ai/free/en/authors/joseph-e-gonzalez/), [Lianmin Zheng](https://md.research.elamur.ai/free/en/authors/lianmin-zheng/), [Ying Sheng](https://md.research.elamur.ai/free/en/authors/ying-sheng/).

3 papers in our library · 2023–2024

[OpenAlex](https://openalex.org/A5039788110) · [ORCID](https://orcid.org/0000-0002-1953-7751) · [**h-index 27**](https://openalex.org/authors/A5039788110) · [92 works](https://openalex.org/works?filter=author.id:A5039788110) · [2,207 citations](https://openalex.org/works?filter=author.id:A5039788110&sort=cited_by_count:desc) OpenAlex, 2026-10-14

[📄 3 works in our library](https://md.research.elamur.ai/free/en/authors/shiyi-cao/#papers) · [🔗 Cited 1,035 times in our library](https://md.research.elamur.ai/free/en/authors/shiyi-cao/cited-by/) · [14 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #2954](https://md.research.elamur.ai/free/en/paper-stars/page/30/#star-2954)

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Shiyi+Cao) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Shiyi+Cao) · [dblp](https://dblp.org/search?q=Shiyi+Cao) · [ACL Anthology](https://aclanthology.org/search/?q=Shiyi+Cao)

## Affiliations

[🎓**University of California, Berkeley** Berkeley · United States 2023–2026 · 14 papers*current*](https://md.research.elamur.ai/free/en/universities/university-of-california-berkeley/) · [🎓**Changsha University of Science and Technology** Changsha · China 2012–2018 · 21 papersEducation · College of Physics and Electronic Science](https://md.research.elamur.ai/free/en/universities/changsha-university-of-science-and-technology/) · [🏢**Huawei Technologies** Shenzhen · China 2010–2024 · 16 papers](https://md.research.elamur.ai/free/en/companies/huawei-technologies/) · [🎓**Wuhan University** Wuhan · China 2018–2025 · 7 papers](https://md.research.elamur.ai/free/en/universities/wuhan-university/) · [🎓**National University of Defense Technology** Changsha · China 2010–2016 · 6 papers](https://md.research.elamur.ai/free/en/universities/national-university-of-defense-technology/) · [🎓**Wuhan University of Technology** Wuhan · China 2021–2024 · 5 papers](https://md.research.elamur.ai/free/en/universities/wuhan-university-of-technology/) · [🔬**State Key Laboratory of Silicate Materials for Architecture** Wuhan 2021–2024 · 4 papers](https://ror.org/03deb8c89) · [🎓**Yangzhou University** Yangzhou · China 2013–2018 · 4 papers](https://md.research.elamur.ai/free/en/universities/yangzhou-university/) · [🎓**Huazhong University of Science and Technology** Wuhan · China 2022–2024 · 3 papers](https://md.research.elamur.ai/free/en/universities/huazhong-university-of-science-and-technology/) · [🎓**Shanghai Jiao Tong University** Shanghai · China 2019–2022 · 2 papers](https://md.research.elamur.ai/free/en/universities/shanghai-jiao-tong-university/)

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 5 more institutions on single bylines are not listed.

## Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 3 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 3 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Hardware and Architecture · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/hardware-and-architecture/)

🧭 Topics 2 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Reasoning · 1 work](https://md.research.elamur.ai/free/en/topics/reasoning/)

💡 Concepts 1 Key ideas and methods explained on our concept pages.[Retrieval-augmented generation · 1 work](https://md.research.elamur.ai/free/en/concepts/retrieval-augmented-generation/)

## Works by year

### 2020s

[**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/shiyi-cao/year/2024/) · [**2023** 2 papers](https://md.research.elamur.ai/free/en/authors/shiyi-cao/year/2023/)

## Papers

The most cited first (OpenAlex and our library).

1. **[SGLang: Efficient Execution of Structured Language Model Programs](https://md.research.elamur.ai/free/en/papers/zheng-2023-sglang-efficient-execution-structured-language/)** *(2023 · 729 citations)* Modern LLM applications such as agents, few-shot evaluation, tree-of-thought search, RAG and JSON extraction rarely make a single model call.
2. **[S-LoRA: Serving Thousands of Concurrent LoRA Adapters](https://md.research.elamur.ai/free/en/papers/sheng-2023-s-lora-serving-thousands-concurrent/)** *(2023 · 80 citations)* Organizations increasingly fine-tune one base LLM into many task-specific LoRA variants, but serving them all at once is poorly supported.
3. **[Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models](https://md.research.elamur.ai/free/en/papers/yang-2024-buffer-thoughts-thought-augmented-reasoning/)** *(2024 · 67 citations)* Prompting strategies for LLM reasoning fall into two camps. Single-query methods such as CoT or few-shot prompting rely on hand-made, task-specific exemplars. Multi-query methods such as ToT and GoT explore many reasoning paths but are computationally expensive. Neither reuses general lessons from problems already…

## All works

17 works of theirs in our library, the most cited first; 3 with a page here, the others link their original until we summarise them.

1. **[SGLang: Efficient Execution of Structured Language Model Programs](https://md.research.elamur.ai/free/en/papers/zheng-2023-sglang-efficient-execution-structured-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Lianmin Zheng, Liangsheng Yin, Zhiqiang Xie, et al.*2023 · 729 citations*
2. [**S-LoRA: Serving Thousands of Concurrent LoRA Adapters MLSys 2024**Ying Sheng, Shiyi Cao, Dacheng Li, et al.*2023 · 80 citations*](https://md.research.elamur.ai/free/en/papers/sheng-2023-s-lora-serving-thousands-concurrent/)
3. **[NVILA: Efficient Frontier Visual Language Models ↗](https://doi.org/10.1109/cvpr52734.2025.00390) IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yet**Zhijian Liu et al.*2025 · 73 citations*
4. **[Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models](https://md.research.elamur.ai/free/en/papers/yang-2024-buffer-thoughts-thought-augmented-reasoning/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Ling Yang, Zhaochen Yu, Tianjun Zhang, et al.*2024 · 67 citations*
5. **[Fairness in Serving Large Language Models ↗](https://arxiv.org/abs/2401.00588) arXiv (Cornell University) · no summary yet**Ying Sheng et al.*2023 · 62 citations*
6. **[LLMs Can Easily Learn to Reason from Demonstrations Structure, not content, is what matters! ↗](https://arxiv.org/abs/2502.07374) arXiv:2502.07374 · no summary yet**Dacheng Li et al.*2025 · 56 citations*
7. **[MoE-Lightning: High-Throughput MoE Inference on Memory-constrained GPUs ↗](https://arxiv.org/abs/2411.11217) ASPLOS 2025 · no summary yet**Shiyi Cao et al.*2024 · 51 citations*
8. **[NEO: Saving GPU Memory Crisis with CPU Offloading for Online LLM Inference ↗](https://arxiv.org/abs/2411.01142) arXiv:2411.01142 · no summary yet**Xuanlin Jiang et al.*2024 · 37 citations*
9. **[MoE-L ightning : High-Throughput MoE Inference on Memory-constrained GPUs ↗](https://doi.org/10.1145/3669940.3707267) ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) · no summary yet**Shiyi Cao et al.*2025 · 28 citations*
10. **[Autonomous biomedical research with an artificial intelligence agent ↗](https://doi.org/10.1126/science.adz4351) Science · no summary yet**Kexin Huang et al.*2026 · 26 citations*
11. **[S*: Test Time Scaling for Code Generation ↗](https://aclanthology.org/2025.findings-emnlp.865/) Findings of the Association for Computational Linguistics: EMNLP 2025 · no summary yet**Dacheng Li et al.*2025 · 26 citations*
12. **[K-Search: LLM Kernel Generation via Co-Evolving Intrinsic World Model ↗](https://arxiv.org/abs/2602.19128) arXiv:2602.19128 · no summary yet**Shiyi Cao et al.*2026 · 21 citations*
13. **[Language Models Can Easily Learn to Reason from Demonstrations ↗](https://aclanthology.org/2025.findings-emnlp.866/) Findings of the Association for Computational Linguistics: EMNLP 2025 · no summary yet**Dacheng Li et al.*2025 · 14 citations*
14. **[Optimizing LLM Queries in Relational Data Analytics Workloads ↗](https://arxiv.org/abs/2403.05821) arXiv:2403.05821 · no summary yet**Shu Liu et al.*2024 · 12 citations*
15. **[WorldModelBench: Judging Video Generation Models As World Models ↗](https://doi.org/10.52202/085713-1834) neural information processing systems · no summary yet**Dacheng Li et al.*2025 · 11 citations*
16. **[SkyRL-Agent: Efficient RL Training for Multi-turn LLM Agent ↗](https://arxiv.org/abs/2511.16108) arXiv (Cornell University) · no summary yet**Shiyi Cao et al.*2025 · 8 citations*
17. **[Locality-aware Fair Scheduling in LLM Serving ↗](https://arxiv.org/abs/2501.14312) arXiv (Cornell University) · no summary yet**Shiyi Cao et al.*2025 · 7 citations*

## Co-authors here

12 of 16 co-authors with a page, the most papers together first.

- [Joseph E. Gonzalez](https://md.research.elamur.ai/free/en/authors/joseph-e-gonzalez/) ×2
- [Lianmin Zheng](https://md.research.elamur.ai/free/en/authors/lianmin-zheng/) ×2
- [Ying Sheng](https://md.research.elamur.ai/free/en/authors/ying-sheng/) ×2
- [Banghua Zhu](https://md.research.elamur.ai/free/en/authors/banghua-zhu/)
- [Bin Cui](https://md.research.elamur.ai/free/en/authors/bin-cui/)
- [Clark Barrett](https://md.research.elamur.ai/free/en/authors/clark-barrett/)
- [Cody Hao Yu](https://md.research.elamur.ai/free/en/authors/cody-hao-yu/)
- [Coleman Hooper](https://md.research.elamur.ai/free/en/authors/coleman-hooper/)
- [Dacheng Li](https://md.research.elamur.ai/free/en/authors/dacheng-li/)
- [Ion Gabriel Stoica](https://md.research.elamur.ai/free/en/authors/ion-gabriel-stoica/)
- [Kurt Keutzer](https://md.research.elamur.ai/free/en/authors/kurt-keutzer/)
- [Ling Yang](https://md.research.elamur.ai/free/en/authors/ling-yang/)

## Venues

Where their works here were published, the most works first, with the editions of those that have a page.

- [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/) ×2: [NeurIPS 2024](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2024/), [NeurIPS 2023](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/2023/)
- Findings of the Association for Computational Linguistics: EMNLP 2025 ×2
- ACM International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS)
- ASPLOS 2025
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- MLSys 2024
- Science
- neural information processing systems

## Cited by

Papers of our library cite their works 1,035 times (of the 149,439 papers whose bibliographies we read); [116 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/shiyi-cao/cited-by/).

Updated 2 November 2026