--- title: "Zhao Song — author profile and papers — Elamur Research" description: "Zhao Song, Kunming University of Science and Technology: 2 papers on Elamur Research (2023), h-index 9 — affiliations, topics, co-authors…" canonical: "https://research.elamur.ai/free/en/authors/zhao-song/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/zhao-song/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Zhao Song # Zhao Song Zhao Song has 2 papers in our library, in 2023, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Christopher Ré](https://md.research.elamur.ai/free/en/authors/christopher-re/), [Tianyi Zhou](https://md.research.elamur.ai/free/en/authors/tianyi-zhou/), [Yuandong Tian](https://md.research.elamur.ai/free/en/authors/yuandong-tian/). 2 papers in our library · 2023 [OpenAlex](https://openalex.org/A5014701378) · [ORCID](https://orcid.org/0000-0002-8787-5250) · [**h-index 9**](https://openalex.org/authors/A5014701378) · [31 works](https://openalex.org/works?filter=author.id:A5014701378) · [276 citations](https://openalex.org/works?filter=author.id:A5014701378&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/zhao-song/#papers) · [🔗 Cited 289 times in our library](https://md.research.elamur.ai/free/en/authors/zhao-song/cited-by/) · [⭐ Paper Stars ranking: #5471](https://md.research.elamur.ai/free/en/paper-stars/page/55/#star-5471) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Zhao+Song) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Zhao+Song) · [dblp](https://dblp.org/search?q=Zhao+Song) · [ACL Anthology](https://aclanthology.org/search/?q=Zhao+Song) ## Affiliations [🎓**Kunming University of Science and Technology** Kunming · China 2026 · 1 paper*current*](https://md.research.elamur.ai/free/en/universities/kunming-university-of-science-and-technology/) · [🏛️**Chinese Academy of Sciences** Beijing · China 2011–2025 · 10 papers](https://md.research.elamur.ai/free/en/government/chinese-academy-of-sciences/) · [🎓**Zhengzhou University of Aeronautics** Zhengzhou · China 2008–2024 · 10 papers](https://ror.org/01qjyzh50) · [🔬**Shenzhen Institutes of Advanced Technology** Shenzhen · China 2018–2025 · 6 papers](https://md.research.elamur.ai/free/en/labs/shenzhen-institutes-of-advanced-technology/) · [🎓**University of Chinese Academy of Sciences** Beijing · China 2012–2020 · 6 papers](https://md.research.elamur.ai/free/en/universities/university-of-chinese-academy-of-sciences/) · [🎓**Chinese University of Hong Kong** Hong Kong · China 2018–2025 · 5 papers](https://md.research.elamur.ai/free/en/universities/chinese-university-of-hong-kong/) · [🔬**Institute of Coal Chemistry** Taiyuan · China 2012–2013 · 2 papers](https://ror.org/05j73fd60) · [🎓**Naval University of Engineering** Wuhan · China 2010 · 2 papers](https://ror.org/056vyez31) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 4 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Vision and Pattern Recognition · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Language and Linguistics · 1 work](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 2 works](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2023** 2 papers](https://md.research.elamur.ai/free/en/authors/zhao-song/year/2023/) ## Papers The most cited first (OpenAlex and our library). 1. **[Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time](https://md.research.elamur.ai/free/en/papers/liu-2023-deja-vu-contextual-sparsity-efficient/)** *(2023 · 185 citations)* Serving very large language models is slow, especially when generating tokens one at a time in latency-sensitive settings. 2. **[H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhang-2023-h-2-o-heavy-hitter/)** *(2023 · 124 citations)* Serving large language models is costly partly because of the KV cache. This is the stored attention keys and values, and it grows linearly with batch size and sequence length. A 30B model with batch 128 and 1024-token sequences already needs about 180GB. The authors look for a way to cap this cache without hurting… ## Co-authors here 12 of 14 co-authors with a page, the most papers together first. - [Christopher Ré](https://md.research.elamur.ai/free/en/authors/christopher-re/) ×2 - [Tianyi Zhou](https://md.research.elamur.ai/free/en/authors/tianyi-zhou/) ×2 - [Yuandong Tian](https://md.research.elamur.ai/free/en/authors/yuandong-tian/) ×2 - [Beidi Chen](https://md.research.elamur.ai/free/en/authors/beidi-chen/) - [Binhang Yuan](https://md.research.elamur.ai/free/en/authors/binhang-yuan/) - [Ce Zhang](https://md.research.elamur.ai/free/en/authors/ce-zhang/) - [Clark Barrett](https://md.research.elamur.ai/free/en/authors/clark-barrett/) - [Jue Wang](https://md.research.elamur.ai/free/en/authors/jue-wang/) - [Lianmin Zheng](https://md.research.elamur.ai/free/en/authors/lianmin-zheng/) - [Tianlong Chen](https://md.research.elamur.ai/free/en/authors/tianlong-chen/) - [Tri Dao](https://md.research.elamur.ai/free/en/authors/tri-dao/) - [Ying Sheng](https://md.research.elamur.ai/free/en/authors/ying-sheng/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [International Conference on Machine Learning (ICML)](https://md.research.elamur.ai/free/en/venues/international-conference-on-machine-learning/): [ICML 2023](https://md.research.elamur.ai/free/en/venues/international-conference-on-machine-learning/2023/) ## Cited by Papers of our library cite their works 289 times (of the 149,439 papers whose bibliographies we read); [45 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/zhao-song/cited-by/). Updated 2 November 2026