--- title: "Weigao Sun — author profile and papers — Elamur Research" description: "Weigao Sun, Shanghai Artificial Intelligence Laboratory: 5 papers on Elamur Research (2023–2025), h-index 6 — affiliations, topics…" canonical: "https://research.elamur.ai/free/en/authors/weigao-sun/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/weigao-sun/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Weigao Sun # Weigao Sun Weigao Sun has 5 papers in our library, in 2023–2025, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/); often with [Disen Lan](https://md.research.elamur.ai/free/en/authors/disen-lan/), [Dong Li](https://md.research.elamur.ai/free/en/authors/dong-li/), [Jiaxi Hu](https://md.research.elamur.ai/free/en/authors/jiaxi-hu/). 5 papers in our library · 2023–2025 [OpenAlex](https://openalex.org/A5037718676) · [ORCID](https://orcid.org/0000-0003-2551-924X) · [**h-index 6**](https://openalex.org/authors/A5037718676) · [38 works](https://openalex.org/works?filter=author.id:A5037718676) · [210 citations](https://openalex.org/works?filter=author.id:A5037718676&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 5 works in our library](https://md.research.elamur.ai/free/en/authors/weigao-sun/#papers) · [🔗 Cited 188 times in our library](https://md.research.elamur.ai/free/en/authors/weigao-sun/cited-by/) · [2 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #6367](https://md.research.elamur.ai/free/en/paper-stars/page/64/#star-6367) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Weigao+Sun) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Weigao+Sun) · [dblp](https://dblp.org/search?q=Weigao+Sun) · [ACL Anthology](https://aclanthology.org/search/?q=Weigao+Sun) ## Affiliations [🔬**Shanghai Artificial Intelligence Laboratory** Shanghai · China 2023–2026 · 13 papers*current*](https://md.research.elamur.ai/free/en/labs/shanghai-artificial-intelligence-laboratory/) · [🎓**Huazhong University of Science and Technology** Wuhan · China 2018–2020 · 9 papers](https://md.research.elamur.ai/free/en/universities/huazhong-university-of-science-and-technology/) · [🔬**State Key Laboratory of Digital Manufacturing Equipment and Technology** Wuhan · China 2019 · 5 papers](https://ror.org/004z1wz18) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 6 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 5 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 5 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 5 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 5 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Computer Vision and Pattern Recognition · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Hardware and Architecture · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/hardware-and-architecture/) 🧭 Topics 2 Research subjects and languages the work is about.[Language models & pretraining · 3 works](https://md.research.elamur.ai/free/en/topics/language-models/) · [Reasoning · 1 work](https://md.research.elamur.ai/free/en/topics/reasoning/) ## Works by year ### 2020s [**2025** 3 papers](https://md.research.elamur.ai/free/en/authors/weigao-sun/year/2025/) · [**2024** 1 paper](https://md.research.elamur.ai/free/en/authors/weigao-sun/year/2024/) · [**2023** 1 paper](https://md.research.elamur.ai/free/en/authors/weigao-sun/year/2023/) ## Papers The most cited first (OpenAlex and our library). 1. **[A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond](https://md.research.elamur.ai/free/en/papers/qu-2025-survey-efficient-reasoning-large-reasoning/)** *(2025 · 55 citations)* Large Reasoning Models (LRMs) such as DeepSeek-R1, OpenAI o1/o3 and QwQ gain accuracy by writing long chain-of-thought (CoT) traces before answering. 2. **[TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer](https://md.research.elamur.ai/free/en/papers/qin-2023-transnormerllm-faster-better-large/)** *(2023 · 33 citations)* Linear attention promises to remove the quadratic cost of softmax attention. In practice, earlier linear-attention models have trailed Transformers in language-modeling quality and rarely ran faster on real hardware. The authors close this gap with TransNormerLLM, a redesigned version of their TransNormer… 3. **[Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models](https://md.research.elamur.ai/free/en/papers/qin-2024-lightning-attention-2-free/)** *(2024 · 31 citations)* Linear attention should cost O(n) instead of the O(n²) of softmax attention. In causal language modeling, however, existing implementations lose this advantage: the kernel trick needs a cumulative summation (cumsum) that parallelizes poorly on GPUs. Lightning Attention-1 had already reduced the memory-I/O bottleneck… 4. **[Liger: Linearizing Large Language Models to Gated Recurrent Structures](https://md.research.elamur.ai/free/en/papers/lan-2025-liger-linearizing-large-language-models/)** *(2025 · 9 citations)* Transformer LLMs have attention cost that grows quadratically with sequence length, and their KV cache keeps growing during generation. 5. **[MoM: Linear Sequence Modeling with Mixture-of-Memories](https://md.research.elamur.ai/free/en/papers/du-2025-mom-linear-sequence-modeling-mixture/)** *(2025 · 7 citations)* Linear sequence models such as linear attention, state space models and linear RNNs train in linear time and run inference with constant cost. ## All works 7 works of theirs in our library, the most cited first; 5 with a page here, the others link their original until we summarise them. 1. [**A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond arXiv:2503.21614**Xiaoye Qu, Yafu Li, Zhao-Chen Su, et al.*2025 · 55 citations*](https://md.research.elamur.ai/free/en/papers/qu-2025-survey-efficient-reasoning-large-reasoning/) 2. [**TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer arXiv:2307.14995**Zhen Qin, Dong Li, Weigao Sun, et al.*2023 · 33 citations*](https://md.research.elamur.ai/free/en/papers/qin-2023-transnormerllm-faster-better-large/) 3. [**Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models arXiv:2401.04658**Zhen Qin, Weigao Sun, Dong Li, et al.*2024 · 31 citations*](https://md.research.elamur.ai/free/en/papers/qin-2024-lightning-attention-2-free/) 4. **[Linear Attention Sequence Parallelism ↗](https://arxiv.org/abs/2404.02882) arXiv:2404.02882 · no summary yet**Weigao Sun et al.*2024 · 12 citations* 5. [**Liger: Linearizing Large Language Models to Gated Recurrent Structures arXiv:2503.01496**Disen Lan, Weigao Sun, Jiaxi Hu, et al.*2025 · 9 citations*](https://md.research.elamur.ai/free/en/papers/lan-2025-liger-linearizing-large-language-models/) 6. [**MoM: Linear Sequence Modeling with Mixture-of-Memories arXiv:2502.13685**Jusen Du, Weigao Sun, Disen Lan, et al.*2025 · 7 citations*](https://md.research.elamur.ai/free/en/papers/du-2025-mom-linear-sequence-modeling-mixture/) 7. **[CogniBench: A Legal-inspired Framework and Dataset for Assessing Cognitive Faithfulness of Large Language Models ↗](https://aclanthology.org/2025.acl-long.1046/) Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Xiaqiang Tang et al.*2025 · 4 citations* ## Co-authors here 12 of 20 co-authors with a page, the most papers together first. - [Disen Lan](https://md.research.elamur.ai/free/en/authors/disen-lan/) ×2 - [Dong Li](https://md.research.elamur.ai/free/en/authors/dong-li/) ×2 - [Jiaxi Hu](https://md.research.elamur.ai/free/en/authors/jiaxi-hu/) ×2 - [Jusen Du](https://md.research.elamur.ai/free/en/authors/jusen-du/) ×2 - [Weixuan Sun](https://md.research.elamur.ai/free/en/authors/weixuan-sun/) ×2 - [Xuyang Shen](https://md.research.elamur.ai/free/en/authors/xuyang-shen/) ×2 - [Yiran Zhong](https://md.research.elamur.ai/free/en/authors/yiran-zhong/) ×2 - [Yu Cheng](https://md.research.elamur.ai/free/en/authors/yu-cheng/) ×2 - [Zhen Qin](https://md.research.elamur.ai/free/en/authors/zhen-qin/) ×2 - [Daizong Liu](https://md.research.elamur.ai/free/en/authors/daizong-liu/) - [Dongrui Liu](https://md.research.elamur.ai/free/en/authors/dongrui-liu/) - [Ganqu Cui](https://md.research.elamur.ai/free/en/authors/ganqu-cui/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) ## Cited by Papers of our library cite their works 188 times (of the 149,439 papers whose bibliographies we read); [44 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/weigao-sun/cited-by/). Updated 1 November 2026