--- title: "Junyuan Shang — author profile and papers — Elamur Research" description: "Junyuan Shang, South China University of Technology: 4 papers on Elamur Research (2020–2025), h-index 13 — affiliations, topics…" canonical: "https://research.elamur.ai/free/en/authors/junyuan-shang/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/junyuan-shang/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Junyuan Shang # Junyuan Shang Junyuan Shang has 4 papers in our library, in 2020–2025, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Shuohuan Wang](https://md.research.elamur.ai/free/en/authors/shuohuan-wang/), [Yu Sun](https://md.research.elamur.ai/free/en/authors/yu-sun/), [Siyu Ding](https://md.research.elamur.ai/free/en/authors/siyu-ding/). 4 papers in our library · 2020–2025 [OpenAlex](https://openalex.org/A5023311055) · [ORCID](https://orcid.org/0000-0003-4301-750X) · [**h-index 13**](https://openalex.org/authors/A5023311055) · [67 works](https://openalex.org/works?filter=author.id:A5023311055) · [1,861 citations](https://openalex.org/works?filter=author.id:A5023311055&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 4 works in our library](https://md.research.elamur.ai/free/en/authors/junyuan-shang/#papers) · [🔗 Cited 237 times in our library](https://md.research.elamur.ai/free/en/authors/junyuan-shang/cited-by/) · [2 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #4591](https://md.research.elamur.ai/free/en/paper-stars/page/46/#star-4591) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Junyuan+Shang) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Junyuan+Shang) · [dblp](https://dblp.org/search?q=Junyuan+Shang) · [ACL Anthology](https://aclanthology.org/search/?q=Junyuan+Shang) ## Affiliations [🏢**Baidu** Beijing · China 2020–2026 · 26 papers*current*](https://md.research.elamur.ai/free/en/companies/baidu/) · [🎓**South China University of Technology** Guangzhou · China 2018–2026 · 21 papers*current*](https://md.research.elamur.ai/free/en/universities/south-china-university-of-technology/) · [🎓**Peking University** Beijing · China 2017–2021 · 10 papers](https://md.research.elamur.ai/free/en/universities/peking-university/) · [🎓**Georgia Institute of Technology** Atlanta · United States 2018–2019 · 2 papers](https://md.research.elamur.ai/free/en/universities/georgia-institute-of-technology/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 4 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Vision and Pattern Recognition · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Language and Linguistics · 4 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 2 works](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2025** 1 paper](https://md.research.elamur.ai/free/en/authors/junyuan-shang/year/2025/) · [**2021** 2 papers](https://md.research.elamur.ai/free/en/authors/junyuan-shang/year/2021/) · [**2020** 1 paper](https://md.research.elamur.ai/free/en/authors/junyuan-shang/year/2020/) ## Papers The most cited first (OpenAlex and our library). 1. **[ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation](https://md.research.elamur.ai/free/en/papers/sun-2021-ernie-3-0-large/)** *(2021 · 332 citations)* Most very large language models, such as GPT-3, learn only from raw text and are trained auto-regressively. 2. **[ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation](https://md.research.elamur.ai/free/en/papers/wang-2021-ernie-3-0-titan/)** *(2021 · 63 citations)* Very large language models such as GPT-3 show that scale pays off. However, most are trained on plain text only, and their outputs are hard to steer or verify against real-world facts. This work scales up the knowledge-enhanced ERNIE 3.0 framework, which combines auto-encoding and auto-regressive networks and learns… 3. **[ERNIE-Doc: A Retrospective Long-Document Modeling Transformer](https://md.research.elamur.ai/free/en/papers/ding-2020-ernie-doc-retrospective-long/)** *(2020 · 27 citations)* Standard Transformers struggle with long documents because self-attention cost grows quadratically with input length. 4. **[Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking](https://md.research.elamur.ai/free/en/papers/chen-2025-inner-thinking-transformer-leveraging-dynamic/)** *(2025 · 16 citations)* Larger LLMs bring diminishing returns, and small models hit capacity limits. Chain-of-Thought style test-time scaling also has a weakness: it only works if the model produces the critical tokens correctly. The authors trained GPT-2 on AQuA and tracked gradient norms layer by layer. Tokens the model gets right settle… ## All works 6 works of theirs in our library, the most cited first; 4 with a page here, the others link their original until we summarise them. 1. **[GAMENet: Graph Augmented MEmory Networks for Recommending Medication Combination ↗](https://doi.org/10.1609/aaai.v33i01.33011126) Proceedings of the AAAI Conference on Artificial Intelligence · no summary yet**Junyuan Shang et al.*2019 · 341 citations* 2. [**ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation arXiv:2107.02137**Yu Sun, Shuohuan Wang, Shikun Feng, et al.*2021 · 332 citations*](https://md.research.elamur.ai/free/en/papers/sun-2021-ernie-3-0-large/) 3. **[Pre-training of Graph Augmented Transformers for Medication Recommendation ↗](https://doi.org/10.24963/ijcai.2019/825) International Joint Conference on Artificial Intelligence · no summary yet**Junyuan Shang et al.*2019 · 313 citations* 4. [**ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation arXiv:2112.12731**Shuohuan Wang, Yu Sun, Yang Xiang, et al.*2021 · 63 citations*](https://md.research.elamur.ai/free/en/papers/wang-2021-ernie-3-0-titan/) 5. [**ERNIE-Doc: A Retrospective Long-Document Modeling Transformer arXiv:2012.15688**Siyu Ding, Junyuan Shang, Shuohuan Wang, et al.*2020 · 27 citations*](https://md.research.elamur.ai/free/en/papers/ding-2020-ernie-doc-retrospective-long/) 6. **[Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking](https://md.research.elamur.ai/free/en/papers/chen-2025-inner-thinking-transformer-leveraging-dynamic/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Yilong Chen, Junyuan Shang, Zhenyu Zhang, et al.*2025 · 16 citations* ## Co-authors here 12 of 18 co-authors with a page, the most papers together first. - [Shuohuan Wang](https://md.research.elamur.ai/free/en/authors/shuohuan-wang/) ×4 - [Yu Sun](https://md.research.elamur.ai/free/en/authors/yu-sun/) ×4 - [Siyu Ding](https://md.research.elamur.ai/free/en/authors/siyu-ding/) ×3 - [Chao Pang](https://md.research.elamur.ai/free/en/authors/chao-pang/) ×2 - [Haifeng Wang](https://md.research.elamur.ai/free/en/authors/haifeng-wang/) ×2 - [Hua Ren Wu](https://md.research.elamur.ai/free/en/authors/hua-ren-wu/) ×2 - [Jiaxiang Liu](https://md.research.elamur.ai/free/en/authors/jiaxiang-liu/) ×2 - [Shikun Feng](https://md.research.elamur.ai/free/en/authors/shikun-feng/) ×2 - [Xuyi Chen](https://md.research.elamur.ai/free/en/authors/xuyi-chen/) ×2 - [Yanbin Zhao](https://md.research.elamur.ai/free/en/authors/yanbin-zhao/) ×2 - [Zhihua Wu](https://md.research.elamur.ai/free/en/authors/zhihua-wu/) ×2 - [Hao Tian](https://md.research.elamur.ai/free/en/authors/hao-tian/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/): [ACL 2025](https://md.research.elamur.ai/free/en/venues/acl/2025/) - International Joint Conference on Artificial Intelligence - Proceedings of the AAAI Conference on Artificial Intelligence ## Cited by Papers of our library cite their works 237 times (of the 149,439 papers whose bibliographies we read); [49 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/junyuan-shang/cited-by/). Updated 30 October 2026