--- title: "Simeng Sun — author profile and papers — Elamur Research" description: "Simeng Sun, Nanjing Municipal Center for Disease Control And Prevention: 2 papers on Elamur Research (2021–2024), h-index 14…" canonical: "https://research.elamur.ai/free/en/authors/simeng-sun/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/simeng-sun/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Simeng Sun # Simeng Sun Simeng Sun has 2 papers in our library, in 2021–2024, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Andrew Mattarella-Micke](https://md.research.elamur.ai/free/en/authors/andrew-mattarella-micke/), [Boris Ginsburg](https://md.research.elamur.ai/free/en/authors/boris-ginsburg/), [Cheng-Ping Hsieh](https://md.research.elamur.ai/free/en/authors/cheng-ping-hsieh/). 2 papers in our library · 2021–2024 [OpenAlex](https://openalex.org/A5027122116) · [ORCID](https://orcid.org/0000-0001-9695-9336) · [**h-index 14**](https://openalex.org/authors/A5027122116) · [43 works](https://openalex.org/works?filter=author.id:A5027122116) · [821 citations](https://openalex.org/works?filter=author.id:A5027122116&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/simeng-sun/#papers) · [🔗 Cited 524 times in our library](https://md.research.elamur.ai/free/en/authors/simeng-sun/cited-by/) · [3 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #3404](https://md.research.elamur.ai/free/en/paper-stars/page/35/#star-3404) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Simeng+Sun) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Simeng+Sun) · [dblp](https://dblp.org/search?q=Simeng+Sun) · [ACL Anthology](https://aclanthology.org/search/?q=Simeng+Sun) ## Affiliations [🏛️**Nanjing Municipal Center for Disease Control And Prevention** Nanjing · China 2024–2026 · 2 papers*current*](https://ror.org/03gdvgj95) · [🎓**University of Massachusetts Amherst** Amherst Center · United States 2020–2024 · 19 papers](https://md.research.elamur.ai/free/en/universities/university-of-massachusetts-amherst/) · [🎓**University of Science and Technology of China** Hefei · China 2019–2023 · 8 papers](https://md.research.elamur.ai/free/en/universities/university-of-science-and-technology-of-china/) · [🏢**Microsoft** Redmond · United States 2023–2024 · 3 papers](https://md.research.elamur.ai/free/en/companies/microsoft/) · [🏢**Meta** Menlo Park · United States 2021–2023 · 3 papers](https://md.research.elamur.ai/free/en/companies/meta/) · [🏢**Adobe Systems** San Jose · United States 2021 · 2 papers](https://md.research.elamur.ai/free/en/companies/adobe-systems/) · [🎓**Beihang University** Beijing · China 2017–2018 · 2 papers](https://md.research.elamur.ai/free/en/universities/beihang-university/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 5 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Computer Vision and Pattern Recognition · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 2 works](https://md.research.elamur.ai/free/en/topics/language-models/) ## Works by year ### 2020s [**2024** 1 paper Simeng Sun's papers of 2024](https://md.research.elamur.ai/free/en/papers/hsieh-2024-ruler-s-real-context-size/) · [**2021** 1 paper Simeng Sun's papers of 2021](https://md.research.elamur.ai/free/en/papers/sun-2021-do-long-range-language-models/) ## Papers The most cited first (OpenAlex and our library). 1. **[RULER: What's the Real Context Size of Your Long-Context Language Models?](https://md.research.elamur.ai/free/en/papers/hsieh-2024-ruler-s-real-context-size/)** *(2024 · 386 citations)* Long-context language models are usually checked with the needle-in-a-haystack (NIAH) test. That test only shows whether a model can find one planted fact, so it says little about deeper use of long inputs. The NVIDIA authors built RULER, a fully synthetic benchmark whose input length and difficulty can be set… 2. **[Do Long-Range Language Models Actually Use Long-Range Context?](https://md.research.elamur.ai/free/en/papers/sun-2021-do-long-range-language-models/)** *(2021 · 100 citations)* Long-range Transformer language models can now read thousands of tokens of preceding text, and they reach lower perplexity on benchmarks such as PG-19. ## All works 5 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. [**RULER: What's the Real Context Size of Your Long-Context Language Models? arXiv:2404.06654**Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.*2024 · 386 citations*](https://md.research.elamur.ai/free/en/papers/hsieh-2024-ruler-s-real-context-size/) 2. **[TopicGPT: A Prompt-based Topic Modeling Framework ↗](https://aclanthology.org/2024.naacl-long.164/) NAACL 2024 · no summary yet**Chau Minh Pham et al.*2024 · 167 citations* 3. **[Do Long-Range Language Models Actually Use Long-Range Context?](https://md.research.elamur.ai/free/en/papers/sun-2021-do-long-range-language-models/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Simeng Sun, Kalpesh Krishna, Andrew Mattarella-Micke, et al.*2021 · 100 citations* 4. **[Suri: Multi-constraint Instruction Following in Long-form Text Generation ↗](https://aclanthology.org/2024.findings-emnlp.94/) Findings of the Association for Computational Linguistics: EMNLP 2024 · no summary yet**Chau Minh Pham, Simeng Sun, Mohit Iyyer*2024 · 18 citations* 5. **[Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHF ↗](https://arxiv.org/abs/2309.09055) arXiv:2309.09055 · no summary yet**Simeng Sun, Dhawal Gupta, Mohit Iyyer*2023 · 9 citations* ## Co-authors here 6 co-authors with a page, the most papers together first. - [Andrew Mattarella-Micke](https://md.research.elamur.ai/free/en/authors/andrew-mattarella-micke/) - [Boris Ginsburg](https://md.research.elamur.ai/free/en/authors/boris-ginsburg/) - [Cheng-Ping Hsieh](https://md.research.elamur.ai/free/en/authors/cheng-ping-hsieh/) - [Kalpesh Krishna](https://md.research.elamur.ai/free/en/authors/kalpesh-krishna/) - [Mohit Iyyer](https://md.research.elamur.ai/free/en/authors/mohit-iyyer/) - [Yang Zhang](https://md.research.elamur.ai/free/en/authors/yang-zhang/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/): [EMNLP 2021](https://md.research.elamur.ai/free/en/venues/emnlp/2021/) - Findings of the Association for Computational Linguistics: EMNLP 2024 - NAACL 2024 ## Cited by Papers of our library cite their works 524 times (of the 141,840 papers whose bibliographies we read); [31 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/simeng-sun/cited-by/). Updated 24 October 2026