---
title: "Zheng Yuan · University of Sheffield — author profile and papers"
description: "Zheng Yuan, University of Sheffield: 6 papers on Elamur Research (2017–2025), h-index 19 — affiliations, topics, co-authors and who cites…"
canonical: "https://research.elamur.ai/free/en/authors/zheng-yuan/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/zheng-yuan/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Zheng Yuan

# Zheng Yuan

Zheng Yuan works in natural language processing. Their papers here centre on how large language models are trained, aligned with human preferences and taught to solve problems, alongside an earlier strand on detecting errors in learner writing. A recurring question is how training data shapes what a model can do: how much of it there is, where it comes from, and how different kinds are combined. The usual method is to fine-tune open LLaMA-family models and test them on public benchmarks. GSM8K, a benchmark for mathematical [reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/), appears often.

The most cited of these papers is [Scaling Relationship on Learning Mathematical Reasoning with Large Language Models](https://md.research.elamur.ai/free/en/papers/yuan-2023-scaling-relationship-learning-mathematical-reasoning/). It studies how improvements from fine-tuning on math word problems vary with the underlying model and the size of the training set. It also introduces rejection sampling fine-tuning, where a model generates many candidate solutions per question and keeps the distinct correct ones as additional examples. [RRHF](https://md.research.elamur.ai/free/en/papers/yuan-2023-rrhf-rank-responses-align-language/) offers a lighter route to preference alignment than the PPO stage of the standard RLHF pipeline. It gathers candidate answers produced by the model, by other systems or by human writers, scores them, and trains with a ranking loss. Earlier, [Artificial Error Generation with Machine Translation and Syntactic Patterns](https://md.research.elamur.ai/free/en/papers/rei-2017-artificial-error-generation-machine-translation/), written with [Marek Rei](https://md.research.elamur.ai/free/en/authors/marek-rei/) and Mariano Felice, created synthetic faulty sentences from correct text to compensate for the shortage of annotated learner writing.

The newest work moves from single skills to combinations of them. [How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition](https://md.research.elamur.ai/free/en/papers/dong-2024-how-abilities-large-language-models/) (2024) blends fine-tuning data for mathematics, code generation and general alignment. It then looks at how the volume of each kind of data, the proportions in which they are blended, the size of the model and the order of training influence each skill.

Yuan is currently at the [University of Sheffield](https://md.research.elamur.ai/free/en/universities/university-of-sheffield/), after earlier periods at [King's College London](https://md.research.elamur.ai/free/en/universities/king-s-college-london/) and the [University of Cambridge](https://md.research.elamur.ai/free/en/universities/university-of-cambridge/), where the work on learner errors was done. The language-model papers grew out of collaborations with [Alibaba Group](https://md.research.elamur.ai/free/en/companies/alibaba-group/) and [Tsinghua University](https://md.research.elamur.ai/free/en/universities/tsinghua-university/). Frequent co-authors include [Hongyi Yuan](https://md.research.elamur.ai/free/en/authors/hongyi-yuan/), Guanting Dong, Keming Lu and Chengpeng Li.

Zheng Yuan has 6 papers in our library, in 2017–2025, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/), [Summarization](https://md.research.elamur.ai/free/en/topics/summarization/); often with [Hongyi Yuan](https://md.research.elamur.ai/free/en/authors/hongyi-yuan/), [Chang Zhou](https://md.research.elamur.ai/free/en/authors/chang-zhou/), [Chengpeng Li](https://md.research.elamur.ai/free/en/authors/chengpeng-li/).

6 papers in our library · 2017–2025

[OpenAlex](https://openalex.org/A5028562219) · [ORCID](https://orcid.org/0000-0003-2406-1708) · [**h-index 19**](https://openalex.org/authors/A5028562219) · [88 works](https://openalex.org/works?filter=author.id:A5028562219) · [1,356 citations](https://openalex.org/works?filter=author.id:A5028562219&sort=cited_by_count:desc) OpenAlex, 2026-10-14

[📄 6 works in our library](https://md.research.elamur.ai/free/en/authors/zheng-yuan/#papers) · [🔗 Cited 983 times in our library](https://md.research.elamur.ai/free/en/authors/zheng-yuan/cited-by/) · [7 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #2495](https://md.research.elamur.ai/free/en/paper-stars/page/25/#star-2495)

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Zheng+Yuan) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Zheng+Yuan) · [dblp](https://dblp.org/search?q=Zheng+Yuan) · [ACL Anthology](https://aclanthology.org/search/?q=Zheng+Yuan)

## Affiliations

[🎓**University of Sheffield** Sheffield · United Kingdom 2025–2026 · 9 papersEmployment since 2025 · Senior Lecturer, School of Computer Science*current*](https://md.research.elamur.ai/free/en/universities/university-of-sheffield/) · [🎓**University of Cambridge** Cambridge · United Kingdom 2013–2024 · 21 papersEmployment 2016–2022 · Research Associate, Department of Computer Science and Technology](https://md.research.elamur.ai/free/en/universities/university-of-cambridge/) · [🎓**King's College London** London · United Kingdom 2022–2025 · 15 papersEmployment until 2025Employment 2022–2025 · Lecturer, Department of Informatics](https://md.research.elamur.ai/free/en/universities/king-s-college-london/) · [🎓**Tsinghua University** Beijing · China 2021–2023 · 5 papers](https://md.research.elamur.ai/free/en/universities/tsinghua-university/) · [🎓**Beijing Jiaotong University** Beijing · China 2021–2024 · 4 papers](https://md.research.elamur.ai/free/en/universities/beijing-jiaotong-university/) · [🎓**Southwest Jiaotong University** Chengdu · China 2007–2020 · 3 papers](https://ror.org/00hn7w693) · [🎓**Shanghai Jiao Tong University** Shanghai · China 2024–2025 · 2 papers](https://md.research.elamur.ai/free/en/universities/shanghai-jiao-tong-university/) · [🏥**Shanghai Ninth People's Hospital** Shanghai · China 2024–2025 · 2 papers](https://ror.org/010826a91) · [🏢**Alibaba Group** Hangzhou · China 2023 · 2 papers](https://md.research.elamur.ai/free/en/companies/alibaba-group/) · [🎓**Northwestern University** Evanston · United States 2018–2020 · 2 papers](https://md.research.elamur.ai/free/en/universities/northwestern-university/)

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 14 more institutions on single bylines are not listed.

## Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 7 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 6 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 6 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 6 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 6 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Computational Theory and Mathematics · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computational-theory-and-mathematics/) · [Computer Vision and Pattern Recognition · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · [Information Systems · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/)

🧭 Topics 6 Research subjects and languages the work is about.[Language models & pretraining · 4 works](https://md.research.elamur.ai/free/en/topics/language-models/) · [Reasoning · 1 work](https://md.research.elamur.ai/free/en/topics/reasoning/) · [Machine translation · 1 work](https://md.research.elamur.ai/free/en/topics/machine-translation/) · [Information retrieval & search · 1 work](https://md.research.elamur.ai/free/en/topics/information-retrieval/) · [Evaluation & benchmarks · 1 work](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [Summarization · 1 work](https://md.research.elamur.ai/free/en/topics/summarization/)

## Works by year

### 2020s

[**2025** 1 paper Zheng Yuan's papers of 2025](https://md.research.elamur.ai/free/en/papers/zhang-2025-survey-graph-retrieval-augmented-generation/) · [**2024** 1 paper Zheng Yuan's papers of 2024](https://md.research.elamur.ai/free/en/papers/dong-2024-how-abilities-large-language-models/) · [**2023** 3 papers Zheng Yuan's papers of 2023](https://md.research.elamur.ai/free/en/authors/zheng-yuan/year/2023/)

### 2010s

[**2017** 1 paper Zheng Yuan's papers of 2017](https://md.research.elamur.ai/free/en/papers/rei-2017-artificial-error-generation-machine-translation/)

## Papers

The most cited first (OpenAlex and our library).

1. **[Scaling Relationship on Learning Mathematical Reasoning with Large Language Models](https://md.research.elamur.ai/free/en/papers/yuan-2023-scaling-relationship-learning-mathematical-reasoning/)** *(2023 · 252 citations)* Solving math word problems is hard for LLMs, and it was unclear how fine-tuning gains depend on the base model and on how much data is available.
2. **[RRHF: Rank Responses to Align Language Models with Human Feedback without tears](https://md.research.elamur.ai/free/en/papers/yuan-2023-rrhf-rank-responses-align-language/)** *(2023 · 194 citations)* Large language models are usually aligned with human preferences using the RLHF pipeline from InstructGPT.
3. **[How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition](https://md.research.elamur.ai/free/en/papers/dong-2024-how-abilities-large-language-models/)** *(2024 · 145 citations)* Open-source models are usually fine-tuned for one skill at a time, while proprietary LLMs handle many skills at once.
4. **[Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence Tasks](https://md.research.elamur.ai/free/en/papers/sottana-2023-evaluation-metrics-era-gpt-4/)** *(2023 · 89 citations)* The authors examine whether standard automatic metrics still judge modern generative LLMs fairly on sequence-to-sequence tasks.
5. **[Artificial Error Generation with Machine Translation and Syntactic Patterns](https://md.research.elamur.ai/free/en/papers/rei-2017-artificial-error-generation-machine-translation/)** *(2017 · 82 citations)* Automated detection of writing errors is limited by the small amount of manually annotated learner data. Rei, Felice, Yuan and Briscoe (Cambridge, ALTA Institute) address this by synthesising erroneous text from correct sentences. They compare two supervised approaches, both trained on the public FCE training set…
6. **[A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models](https://md.research.elamur.ai/free/en/papers/zhang-2025-survey-graph-retrieval-augmented-generation/)** *(2025 · 64 citations)* General-purpose LLMs often fall short in specialized fields. Their domain knowledge is shallow, they struggle with long chains of rule-bound reasoning, and they misread terms whose meaning depends on context. Fine-tuning on domain data can introduce hallucinations and catastrophic forgetting. Classic RAG avoids…

## All works

13 works of theirs in our library, the most cited first; 6 with a page here, the others link their original until we summarise them.

1. **[Grammatical error correction using neural machine translation ↗](https://aclanthology.org/N16-1042/) Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yet**Zheng Yuan, Ted Briscoe*2016 · 339 citations*
2. [**Scaling Relationship on Learning Mathematical Reasoning with Large Language Models arXiv:2308.01825**Zheng Yuan, Hongyi Yuan, Chengpeng Li, et al.*2023 · 252 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2023-scaling-relationship-learning-mathematical-reasoning/)
3. [**RRHF: Rank Responses to Align Language Models with Human Feedback without tears arXiv:2304.05302**Zheng Yuan, Hongyi Yuan, Chuanqi Tan, et al.*2023 · 194 citations*](https://md.research.elamur.ai/free/en/papers/yuan-2023-rrhf-rank-responses-align-language/)
4. **[How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition](https://md.research.elamur.ai/free/en/papers/dong-2024-how-abilities-large-language-models/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Guanting Dong, Hongyi Yuan, Keming Lu, et al.*2024 · 145 citations*
5. **[Constrained Grammatical Error Correction using Statistical Machine Translation ↗](https://aclanthology.org/W13-3607/) Proceedings of the Seventeenth Conference on Computational Natural Language Learning: Shared Task · no summary yet**Zheng Yuan, Mariano Felice*2013 · 98 citations*
6. **[How well do Large Language Models perform in Arithmetic tasks? ↗](https://arxiv.org/abs/2304.02015) arXiv:2304.02015 · no summary yet**Zheng Yuan et al.*2023 · 91 citations*
7. **[Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence Tasks](https://md.research.elamur.ai/free/en/papers/sottana-2023-evaluation-metrics-era-gpt-4/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Andrea Sottana, Bin Liang, Kai Zou, et al.*2023 · 89 citations*
8. **[Artificial Error Generation with Machine Translation and Syntactic Patterns](https://md.research.elamur.ai/free/en/papers/rei-2017-artificial-error-generation-machine-translation/) [Workshop on Innovative Use of NLP for Building Educational Applications (BEA)](https://md.research.elamur.ai/free/en/venues/bea/)**Marek Rei, Mariano Felice, Zheng Yuan, et al.*2017 · 82 citations*
9. [**A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Models arXiv:2501.13958**Qinggang Zhang, Shengyuan Chen, Yuanchen Bei, et al.*2025 · 64 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2025-survey-graph-retrieval-augmented-generation/)
10. **[On the application of Large Language Models for language teaching and assessment technology ↗](https://arxiv.org/abs/2307.08393) arXiv:2307.08393 · no summary yet**Andrew Caines et al.*2023 · 51 citations*
11. **[The BEA 2023 Shared Task on Generating AI Teacher Responses in Educational Dialogues ↗](https://aclanthology.org/2023.bea-1.64/) Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2023) · no summary yet**Anaïs Tack et al.*2023 · 51 citations*
12. **[Prompting open-source and commercial language models for grammatical error correction of English learner text ↗](https://aclanthology.org/2024.findings-acl.711/) Findings of the Association for Computational Linguistics: ACL 2024 · no summary yet**Christopher Davis et al.*2024 · 42 citations*
13. **[How effective is machine translation on low-resource code-switching? A case study comparing human and automatic metrics ↗](https://aclanthology.org/2023.findings-acl.893/) Findings of the Association for Computational Linguistics: ACL 2023 · no summary yet**Li Nguyen et al.*2023 · 5 citations*

## Co-authors here

12 of 19 co-authors with a page, the most papers together first.

- [Hongyi Yuan](https://md.research.elamur.ai/free/en/authors/hongyi-yuan/) ×3
- [Chang Zhou](https://md.research.elamur.ai/free/en/authors/chang-zhou/) ×2
- [Chengpeng Li](https://md.research.elamur.ai/free/en/authors/chengpeng-li/) ×2
- [Chuanqi Tan](https://md.research.elamur.ai/free/en/authors/chuanqi-tan/) ×2
- [Guanting Dong](https://md.research.elamur.ai/free/en/authors/guanting-dong/) ×2
- [Jingren Zhou](https://md.research.elamur.ai/free/en/authors/jingren-zhou/) ×2
- [Keming Lu](https://md.research.elamur.ai/free/en/authors/keming-lu/) ×2
- [Wei Wang](https://md.research.elamur.ai/free/en/authors/wei-wang/) ×2
- [Bin Liang](https://md.research.elamur.ai/free/en/authors/bin-liang/)
- [Dayiheng Liu](https://md.research.elamur.ai/free/en/authors/dayiheng-liu/)
- [Fei Huang](https://md.research.elamur.ai/free/en/authors/fei-huang/)
- [Hao Chen](https://md.research.elamur.ai/free/en/authors/hao-chen/)

## Venues

Where their works here were published, the most works first, with the editions of those that have a page.

- [Workshop on Innovative Use of NLP for Building Educational Applications (BEA)](https://md.research.elamur.ai/free/en/venues/bea/) ×2: [BEA 2017](https://md.research.elamur.ai/free/en/venues/bea/2017/)
- Findings of the Association for Computational Linguistics: ACL 2024 ×2
- [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/): [ACL 2024](https://md.research.elamur.ai/free/en/venues/acl/2024/)
- [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/): [EMNLP 2023](https://md.research.elamur.ai/free/en/venues/emnlp/2023/)
- Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Proceedings of the Seventeenth Conference on Computational Natural Language Learning: Shared Task

## Cited by

Papers of our library cite their works 983 times (of the 141,840 papers whose bibliographies we read); [74 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/zheng-yuan/cited-by/).

Updated 24 October 2026