---
title: "Evaluating LLM-based Text Simplification for German: Effects on"
description: "The paper asks whether current LLM-based simplifiers for German are useful in realistic document-level Easy Language… 65 references."
authors: ["Luisa Carrer", "Andreas Säuberli", "Martin Kappus", "Lukas Fischer", "Sarah Ebling"]
year: 2026
venue: "Proceedings of the Fifteenth Language Resources and Evaluation Conference"
source: "https://aclanthology.org/2026.lrec-1.571/"
doi: "10.63317/3688akbpcnjn"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/carrer-2026-evaluating-llm-based-text-simplification/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/carrer-2026-evaluating-llm-based-text-simplification/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/29/) / Evaluating LLM-based Text Simplification for German: Effects on Post-Editing Effort, Quality Ratings, and User Comprehension

# Evaluating LLM-based Text Simplification for German: Effects on Post-Editing Effort, Quality Ratings, and User Comprehension

**Authors:** [Luisa Carrer](https://md.research.elamur.ai/free/en/authors/luisa-carrer/), [Andreas Säuberli](https://md.research.elamur.ai/free/en/authors/andreas-sauberli/), Martin Kappus, Lukas Fischer and [Sarah Ebling](https://md.research.elamur.ai/free/en/authors/sarah-ebling/) · **Year:** 2026 · **Venue:** [Proceedings of the Fifteenth Language Resources and Evaluation Conference](https://md.research.elamur.ai/free/en/venues/lrec/) ([LREC 2026](https://md.research.elamur.ai/free/en/venues/lrec/2026/)) · **Publisher:** [European Language Resources Association (ELRA)](https://md.research.elamur.ai/free/en/publishers/european-language-resources-association-elra/) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.lrec-1.571/) · [PDF](https://aclanthology.org/2026.lrec-1.571.pdf) · [DOI 10.63317/3688akbpcnjn](https://doi.org/10.63317/3688akbpcnjn) · [OpenAlex](https://openalex.org/W7160201701)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
The paper asks whether current LLM-based simplifiers for German are useful in realistic document-level Easy Language production. Earlier work found that neural systems gave post-editors no measurable speed-up. The authors evaluated two closed systems: the commercial capito.ai at CEFR level A2, and zero-shot GPT-4o (snapshot gpt-4o-2024-08-06). They used eight source documents taken from an Austrian provider's parallel corpus. Each document was rendered in five simplified versions: two raw machine outputs, a fully manual simplification, and post-edited versions of each machine output. Three stakeholder groups took part:

- **Post-editors**, whose effort was measured.
- **Professional Easy Language experts**, who rated quality.
- **End users**, whose perceived and actual comprehension were tested.

Semi-automatic simplification raised productivity by roughly 30% compared with manual work. Expert ratings were broadly favourable, and GPT-4o outputs improved user comprehension. The groups differed noticeably in how they perceived and understood the texts. The study argues that German ATS has advanced and that a single evaluator type is not enough to judge whether it serves accessibility goals.

## Key points
- **Systems and outputs:** capito.ai (A2 level) and GPT-4o were tested. GPT-4o got a short zero-shot prompt asking for an Easy Language rendering with no commentary. The five target versions per text were capito, gpt-4o, human, capito+pe and gpt-4o+pe.
- **Source texts:** eight texts of 100–300 words, covering news, administrative and tourism genres. They were chosen to avoid widely familiar topics and to need no extra context. Austrian wording and spelling were adjusted for Swiss readers (e.g., Straße > Strasse).
- **Productivity:** post-editing machine output was about 30% faster than simplifying from scratch.
- **Text measures and readability:** the two raw LLM outputs had similar length and vocabulary measures. The post-edited and manual versions were longer and lexically less varied, which suggests that humans added explanations (explicitation). Readability, measured with the Amstad Flesch-Index, varied less across versions.
- **Expert verdicts:** experts often judged that even the human and post-edited texts were not yet true Easy Language. They cited subordinate clauses, passives, unexplained terms and dense layout.

## Interesting ideas
- Judging the same outputs through three lenses (editor effort, expert rating, reader comprehension) reveals disagreements that a single metric would hide.
- Post-editing effort is split into time, edit actions and cognitive load, where cognitive load is approximated by clusters of short typing pauses. This gives a fine-grained cost of fixing machine output.
- Multiple-choice comprehension items include a "not in the text" distractor, which catches readers or systems that invent content.
- Comparing simple surface statistics across versions (length, unique words, type/token ratio) exposed that humans add explanations while LLMs mostly cut.
- The gap between how well readers think they understood a text and how well they actually did is treated as a finding in its own right.

## For Mova

How these ideas could serve Mova, our small open language model — its files, stages and tests:

- **I1** (answer): Score answers both by gold-test accuracy and by an independent "would a reader actually get this" check, and flag cases where the two disagree.
- **I2** (learn): Measure how much repair LLM-teacher or silver parses need (edit counts, correction time) to rank teacher tiers by real cost rather than by raw accuracy.
- **I3** (answer): Add an explicit "not stated" option to fable and tale QA as a negative control, so that guessing from world knowledge is penalised.
- **I4** (back): Track the same statistics between input and text regenerated through the meaning graph, to detect whether the compressor silently drops or adds content.
- **I5** (learn): Log model confidence next to correctness on each evaluation set to spot overconfident stages in the pipeline.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Ludwig-Maximilians-Universität München](https://md.research.elamur.ai/free/en/universities/ludwig-maximilians-universitat-munchen/) — University, Munich, Germany · 107 works · 56,478 citations
- [University of Zurich](https://md.research.elamur.ai/free/en/universities/university-of-zurich/) — University, Zurich, Switzerland · 78 works · 12,260 citations
- [ZHAW Zurich University of Applied Sciences](https://md.research.elamur.ai/free/en/universities/zhaw-zurich-university-of-applied-sciences/) — University, Winterthur, Switzerland · 6 works · 181 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (2): [🔁 Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/) · 1,087 works · [📏 Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · 1,220 works

## Cite

Cite as: Luisa Carrer, Andreas Säuberli, Martin Kappus, Lukas Fischer and Sarah Ebling. 2026. Evaluating LLM-based Text Simplification for German: Effects on Post-Editing Effort, Quality Ratings, and User Comprehension. Proceedings of the Fifteenth Language Resources and Evaluation Conference.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{carrer2026evaluating,
  title = {{Evaluating LLM-based Text Simplification for German: Effects on Post-Editing Effort, Quality Ratings, and User Comprehension}},
  author = {Luisa Carrer, Andreas Säuberli, Martin Kappus, Lukas Fischer and Sarah Ebling},
  booktitle = {Proceedings of the Fifteenth Language Resources and Evaluation Conference},
  year = {2026},
  doi = {10.63317/3688akbpcnjn},
  url = {https://doi.org/10.63317/3688akbpcnjn}
}
```

- [← previous Evaluating LLM Style Transfer Through Readability-Based Age Assessments](https://md.research.elamur.ai/free/en/papers/maro-2026-evaluating-llm-style-transfer-through/)
- [next → Evaluating LLMs for Detecting Demographic-Targeted Social Bias: A Comprehensive Benchmark Study](https://md.research.elamur.ai/free/en/papers/majumdar-2026-evaluating-llms-detecting-demographic-targeted/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/29/)

## References

65 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Sweta Agrawal and Marine Carpuat. 2024. Do text simplification systems preserve meaning? A human evaluation via reading comprehension. Transactions of the Association for Computational Linguistics, 12:432–448. [find](https://scholar.google.com/scholar?q=Sweta+Agrawal+and+Marine+Carpuat%2E+2024%2E+Do+text+simplification+systems+preserve+meaning%3F+A+human+evaluation+via+reading+comprehension%2E+Transactions+of+the+Association+for+Computational+Linguistics%2C+12)
2. Sarah Ahrens, Silvana Deilen, Sergio Hernandez Garrido, Ekaterina Lapshinova-Koltunski, and Christiane Maaß. 2025. [Evaluation of machine translation errors in German Plain Language texts in the domain of health information](https://md.research.elamur.ai/free/en/papers/ahrens-2025-evaluation-machine-translation-errors-german/). In Proceedings of the 21st Conference on Natural Language Processing (KONVENS 2025): Workshops, pages 176–185, Hannover, Germany. HsH Applied Academics.
3. Suha S. Al-Thanyyan and Aqil M. Azmi. 2021. Automated text simplification: A survey. ACM Comput. Surv., 54(2). [find](https://scholar.google.com/scholar?q=Suha+S%2E+Al%2DThanyyan+and+Aqil+M%2E+Azmi%2E+2021%2E+Automated+text+simplification%3A+A+survey%2E+ACM+Comput%2E+Surv%2E%2C+54%282%29%2E)
4. Oliver Alonzo, Jessica Trussell, Becca Dingman, and Matt Huenerfauth. 2021. Comparison of methods for evaluating complexity of simplified texts among deaf and hard-of-hearing adults at different literacy levels. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, CHI ’21, Yokohama, Japan. Association for Computing Machinery. [find](https://scholar.google.com/scholar?q=Oliver+Alonzo%2C+Jessica+Trussell%2C+Becca+Dingman%2C+and+Matt+Huenerfauth%2E+2021%2E+Comparison+of+methods+for+evaluating+complexity+of+simplified+texts+among+deaf+and+hard%2Dof%2Dhearing+adults+at+different+liter)
5. Fernando Alva-Manchego, Carolina Scarton, and Lucia Specia. 2020. [Data-driven sentence simplification: Survey and benchmark](https://md.research.elamur.ai/free/en/papers/manchego-2020-data-driven-sentence-simplification-survey/). Computational Linguistics, 46(1):135–187. [↗](https://doi.org/10.1162/coli_a_00370)
6. Fernando Alva-Manchego, Carolina Scarton, and Lucia Specia. 2021. [The (un)suitability of automatic evaluation metrics for text simplification](https://md.research.elamur.ai/free/en/papers/manchego-2021-un-suitability-automatic-evaluation-metrics/). Computational Linguistics, 47(4):861–889. [↗](https://doi.org/10.1162/coli_a_00418)
7. Sergi Alvarez-Vidal and Antoni Oliver. 2023. Assessing MT with measures of PE effort. Ampersand, 11:100125. [↗](https://doi.org/10.1016/j.amper.2023.100125)
8. Fabio Alves. 2003. Triangulating Translation: Perspectives in process oriented research. John Benjamins Publishing Company, Amsterdam. [find](https://scholar.google.com/scholar?q=Fabio+Alves%2E+2003%2E+Triangulating+Translation%3A+Perspectives+in+process+oriented+research%2E+John+Benjamins+Publishing+Company%2C+Amsterdam%2E)
9. Toni Amstad. 1978. Wie verständlich sind unsere Zeitungen? Ph.D. thesis, University of Zurich, Zürich. [find](https://scholar.google.com/scholar?q=Toni+Amstad%2E+1978%2E+Wie+verst%C3%A4ndlich+sind+unsere+Zeitungen%3F+Ph%2ED%2E+thesis%2C+University+of+Zurich%2C+Z%C3%BCrich%2E)
10. Heather Becker, Greg Roberts, Janet Morrison, and Julie Silver. 2004. Recruiting people with disabilities as research participants: Challenges and strategies to address them. Mental Retardation, 42(6):471–475. [↗](https://doi.org/10.1352/0047-6765(2004)42<471:rpwdar>2.0.co;2)
11. Nadine Beks van Raaij, Daan Kolkman, and Ksenia Podoynitsyna. 2024. Clearer governmental communication: Text simplification with Chat-GPT evaluated by quantitative and qualitative research. In Proceedings of the Workshop on DeTermIt! Evaluating Text Difficulty in a Multilingual Context @ LREC-COLING 2024, pages 152–178, Torino, Italia. ELRA and ICCL. [find](https://scholar.google.com/scholar?q=Nadine+Beks+van+Raaij%2C+Daan+Kolkman%2C+and+Ksenia+Podoynitsyna%2E+2024%2E+Clearer+governmental+communication%3A+Text+simplification+with+Chat%2DGPT+evaluated+by+quantitative+and+qualitative+research%2E+In+Proceed)
12. Gilles Caporossi, Christophe Leblay, and Hakim Usoof. 2023. GenoGraphiX-Log version 2.0. User guide. Les Cahiers Du GERAD G-2020-68, pages 1–63. [find](https://scholar.google.com/scholar?q=Gilles+Caporossi%2C+Christophe+Leblay%2C+and+Hakim+Usoof%2E+2023%2E+GenoGraphiX%2DLog+version+2%2E0%2E+User+guide%2E+Les+Cahiers+Du+GERAD+G%2D2020%2D68%2C+pages+1%E2%80%9363%2E)
13. Luisa Carrer, Andreas Säuberli, Martin Kappus, and Sarah Ebling. 2024. Towards holistic human evaluation of automatic text simplification. In Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024, pages 71–80, Torino, Italia. ELRA and ICCL. [↗](https://doi.org/10.21256/zhaw-31346)
14. Liam Cripwell, Joël Legrand, and Claire Gardent. 2024. Evaluating document simplification: On the importance of separately assessing simplicity and meaning preservation. In Proceedings of the 3rd Workshop on Tools and Resources for People with REAding DIfficulties (READI) @ LREC-COLING 2024, pages 1–14, Torino, Italia. ELRA and ICCL. [↗](https://doi.org/10.48550/arxiv.2404.03278)
15. Scott A Crossley, Hae Sung Yang, and Danielle S McNamara. 2014. What’s so simple about simplified texts? A computational and psycholinguistic investigation of text comprehension and text processing. Reading in a Foreign Language, 26(1):92–113. [find](https://scholar.google.com/scholar?q=Scott+A+Crossley%2C+Hae+Sung+Yang%2C+and+Danielle+S+McNamara%2E+2014%2E+What%E2%80%99s+so+simple+about+simplified+texts%3F+A+computational+and+psycholinguistic+investigation+of+text+comprehension+and+text+processing%2E+R)
16. Cristina Cumbreño and Nora Aranberri. 2021. What Do You Say? Comparison of Metrics for Post-editing Effort, page 57–79. Springer International Publishing. [find](https://scholar.google.com/scholar?q=Cristina+Cumbre%C3%B1o+and+Nora+Aranberri%2E+2021%2E+What+Do+You+Say%3F+Comparison+of+Metrics+for+Post%2Dediting+Effort%2C+page+57%E2%80%9379%2E+Springer+International+Publishing%2E)
17. Silvana Deilen, Sergio Hernández Garrido, Ekaterina Lapshinova-Koltunski, and Christiane Maaß. 2023. Using ChatGPT as a CAT tool in Easy Language translation. In Proceedings of the Second Workshop on Text Simplification, Accessibility and Readability, pages 1–10, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria. [↗](https://doi.org/10.48550/arxiv.2308.11563)
18. Silvana Deilen, Ekaterina Lapshinova-Koltunski, Sergio Garrido, Julian Hörner, Christiane Maaß, Vanessa Theel, and Sophie Ziemer. 2024. Evaluation of intralingual machine translation for health communication. In Proceedings of the 25th Annual Conference of the European Association for Machine Translation (Volume 1), pages 469–479, Sheffield, UK. European Association for Machine Translation (EAMT). [find](https://scholar.google.com/scholar?q=Silvana+Deilen%2C+Ekaterina+Lapshinova%2DKoltunski%2C+Sergio+Garrido%2C+Julian+H%C3%B6rner%2C+Christiane+Maa%C3%9F%2C+Vanessa+Theel%2C+and+Sophie+Ziemer%2E+2024%2E+Evaluation+of+intralingual+machine+translation+for+health+commun)
19. Christa Dürscheid, Stephan Elspaß, and Arne Ziegler. 2015. Variantengrammatik des Standarddeutschen. Konzeption, methodische Fragen, Fallanalysen, pages 207–236. VR Unipress. [find](https://scholar.google.com/scholar?q=Christa+D%C3%BCrscheid%2C+Stephan+Elspa%C3%9F%2C+and+Arne+Ziegler%2E+2015%2E+Variantengrammatik+des+Standarddeutschen%2E+Konzeption%2C+methodische+Fragen%2C+Fallanalysen%2C+pages+207%E2%80%93236%2E+VR+Unipress%2E)
20. Sarah Ebling, Alessia Battisti, Marek Kostrzewa, Dominik Pfütze, Annette Rios, Andreas Säuberli, and Nicolas Spring. 2022. Automatic text simplification for German. Frontiers in Communication, Volume 7 - 2022. [↗](https://doi.org/10.3389/fcomm.2022.706718)
21. ELIS Research. 2025. European language industry survey 2025: Trends, expectations and concerns of the European language industry. Accessed: 16 Oct 2025. [find](https://scholar.google.com/scholar?q=ELIS+Research%2E+2025%2E+European+language+industry+survey+2025%3A+Trends%2C+expectations+and+concerns+of+the+European+language+industry%2E+Accessed%3A+16+Oct+2025%2E)
22. Inmaculada Fajardo, Vicenta Ávila, Antonio Ferrer, Gema Tavares, Marcos Gómez, and Ana Hernández. 2014. Easy-to-read texts for students with intellectual disability: linguistic factors affecting comprehension. Journal of applied research in intellectual disabilities, 27(3):212–225. [↗](https://doi.org/10.1111/jar.12065)
23. Christian Federmann. 2018. Appraise evaluation framework for machine translation. In Proceedings of the 27th International Conference on Computational Linguistics: System Demonstrations, pages 86–88, Santa Fe, New Mexico. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Christian+Federmann%2E+2018%2E+Appraise+evaluation+framework+for+machine+translation%2E+In+Proceedings+of+the+27th+International+Conference+on+Computational+Linguistics%3A+System+Demonstrations%2C+pages+86%E2%80%9388%2C+)
24. W. M. L. Finlay and E. Lyons. 2001. Methodological issues in interviewing and using self-report questionnaires with people with mental retardation. Psychological Assessment, 13(3):319–335. [↗](https://doi.org/10.1037//1040-3590.13.3.319)
25. Sian Gooding. 2022. On the ethical considerations of text simplification. In Ninth Workshop on Speech and Language Processing for Assistive Technologies (SLPAT-2022), pages 50–57, Dublin, Ireland. Association for Computational Linguistics. [↗](https://doi.org/10.48448/vqz3-gz84)
26. Sian Gooding, Yevgeni Berzak, Tony Mak, and Matt Sharifi. 2021. Predicting text readability from scrolling interactions. In Proceedings of the 25th Conference on Computational Natural Language Learning, pages 380–390, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sian+Gooding%2C+Yevgeni+Berzak%2C+Tony+Mak%2C+and+Matt+Sharifi%2E+2021%2E+Predicting+text+readability+from+scrolling+interactions%2E+In+Proceedings+of+the+25th+Conference+on+Computational+Natural+Language+Learnin)
27. Natalia Grabar and Horacio Saggion. 2022. Evaluation of automatic text simplification: Where are we now, where should we go from here. In Actes de la 29e Conférence sur le Traitement Automatique des Langues Naturelles. Volume 1 : conférence principale, pages 453–463, Avignon, France. ATALA. [find](https://scholar.google.com/scholar?q=Natalia+Grabar+and+Horacio+Saggion%2E+2022%2E+Evaluation+of+automatic+text+simplification%3A+Where+are+we+now%2C+where+should+we+go+from+here%2E+In+Actes+de+la+29e+Conf%C3%A9rence+sur+le+Traitement+Automatique+des+L)
28. Yvette Graham, Timothy Baldwin, Alistair Moffat, and Justin Zobel. 2013. Continuous measurement scales in human evaluation of machine translation. In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, pages 33–41, Sofia, Bulgaria. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yvette+Graham%2C+Timothy+Baldwin%2C+Alistair+Moffat%2C+and+Justin+Zobel%2E+2013%2E+Continuous+measurement+scales+in+human+evaluation+of+machine+translation%2E+In+Proceedings+of+the+7th+Linguistic+Annotation+Works)
29. Theo Guidroz, Diego Ardila, Jimmy Li, Adam Mansour, Paul Jhun, Nina Gonzalez, Xiang Ji, Mike Sanchez, Sujay Kakarmath, Mathias MJ Bellaiche, Miguel Ángel Garrido, Faruk Ahmed, Divyansh Choudhary, Jay Hartford, Chenwei Xu, Henry Javier Serrano Echeverria, Yifan Wang, Jeff Shaffer, Eric, Cao, Yossi Matias, Avinatan Hassidim, Dale R Webster, Yun Liu, Sho Fujiwara, Peggy Bui, and Quang Duong. 2025. LLM-based text simplification and its effect on user comprehension and cognitive load. [↗](https://doi.org/10.48550/arxiv.2505.01980)
30. Matt Huenerfauth, Lijun Feng, and Noémie Elhadad. 2009. Comparing evaluation techniques for text readability software for adults with intellectual disabilities. In Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility, Assets ’09, page 3–10, Pittsburgh, Pennsylvania, USA. Association for Computing Machinery. [find](https://scholar.google.com/scholar?q=Matt+Huenerfauth%2C+Lijun+Feng%2C+and+No%C3%A9mie+Elhadad%2E+2009%2E+Comparing+evaluation+techniques+for+text+readability+software+for+adults+with+intellectual+disabilities%2E+In+Proceedings+of+the+11th+Internationa)
31. Glyn Jones. 2020. Designing multiple-choice test items. In The Routledge Handbook of Second Language Acquisition and Language Testing, chapter 9, pages 90–101. Routledge. [↗](https://doi.org/10.4324/9781351034784-11)
32. Martin Kappus and Maureen Ehrensberger-Dow. 2020. The ergonomics of translation tools: understanding when less is actually more. The Interpreter and Translator Trainer, 14(4):386–404. [↗](https://doi.org/10.1080/1750399x.2020.1839998)
33. Tannon Kew, Alison Chi, Laura Vásquez-Rodríguez, Sweta Agrawal, Dennis Aumiller, Fernando Alva-Manchego, and Matthew Shardlow. 2023. BLESS: Benchmarking large language models on sentence simplification. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 13291–13309, Singapore. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Tannon+Kew%2C+Alison+Chi%2C+Laura+V%C3%A1squez%2DRodr%C3%ADguez%2C+Sweta+Agrawal%2C+Dennis+Aumiller%2C+Fernando+Alva%2DManchego%2C+and+Matthew+Shardlow%2E+2023%2E+BLESS%3A+Benchmarking+large+language+models+on+sentence+simplificatio)
34. Maarit Koponen. 2016. Is machine translation post-editing worth the effort? A survey of research into post-editing and effort. The Journal of Specialised Translation, (25):131–148. [find](https://scholar.google.com/scholar?q=Maarit+Koponen%2E+2016%2E+Is+machine+translation+post%2Dediting+worth+the+effort%3F+A+survey+of+research+into+post%2Dediting+and+effort%2E+The+Journal+of+Specialised+Translation%2C+%2825%29%3A131%E2%80%93148%2E)
35. Hans P. Krings. 2001. Repairing Texts: Empirical Investigations of Machine Translation Post-editing Processes. Translation studies. Kent State University Press, Kent, Ohio and London. [find](https://scholar.google.com/scholar?q=Hans+P%2E+Krings%2E+2001%2E+Repairing+Texts%3A+Empirical+Investigations+of+Machine+Translation+Post%2Dediting+Processes%2E+Translation+studies%2E+Kent+State+University+Press%2C+Kent%2C+Ohio+and+London%2E)
36. Isabel Lacruz, Michael Denkowski, and Alon Lavie. 2014. Cognitive demand and cognitive effort in post-editing. In Proceedings of the 11th Conference of the Association for Machine Translation in the Americas, pages 73–84, Vancouver, Canada. Association for Machine Translation in the Americas. [find](https://scholar.google.com/scholar?q=Isabel+Lacruz%2C+Michael+Denkowski%2C+and+Alon+Lavie%2E+2014%2E+Cognitive+demand+and+cognitive+effort+in+post%2Dediting%2E+In+Proceedings+of+the+11th+Conference+of+the+Association+for+Machine+Translation+in+the+A)
37. Isabel Lacruz, Gregory M. Shreve, and Erik Angelone. 2012. Average pause ratio as an indicator of cognitive effort in post-editing: A case study. In Workshop on Post-Editing Technology and Practice, San Diego, California, USA. Association for Machine Translation in the Americas. [find](https://scholar.google.com/scholar?q=Isabel+Lacruz%2C+Gregory+M%2E+Shreve%2C+and+Erik+Angelone%2E+2012%2E+Average+pause+ratio+as+an+indicator+of+cognitive+effort+in+post%2Dediting%3A+A+case+study%2E+In+Workshop+on+Post%2DEditing+Technology+and+Practice%2C+S)
38. Gondy Leroy, James E Endicott, David Kauchak, Obay Mouradi, and Melissa Just. 2013. User evaluation of the effects of a text simplification algorithm using term familiarity on perception, understanding, learning, and information retention. Journal of medical Internet research, 15(7):e144. [find](https://scholar.google.com/scholar?q=Gondy+Leroy%2C+James+E+Endicott%2C+David+Kauchak%2C+Obay+Mouradi%2C+and+Melissa+Just%2E+2013%2E+User+evaluation+of+the+effects+of+a+text+simplification+algorithm+using+term+familiarity+on+perception%2C+understandin)
39. Gondy Leroy, David Kauchak, Diane Haeger, and Douglas Spegman. 2022. Evaluation of an online text simplification editor using manual and automated metrics for perceived and actual text difficulty. JAMIA Open, 5(2):ooac044. [find](https://scholar.google.com/scholar?q=Gondy+Leroy%2C+David+Kauchak%2C+Diane+Haeger%2C+and+Douglas+Spegman%2E+2022%2E+Evaluation+of+an+online+text+simplification+editor+using+manual+and+automated+metrics+for+perceived+and+actual+text+difficulty%2E+JAM)
40. John Michael Linacre. 1989. Many-faceted Rasch measurement. Ph.D. thesis, The University of Chicago. [find](https://scholar.google.com/scholar?q=John+Michael+Linacre%2E+1989%2E+Many%2Dfaceted+Rasch+measurement%2E+Ph%2ED%2E+thesis%2C+The+University+of+Chicago%2E)
41. Christiane Maaß. 2020. Easy Language–Plain Language–Easy Language Plus: Balancing comprehensibility and acceptability. Frank & Timme, Berlin. [find](https://scholar.google.com/scholar?q=Christiane+Maa%C3%9F%2E+2020%2E+Easy+Language%E2%80%93Plain+Language%E2%80%93Easy+Language+Plus%3A+Balancing+comprehensibility+and+acceptability%2E+Frank+%26+Timme%2C+Berlin%2E)
42. Margot Madina, Itziar Gonzalez-Dios, and Melanie Siegel. 2024. Towards reliable E2R texts: A proposal for standardized evaluation practices. In Computers Helping People with Special Needs, pages 224–231, Cham. Springer Nature Switzerland. [find](https://scholar.google.com/scholar?q=Margot+Madina%2C+Itziar+Gonzalez%2DDios%2C+and+Melanie+Siegel%2E+2024%2E+Towards+reliable+E2R+texts%3A+A+proposal+for+standardized+evaluation+practices%2E+In+Computers+Helping+People+with+Special+Needs%2C+pages+224%E2%80%932)
43. Jonathan Mallinson, Rico Sennrich, and Mirella Lapata. 2020. Zero-shot crosslingual sentence simplification. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 5109–5126, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jonathan+Mallinson%2C+Rico+Sennrich%2C+and+Mirella+Lapata%2E+2020%2E+Zero%2Dshot+crosslingual+sentence+simplification%2E+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28)
44. Louis Martin, Angela Fan, Éric de la Clergerie, Antoine Bordes, and Benoît Sagot. 2022. [MUSS: Multilingual unsupervised sentence simplification by mining paraphrases](https://md.research.elamur.ai/free/en/papers/martin-2022-muss-multilingual-unsupervised-sentence-simplification/). In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 1651–1664, Marseille, France. European Language Resources Association.
45. Paloma Martínez, Alberto Ramos, and Lourdes Moreno. 2024. Exploring Large Language Models to generate Easy to Read content. Frontiers in Computer Science, Volume 6 - 2024. [find](https://scholar.google.com/scholar?q=Paloma+Mart%C3%ADnez%2C+Alberto+Ramos%2C+and+Lourdes+Moreno%2E+2024%2E+Exploring+Large+Language+Models+to+generate+Easy+to+Read+content%2E+Frontiers+in+Computer+Science%2C+Volume+6+%2D+2024%2E)
46. Kai North, Tharindu Ranasinghe, Matthew Shardlow, and Marcos Zampieri. 2025. Deep learning approaches to lexical simplification: A survey. Journal of Intelligent Information Systems, 63(1):111–134. [↗](https://doi.org/10.1007/s10844-024-00882-9)
47. Jipeng Qiang, Minjiang Huang, Yi Zhu, Yunhao Yuan, Chaowei Zhang, and Kui Yu. 2025. Redefining simplicity: Benchmarking Large Language Models from lexical to document simplification. [↗](https://doi.org/10.48550/arxiv.2502.08281)
48. Ehud Reiter. 2025. We should evaluate real-world impact. Computational Linguistics, pages 1–13. [↗](https://doi.org/10.1162/coli.a.18)
49. Luz Rello, Ricardo Baeza-Yates, Stefan Bott, and Horacio Saggion. 2013a. Simplify or help? Text simplification strategies for people with dyslexia. In Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility, W4A ’13, Rio de Janeiro, Brazil. Association for Computing Machinery. [find](https://scholar.google.com/scholar?q=Luz+Rello%2C+Ricardo+Baeza%2DYates%2C+Stefan+Bott%2C+and+Horacio+Saggion%2E+2013a%2E+Simplify+or+help%3F+Text+simplification+strategies+for+people+with+dyslexia%2E+In+Proceedings+of+the+10th+International+Cross%2DDisci)
50. Luz Rello, Ricardo Baeza-Yates, Laura Dempere-Marco, and Horacio Saggion. 2013b. Frequent words improve readability and short words improve understandability for people with dyslexia. In INTERACT ’13, pages 203–219, Cape Town, South Africa. Springer. [find](https://scholar.google.com/scholar?q=Luz+Rello%2C+Ricardo+Baeza%2DYates%2C+Laura+Dempere%2DMarco%2C+and+Horacio+Saggion%2E+2013b%2E+Frequent+words+improve+readability+and+short+words+improve+understandability+for+people+with+dyslexia%2E+In+INTERACT+%E2%80%9913%2C)
51. Luz Rello, Susana Bautista, Ricardo Baeza-Yates, Pablo Gervás, Raquel Hervás, and Horacio Saggion. 2013c. One half or 50%? An eye-tracking study of number representation readability. In IN-TERACT ’13, pages 229–245, Cape Town, South Africa. Springer. [find](https://scholar.google.com/scholar?q=Luz+Rello%2C+Susana+Bautista%2C+Ricardo+Baeza%2DYates%2C+Pablo+Gerv%C3%A1s%2C+Raquel+Herv%C3%A1s%2C+and+Horacio+Saggion%2E+2013c%2E+One+half+or+50%25%3F+An+eye%2Dtracking+study+of+number+representation+readability%2E+In+IN%2DTERACT+%E2%80%9913%2C)
52. Michael Ryan, Tarek Naous, and Wei Xu. 2023. Revisiting non-English text simplification: A unified multilingual benchmark. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4898–4927, Toronto, Canada. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Michael+Ryan%2C+Tarek+Naous%2C+and+Wei+Xu%2E+2023%2E+Revisiting+non%2DEnglish+text+simplification%3A+A+unified+multilingual+benchmark%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Association+for+Computationa)
53. Horacio Saggion, Sanja Štajner, Stefan Bott, Simon Mille, Luz Rello, and Biljana Drndarevic. 2015. Making it Simplext: Implementation and evaluation of a text simplification system for Spanish. ACM Trans. Access. Comput., 6(4). [find](https://scholar.google.com/scholar?q=Horacio+Saggion%2C+Sanja+%C5%A0tajner%2C+Stefan+Bott%2C+Simon+Mille%2C+Luz+Rello%2C+and+Biljana+Drndarevic%2E+2015%2E+Making+it+Simplext%3A+Implementation+and+evaluation+of+a+text+simplification+system+for+Spanish%2E+ACM+Tr)
54. Fumiko Samejima. 1997. Graded response model. In Wim J. van der Linden and Ronald K. Hambleton, editors, Handbook of Modern Item Response Theory, pages 85–100. Springer New York, New York, NY. [↗](https://doi.org/10.1007/978-1-4757-2691-6_5)
55. Andreas Säuberli, Franz Holzknecht, Patrick Haller, Silvana Deilen, Laura Schiffl, Silvia Hansen-Schirra, and Sarah Ebling. 2024. Digital comprehensibility assessment of simplified texts among persons with intellectual disabilities. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems, CHI ’24, New York, NY, USA. Association for Computing Machinery. [find](https://scholar.google.com/scholar?q=Andreas+S%C3%A4uberli%2C+Franz+Holzknecht%2C+Patrick+Haller%2C+Silvana+Deilen%2C+Laura+Schiffl%2C+Silvia+Hansen%2DSchirra%2C+and+Sarah+Ebling%2E+2024%2E+Digital+comprehensibility+assessment+of+simplified+texts+among+persons)
56. Scarton Scarton, Mikel L. Forcada, Miquel Esplà-Gomis, and Lucia Specia. 2019. Estimating post-editing effort: a study on human judgements, task-based and reference-based metrics of MT quality. In Proceedings of the 16th International Conference on Spoken Language Translation, Hong Kong. Association for Computational Linguistics. [↗](https://doi.org/10.5281/zenodo.3525002)
57. Sanja Štajner and Sergiu Nisioi. 2018. A detailed evaluation of neural sequence-to-sequence models for in-domain and cross-domain text simplification. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Miyazaki, Japan. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Sanja+%C5%A0tajner+and+Sergiu+Nisioi%2E+2018%2E+A+detailed+evaluation+of+neural+sequence%2Dto%2Dsequence+models+for+in%2Ddomain+and+cross%2Ddomain+text+simplification%2E+In+Proceedings+of+the+Eleventh+International+Conf)
58. Marie Stevenson. 2010. Researching reading. In Brian Paltridge and Aek Phakiti, editors, Continuum Companion to Research Methods in Applied Linguistics, pages 174–190. Continuum London, England. [find](https://scholar.google.com/scholar?q=Marie+Stevenson%2E+2010%2E+Researching+reading%2E+In+Brian+Paltridge+and+Aek+Phakiti%2C+editors%2C+Continuum+Companion+to+Research+Methods+in+Applied+Linguistics%2C+pages+174%E2%80%93190%2E+Continuum+London%2C+England%2E)
59. Regina Stodden. 2021. When the scale is unclear – analysis of the interpretation of rating scales in human evaluation of text simplification. In Proceedings of the First Workshop on Current Trends in Text Simplification (CTTS 2021) co-located with the 37th Conference of the Spanish Society for Natural Language Processing (SE-PLN2021), Online (initially located in Málaga, Spain), September 21st, 2021, volume 2944 of CEUR Workshop Proceedings. CEUR-WS.org. [find](https://scholar.google.com/scholar?q=Regina+Stodden%2E+2021%2E+When+the+scale+is+unclear+%E2%80%93+analysis+of+the+interpretation+of+rating+scales+in+human+evaluation+of+text+simplification%2E+In+Proceedings+of+the+First+Workshop+on+Current+Trends+in+)
60. Regina Stodden. 2026. Automatic German Text Simplification: Data, Evaluation, and Models, 1 edition, volume 21 of Easy – Plain – Accessible. Frank & Timme. [find](https://scholar.google.com/scholar?q=Regina+Stodden%2E+2026%2E+Automatic+German+Text+Simplification%3A+Data%2C+Evaluation%2C+and+Models%2C+1+edition%2C+volume+21+of+Easy+%E2%80%93+Plain+%E2%80%93+Accessible%2E+Frank+%26+Timme%2E)
61. Andreas Säuberli, Silvia Hansen-Schirra, Franz Holzknecht, Silke Gutermuth, Silvana Deilen, Laura Schiffl, and Sarah Ebling. 2023. Enabling text comprehensibility assessment for people with intellectual disabilities using a mobile application. Frontiers in Communication, 8. [↗](https://doi.org/10.3389/fcomm.2023.1175625)
62. Susanne Trauzettel-Klosinski, Klaus Dietz, and the IReST Study Group. 2012. Standardized Assessment of Reading Performance: The New International Reading Speed Texts IReST. Investigative Ophthalmology & Visual Science, 53(9):5452– 5461. [find](https://scholar.google.com/scholar?q=Susanne+Trauzettel%2DKlosinski%2C+Klaus+Dietz%2C+and+the+IReST+Study+Group%2E+2012%2E+Standardized+Assessment+of+Reading+Performance%3A+The+New+International+Reading+Speed+Texts+IReST%2E+Investigative+Ophthalmology)
63. Lucas Nunes Vieira. 2017. Cognitive effort and different task foci in post-editing of machine translation: A think-aloud study. Across Languages and Cultures, 18(1):79–105. [↗](https://doi.org/10.1556/084.2017.18.1.4)
64. Sanja Štajner. 2021. Automatic text simplification for social good: Progress and challenges. In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 2637– 2652, Online. Association for Computational Linguistics. [↗](https://doi.org/10.48448/pye9-5254)
65. Raeesa Yousaf, Marina Walther, and Michael Gertz. 2025. Accessible language simplification: Large Language Models for generating Easy German. In KI 2025: Advances in Artificial Intelligence, pages 204–217, Cham. Springer Nature Switzerland. [find](https://scholar.google.com/scholar?q=Raeesa+Yousaf%2C+Marina+Walther%2C+and+Michael+Gertz%2E+2025%2E+Accessible+language+simplification%3A+Large+Language+Models+for+generating+Easy+German%2E+In+KI+2025%3A+Advances+in+Artificial+Intelligence%2C+pages+204)

*Updated 1 November 2026*