---
title: "Revisiting Masking After Fifteen Years: Early Approaches to"
description: "These methods should define explicit abstraction levels and reversibility classes, and record… 20 references, cited by 1 paper here."
authors: ["Georg Rehm", "Thorsten Trippel", "Andreas Witt"]
year: 2026
venue: "Proceedings of Leveraging Derived Text Formats to Unlock Copyrighted Collections for Open Science (DTF) @ LREC 2026"
source: "https://aclanthology.org/2026.dtf-1.4/"
doi: "10.63317/4ywpnvfa3znb"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/rehm-2026-revisiting-masking-after-fifteen-years/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/rehm-2026-revisiting-masking-after-fifteen-years/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/16/) / Revisiting Masking After Fifteen Years: Early Approaches to Non-Reconstructable Linguistic Data in the current context

# Revisiting Masking After Fifteen Years: Early Approaches to Non-Reconstructable Linguistic Data in the current context

**Authors:** [Georg Rehm](https://md.research.elamur.ai/free/en/authors/georg-rehm/), [Thorsten Trippel](https://md.research.elamur.ai/free/en/authors/thorsten-trippel/) and [Andreas Witt](https://md.research.elamur.ai/free/en/authors/andreas-witt/) · **Year:** 2026 · **Venue:** [Proceedings of Leveraging Derived Text Formats to Unlock Copyrighted Collections for Open Science (DTF) @ LREC 2026](https://md.research.elamur.ai/free/en/venues/dtf/) ([Leveraging Derived Text Formats to Unlock Copyrighted Collections for Open Science (DTF) @ LREC 2026](https://md.research.elamur.ai/free/en/venues/dtf/2026/)) · **Publisher:** [European Language Resources Association (ELRA)](https://md.research.elamur.ai/free/en/publishers/european-language-resources-association-elra/) · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.dtf-1.4/) · [PDF](https://aclanthology.org/2026.dtf-1.4.pdf) · [DOI 10.63317/4ywpnvfa3znb](https://doi.org/10.63317/4ywpnvfa3znb) · [OpenAlex](https://openalex.org/W7166526654)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/rehm-2026-revisiting-masking-after-fifteen-years/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
This position paper revisits two 2007 proposals by the same authors for sharing annotated corpora whose source texts cannot be legally redistributed due to copyright, contracts or privacy. Both proposals mask the text but keep the annotations. The first, presented at TLT 2007, hid the word forms in treebanks while keeping syntactic and morphological structure. The second, presented at DH 2007, extended this to any XML-annotated corpus using configurable random string substitution.

The authors place these ideas within today's Derived Text Formats (DTFs). They argue that LLMs, FAIR principles and new standards now call for more formal methods. These methods should define explicit abstraction levels and reversibility classes, and record provenance in a machine-actionable way. The paper sketches a modern DTF generation workflow, illustrated with the MONA-pipe framework, and covers use cases in linguistics, the digital humanities and NLP. It concludes that DTFs offer a sustainable, infrastructure-ready route to research that is reproducible and legally safe. This matters for anyone who needs to publish benchmarks or derived datasets from protected texts.

## Key points
- **Original 2007 masking methods:**
  - Masked treebanks swapped tokens for neutral placeholders but kept constituent trees, dependencies and grammatical features.
  - Corpus masking could optionally keep token length, capitalisation and affixes.
  - Both were implemented in the CorpusMasker tool (Dellert, 2007, v0.1).
- **Standards that support DTFs:** TEI, ISO annotation models (MAF, LAF, SynAF, SemAF, LMF), CMDI metadata, PISA, and the draft DIN 19,461 DTF specification.
- **New risk from LLMs:** LLMs could partially reconstruct masked text from structural or distributional cues. Du et al. (2025) find that reconstruction is still poor, but caution is warranted as models improve.
- **Legal context:**
  - GDPR limits sharing of data that contains personal information.
  - The German TDM exception (§ 44b UrhG) allows model training but not redistribution of the corpus, so non-reversible derived formats are needed for reproducibility.
- **Infrastructure context:** The relevant infrastructures named are Text+, NFDI, EOSC, CLARIN, META-SHARE, European Language Grid and the European Language Data Space.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [German Research Centre for Artificial Intelligence](https://md.research.elamur.ai/free/en/labs/german-research-centre-for-artificial-intelligence/) — Research institute, Kaiserslautern, Germany · 77 works · 29,479 citations
- [Leibniz Institute for the German Language](https://md.research.elamur.ai/free/en/labs/leibniz-institute-for-the-german-language/) — Research institute, Mannheim, Germany · 5 works · 22 citations

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works · [📚 Literature and Literary Theory](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/literature-and-literary-theory/) · 519 works

## Cite

Cite as: Georg Rehm, Thorsten Trippel and Andreas Witt. 2026. Revisiting Masking After Fifteen Years: Early Approaches to Non-Reconstructable Linguistic Data in the current context. Proceedings of Leveraging Derived Text Formats to Unlock Copyrighted Collections for Open Science (DTF) @ LREC 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{rehm2026revisiting,
  title = {{Revisiting Masking After Fifteen Years: Early Approaches to Non-Reconstructable Linguistic Data in the current context}},
  author = {Georg Rehm, Thorsten Trippel and Andreas Witt},
  booktitle = {Proceedings of Leveraging Derived Text Formats to Unlock Copyrighted Collections for Open Science (DTF) @ LREC 2026},
  year = {2026},
  doi = {10.63317/4ywpnvfa3znb},
  url = {https://doi.org/10.63317/4ywpnvfa3znb}
}
```

- [← previous Revisiting Audio-language Pretraining for Learning General-purpose Audio Representation](https://md.research.elamur.ai/free/en/papers/tseng-2026-revisiting-audio-language-pretraining-learning/)
- [next → Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languages](https://md.research.elamur.ai/free/en/papers/yari-2026-revisiting-metric-reliability-fine-grained/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/16/)

## References

20 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Johannes Dellert. 2007. Corpusmasker: A tool for parameterised masking of linguistic resources. [https://www.lingexp.uni-tuebingen.de/sfb441/c2/corpus-masker-0.1.tar](https://www.lingexp.uni-tuebingen.de/sfb441/c2/corpus-masker-0.1.tar). gz. Version 0.1, SFB 441 “Linguistic Data Structures”, University of Tübingen. [↗](https://www.lingexp.uni-tuebingen.de/sfb441/c2/corpus-masker-0.1.tar)
2. ISO 24615-1:2014. 2014. Language resource management — syntactic annotation framework (SynAF) — part 1: Syntactic model. International Standard, International Organisation for Standardizaton (ISO), Geneva. [find](https://scholar.google.com/scholar?q=ISO+24615%2D1%3A2014%2E+2014%2E+Language+resource+management+%E2%80%94+syntactic+annotation+framework+%28SynAF%29+%E2%80%94+part+1%3A+Syntactic+model%2E+International+Standard%2C+International+Organisation+for+Standardizaton+%28ISO%29%2C+Ge)
3. DIN 19461:2026-04 (E). 2026. Sprachressourcen und Sprachtechnologie - Abgeleitete Textformate (ATF). Technical report, Deutsches Institut für Normung, Berlin. [find](https://scholar.google.com/scholar?q=DIN+19461%3A2026%2D04+%28E%29%2E+2026%2E+Sprachressourcen+und+Sprachtechnologie+%2D+Abgeleitete+Textformate+%28ATF%29%2E+Technical+report%2C+Deutsches+Institut+f%C3%BCr+Normung%2C+Berlin%2E)
4. ISO 24617-1:2012. 2012. Language resource management — semantic annotation framework (SemAF) — part 1: Time and events (semaf-time, iso-timeml). International Standard, International Organisation for Standardization (ISO), Geneva. [find](https://scholar.google.com/scholar?q=ISO+24617%2D1%3A2012%2E+2012%2E+Language+resource+management+%E2%80%94+semantic+annotation+framework+%28SemAF%29+%E2%80%94+part+1%3A+Time+and+events+%28semaf%2Dtime%2C+iso%2Dtimeml%29%2E+International+Standard%2C+International+Organisation+for+)
5. Tillmann Dönicke, Florian Barth, Hanna Varachkina, and Caroline Sporleder. 2022. Monapipe: Modes of narration and attribution pipeline for german computational literary studies and language analysis in spacy. In Proceedings of the 18th Conference on Natural Language Processing (KONVENS 2022), Potsda… [find](https://scholar.google.com/scholar?q=Tillmann+D%C3%B6nicke%2C+Florian+Barth%2C+Hanna+Varachkina%2C+and+Caroline+Sporleder%2E+2022%2E+Monapipe%3A+Modes+of+narration+and+attribution+pipeline+for+german+computational+literary+studies+and+language+analysis+i)
6. ISO 24619:2011. 2011. Language resource management – Persistent identification and sustainable access (PISA). International Standard, International Organization for Standardization (ISO), Geneva. [find](https://scholar.google.com/scholar?q=ISO+24619%3A2011%2E+2011%2E+Language+resource+management+%E2%80%93+Persistent+identification+and+sustainable+access+%28PISA%29%2E+International+Standard%2C+International+Organization+for+Standardization+%28ISO%29%2C+Geneva%2E)
7. ISO 24622-1:2015. 2015. Language resource management – Component Metadata Infrastructure (CMDI) – Part 1: The Component Metadata Model. International Standard, International Organization for Standardization (ISO), Geneva. [find](https://scholar.google.com/scholar?q=ISO+24622%2D1%3A2015%2E+2015%2E+Language+resource+management+%E2%80%93+Component+Metadata+Infrastructure+%28CMDI%29+%E2%80%93+Part+1%3A+The+Component+Metadata+Model%2E+International+Standard%2C+International+Organization+for+Standardi)
8. Keli Du, Sarah Ackerschewski, Uygar Navruz, Nazan Sınır, Julian Valline, and Christof Schöch. 2025. Reconstructing shuffled text. bad results for nlp, but good news for using in-copyright texts. Journal of Computational Literary Studies, 4(1). [find](https://scholar.google.com/scholar?q=Keli+Du%2C+Sarah+Ackerschewski%2C+Uygar+Navruz%2C+Nazan+S%C4%B1n%C4%B1r%2C+Julian+Valline%2C+and+Christof+Sch%C3%B6ch%2E+2025%2E+Reconstructing+shuffled+text%2E+bad+results+for+nlp%2C+but+good+news+for+using+in%2Dcopyright+texts%2E+Journ)
9. ISO 24622-2:2019. 2019. Language resource management – Component Metadata Infrastructure (CMDI) – Part 2: The Component Metadata Specification Language. International Standard, International Organization for Standardization (ISO), Geneva. [find](https://scholar.google.com/scholar?q=ISO+24622%2D2%3A2019%2E+2019%2E+Language+resource+management+%E2%80%93+Component+Metadata+Infrastructure+%28CMDI%29+%E2%80%93+Part+2%3A+The+Component+Metadata+Specification+Language%2E+International+Standard%2C+International+Organizat)
10. European Parliament and Council of the European Union. 2026. Regulation (eu) 2016/679 of the european parliament and of the council of 27 april 2016 on the protection of natural persons with regard to the processing of personal data and Timm Lehmberg, Christian Chiarcos, Georg Rehm, and Andreas Witt… [find](https://scholar.google.com/scholar?q=European+Parliament+and+Council+of+the+European+Union%2E+2026%2E+Regulation+%28eu%29+2016%2F679+of+the+european+parliament+and+of+the+council+of+27+april+2016+on+the+protection+of+natural+persons+with+regard+to)
11. Timm Lehmberg, Georg Rehm, Andreas Witt, and Felix Zimmermann. 2008. Digital text collections, linguistic research data, and mashups: Notes on the legal situation. Library Trends, 57(1):52 – 71. [find](https://scholar.google.com/scholar?q=Timm+Lehmberg%2C+Georg+Rehm%2C+Andreas+Witt%2C+and+Felix+Zimmermann%2E+2008%2E+Digital+text+collections%2C+linguistic+research+data%2C+and+mashups%3A+Notes+on+the+legal+situation%2E+Library+Trends%2C+57%281%29%3A52+%E2%80%93+71%2E)
12. MONAPipe 2023. 2023. Monapipe: Modes of narration and attribution pipeline. GitLab repository. Accessed: 2026-03-20. [find](https://scholar.google.com/scholar?q=MONAPipe+2023%2E+2023%2E+Monapipe%3A+Modes+of+narration+and+attribution+pipeline%2E+GitLab+repository%2E+Accessed%3A+2026%2D03%2D20%2E)
13. Stelios Piperidis, Harris Papageorgiou, Christian Spurk, Georg Rehm, Khalid Choukri, Olivier Hamon, Nicoletta Calzolari, Riccardo del Gratta, Bernardo Magnini, and Christian Girardi. 2014. META-SHARE: One year after. In Proceedings of the 9th Language Resources and Evaluation Conference (LREC 2014),… [find](https://scholar.google.com/scholar?q=Stelios+Piperidis%2C+Harris+Papageorgiou%2C+Christian+Spurk%2C+Georg+Rehm%2C+Khalid+Choukri%2C+Olivier+Hamon%2C+Nicoletta+Calzolari%2C+Riccardo+del+Gratta%2C+Bernardo+Magnini%2C+and+Christian+Girardi%2E+2014%2E+META%2DSHARE%3A)
14. Christof Schöch, Frédéric Döhl, Achim Rettinger, Evelyn Gius, Peer Trilcke, Peter Leinen, Fotis Jannidis, Maria Hinzmann, and Jörg Röpke. 2020. Abgeleitete textformate: Text und data mining mit urheberrechtlich geschützten textbeständen. Zeitschrift für digitale Geisteswissenschaften (ZfdG), 5. [find](https://scholar.google.com/scholar?q=Christof+Sch%C3%B6ch%2C+Fr%C3%A9d%C3%A9ric+D%C3%B6hl%2C+Achim+Rettinger%2C+Evelyn+Gius%2C+Peer+Trilcke%2C+Peter+Leinen%2C+Fotis+Jannidis%2C+Maria+Hinzmann%2C+and+J%C3%B6rg+R%C3%B6pke%2E+2020%2E+Abgeleitete+textformate%3A+Text+und+data+mining+mit+urhebe)
15. Text+ on TDM. 2025. Why the training of large language models falls within the scope of the text and data mining exceptions. Last modified: 23 January 2025. [find](https://scholar.google.com/scholar?q=Text%2B+on+TDM%2E+2025%2E+Why+the+training+of+large+language+models+falls+within+the+scope+of+the+text+and+data+mining+exceptions%2E+Last+modified%3A+23+January+2025%2E)
16. UrhG. 2021. § 44b urhg – text und data mining. [https://www.gesetze-im-internet.de/urhg/__44b.html](https://www.gesetze-im-internet.de/urhg/__44b.html). Zugriff am 16. [↗](https://www.gesetze-im-internet.de/urhg/__44b.html)
17. Georg Rehm, editor. 2023. European Language Grid: A Language Technology Platform for Multilingual Europe. Cognitive Technologies. Springer, Cham, Switzerland. [find](https://scholar.google.com/scholar?q=Georg+Rehm%2C+editor%2E+2023%2E+European+Language+Grid%3A+A+Language+Technology+Platform+for+Multilingual+Europe%2E+Cognitive+Technologies%2E+Springer%2C+Cham%2C+Switzerland%2E)
18. Georg Rehm, Stelios Piperidis, Khalid Choukri, Andrejs Vasil , jevs, Katrin Marheinecke, Victoria Arranz, Aivars Bērzin , š, Miltos Deligiannis, Dimitrios Galanis, Maria Gavriilidou, Maria Giagkou, Katerina Gkirtzou, Dimitris Gkoumas, Annika Grützner-Zahn, Athanasia Kolovou, Penny Labropoulou, Andi… [find](https://scholar.google.com/scholar?q=Georg+Rehm%2C+Stelios+Piperidis%2C+Khalid+Choukri%2C+Andrejs+Vasil+%2C+jevs%2C+Katrin+Marheinecke%2C+Victoria+Arranz%2C+Aivars+Be%CC%84rzin+%2C+%C5%A1%2C+Miltos+Deligiannis%2C+Dimitrios+Galanis%2C+Maria+Gavriilidou%2C+Maria+Giagkou%2C+K)
19. Georg Rehm, Andreas Witt, Heike Zinsmeister, and Johannes Dellert. 2007a. Corpus masking: Legally bypassing licensing restrictions for the free distribution of text collections. In Digital Humanities 2007. Conference Abstracts, pages 166–170, Urbana-Champaign. University of Illinois. [find](https://scholar.google.com/scholar?q=Georg+Rehm%2C+Andreas+Witt%2C+Heike+Zinsmeister%2C+and+Johannes+Dellert%2E+2007a%2E+Corpus+masking%3A+Legally+bypassing+licensing+restrictions+for+the+free+distribution+of+text+collections%2E+In+Digital+Humanities+)
20. Georg Rehm, Andreas Witt, Heike Zinsmeister, and Johannes Dellert. 2007b. Masking treebanks [find](https://scholar.google.com/scholar?q=Georg+Rehm%2C+Andreas+Witt%2C+Heike+Zinsmeister%2C+and+Johannes+Dellert%2E+2007b%2E+Masking+treebanks)

*Updated 1 November 2026*