--- title: "Willem Zuidema — author profile and papers in our library" description: "Willem Zuidema, University of Amsterdam: 4 papers on Elamur Research (2020–2023), h-index 24 — affiliations, topics, co-authors and who…" canonical: "https://research.elamur.ai/free/en/authors/willem-zuidema/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/willem-zuidema/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Willem Zuidema # Willem Zuidema Willem Zuidema has 4 papers in our library, in 2020–2023, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Bias, fairness & safety](https://md.research.elamur.ai/free/en/topics/bias-fairness-safety/), [English](https://md.research.elamur.ai/free/en/topics/english/); often with [Jaap Jumelet](https://md.research.elamur.ai/free/en/authors/jaap-jumelet/), [Oskar van der Wal](https://md.research.elamur.ai/free/en/authors/oskar-van-der-wal/), [Arabella Sinclair](https://md.research.elamur.ai/free/en/authors/arabella-sinclair/). 4 papers in our library · 2020–2023 [OpenAlex](https://openalex.org/A5007928903) · [ORCID](https://orcid.org/0000-0002-2362-5447) · [Wikidata](https://www.wikidata.org/wiki/Q73836517) · [**h-index 24**](https://openalex.org/authors/A5007928903) · [179 works](https://openalex.org/works?filter=author.id:A5007928903) · [4,883 citations](https://openalex.org/works?filter=author.id:A5007928903&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 4 works in our library](https://md.research.elamur.ai/free/en/authors/willem-zuidema/#papers) · [🔗 Cited 220 times in our library](https://md.research.elamur.ai/free/en/authors/willem-zuidema/cited-by/) · [3 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #2203](https://md.research.elamur.ai/free/en/paper-stars/page/23/#star-2203) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Willem+Zuidema) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Willem+Zuidema) · [dblp](https://dblp.org/search?q=Willem+Zuidema) · [ACL Anthology](https://aclanthology.org/search/?q=Willem+Zuidema) ## Affiliations [🎓**University of Amsterdam** Amsterdam · Netherlands 2006–2026 · 95 papersEmployment · Associate Professor, ILLC*current*](https://md.research.elamur.ai/free/en/universities/university-of-amsterdam/) · [🎓**Vrije Universiteit Brussel** Brussels · Belgium 1999–2002 · 13 papers](https://md.research.elamur.ai/free/en/universities/vrije-universiteit-brussel/) · [🎓**University of Edinburgh** Edinburgh · United Kingdom 2002–2003 · 7 papers](https://md.research.elamur.ai/free/en/universities/university-of-edinburgh/) · [🎓**Leiden University** Leiden · Netherlands 2008–2010 · 4 papers](https://md.research.elamur.ai/free/en/universities/leiden-university/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 6 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 4 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 4 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 4 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Safety Research · 2 works](https://md.research.elamur.ai/free/en/shelves/social-sciences/safety-research/) · [Social Sciences · 2 works](https://md.research.elamur.ai/free/en/shelves/social-sciences/) 🧭 Topics 3 Research subjects and languages the work is about.[Language models & pretraining · 3 works](https://md.research.elamur.ai/free/en/topics/language-models/) · [Bias, fairness & safety · 2 works](https://md.research.elamur.ai/free/en/topics/bias-fairness-safety/) · [English · 2 works](https://md.research.elamur.ai/free/en/topics/english/) 💡 Concepts 1 Key ideas and methods explained on our concept pages.[Transformer and attention · 1 work](https://md.research.elamur.ai/free/en/concepts/transformer/) ## Works by year ### 2020s [**2023** 1 paper](https://md.research.elamur.ai/free/en/authors/willem-zuidema/year/2023/) · [**2022** 2 papers](https://md.research.elamur.ai/free/en/authors/willem-zuidema/year/2022/) · [**2020** 1 paper](https://md.research.elamur.ai/free/en/authors/willem-zuidema/year/2020/) ## Papers The most cited first (OpenAlex and our library). 1. **[Quantifying Attention Flow in Transformers](https://md.research.elamur.ai/free/en/papers/abnar-2020-quantifying-attention-flow-transformers/)** *(2020 · 1,064 citations)* Raw self-attention weights are often used to explain Transformer decisions. In higher layers, however, every embedding already mixes information from many tokens, so these weights say little about which input tokens mattered. Abnar and Zuidema treat the attention across layers as a directed acyclic graph: nodes are… 2. **[Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations](https://md.research.elamur.ai/free/en/papers/sinclair-2022-structural-persistence-language-models-priming/)** *(2022 · 74 citations)* Do neural language models represent sentence structure abstractly, apart from the specific words used? The authors test this with structural priming, a method from psycholinguistics: after a model reads a sentence with a given construction, does it assign higher probability to a follow-up sentence built the same way?… 3. **[Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model](https://md.research.elamur.ai/free/en/papers/chintam-2023-identifying-adapting-transformer-components-responsible/)** *(2023 · 19 citations)* The paper asks whether gender bias in a language model can be traced to specific internal parts and then reduced by retraining only those parts. 4. **[The Birth of Bias: A case study on the evolution of gender bias in an English language model](https://md.research.elamur.ai/free/en/papers/wal-2022-birth-bias-case-study-evolution/)** *(2022 · 19 citations)* Most work on gender bias in language models detects or removes it after training. This paper asks a prior question: how does a model become biased while it learns? The authors chose a small, fully transparent setup, an LSTM language model trained on an English Wikipedia corpus. They had complete access to the… ## All works 7 works of theirs in our library, the most cited first; 4 with a page here, the others link their original until we summarise them. 1. **[Quantifying Attention Flow in Transformers](https://md.research.elamur.ai/free/en/papers/abnar-2020-quantifying-attention-flow-transformers/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Samira Abnar, Willem Zuidema*2020 · 1,064 citations* 2. **[Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations](https://md.research.elamur.ai/free/en/papers/sinclair-2022-structural-persistence-language-models-priming/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Arabella Sinclair, Jaap Jumelet, Willem Zuidema, et al.*2022 · 74 citations* 3. **[BLiMP-NL: A Corpus of Dutch Minimal Pairs and Acceptability Judgments for Language Model Evaluation ↗](https://aclanthology.org/2025.cl-4.6/) Computational Linguistics · no summary yet**Michelle Suijkerbuijk et al.*2025 · 22 citations* 4. **[Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model](https://md.research.elamur.ai/free/en/papers/chintam-2023-identifying-adapting-transformer-components-responsible/) [BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP](https://md.research.elamur.ai/free/en/venues/blackboxnlp/)**Abhijith Chintam, Rahel Beloch, Willem Zuidema, et al.*2023 · 19 citations* 5. **[The Birth of Bias: A case study on the evolution of gender bias in an English language model](https://md.research.elamur.ai/free/en/papers/wal-2022-birth-bias-case-study-evolution/) [Workshop on Gender Bias in Natural Language Processing](https://md.research.elamur.ai/free/en/venues/gebnlp/)**Oskar Van Der Wal, Jaap Jumelet, Katrin Schulz, et al.*2022 · 19 citations* 6. **[Learning from errors: Using vector-based compositional semantics for parse reranking ↗](https://aclanthology.org/W13-3202/) Proceedings of the Workshop on Continuous Vector Space Models and their Compositionality · no summary yet**Phong Le, Willem Zuidema, Remko Scha*2013 · 8 citations* 7. **[What do self-supervised speech models know about Dutch? Analyzing advantages of language-specific pre-training ↗](https://doi.org/10.21437/interspeech.2025-1526) arXiv:2506.00981 · Proc. INTERSPEECH 2025 · no summary yet**Marianne de Heer Kloots et al.*2025 · 2 citations* ## Co-authors here 6 co-authors with a page, the most papers together first. - [Jaap Jumelet](https://md.research.elamur.ai/free/en/authors/jaap-jumelet/) ×2 - [Oskar van der Wal](https://md.research.elamur.ai/free/en/authors/oskar-van-der-wal/) ×2 - [Arabella Sinclair](https://md.research.elamur.ai/free/en/authors/arabella-sinclair/) - [Michael Hanna](https://md.research.elamur.ai/free/en/authors/michael-hanna/) - [Raquel Fernández](https://md.research.elamur.ai/free/en/authors/raquel-fernandez/) - [Samira Abnar](https://md.research.elamur.ai/free/en/authors/samira-abnar/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/): [ACL 2020](https://md.research.elamur.ai/free/en/venues/acl/2020/) - [BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP](https://md.research.elamur.ai/free/en/venues/blackboxnlp/): [BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP 2023](https://md.research.elamur.ai/free/en/venues/blackboxnlp/2023/) - [Workshop on Gender Bias in Natural Language Processing](https://md.research.elamur.ai/free/en/venues/gebnlp/): [Workshop on Gender Bias in Natural Language Processing 2022](https://md.research.elamur.ai/free/en/venues/gebnlp/2022/) - [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/): [Transactions of the Association for Computational Linguistics (TACL) 2022](https://md.research.elamur.ai/free/en/venues/tacl/2022/) - Computational Linguistics - Proceedings of the Workshop on Continuous Vector Space Models and their Compositionality ## Cited by Papers of our library cite their works 220 times (of the 149,439 papers whose bibliographies we read); [32 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/willem-zuidema/cited-by/). Updated 30 October 2026