--- title: "Guillaume Wenzek — author profile and papers" description: "Guillaume Wenzek, Meta: 2 papers on Elamur Research (2019–2020), h-index 15 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/guillaume-wenzek/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/guillaume-wenzek/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Guillaume Wenzek # Guillaume Wenzek Guillaume Wenzek works on building large text resources for natural language processing out of web crawl data. Their papers here turn raw Common Crawl snapshots into material for training multilingual models. Two concerns run through them: keeping text quality high as corpora grow, and serving languages that have little curated text, such as those with a small Wikipedia. The methods are large-scale processing pipelines and multilingual sentence embeddings applied across dozens of languages. The most cited of these papers is [CCNet](https://md.research.elamur.ai/free/en/papers/wenzek-2020-ccnet-extracting-high-quality-monolingual/) (2020). It describes an open-source pipeline that turns the plain-text dumps of Common Crawl into big monolingual corpora while keeping each document whole rather than breaking it into fragments. The companion paper, [CCMatrix](https://md.research.elamur.ai/free/en/papers/schwenk-2019-ccmatrix-mining-billions-high-quality/) (2019), takes margin-scored bitext mining with LASER embeddings, an approach first used on Wikipedia, and extends it to the web. Its source is ten CCNet-filtered Common Crawl snapshots, amounting to 32.7 billion distinct sentences across 38 languages. Most mining systems first pair up documents and only then search for matching sentences within them. CCMatrix drops that stage and compares each source sentence with each target sentence in a single shared embedding space. The goal is to provide parallel text for pairs of languages where neither side is English, and for subjects beyond the formal, political material found in parliamentary and UN proceedings. Taken together, the two papers, from 2019 and 2020, form one line of work: first cleaned monolingual web text, then parallel sentences mined from it. Wenzek's current affiliation is [Meta](https://md.research.elamur.ai/free/en/companies/meta/) in Menlo Park, and earlier bylines list [Meta](https://md.research.elamur.ai/free/en/companies/meta-israel/) offices in Tel Aviv and London. Co-authors on papers here include [Armand Joulin](https://md.research.elamur.ai/free/en/authors/armand-joulin/) and [Edouard Grave](https://md.research.elamur.ai/free/en/authors/edouard-grave/), with two papers each. Others are [Holger Schwenk](https://md.research.elamur.ai/free/en/authors/holger-schwenk/), [Alexis Conneau](https://md.research.elamur.ai/free/en/authors/alexis-conneau/), [Vishrav Chaudhary](https://md.research.elamur.ai/free/en/authors/vishrav-chaudhary/) and [Francisco Guzmán](https://md.research.elamur.ai/free/en/authors/francisco-guzman/). Guillaume Wenzek has 2 papers in our library, in 2019–2020; often with [Armand Joulin](https://md.research.elamur.ai/free/en/authors/armand-joulin/), [Edouard Grave](https://md.research.elamur.ai/free/en/authors/edouard-grave/), [Alexis Conneau](https://md.research.elamur.ai/free/en/authors/alexis-conneau/). 2 papers in our library · 2019–2020 [OpenAlex](https://openalex.org/A5023203387) · [**h-index 15**](https://openalex.org/authors/A5023203387) · [27 works](https://openalex.org/works?filter=author.id:A5023203387) · [7,269 citations](https://openalex.org/works?filter=author.id:A5023203387&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/guillaume-wenzek/#papers) · [🔗 2,996 citations in our library](https://md.research.elamur.ai/free/en/authors/guillaume-wenzek/cited-by/) · [3 more in our library without a page yet](#also) · [⭐ Paper Star rank #1990](https://md.research.elamur.ai/free/en/paper-stars/page/20/#star-1990) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Guillaume+Wenzek) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Guillaume+Wenzek) · [dblp](https://dblp.org/search?q=Guillaume+Wenzek) · [ACL Anthology](https://aclanthology.org/search/?q=Guillaume+Wenzek) ## Affiliations [🏢**Meta** Menlo Park · United States 2019–2025 · 10 papers*current*](https://md.research.elamur.ai/free/en/companies/meta/) · [🏢**Meta** Tel Aviv · Israel 2015–2020 · 3 papers](https://md.research.elamur.ai/free/en/companies/meta-israel/) · [🎓**University of California, Berkeley** Berkeley · United States 2023 · 2 papers](https://md.research.elamur.ai/free/en/universities/university-of-california-berkeley/) · [🏢**Meta** London · United Kingdom 2020–2021 · 2 papers](https://md.research.elamur.ai/free/en/companies/meta-united-kingdom/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Concepts, shelves and topics Of its works in our library: the number of works on each and its rating among them. 📚 Shelves 7[Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [General Social Sciences · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/general-social-sciences/) · [Social Sciences · 1 work](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · [Information Systems · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) ## Works by year ### 2020s [**2020** 1 paper](https://md.research.elamur.ai/free/en/papers/wenzek-2020-ccnet-extracting-high-quality-monolingual/) ### 2010s [**2019** 1 paper](https://md.research.elamur.ai/free/en/papers/schwenk-2019-ccmatrix-mining-billions-high-quality/) ## Papers The most cited first (OpenAlex and our library). 1. **[CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data](https://md.research.elamur.ai/free/en/papers/wenzek-2020-ccnet-extracting-high-quality-monolingual/)** *(2020 · 650 citations)* Pretrained language models improve as their training corpora grow, but only if data quality is maintained. 2. **[CCMatrix: Mining Billions of High-Quality Parallel Sentences on the WEB](https://md.research.elamur.ai/free/en/papers/schwenk-2019-ccmatrix-mining-billions-high-quality/)** *(2019 · 354 citations)* Parallel corpora are scarce, especially for language pairs that do not include English, and existing sources such as parliamentary or UN proceedings cover mostly formal, political topics. ## Also in our library 3 more works of theirs are in our library without a page here yet; they will appear as we publish them. ## Co-authors here 8 co-authors with a page, the most papers together first. - [Armand Joulin](https://md.research.elamur.ai/free/en/authors/armand-joulin/) ×2 - [Edouard Grave](https://md.research.elamur.ai/free/en/authors/edouard-grave/) ×2 - [Alexis Conneau](https://md.research.elamur.ai/free/en/authors/alexis-conneau/) - [Francisco Guzmán](https://md.research.elamur.ai/free/en/authors/francisco-guzman/) - [Holger Schwenk](https://md.research.elamur.ai/free/en/authors/holger-schwenk/) - [Marie-Anne Lachaux](https://md.research.elamur.ai/free/en/authors/marie-anne-lachaux/) - [Sergey Edunov](https://md.research.elamur.ai/free/en/authors/sergey-edunov/) - [Vishrav Chaudhary](https://md.research.elamur.ai/free/en/authors/vishrav-chaudhary/) ## Cited by Papers of our library cite their works 2,996 times (of the 140,884 papers whose bibliographies we read); [243 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/guillaume-wenzek/cited-by/). Updated 23 October 2026