--- title: "Jonathan Pilault — author profile and papers — Elamur Research" description: "Jonathan Pilault: 2 papers on Elamur Research (2020–2023), h-index 4 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/jonathan-pilault/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/jonathan-pilault/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Jonathan Pilault # Jonathan Pilault Jonathan Pilault has 2 papers in our library, in 2020–2023, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Summarization](https://md.research.elamur.ai/free/en/topics/summarization/); often with [Christopher Pal](https://md.research.elamur.ai/free/en/authors/christopher-pal/), [Orhan Firat](https://md.research.elamur.ai/free/en/authors/orhan-firat/), [Raymond Li](https://md.research.elamur.ai/free/en/authors/raymond-li/). 2 papers in our library · 2020–2023 [OpenAlex](https://openalex.org/A5049628803) · [**h-index 4**](https://openalex.org/authors/A5049628803) · [21 works](https://openalex.org/works?filter=author.id:A5049628803) · [263 citations](https://openalex.org/works?filter=author.id:A5049628803&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/jonathan-pilault/#papers) · [🔗 Cited 145 times in our library](https://md.research.elamur.ai/free/en/authors/jonathan-pilault/cited-by/) · [2 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #5097](https://md.research.elamur.ai/free/en/paper-stars/page/51/#star-5097) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Jonathan+Pilault) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Jonathan+Pilault) · [dblp](https://dblp.org/search?q=Jonathan+Pilault) · [ACL Anthology](https://aclanthology.org/search/?q=Jonathan+Pilault) ## Affiliations [🎓**Polytechnique Montréal** Montreal · Canada 2020–2023 · 6 papers](https://md.research.elamur.ai/free/en/universities/polytechnique-montreal/) · [🔬**Mila - Quebec Artificial Intelligence Institute** Montreal · Canada 2020–2023 · 4 papers](https://md.research.elamur.ai/free/en/labs/mila-quebec-artificial-intelligence-institute/) · [🏢**Zyphra** Palo Alto · United States 2024 · 2 papers](https://ror.org/01wzpra32) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 2 more institutions on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Computer Vision and Pattern Recognition · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) 🧭 Topics 2 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Summarization · 1 work](https://md.research.elamur.ai/free/en/topics/summarization/) ## Works by year ### 2020s [**2023** 1 paper](https://md.research.elamur.ai/free/en/authors/jonathan-pilault/year/2023/) · [**2020** 1 paper](https://md.research.elamur.ai/free/en/authors/jonathan-pilault/year/2020/) ## Papers The most cited first (OpenAlex and our library). 1. **[On Extractive and Abstractive Neural Document Summarization with Transformer Language Models](https://md.research.elamur.ai/free/en/papers/pilault-2020-extractive-abstractive-neural-document-summarization/)** *(2020 · 261 citations)* Neural abstractive models struggle with documents several thousand words long. Recurrent seq2seq systems handle long-range dependencies poorly, and transformer language models (TLMs) cannot fit such long inputs in memory. The authors propose a two-stage hybrid. First, an extractive sentence pointer network selects… 2. **[Block-State Transformers](https://md.research.elamur.ai/free/en/papers/fathi-2023-block-state-transformers/)** *(2023 · 20 citations)* Transformers handle language modeling well, but attention cost grows quadratically with input length, and they generalize poorly to long contexts. ## All works 4 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[On Extractive and Abstractive Neural Document Summarization with Transformer Language Models](https://md.research.elamur.ai/free/en/papers/pilault-2020-extractive-abstractive-neural-document-summarization/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Jonathan Pilault, Raymond Li, Sandeep Subramanian, et al.*2020 · 261 citations* 2. **[Zamba: A Compact 7B SSM Hybrid Model ↗](https://arxiv.org/abs/2405.16712) arXiv:2405.16712 · no summary yet**Paolo Glorioso et al.*2024 · 50 citations* 3. [**Block-State Transformers arXiv:2306.09539**Mahan Fathi, Jonathan Pilault, Orhan Firat, et al.*2023 · 20 citations*](https://md.research.elamur.ai/free/en/papers/fathi-2023-block-state-transformers/) 4. **[On Conditional and Compositional Language Model Differentiable Prompting ↗](https://doi.org/10.24963/ijcai.2023/460) International Joint Conference on Artificial Intelligence · no summary yet**Jonathan Pilault et al.*2023 · 2 citations* ## Co-authors here 4 co-authors with a page, the most papers together first. - [Christopher Pal](https://md.research.elamur.ai/free/en/authors/christopher-pal/) ×2 - [Orhan Firat](https://md.research.elamur.ai/free/en/authors/orhan-firat/) - [Raymond Li](https://md.research.elamur.ai/free/en/authors/raymond-li/) - [Sandeep Subramanian](https://md.research.elamur.ai/free/en/authors/sandeep-subramanian/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/): [EMNLP 2020](https://md.research.elamur.ai/free/en/venues/emnlp/2020/) - International Joint Conference on Artificial Intelligence ## Cited by Papers of our library cite their works 145 times (of the 149,439 papers whose bibliographies we read); [25 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/jonathan-pilault/cited-by/). Updated 30 October 2026