--- title: "Wissam Antoun — author profile and papers · Semitic languages" description: "Wissam Antoun, Institut national de recherche en sciences et technologies du numérique: 3 papers on Elamur Research (2020–2021)…" canonical: "https://research.elamur.ai/free/en/authors/wissam-antoun/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/wissam-antoun/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Wissam Antoun # Wissam Antoun Wissam Antoun has 3 papers in our library, in 2020–2021, most of them on [Semitic languages](https://md.research.elamur.ai/free/en/topics/semitic-languages/), [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Text generation](https://md.research.elamur.ai/free/en/topics/text-generation/); often with [Fady Baly](https://md.research.elamur.ai/free/en/authors/fady-baly/), [Hazem Hajj](https://md.research.elamur.ai/free/en/authors/hazem-hajj/). 3 papers in our library · 2020–2021 [OpenAlex](https://openalex.org/A5050749439) · [ORCID](https://orcid.org/0000-0001-8021-5834) · [**h-index 9**](https://openalex.org/authors/A5050749439) · [33 works](https://openalex.org/works?filter=author.id:A5050749439) · [959 citations](https://openalex.org/works?filter=author.id:A5050749439&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 3 works in our library](https://md.research.elamur.ai/free/en/authors/wissam-antoun/#papers) · [🔗 Cited 858 times in our library](https://md.research.elamur.ai/free/en/authors/wissam-antoun/cited-by/) · [8 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #1655](https://md.research.elamur.ai/free/en/paper-stars/page/17/#star-1655) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Wissam+Antoun) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Wissam+Antoun) · [dblp](https://dblp.org/search?q=Wissam+Antoun) · [ACL Anthology](https://aclanthology.org/search/?q=Wissam+Antoun) ## Affiliations [🔬**Institut national de recherche en sciences et technologies du numérique** Le Chesnay-Rocquencourt · France 2023–2026 · 15 papers*current*](https://md.research.elamur.ai/free/en/labs/institut-national-de-recherche-en-sciences-et-technologies-du-numerique/) · [🔬**ALMANACH: Modélisation et analyse linguistique automatique et humanités computationnelles** Paris · France 2023–2026 · 10 papers*current*](https://md.research.elamur.ai/free/en/labs/almanach-modelisation-et-analyse-linguistique-automatique-et-humanites/) · [🔬**Centre Inria de Paris** Paris · France 2026 · 3 papers*current*](https://md.research.elamur.ai/free/en/labs/centre-inria-de-paris/) · [🎓**Sorbonne Université** Paris · France 2024–2026 · 3 papers*current*](https://md.research.elamur.ai/free/en/universities/sorbonne-universite/) · [🎓**American University of Beirut** Beirut · Lebanon 2018–2020 · 3 papersEducation 2018–2020 · Master of Engineering in Electrical and Computer Engineering, Maroun Semaan Faculty of Engineering and ArchitectureEmployment · Electrical and Computer Engineering](https://md.research.elamur.ai/free/en/universities/american-university-of-beirut/) · [🎓**Notre Dame University – Louaize** Zouk Mosbeh · Lebanon 2014–2018 · 1 paperEducation 2014–2017 · Bachelor of Eng. in Computer and Communication Engineering, Faculty of Engineering](https://ror.org/030br0314) 🏛️**Inria Centre de Recherche de Paris** Paris · [France](https://md.research.elamur.ai/free/en/countries/france/) 2022Employment since 2022 · Research Engineer, Almanach From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed. ## Fields, topics and concepts Of its works in our library, with the number of works on each. 📚 Shelves 4 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 3 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 3 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 3 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 4 Research subjects and languages the work is about.[Semitic languages · 3 works](https://md.research.elamur.ai/free/en/topics/semitic-languages/) · [Multilingual & cross-lingual NLP · 1 work](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · [Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) · [Text generation · 1 work](https://md.research.elamur.ai/free/en/topics/text-generation/) 💡 Concepts 1 Key ideas and methods explained on our concept pages.[Transformer and attention · 1 work](https://md.research.elamur.ai/free/en/concepts/transformer/) ## Works by year ### 2020s [**2021** 2 papers Wissam Antoun's papers of 2021](https://md.research.elamur.ai/free/en/authors/wissam-antoun/year/2021/) · [**2020** 1 paper Wissam Antoun's papers of 2020](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/) ## Papers The most cited first (OpenAlex and our library). 1. **[AraBERT: Transformer-based Model for Arabic Language Understanding](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/)** *(2020 · 1,302 citations)* Arabic has rich morphology, limited NLP resources and little in common with Latin-script languages. As a result, multilingual models such as Google's multilingual BERT represent it poorly. The authors address this by training a BERT model only on Arabic, called AraBERT. It uses the standard BERT-base architecture and… 2. **[AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding](https://md.research.elamur.ai/free/en/papers/antoun-2021-araelectra-pre-training-text-discriminators/)** *(2021 · 97 citations)* Earlier Arabic pretrained encoders, including AraBERT, Arabic-BERT and ARBERT, all relied on masked language modeling. 3. **[AraGPT2: Pre-Trained Transformer for Arabic Language Generation](https://md.research.elamur.ai/free/en/papers/antoun-2021-aragpt2-pre-trained-transformer-arabic/)** *(2021 · 79 citations)* Arabic NLP had strong pre-trained models for understanding tasks, mostly masked-LM encoders such as AraBERT, but lacked a capable generative model. ## All works 11 works of theirs in our library, the most cited first; 3 with a page here, the others link their original until we summarise them. 1. [**AraBERT: Transformer-based Model for Arabic Language Understanding arXiv:2003.00104**Wissam Antoun, Fady Baly, Hazem Hajj*2020 · 1,302 citations*](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/) 2. **[AraELECTRA: Pre-Training Text Discriminators for Arabic Language Understanding](https://md.research.elamur.ai/free/en/papers/antoun-2021-araelectra-pre-training-text-discriminators/) [Arabic Natural Language Processing Workshop (WANLP)](https://md.research.elamur.ai/free/en/venues/wanlp/)**Wissam Antoun, Fady Baly, Hazem Hajj*2021 · 97 citations* 3. **[hULMonA: The Universal Language Model in Arabic ↗](https://aclanthology.org/W19-4608/) Proceedings of the Fourth Arabic Natural Language Processing Workshop · no summary yet**Obeida ElJundi et al.*2019 · 89 citations* 4. **[AraGPT2: Pre-Trained Transformer for Arabic Language Generation](https://md.research.elamur.ai/free/en/papers/antoun-2021-aragpt2-pre-trained-transformer-arabic/) [Arabic Natural Language Processing Workshop (WANLP)](https://md.research.elamur.ai/free/en/venues/wanlp/)**Wissam Antoun, Fady Baly, Hazem Hajj*2021 · 79 citations* 5. **[Multi-Task Learning using AraBert for Offensive Language Detection ↗](https://aclanthology.org/2020.osact-1.16/) Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection · no summary yet**Marc Djandji et al.*2020 · 42 citations* 6. **[Towards a Robust Detection of Language Model-Generated Text: Is ChatGPT that easy to detect? ↗](https://aclanthology.org/2023.jeptalnrecital-long.2/) Actes de CORIA-TALN 2023. Actes de la 30e Conférence sur le Traitement Automatique des Langues Naturelles (TALN), volume 1 : travaux de recherche originaux – articles longs · no summary yet**Wissam Antoun et al.*2023 · 29 citations* 7. **[Empathetic BERT2BERT Conversational Model: Learning Arabic Language Generation with Little Data ↗](https://aclanthology.org/2021.wanlp-1.17/) Proceedings of the Sixth Arabic Natural Language Processing Workshop · no summary yet**Tarek Naous et al.*2021 · 20 citations* 8. **[CamemBERT 2.0: A Smarter French Language Model Aged to Perfection ↗](https://arxiv.org/abs/2411.08868) arXiv:2411.08868 · no summary yet**Wissam Antoun et al.*2024 · 19 citations* 9. **[Data-Efficient French Language Modeling with CamemBERTa ↗](https://aclanthology.org/2023.findings-acl.320/) Findings of the Association for Computational Linguistics: ACL 2023 · no summary yet**Wissam Antoun, Benoît Sagot, Djamé Seddah*2023 · 13 citations* 10. **[Gaperon: A Peppered English-French Generative Language Model Suite ↗](https://aclanthology.org/2026.findings-acl.1955/) Findings of the Association for Computational Linguistics: ACL 2026 · no summary yet**Nathan Godey et al.*2026 · 5 citations* 11. **[Language-Switching Triggers Take a Latent Detour Through Language Models ↗](https://arxiv.org/abs/2605.18646) arXiv:2605.18646 · no summary yet**Francis Kulumba et al.*2026* ## Co-authors here 2 co-authors with a page, the most papers together first. - [Fady Baly](https://md.research.elamur.ai/free/en/authors/fady-baly/) ×3 - [Hazem Hajj](https://md.research.elamur.ai/free/en/authors/hazem-hajj/) ×3 ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Arabic Natural Language Processing Workshop (WANLP)](https://md.research.elamur.ai/free/en/venues/wanlp/) ×4: [WANLP 2021](https://md.research.elamur.ai/free/en/venues/wanlp/2021/) ×2 - Findings of the Association for Computational Linguistics: ACL 2023 ×2 - Actes de CORIA-TALN 2023. Actes de la 30e Conférence sur le Traitement Automatique des Langues Naturelles (TALN), volume 1 : travaux de recherche originaux – articles longs - Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection ## Cited by Papers of our library cite their works 858 times (of the 141,840 papers whose bibliographies we read); [198 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/wissam-antoun/cited-by/). Updated 24 October 2026