--- title: "Koustuv Sinha — author profile and papers — Elamur Research" description: "Koustuv Sinha: 2 papers on Elamur Research (2021), h-index 14 — affiliations, topics, co-authors and who cites them in our library." canonical: "https://research.elamur.ai/free/en/authors/koustuv-sinha/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/koustuv-sinha/) [home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Koustuv Sinha # Koustuv Sinha Koustuv Sinha has 2 papers in our library, in 2021, most of them on [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/); often with [Adina Williams](https://md.research.elamur.ai/free/en/authors/adina-williams/), [Joelle Pineau](https://md.research.elamur.ai/free/en/authors/joelle-pineau/), [Dieuwke Hupkes](https://md.research.elamur.ai/free/en/authors/dieuwke-hupkes/). 2 papers in our library · 2021 [OpenAlex](https://openalex.org/A5109576489) · [ORCID](https://orcid.org/0000-0002-2803-9236) · [**h-index 14**](https://openalex.org/authors/A5109576489) · [77 works](https://openalex.org/works?filter=author.id:A5109576489) · [1,229 citations](https://openalex.org/works?filter=author.id:A5109576489&sort=cited_by_count:desc) OpenAlex, 2026-10-14 [📄 2 works in our library](https://md.research.elamur.ai/free/en/authors/koustuv-sinha/#papers) · [🔗 Cited 180 times in our library](https://md.research.elamur.ai/free/en/authors/koustuv-sinha/cited-by/) · [1 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #3650](https://md.research.elamur.ai/free/en/paper-stars/page/37/#star-3650) The profile is the library's match of the name; two people with one name are not always told apart. Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Koustuv+Sinha) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Koustuv+Sinha) · [dblp](https://dblp.org/search?q=Koustuv+Sinha) · [ACL Anthology](https://aclanthology.org/search/?q=Koustuv+Sinha) ## Affiliations [🎓**McGill University** Montreal · Canada 2018–2022 · 18 papers](https://md.research.elamur.ai/free/en/universities/mcgill-university/) · [🔬**Mila - Quebec Artificial Intelligence Institute** Montreal · Canada 2018–2022 · 5 papers](https://md.research.elamur.ai/free/en/labs/mila-quebec-artificial-intelligence-institute/) · [🏢**Meta** Menlo Park · United States 2016–2022 · 3 papers](https://md.research.elamur.ai/free/en/companies/meta/) · [🎓**ETH Zurich** Zurich · Switzerland 2023–2024 · 2 papers](https://md.research.elamur.ai/free/en/universities/eth-zurich/) From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 2 more institutions on single bylines are not listed. ## Concepts, shelves and topics Of its works in our library: the number of works on each and its rating among them. 📚 Shelves 4 The field of science this work belongs to (OpenAlex fields).[Artificial Intelligence · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Arts and Humanities · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 2 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Language and Linguistics · 2 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) 🧭 Topics 1 Research subjects and languages the work is about.[Language models & pretraining · 1 work](https://md.research.elamur.ai/free/en/topics/language-models/) 💡 Concepts 1 Key ideas and methods explained on our concept pages.[Distributional semantics · 1 work](https://md.research.elamur.ai/free/en/concepts/distributional-semantics/) ## Works by year ### 2020s [**2021** 2 papers Koustuv Sinha's papers of 2021](https://md.research.elamur.ai/free/en/authors/koustuv-sinha/year/2021/) ## Papers The most cited first (OpenAlex and our library). 1. **[Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little](https://md.research.elamur.ai/free/en/papers/sinha-2021-masked-language-modeling-distributional-hypothesis/)** *(2021 · 292 citations)* The paper asks why masked language model (MLM) pre-training works so well. One common view holds that models like BERT learn syntactic abstractions similar to a classical NLP pipeline. The authors test a different explanation: the benefit comes mainly from capturing higher-order word co-occurrence statistics. 2. **[UnNatural Language Inference](https://md.research.elamur.ai/free/en/papers/sinha-2021-unnatural-language-inference/)** *(2021 · 132 citations)* This paper tests whether high-performing Natural Language Inference (NLI) models actually depend on word order, which is a basic requirement for "knowing syntax." The authors randomly shuffle the words of premise and hypothesis sentences and check whether models still output the original gold label. ## All works 3 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them. 1. **[Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little](https://md.research.elamur.ai/free/en/papers/sinha-2021-masked-language-modeling-distributional-hypothesis/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Koustuv Sinha, Robin Jia, Dieuwke Hupkes, et al.*2021 · 292 citations* 2. **[UnNatural Language Inference](https://md.research.elamur.ai/free/en/papers/sinha-2021-unnatural-language-inference/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, et al.*2021 · 132 citations* 3. **[Efficient Tool Use with Chain-of-Abstraction Reasoning](https://aclanthology.org/2025.coling-main.185/) Proceedings of the 31st International Conference on Computational Linguistics · original ↗ · no summary yet**Silin Gao et al.*2025 · 13 citations* ## Co-authors here 5 co-authors with a page, the most papers together first. - [Adina Williams](https://md.research.elamur.ai/free/en/authors/adina-williams/) ×2 - [Joelle Pineau](https://md.research.elamur.ai/free/en/authors/joelle-pineau/) ×2 - [Dieuwke Hupkes](https://md.research.elamur.ai/free/en/authors/dieuwke-hupkes/) - [Douwe Kiela](https://md.research.elamur.ai/free/en/authors/douwe-kiela/) - [Robin Jia](https://md.research.elamur.ai/free/en/authors/robin-jia/) ## Venues Where their works here were published, the most works first, with the editions of those that have a page. - [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/): [ACL 2021](https://md.research.elamur.ai/free/en/venues/acl/2021/) - [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/): [EMNLP 2021](https://md.research.elamur.ai/free/en/venues/emnlp/2021/) - Proceedings of the 31st International Conference on Computational Linguistics ## Cited by Papers of our library cite their works 180 times (of the 141,840 papers whose bibliographies we read); [14 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/koustuv-sinha/cited-by/). Updated 24 October 2026