---
title: "Iz Beltagy — all works — Elamur Research"
description: "All 26 works of Iz Beltagy in the Elamur Research library, the most cited first: our summaries where we have them, else the original."
canonical: "https://research.elamur.ai/free/en/authors/iz-beltagy/works/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/iz-beltagy/works/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / [Iz Beltagy](https://md.research.elamur.ai/free/en/authors/iz-beltagy/) / all works

# Iz Beltagy — all works

26 works · [← Iz Beltagy](https://md.research.elamur.ai/free/en/authors/iz-beltagy/)

1. [**Longformer: The Long-Document Transformer arXiv:2004.05150**Iz Beltagy, Matthew E. Peters, Arman Cohan*2020 · 3,880 citations*](https://md.research.elamur.ai/free/en/papers/beltagy-2020-longformer-long-document-transformer/)
2. **[SciBERT: A Pretrained Language Model for Scientific Text](https://md.research.elamur.ai/free/en/papers/beltagy-2019-scibert-pretrained-language-model-scientific/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Iz Beltagy, Kyle Lo, Arman Cohan*2019 · 3,582 citations*
3. **[Don't Stop Pretraining: Adapt Language Models to Domains and Tasks ↗](https://aclanthology.org/2020.acl-main.740/) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yet**Suchin Gururangan et al.*2020 · 3,079 citations*
4. **[BLOOM: A 176B-Parameter Open-Access Multilingual Language Model ↗](https://arxiv.org/abs/2211.05100) arXiv:2211.05100 · no summary yet**BigScience Workshop et al.*2022 · 1,606 citations*
5. **[SPECTER: Document-level Representation Learning using Citation-informed Transformers](https://md.research.elamur.ai/free/en/papers/cohan-2020-specter-document-level-representation-learning/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Arman Cohan, Sergey Feldman, Iz Beltagy, et al.*2020 · 697 citations*
6. **[ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing](https://md.research.elamur.ai/free/en/papers/neumann-2019-scispacy-fast-robust-models-biomedical/) [BioNLP Shared Task Workshop](https://md.research.elamur.ai/free/en/venues/bionlp-workshop-and-shared-task/)**Mark Neumann, Daniel King, Iz Beltagy, et al.*2019 · 680 citations*
7. **[OLMo: Accelerating the Science of Language Models ↗](https://aclanthology.org/2024.acl-long.841/) Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Dirk Groeneveld et al.*2024 · 429 citations*
8. **[Construction of the Literature Graph in Semantic Scholar](https://md.research.elamur.ai/free/en/papers/ammar-2018-construction-literature-graph-semantic-scholar/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Waleed Ammar, Dirk Groeneveld, Chandra Bhagavatula, et al.*2018 · 400 citations*
9. **[A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers](https://md.research.elamur.ai/free/en/papers/dasigi-2021-dataset-information-seeking-questions-answers/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Pradeep Dasigi, Kyle Lo, Iz Beltagy, et al.*2021 · 384 citations*
10. **[Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research ↗](https://aclanthology.org/2024.acl-long.840/) Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Luca Soldaini et al.*2024 · 341 citations*
11. **[How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources](https://md.research.elamur.ai/free/en/papers/wang-2023-far-camels-go-exploring-state/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Yizhong Wang, Hamish Ivison, Pradeep Dasigi, et al.*2023 · 317 citations*
12. **[SciREX: A Challenge Dataset for Document-Level Information Extraction](https://md.research.elamur.ai/free/en/papers/jain-2020-scirex-challenge-dataset-document-level/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Sarthak Jain, Madeleine van Zuylen, Hannaneh Hajishirzi, et al.*2020 · 220 citations*
13. [**Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2 arXiv:2311.10702**Hamish Ivison, Yizhong Wang, Valentina Pyatkin, et al.*2023 · 207 citations*](https://md.research.elamur.ai/free/en/papers/ivison-2023-camels-changing-climate-enhancing-lm/)
14. **[PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization](https://md.research.elamur.ai/free/en/papers/xiao-2022-primera-pyramid-based-masked-sentence/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Wen Xiao, Iz Beltagy, Giuseppe Carenini, et al.*2022 · 205 citations*
15. **[Pretrained Language Models for Sequential Sentence Classification ↗](https://aclanthology.org/D19-1383/) Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yet**Arman Cohan et al.*2019 · 172 citations*
16. **[Few-Shot Self-Rationalization with Natural Language Prompts](https://md.research.elamur.ai/free/en/papers/marasovic-2022-few-shot-self-rationalization-natural/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Ana Marasovic, Iz Beltagy, Doug Downey, et al.*2022 · 134 citations*
17. **[The Semantic Scholar Open Data Platform ↗](https://arxiv.org/abs/2301.10140) arXiv (Cornell University) · no summary yet**Rodney Kinney et al.*2023 · 126 citations*
18. **[CDLM: Cross-Document Language Modeling](https://md.research.elamur.ai/free/en/papers/caciularu-2021-cdlm-cross-document-language-modeling/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Avi Caciularu, Arman Cohan, Iz Beltagy, et al.*2021 · 106 citations*
19. **[MultiVerS: Improving scientific claim verification with weak supervision and full-document context ↗](https://aclanthology.org/2022.findings-naacl.6/) Findings of the Association for Computational Linguistics: NAACL 2022 · no summary yet**David Wadden et al.*2022 · 98 citations*
20. **[SciFact-Open: Towards open-domain scientific claim verification](https://md.research.elamur.ai/free/en/papers/wadden-2022-scifact-open-open-domain-scientific/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**David Wadden, Kyle Lo, Bailey Kuehl, et al.*2022 · 94 citations*
21. **[MS^2: Multi-Document Summarization of Medical Studies ↗](https://aclanthology.org/2021.emnlp-main.594/) Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yet**Jay DeYoung et al.*2021 · 84 citations*
22. **[What Language Model to Train if You Have One Million GPU Hours? ↗](https://arxiv.org/abs/2210.15424) arXiv:2210.15424 · no summary yet**Teven Le Scao et al.*2022 · 73 citations*
23. **[What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? ↗](https://arxiv.org/abs/2204.05832) arXiv:2204.05832 · no summary yet**Thomas Wang et al.*2022 · 62 citations*
24. **[Z-ICL: Zero-Shot In-Context Learning with Pseudo-Demonstrations ↗](https://aclanthology.org/2023.acl-long.129/) Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Xinxi Lyu et al.*2023 · 56 citations*
25. **[Paloma: A Benchmark for Evaluating Language Model Fit](https://md.research.elamur.ai/free/en/papers/magnusson-2023-paloma-benchmark-evaluating-language-model/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Ian Magnusson, Akshita Bhagia, Valentin Hofmann, et al.*2023 · 42 citations*
26. [**Source-Aware Training Enables Knowledge Attribution in Language Models arXiv:2404.01019**Muhammad Khalifa, David Wadden, Emma Strubell, et al.*2024 · 21 citations*](https://md.research.elamur.ai/free/en/papers/khalifa-2024-source-aware-training-enables-knowledge/)