--- title: "Papers of 2020 — page 1" description: "Papers of 2020: 625 papers of the Elamur Research library — what each work is about in our own words, its ideas, references and who cites it." canonical: "https://research.elamur.ai/free/en/papers/2020/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/2020/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / 2020 # Papers of 2020 — page 1 625 papers · [all years](https://md.research.elamur.ai/free/en/papers/) **1** [2](https://md.research.elamur.ai/free/en/papers/2020/page/2/) … [7](https://md.research.elamur.ai/free/en/papers/2020/page/7/) [next →](https://md.research.elamur.ai/free/en/papers/2020/page/2/) **[Array Programming with NumPy](https://md.research.elamur.ai/free/en/papers/harris-2020-array-programming-numpy/)**Charles R. Harris, K. Jarrod Millman, Stéfan J. van der Walt, et al.*[Nature](https://md.research.elamur.ai/free/en/venues/nature/) · 23,591 citations* **[End-to-End Object Detection with Transformers](https://md.research.elamur.ai/free/en/papers/carion-2020-end-end-object-detection-transformers/)**Nicolas Carion, Francisco Massa, Gabriel Synnaeve, et al.*[Lecture notes in computer science](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/) · 16,761 citations* **[Transformers: State-of-the-Art Natural Language Processing](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/)**Thomas Wolf, Lysandre Debut, Victor Sanh, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 15,591 citations* **[BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension](https://md.research.elamur.ai/free/en/papers/lewis-2020-bart-denoising-sequence-sequence-pre/)**Mike Lewis, Yinhan Liu, Naman Goyal, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 12,752 citations* - [Language Models are Few-Shot Learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/) — Tom B. Brown, Benjamin Mann, Nick Ryder, et al. · arXiv:2005.14165 · 10,782 citations - [A Simple Framework for Contrastive Learning of Visual Representations](https://md.research.elamur.ai/free/en/papers/chen-2020-simple-framework-contrastive-learning-visual/) — Ting Chen, Simon Kornblith, Mohammad Norouzi, et al. · arXiv:2002.05709 · 7,774 citations **[Dense Passage Retrieval for Open-Domain Question Answering](https://md.research.elamur.ai/free/en/papers/karpukhin-2020-dense-passage-retrieval-open-domain/)**Vladimir Karpukhin, Barlas Oguz, Sewon Min, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 5,370 citations* - [Measuring Massive Multitask Language Understanding](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/) — Dan Hendrycks, Collin Burns, Steven Basart, et al. · arXiv:2009.03300 · 3,489 citations **[Conformer: Convolution-augmented Transformer for Speech Recognition](https://md.research.elamur.ai/free/en/papers/gulati-2020-conformer-convolution-augmented-transformer-speech/)**Anmol Gulati, James Qin, Chung-Cheng Chiu, et al.*[Interspeech](https://md.research.elamur.ai/free/en/venues/interspeech-usb/) · 3,433 citations* **[CodeBERT: A Pre-Trained Model for Programming and Natural Languages](https://md.research.elamur.ai/free/en/papers/feng-2020-codebert-pre-trained-model-programming/)**Zhangyin Feng, Daya Guo, Duyu Tang, et al.*[Findings of the Association for Computational…](https://md.research.elamur.ai/free/en/venues/findings/) · 2,954 citations* - [Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing](https://md.research.elamur.ai/free/en/papers/gu-2020-domain-specific-language-model-pretraining/) — Yu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon · arXiv:2007.15779 · 2,636 citations - [Stanza: A Python Natural Language Processing Toolkit for Many Human Languages](https://md.research.elamur.ai/free/en/papers/qi-2020-stanza-python-natural-language-processing/) — Peng Qi, Yuhao Zhang, Yuhui Zhang, et al. · English · 2,347 citations **[A Primer in BERTology: What We Know About How BERT Works](https://md.research.elamur.ai/free/en/papers/rogers-2020-primer-bertology-what-we-know/)**Anna Rogers, Olga Kovaleva, Anna Rumshisky*[Transactions of the Association for…](https://md.research.elamur.ai/free/en/venues/tacl/) · 2,127 citations* **[Knowledge Graphs](https://md.research.elamur.ai/free/en/papers/hogan-2020-knowledge-graphs/)**Aidan Hogan, Eva Blomqvist, Michael Cochez, et al.*[ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/) · 2,011 citations* - [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://md.research.elamur.ai/free/en/papers/dosovitskiy-2020-image-worth-16x16-words-transformers/) — Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al. · arXiv:2010.11929 · 1,947 citations **[AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts](https://md.research.elamur.ai/free/en/papers/shin-2020-autoprompt-eliciting-knowledge-language-models/)**Taylor Shin, Yasaman Razeghi, Robert L. Logan IV, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 1,879 citations* **[Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks](https://md.research.elamur.ai/free/en/papers/li-2020-oscar-object-semantics-aligned-pre/)**Xiujun Li, Xi Yin, Chunyuan Li, et al.*[Lecture notes in computer science](https://md.research.elamur.ai/free/en/venues/lecture-notes-in-computer-science/) · 1,827 citations* - [Scaling Laws for Neural Language Models](https://md.research.elamur.ai/free/en/papers/kaplan-2020-scaling-laws-neural-language-models/) — Jared Kaplan, Sam McCandlish, Tom Henighan, et al. · arXiv:2001.08361 · 1,814 citations - [DeBERTa: Decoding-enhanced BERT with Disentangled Attention](https://md.research.elamur.ai/free/en/papers/he-2020-deberta-decoding-enhanced-bert-disentangled/) — Pengcheng He, Xiaodong Liu, Jianfeng Gao, et al. · arXiv:2006.03654 · 1,800 citations - [COMET: A Neural Framework for MT Evaluation](https://md.research.elamur.ai/free/en/papers/rei-2020-comet-neural-framework-mt-evaluation/) — Ricardo Rei, Craig Stewart, Ana C Farinha, et al. · Machine translation · 1,784 citations **[ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT](https://md.research.elamur.ai/free/en/papers/khattab-2020-colbert-efficient-effective-passage/)**Omar Khattab, Matei Zaharia*[International ACM SIGIR Conference on Research…](https://md.research.elamur.ai/free/en/venues/international-acm-sigir-conference-on-research-and-development-in-information/) · 1,776 citations* - [Pre-trained Models for Natural Language Processing: A Survey](https://md.research.elamur.ai/free/en/papers/qiu-2020-pre-trained-models-natural-language/) — Xipeng Qiu, Tianxiang Sun, Yige Xu, et al. · arXiv:2003.08271 · SCIENCE CHINA Technological… · 1,740 citations - [Longformer: The Long-Document Transformer](https://md.research.elamur.ai/free/en/papers/beltagy-2020-longformer-long-document-transformer/) — Iz Beltagy, Matthew E. Peters, Arman Cohan · arXiv:2004.05150 · 1,737 citations **[Language (Technology) is Power: A Critical Survey of “Bias” in NLP](https://md.research.elamur.ai/free/en/papers/blodgett-2020-language-technology-is-power-critical/)**Su Lin Blodgett, Solon Barocas, Hal Daumé III, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 1,700 citations* - [Score-Based Generative Modeling through Stochastic Differential Equations](https://md.research.elamur.ai/free/en/papers/song-2020-score-based-generative-modeling-through/) — Yang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, et al. · arXiv:2011.13456 · 1,528 citations **[Efficient Transformers: A Survey](https://md.research.elamur.ai/free/en/papers/tay-2020-efficient-transformers-survey/)**Yi Tay, Mostafa Dehghani, Dara Bahri, et al.*[ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/) · 1,513 citations* **[How Can We Know What Language Models Know?](https://md.research.elamur.ai/free/en/papers/jiang-2020-how-can-we-know-what/)**Zhengbao Jiang, Frank F. Xu, Jun Araki, et al.*[Transactions of the Association for…](https://md.research.elamur.ai/free/en/venues/tacl/) · 1,493 citations* **[The State and Fate of Linguistic Diversity and Inclusion in the NLP World](https://md.research.elamur.ai/free/en/papers/joshi-2020-state-fate-linguistic-diversity-inclusion/)**Pratik Joshi, Sebastin Santy, Amar Budhiraja, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 1,492 citations* **[LEGAL-BERT: The Muppets straight out of Law School](https://md.research.elamur.ai/free/en/papers/chalkidis-2020-legal-bert-muppets-straight-out/)**Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, et al.*[Findings of the Association for Computational…](https://md.research.elamur.ai/free/en/venues/findings/) · 1,490 citations* **[Language-agnostic BERT Sentence Embedding](https://md.research.elamur.ai/free/en/papers/feng-2020-language-agnostic-bert-sentence-embedding/)**Fangxiaoyu Feng, Yinfei Yang, Daniel Cer, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 1,412 citations* **[Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data](https://md.research.elamur.ai/free/en/papers/bender-2020-climbing-nlu-meaning-form-understanding/)**Emily M. Bender, Alexander Koller*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 1,371 citations* **[wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations](https://md.research.elamur.ai/free/en/papers/baevski-2020-wav2vec-2-0-framework-self/)**Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.*[Conference on Neural Information Processing…](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/) · 1,355 citations* **[Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation](https://md.research.elamur.ai/free/en/papers/reimers-2020-making-monolingual-sentence-embeddings-multilingual/)**Nils Reimers, Iryna Gurevych*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 1,320 citations* - [AraBERT: Transformer-based Model for Arabic Language Understanding](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/) — Wissam Antoun, Fady Baly, Hazem Hajj · arXiv:2003.00104 · 1,297 citations **[RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models](https://md.research.elamur.ai/free/en/papers/gehman-2020-realtoxicityprompts-evaluating-neural-toxic-degeneration/)**Samuel Gehman, Suchin Gururangan, Maarten Sap, et al.*[Findings of the Association for Computational…](https://md.research.elamur.ai/free/en/venues/findings/) · 1,277 citations* **[On the Cross-lingual Transferability of Monolingual Representations](https://md.research.elamur.ai/free/en/papers/artetxe-2020-cross-lingual-transferability-monolingual-representations/)**Mikel Artetxe, Sebastian Ruder, Dani Yogatama*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 1,168 citations* **[BERTweet: A pre-trained language model for English Tweets](https://md.research.elamur.ai/free/en/papers/nguyen-2020-bertweet-pre-trained-language-model/)**Dat Quoc Nguyen, Thanh Vu, Anh Tuan Nguyen*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 1,139 citations* **[Quantifying Attention Flow in Transformers](https://md.research.elamur.ai/free/en/papers/abnar-2020-quantifying-attention-flow-transformers/)**Samira Abnar, Willem Zuidema*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 1,049 citations* **[MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices](https://md.research.elamur.ai/free/en/papers/sun-2020-mobilebert-compact-task-agnostic-bert/)**Zhiqing Sun, Hongkun Yu, Xiaodan Song, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 1,003 citations* **[Big Bird: Transformers for Longer Sequences](https://md.research.elamur.ai/free/en/papers/zaheer-2020-big-bird-transformers-longer-sequences/)**Manzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.*[Conference on Neural Information Processing…](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/) · 992 citations* - [TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classification](https://md.research.elamur.ai/free/en/papers/barbieri-2020-tweeteval-unified-benchmark-comparative-evaluation/) — Francesco Barbieri, Jose Camacho-Collados, Leonardo Neves, et al. · arXiv:2010.12421 · 952 citations - [AdapterFusion: Non-Destructive Task Composition for Transfer Learning](https://md.research.elamur.ai/free/en/papers/pfeiffer-2020-adapterfusion-non-destructive-task-composition/) — Jonas Pfeiffer, Aishwarya Kamath, Andreas Rücklé, et al. · arXiv:2005.00247 · Proceedings of EACL 2021 · 948 citations - [MPNet: Masked and Permuted Pre-training for Language Understanding](https://md.research.elamur.ai/free/en/papers/song-2020-mpnet-masked-permuted-pre-training/) — Kaitao Song, Xu Tan, Tao Qin, et al. · arXiv:2004.09297 · 944 citations **[Topic Modeling in Embedding Spaces](https://md.research.elamur.ai/free/en/papers/dieng-2020-topic-modeling-embedding-spaces/)**Adji B. Dieng, Francisco J. R. Ruiz, David M. Blei*[Transactions of the Association for…](https://md.research.elamur.ai/free/en/venues/tacl/) · 914 citations* - [Extracting Training Data from Large Language Models](https://md.research.elamur.ai/free/en/papers/carlini-2020-extracting-training-data-large-language/) — Nicholas Carlini, Florian Tramer, Eric Wallace, et al. · arXiv:2012.07805 · 901 citations **[CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models](https://md.research.elamur.ai/free/en/papers/nangia-2020-crows-pairs-challenge-dataset-measuring/)**Nikita Nangia, Clara Vania, Rasika Bhalerao, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 886 citations* **[TextAttack: A Framework for Adversarial Attacks, Data Augmentation, and Adversarial Training in NLP](https://md.research.elamur.ai/free/en/papers/morris-2020-textattack-framework-adversarial-attacks-data/)**John X. Morris, Eli Lifland, Jin Yong Yoo, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 857 citations* **[TaPas: Weakly Supervised Table Parsing via Pre-training](https://md.research.elamur.ai/free/en/papers/herzig-2020-tapas-weakly-supervised-table-parsing/)**Jonathan Herzig, Pawel Krzysztof Nowak, Thomas Müller, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 844 citations* **[UNIFIEDQA: Crossing Format Boundaries with a Single QA System](https://md.research.elamur.ai/free/en/papers/khashabi-2020-unifiedqa-crossing-format-boundaries-single/)**Daniel Khashabi, Sewon Min, Tushar Khot, et al.*[Findings of the Association for Computational…](https://md.research.elamur.ai/free/en/venues/findings/) · 843 citations* **[What BERT Is Not: Lessons from a New Suite of Psycholinguistic Diagnostics for Language Models](https://md.research.elamur.ai/free/en/papers/ettinger-2020-what-bert-is-not-lessons/)**Allyson Ettinger*[Transactions of the Association for…](https://md.research.elamur.ai/free/en/venues/tacl/) · 843 citations* **[BERT-ATTACK: Adversarial Attack Against BERT Using BERT](https://md.research.elamur.ai/free/en/papers/li-2020-bert-attack-adversarial-attack-against/)**Linyang Li, Ruotian Ma, Qipeng Guo, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 840 citations* **[A Unified MRC Framework for Named Entity Recognition](https://md.research.elamur.ai/free/en/papers/li-2020-unified-mrc-framework-named-entity/)**Xiaoya Li, Jingrong Feng, Yuxian Meng, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 833 citations* **[MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer](https://md.research.elamur.ai/free/en/papers/pfeiffer-2020-mad-x-adapter-based-framework/)**Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 831 citations* **[On the Sentence Embeddings from Pre-trained Language Models](https://md.research.elamur.ai/free/en/papers/li-2020-sentence-embeddings-pre-trained-language/)**Bohan Li, Hao Zhou, Junxian He, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 830 citations* - [DocVQA: A Dataset for VQA on Document Images](https://md.research.elamur.ai/free/en/papers/mathew-2020-docvqa-dataset-vqa-document-images/) — Minesh Mathew, Dimosthenis Karatzas, C.V. Jawahar · arXiv:2007.00398 · 820 citations **[ERASER: A Benchmark to Evaluate Rationalized NLP Models](https://md.research.elamur.ai/free/en/papers/deyoung-2020-eraser-benchmark-evaluate-rationalized-nlp/)**Jay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 820 citations* - [Revisiting Pre-Trained Models for Chinese Natural Language Processing](https://md.research.elamur.ai/free/en/papers/cui-2020-revisiting-pre-trained-models-chinese/) — Yiming Cui, Wanxiang Che, Ting Liu, et al. · arXiv:2004.13922 · 788 citations **[Relational Graph Attention Network for Aspect-based Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/wang-2020-relational-graph-attention-network-aspect/)**Kai Wang, Weizhou Shen, Yunyi Yang, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 775 citations* - [Reformer: The Efficient Transformer](https://md.research.elamur.ai/free/en/papers/kitaev-2020-reformer-efficient-transformer/) — Nikita Kitaev, Łukasz Kaiser, Anselm Levskaya · arXiv:2001.04451 · 774 citations **[AdapterHub: A Framework for Adapting Transformers](https://md.research.elamur.ai/free/en/papers/pfeiffer-2020-adapterhub-framework-adapting-transformers/)**Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 747 citations* **[Towards Faithfully Interpretable NLP Systems: How Should We Define and Evaluate Faithfulness?](https://md.research.elamur.ai/free/en/papers/jacovi-2020-faithfully-interpretable-nlp-systems-how/)**Alon Jacovi, Yoav Goldberg*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 747 citations* **[Integrating Multimodal Information in Large Pretrained Transformers](https://md.research.elamur.ai/free/en/papers/rahman-2020-integrating-multimodal-information-large-pretrained/)**Wasifur Rahman, Md Kamrul Hasan, Sangwu Lee, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 742 citations* **[Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps](https://md.research.elamur.ai/free/en/papers/ho-2020-constructing-multi-hop-qa-dataset/)**Xanh Ho, Anh-Khoa Duong Nguyen, Saku Sugawara, et al.*[International Conference on Computational…](https://md.research.elamur.ai/free/en/venues/coling/) · 735 citations* **[Dice Loss for Data-imbalanced NLP Tasks](https://md.research.elamur.ai/free/en/papers/li-2020-dice-loss-data-imbalanced-nlp/)**Xiaoya Li, Xiaofei Sun, Yuxian Meng, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 734 citations* **[A Novel Cascade Binary Tagging Framework for Relational Triple Extraction](https://md.research.elamur.ai/free/en/papers/wei-2020-novel-cascade-binary-tagging-framework/)**Zhepei Wei, Jianlin Su, Yue Wang, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 732 citations* **[IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages](https://md.research.elamur.ai/free/en/papers/kakwani-2020-indicnlpsuite-monolingual-corpora-evaluation-benchmarks/)**Divyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, et al.*[Findings of the Association for Computational…](https://md.research.elamur.ai/free/en/venues/findings/) · 730 citations* **[Fact or Fiction: Verifying Scientific Claims](https://md.research.elamur.ai/free/en/papers/wadden-2020-fact-or-fiction-verifying-scientific/)**David Wadden, Shanchuan Lin, Kyle Lo, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 706 citations* **[TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages](https://md.research.elamur.ai/free/en/papers/clark-2020-tydi-qa-benchmark-information-seeking/)**Jonathan H. Clark, Eunsol Choi, Michael Collins, et al.*[Transactions of the Association for…](https://md.research.elamur.ai/free/en/venues/tacl/) · 691 citations* **[SPECTER: Document-level Representation Learning using Citation-informed Transformers](https://md.research.elamur.ai/free/en/papers/cohan-2020-specter-document-level-representation-learning/)**Arman Cohan, Sergey Feldman, Iz Beltagy, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 690 citations* **[TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data](https://md.research.elamur.ai/free/en/papers/yin-2020-tabert-pretraining-joint-understanding-textual/)**Pengcheng Yin, Graham Neubig, Wen-tau Yih, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 690 citations* **[CORD-19: The COVID-19 Open Research Dataset](https://md.research.elamur.ai/free/en/papers/wang-2020-cord-19-covid-19-open/)**Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, et al.*[Workshop on NLP for COVID-19 at ACL](https://md.research.elamur.ai/free/en/venues/nlpcovid19/) · 685 citations* - [Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval](https://md.research.elamur.ai/free/en/papers/xiong-2020-approximate-nearest-neighbor-negative-contrastive/) — Lee Xiong, Chenyan Xiong, Ye Li, et al. · arXiv:2007.00808 · 681 citations **[Social Bias Frames: Reasoning about Social and Power Implications of Language](https://md.research.elamur.ai/free/en/papers/sap-2020-social-bias-frames-reasoning-about/)**Maarten Sap, Saadia Gabriel, Lianhui Qin, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 680 citations* **[Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base Embeddings](https://md.research.elamur.ai/free/en/papers/saxena-2020-improving-multi-hop-question-answering/)**Apoorv Saxena, Aditay Tripathi, Partha Talukdar*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 670 citations* **[BAE: BERT-based Adversarial Examples for Text Classification](https://md.research.elamur.ai/free/en/papers/garg-2020-bae-bert-based-adversarial-examples/)**Siddhant Garg, Goutham Ramakrishnan*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 665 citations* **[KILT: a Benchmark for Knowledge Intensive Language Tasks](https://md.research.elamur.ai/free/en/papers/petroni-2020-kilt-benchmark-knowledge-intensive-language/)**Fabio Petroni, Aleksandra Piktus, Angela Fan, et al.*[Conference of the North American Chapter of the…](https://md.research.elamur.ai/free/en/venues/naacl/) · 663 citations* - [K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters](https://md.research.elamur.ai/free/en/papers/wang-2020-k-adapter-infusing-knowledge-pre/) — Ruize Wang, Duyu Tang, Nan Duan, et al. · arXiv:2002.01808 · 662 citations **[Efficient Content-Based Sparse Attention with Routing Transformers](https://md.research.elamur.ai/free/en/papers/roy-2020-efficient-content-based-sparse-attention/)**Aurko Roy, Mohammad Saffar, Ashish Vaswani, et al.*[Transactions of the Association for…](https://md.research.elamur.ai/free/en/venues/tacl/) · 660 citations* **[CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data](https://md.research.elamur.ai/free/en/papers/wenzek-2020-ccnet-extracting-high-quality-monolingual/)**Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, et al.*[Language Resources and Evaluation Conference…](https://md.research.elamur.ai/free/en/venues/lrec/) · 650 citations* - [CodeSearchNet Challenge: Evaluating the State of Semantic Code Search](https://md.research.elamur.ai/free/en/papers/husain-2020-codesearchnet-challenge-evaluating-state-semantic/) — Hamel Husain, Ho-Hsiang Wu, Tiferet Gazit, et al. · arXiv:1909.09436 · 647 citations **[A Frustratingly Easy Approach for Entity and Relation Extraction](https://md.research.elamur.ai/free/en/papers/zhong-2020-frustratingly-easy-approach-entity-relation/)**Zexuan Zhong, Danqi Chen*[Conference of the North American Chapter of the…](https://md.research.elamur.ai/free/en/venues/naacl/) · 629 citations* **[Efficient Intent Detection with Dual Sentence Encoders](https://md.research.elamur.ai/free/en/papers/casanueva-2020-efficient-intent-detection-dual-sentence/)**Iñigo Casanueva, Tadas Temčinas, Daniela Gerz, et al.*[Workshop on Natural Language Processing for…](https://md.research.elamur.ai/free/en/venues/nlp4convai/) · 622 citations* **[Scalable Zero-shot Entity Linking with Dense Entity Retrieval](https://md.research.elamur.ai/free/en/papers/wu-2020-scalable-zero-shot-entity-linking/)**Ledell Wu, Fabio Petroni, Martin Josifoski, et al.*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 618 citations* **[Event Extraction by Answering (Almost) Natural Questions](https://md.research.elamur.ai/free/en/papers/du-2020-event-extraction-answering-almost-natural/)**Xinya Du, Claire Cardie*[Conference on Empirical Methods in Natural…](https://md.research.elamur.ai/free/en/venues/emnlp/) · 602 citations* **[A Joint Neural Model for Information Extraction with Global Features](https://md.research.elamur.ai/free/en/papers/lin-2020-joint-neural-model-information-extraction/)**Ying Lin, Heng Ji, Fei Huang, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 600 citations* **[Named Entity Recognition as Dependency Parsing](https://md.research.elamur.ai/free/en/papers/yu-2020-named-entity-recognition-as-dependency/)**Juntao Yu, Bernd Bohnet, Massimo Poesio*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 594 citations* - [Towards a Human-like Open-Domain Chatbot](https://md.research.elamur.ai/free/en/papers/adiwardana-2020-towards-human-like-open-domain/) — Daniel Adiwardana, Minh-Thang Luong, David R. So, et al. · arXiv:2001.09977 · 573 citations **[Multilingual Universal Sentence Encoder for Semantic Retrieval](https://md.research.elamur.ai/free/en/papers/yang-2020-multilingual-universal-sentence-encoder-semantic/)**Yinfei Yang, Daniel Cer, Amin Ahmad, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 571 citations* **[PhoBERT: Pre-trained language models for Vietnamese](https://md.research.elamur.ai/free/en/papers/nguyen-2020-phobert-pre-trained-language-models/)**Dat Quoc Nguyen, Anh Tuan Nguyen*[Findings of the Association for Computational…](https://md.research.elamur.ai/free/en/venues/findings/) · 571 citations* **[Extractive Summarization as Text Matching](https://md.research.elamur.ai/free/en/papers/zhong-2020-extractive-summarization-as-text-matching/)**Ming Zhong, Pengfei Liu, Yiran Chen, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 567 citations* **[MIND: A Large-scale Dataset for News Recommendation](https://md.research.elamur.ai/free/en/papers/wu-2020-mind-large-scale-dataset-news/)**Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 562 citations* - [XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization](https://md.research.elamur.ai/free/en/papers/hu-2020-xtreme-massively-multilingual-multi-task/) — Junjie Hu, Sebastian Ruder, Aditya Siddhant, et al. · arXiv:2003.11080 · 551 citations - [What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams](https://md.research.elamur.ai/free/en/papers/jin-2020-disease-this-patient-have-large/) — Di Jin, Eileen Pan, Nassim Oufattole, et al. · arXiv:2009.13081 · 540 citations **[Document Ranking with a Pretrained Sequence-to-Sequence Model](https://md.research.elamur.ai/free/en/papers/nogueira-2020-document-ranking-pretrained-sequence-sequence/)**Rodrigo Nogueira, Zhiying Jiang, Ronak Pradeep, et al.*[Findings of the Association for Computational…](https://md.research.elamur.ai/free/en/venues/findings/) · 538 citations* **[TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linking](https://md.research.elamur.ai/free/en/papers/wang-2020-tplinker-single-stage-joint-extraction/)**Yucheng Wang, Bowen Yu, Yueyang Zhang, et al.*[International Conference on Computational…](https://md.research.elamur.ai/free/en/venues/coling/) · 527 citations* - [Evaluating Models' Local Decision Boundaries via Contrast Sets](https://md.research.elamur.ai/free/en/papers/gardner-2020-evaluating-models-local-decision-boundaries/) — Matt Gardner, Yoav Artzi, Victoria Basmov, et al. · Mova's core list · 520 citations **[How Does NLP Benefit Legal System: A Summary of Legal Artificial Intelligence](https://md.research.elamur.ai/free/en/papers/zhong-2020-how-does-nlp-benefit-legal/)**Haoxi Zhong, Chaojun Xiao, Cunchao Tu, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 518 citations* **[MLS: A Large-Scale Multilingual Dataset for Speech Research](https://md.research.elamur.ai/free/en/papers/pratap-2020-mls-large-scale-multilingual-dataset/)**Vineel Pratap, Qiantong Xu, Anuroop Sriram, et al.*[Interspeech](https://md.research.elamur.ai/free/en/venues/interspeech-usb/) · 510 citations* **[FLAT: Chinese NER Using Flat-Lattice Transformer](https://md.research.elamur.ai/free/en/papers/li-2020-flat-chinese-ner-flat-lattice/)**Xiaonan Li, Hang Yan, Xipeng Qiu, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 503 citations* **[DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference](https://md.research.elamur.ai/free/en/papers/xin-2020-deebert-dynamic-early-exiting-accelerating/)**Ji Xin, Raphael Tang, Jaejun Lee, et al.*[Annual Meeting of the Association for…](https://md.research.elamur.ai/free/en/venues/acl/) · 480 citations* **1** [2](https://md.research.elamur.ai/free/en/papers/2020/page/2/) … [7](https://md.research.elamur.ai/free/en/papers/2020/page/7/) [next →](https://md.research.elamur.ai/free/en/papers/2020/page/2/)