---
title: "Workshop on Representation Learning for NLP 2020 — accepted"
description: "Workshop on Representation Learning for NLP 2020 — accepted papers: 2 papers in the Elamur Research library (Online), with our…"
canonical: "https://research.elamur.ai/free/en/venues/repl4nlp/2020/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/venues/repl4nlp/2020/)

[home](https://md.research.elamur.ai/free/en/) / [venues](https://md.research.elamur.ai/free/en/venues/) / [Workshop on Representation Learning for…](https://md.research.elamur.ai/free/en/venues/repl4nlp/) / 2020

# Workshop on Representation Learning for NLP 2020 — accepted papers

Workshop on Representation Learning for NLP 2020 is the 2020 edition of the Workshop on Representation Learning for NLP, held in Online, July 2020 (publisher: Association for Computational Linguistics). The ACL Anthology lists 24 papers of it; our library holds 2 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

[**24** papers in the proceedings](#all) · [**2** works in our library](https://md.research.elamur.ai/free/en/venues/repl4nlp/2020/#works) · [**863** citations of these works](https://md.research.elamur.ai/free/en/venues/repl4nlp/2020/#works)**Online** where it was held**July 2020** when

## Most cited papers

By their OpenAlex citations; a paper with our summary links to its page here, the others to the original.

1. **[Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning](https://md.research.elamur.ai/free/en/papers/gordon-2020-compressing-bert-studying-effects-weight/)**Mitchell Gordon, Kevin Duh, Nicholas Andrews*297 citations · our summary*
2. **[Are All Languages Created Equal in Multilingual BERT?](https://md.research.elamur.ai/free/en/papers/wu-2020-are-all-languages-created-equal/)**Shijie Wu, Mark Dredze*234 citations · our summary*
3. **[Contextual and Non-Contextual Word Embeddings: an in-depth Linguistic Investigation ↗](https://aclanthology.org/2020.repl4nlp-1.15/)**Alessio Miaschi, Felice Dell'Orletta*72 citations*
4. **[Zero-Resource Cross-Domain Named Entity Recognition ↗](https://aclanthology.org/2020.repl4nlp-1.1/)**Zihan Liu, Genta Indra Winata, Pascale Fung*49 citations*
5. **[A Cross-Task Analysis of Text Span Representations ↗](https://aclanthology.org/2020.repl4nlp-1.20/)**Shubham Toshniwal, Haoyue Shi, Bowen Shi et al.*30 citations*
6. **[Staying True to Your Word: (How) Can Attention Become Explanation? ↗](https://aclanthology.org/2020.repl4nlp-1.17/)**Martin Tutek, Jan Snajder*26 citations*
7. **[Adversarial Training for Commonsense Inference ↗](https://aclanthology.org/2020.repl4nlp-1.8/)**Lis Pereira, Xiaodong Liu, Fei Cheng et al.*25 citations*
8. **[Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT ↗](https://aclanthology.org/2020.repl4nlp-1.10/)**Ashutosh Adhikari, Achyudh Ram, Raphael Tang et al.*23 citations*
9. **[Adversarial Alignment of Multilingual Models for Extracting Temporal Expressions from Text ↗](https://aclanthology.org/2020.repl4nlp-1.14/)**Lukas Lange, Anastasiia Iurshina, Heike Adel et al.*22 citations*
10. **[What's in a Name? Are BERT Named Entity Representations just as Good for any other Name? ↗](https://aclanthology.org/2020.repl4nlp-1.24/)**Sriram Balasubramanian, Naman Jain, Gaurav Jindal et al.*21 citations*

## All accepted papers (24)

The most cited first; 2 with our summary link to their page here, the others to the original.

1. **[Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning](https://md.research.elamur.ai/free/en/papers/gordon-2020-compressing-bert-studying-effects-weight/)**Mitchell Gordon, Kevin Duh, Nicholas Andrews*297 citations · our summary*
2. **[Are All Languages Created Equal in Multilingual BERT?](https://md.research.elamur.ai/free/en/papers/wu-2020-are-all-languages-created-equal/)**Shijie Wu, Mark Dredze*234 citations · our summary*
3. **[Contextual and Non-Contextual Word Embeddings: an in-depth Linguistic Investigation ↗](https://aclanthology.org/2020.repl4nlp-1.15/)**Alessio Miaschi, Felice Dell'Orletta*72 citations*
4. **[Zero-Resource Cross-Domain Named Entity Recognition ↗](https://aclanthology.org/2020.repl4nlp-1.1/)**Zihan Liu, Genta Indra Winata, Pascale Fung*49 citations*
5. **[A Cross-Task Analysis of Text Span Representations ↗](https://aclanthology.org/2020.repl4nlp-1.20/)**Shubham Toshniwal, Haoyue Shi, Bowen Shi et al.*30 citations*
6. **[Staying True to Your Word: (How) Can Attention Become Explanation? ↗](https://aclanthology.org/2020.repl4nlp-1.17/)**Martin Tutek, Jan Snajder*26 citations*
7. **[Adversarial Training for Commonsense Inference ↗](https://aclanthology.org/2020.repl4nlp-1.8/)**Lis Pereira, Xiaodong Liu, Fei Cheng et al.*25 citations*
8. **[Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT ↗](https://aclanthology.org/2020.repl4nlp-1.10/)**Ashutosh Adhikari, Achyudh Ram, Raphael Tang et al.*23 citations*
9. **[Adversarial Alignment of Multilingual Models for Extracting Temporal Expressions from Text ↗](https://aclanthology.org/2020.repl4nlp-1.14/)**Lukas Lange, Anastasiia Iurshina, Heike Adel et al.*22 citations*
10. **[What's in a Name? Are BERT Named Entity Representations just as Good for any other Name? ↗](https://aclanthology.org/2020.repl4nlp-1.24/)**Sriram Balasubramanian, Naman Jain, Gaurav Jindal et al.*21 citations*
11. **[Supertagging with CCG primitives ↗](https://aclanthology.org/2020.repl4nlp-1.23/)**Aditya Bhargava, Gerald Penn*14 citations*
12. **[Learning Geometric Word Meta-Embeddings ↗](https://aclanthology.org/2020.repl4nlp-1.6/)**Pratik Jawanpuria, Satya Dev N T V, Anoop Kunchukuttan et al.*11 citations*
13. **[Learning Probabilistic Sentence Representations from Paraphrases ↗](https://aclanthology.org/2020.repl4nlp-1.3/)**Mingda Chen, Kevin Gimpel*8 citations*
14. **[Improving Bilingual Lexicon Induction with Unsupervised Post-Processing of Monolingual Word Vector Spaces ↗](https://aclanthology.org/2020.repl4nlp-1.7/)**Ivan Vulić, Anna Korhonen, Goran Glavaš*7 citations*
15. **[A Metric Learning Approach to Misogyny Categorization ↗](https://aclanthology.org/2020.repl4nlp-1.12/)**Juan Manuel Coria, Sahar Ghannay, Sophie Rosset et al.*6 citations*
16. **[Enhancing Transformer with Sememe Knowledge ↗](https://aclanthology.org/2020.repl4nlp-1.21/)**Yuhui Zhang, Chenghao Yang, Zhengping Zhou et al.*5 citations*
17. **[Compositionality and Capacity in Emergent Languages ↗](https://aclanthology.org/2020.repl4nlp-1.5/)**Abhinav Gupta, Cinjon Resnick, Jakob Foerster et al.*4 citations*
18. **[Encodings of Source Syntax: Similarities in NMT Representations Across Target Languages ↗](https://aclanthology.org/2020.repl4nlp-1.2/)**Tyler A. Chang, Anna Rafferty*4 citations*
19. **[Evaluating Natural Alpha Embeddings on Intrinsic and Extrinsic Tasks ↗](https://aclanthology.org/2020.repl4nlp-1.9/)**Riccardo Volpi, Luigi Malagò*4 citations*
20. **[Joint Training with Semantic Role Labeling for Better Generalization in Natural Language Inference ↗](https://aclanthology.org/2020.repl4nlp-1.11/)**Cemil Cengiz, Deniz Yuret*4 citations*
21. **[Evaluating Compositionality of Sentence Representation Models ↗](https://aclanthology.org/2020.repl4nlp-1.22/)**Hanoz Bhathena, Angelica Willis, Nathan Dass*3 citations*
22. **[On Dimensional Linguistic Properties of the Word Embedding Space ↗](https://aclanthology.org/2020.repl4nlp-1.19/)**Vikas Raunak, Vaibhav Kumar, Vivek Gupta et al.*3 citations*
23. **[Word Embeddings as Tuples of Feature Probabilities ↗](https://aclanthology.org/2020.repl4nlp-1.4/)**Siddharth Bhat, Alok Debnath, Souvik Banerjee et al.*3 citations*
24. **[On the Choice of Auxiliary Languages for Improved Sequence Tagging ↗](https://aclanthology.org/2020.repl4nlp-1.13/)**Lukas Lange, Heike Adel, Jannik Strötgen

## Papers with our summary in our library (2)

The most cited first (OpenAlex citations plus our library's).

1. **[Are All Languages Created Equal in Multilingual BERT?](https://md.research.elamur.ai/free/en/papers/wu-2020-are-all-languages-created-equal/) [Workshop on Representation Learning for NLP](https://md.research.elamur.ai/free/en/venues/repl4nlp/)**Shijie Wu, Mark Dredze*2020 · 458 citations*
2. **[Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning](https://md.research.elamur.ai/free/en/papers/gordon-2020-compressing-bert-studying-effects-weight/) [Workshop on Representation Learning for NLP](https://md.research.elamur.ai/free/en/venues/repl4nlp/)**Mitchell Gordon, Kevin Duh, Nicholas Andrews*2020 · 405 citations*

## Top topics

Topics of its works in our library, with the number of works on each.

[Multilingual & cross-lingual NLP (1)](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · [Efficient models & compression (1)](https://md.research.elamur.ai/free/en/topics/efficient-models/)

## Fields

[Arts and Humanities (2)](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science (2)](https://md.research.elamur.ai/free/en/shelves/computer-science/)

## Top authors

Authors with a page who published here most often: their works here, and the citations of those works.

[🧑‍🔬**Mark Dredze**1 work here · 458 citations](https://md.research.elamur.ai/free/en/authors/mark-dredze/) · [🧑‍🔬**Shijie Wu**1 work here · 458 citations](https://md.research.elamur.ai/free/en/authors/shijie-wu/) · [🧑‍🔬**Kevin Duh**1 work here · 405 citations](https://md.research.elamur.ai/free/en/authors/kevin-duh/) · [🧑‍🔬**Mitchell Gordon**1 work here · 405 citations](https://md.research.elamur.ai/free/en/authors/mitchell-gordon/) · [🧑‍🔬**Nicholas Andrews**1 work here · 405 citations](https://md.research.elamur.ai/free/en/authors/nicholas-andrews/)

## Top institutions

Institutions on the bylines of its works here, by the number of works.

[🎓**Johns Hopkins University** Baltimore · United States 2 works here](https://md.research.elamur.ai/free/en/universities/johns-hopkins-university/)

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

- [← previous Workshop on Representation Learning for NLP 2017](https://md.research.elamur.ai/free/en/venues/repl4nlp/2017/)
- [next → Workshop on Representation Learning for NLP 2021](https://md.research.elamur.ai/free/en/venues/repl4nlp/2021/)
- [↑ back to Workshop on Representation Learning for NLP](https://md.research.elamur.ai/free/en/venues/repl4nlp/)