---
title: "Workshop on Multilingual Representation Learning 2021"
description: "Workshop on Multilingual Representation Learning 2021 — accepted papers: 3 papers in the Elamur Research library (Punta Cana…"
canonical: "https://research.elamur.ai/free/en/venues/mrl/2021/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/venues/mrl/2021/)

[home](https://md.research.elamur.ai/free/en/) / [venues](https://md.research.elamur.ai/free/en/venues/) / [Workshop on Multilingual Representation…](https://md.research.elamur.ai/free/en/venues/mrl/) / 2021

# Workshop on Multilingual Representation Learning 2021 — accepted papers

Workshop on Multilingual Representation Learning 2021 is the 2021 edition of the Workshop on Multilingual Representation Learning, held in Punta Cana, Dominican Republic, November 2021 (publisher: Association for Computational Linguistics). The ACL Anthology lists 24 papers of it; our library holds 3 with our summaries. Below: the most cited papers, every accepted paper, and ours with their topics, authors and institutions.

📍 Punta Cana, Dominican Republic · 🗓 November 2021

[**24** papers in the proceedings](#all) · [**3** works in our library](https://md.research.elamur.ai/free/en/venues/mrl/2021/#works) · [**445** citations of these works](https://md.research.elamur.ai/free/en/venues/mrl/2021/#works)

## Most cited papers

By their OpenAlex citations; a paper with our summary links to its page here, the others to the original.

1. **[Small Data? No Problem! Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages](https://md.research.elamur.ai/free/en/papers/ogueji-2021-small-data-no-problem-exploring/)**Kelechi Ogueji, Yuxin Zhu, Jimmy Lin*118 citations · our summary*
2. **[Language Models are Few-shot Multilingual Learners](https://md.research.elamur.ai/free/en/papers/winata-2021-language-models-are-few-shot/)**Genta Indra Winata, Andrea Madotto, Zhaojiang Lin et al.*93 citations · our summary*
3. **[Mr. TyDi: A Multi-lingual Benchmark for Dense Retrieval ↗](https://aclanthology.org/2021.mrl-1.12/)**Xinyu Zhang, Xueguang Ma, Peng Shi et al.*51 citations*
4. **[VisualSem: a high-quality knowledge graph for vision and language ↗](https://aclanthology.org/2021.mrl-1.13/)**Houda Alberts, Ningyuan Huang, Yash Deshpande et al.*34 citations*
5. **[Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Filling ↗](https://aclanthology.org/2021.mrl-1.18/)**Jitin Krishnan, Antonios Anastasopoulos, Hemant Purohit et al.*27 citations*
6. **[Specializing Multilingual Language Models: An Empirical Study ↗](https://aclanthology.org/2021.mrl-1.5/)**Ethan C. Chau, Noah A. Smith*14 citations*
7. **[Cross-Lingual Training of Dense Retrievers for Document Retrieval ↗](https://aclanthology.org/2021.mrl-1.24/)**Peng Shi, Rui Zhang, He Bai et al.*12 citations*
8. **[Analyzing the Effects of Reasoning Types on Cross-Lingual Transfer Performance ↗](https://aclanthology.org/2021.mrl-1.8/)**Karthikeyan K, Aalok Sathe, Somak Aditya et al.*7 citations*
9. **[Learning Contextualised Cross-lingual Word Embeddings and Alignments for Extremely Low-Resource Languages Using Parallel Corpora ↗](https://aclanthology.org/2021.mrl-1.2/)**Takashi Wada, Tomoharu Iwata, Yuji Matsumoto et al.*7 citations*
10. **[The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding ↗](https://aclanthology.org/2021.mrl-1.16/)**Archiki Prasad, Mohammad Ali Rehan, Shreya Pathak et al.*6 citations*

## All accepted papers (24)

The most cited first; 3 with our summary link to their page here, the others to the original.

1. **[Small Data? No Problem! Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages](https://md.research.elamur.ai/free/en/papers/ogueji-2021-small-data-no-problem-exploring/)**Kelechi Ogueji, Yuxin Zhu, Jimmy Lin*118 citations · our summary*
2. **[Language Models are Few-shot Multilingual Learners](https://md.research.elamur.ai/free/en/papers/winata-2021-language-models-are-few-shot/)**Genta Indra Winata, Andrea Madotto, Zhaojiang Lin et al.*93 citations · our summary*
3. **[Mr. TyDi: A Multi-lingual Benchmark for Dense Retrieval ↗](https://aclanthology.org/2021.mrl-1.12/)**Xinyu Zhang, Xueguang Ma, Peng Shi et al.*51 citations*
4. **[VisualSem: a high-quality knowledge graph for vision and language ↗](https://aclanthology.org/2021.mrl-1.13/)**Houda Alberts, Ningyuan Huang, Yash Deshpande et al.*34 citations*
5. **[Multilingual Code-Switching for Zero-Shot Cross-Lingual Intent Prediction and Slot Filling ↗](https://aclanthology.org/2021.mrl-1.18/)**Jitin Krishnan, Antonios Anastasopoulos, Hemant Purohit et al.*27 citations*
6. **[Specializing Multilingual Language Models: An Empirical Study ↗](https://aclanthology.org/2021.mrl-1.5/)**Ethan C. Chau, Noah A. Smith*14 citations*
7. **[Cross-Lingual Training of Dense Retrievers for Document Retrieval ↗](https://aclanthology.org/2021.mrl-1.24/)**Peng Shi, Rui Zhang, He Bai et al.*12 citations*
8. **[Analyzing the Effects of Reasoning Types on Cross-Lingual Transfer Performance ↗](https://aclanthology.org/2021.mrl-1.8/)**Karthikeyan K, Aalok Sathe, Somak Aditya et al.*7 citations*
9. **[Learning Contextualised Cross-lingual Word Embeddings and Alignments for Extremely Low-Resource Languages Using Parallel Corpora ↗](https://aclanthology.org/2021.mrl-1.2/)**Takashi Wada, Tomoharu Iwata, Yuji Matsumoto et al.*7 citations*
10. **[The Effectiveness of Intermediate-Task Training for Code-Switched Natural Language Understanding ↗](https://aclanthology.org/2021.mrl-1.16/)**Archiki Prasad, Mohammad Ali Rehan, Shreya Pathak et al.*6 citations*
11. **[Learning Cross-lingual Representations for Event Coreference Resolution with Multi-view Alignment and Optimal Transport ↗](https://aclanthology.org/2021.mrl-1.6/)**Duy Phung, Hieu Minh Tran, Minh Van Nguyen et al.*5 citations*
12. **[Do not neglect related languages: The case of low-resource Occitan cross-lingual word embeddings ↗](https://aclanthology.org/2021.mrl-1.4/)**Lisa Woller, Viktor Hangya, Alexander Fraser*3 citations*
13. **[Multilingual and Multilabel Emotion Recognition using Virtual Adversarial Training](https://md.research.elamur.ai/free/en/papers/gupta-2021-multilingual-multilabel-emotion-recognition-virtual/)**Vikram Gupta*3 citations · our summary*
14. **[On the Cross-lingual Transferability of Contextualized Sense Embeddings ↗](https://aclanthology.org/2021.mrl-1.10/)**Kiamehr Rezaee, Daniel Loureiro, Jose Camacho-Collados et al.*3 citations*
15. **[Shaking Syntactic Trees on the Sesame Street: Multilingual Probing with Controllable Perturbations ↗](https://aclanthology.org/2021.mrl-1.17/)**Ekaterina Taktasheva, Vladislav Mikhailov, Ekaterina Artemova*3 citations*
16. **[Analysis of Zero-Shot Crosslingual Learning between English and Korean for Named Entity Recognition ↗](https://aclanthology.org/2021.mrl-1.19/)**Jongin Kim, Nayoung Choi, Seunghyun Lim et al.*1 citation*
17. **[Improving the Diversity of Unsupervised Paraphrasing with Embedding Outputs ↗](https://aclanthology.org/2021.mrl-1.15/)**Monisha Jegadeesan, Sachin Kumar, John Wieting et al.*1 citation*
18. **[Sequence Mixup for Zero-Shot Cross-Lingual Part-Of-Speech Tagging ↗](https://aclanthology.org/2021.mrl-1.22/)**Megh Thakkar, Vishwa Shah, Ramit Sawhney et al.*1 citation*
19. **[Vyākarana: A Colorless Green Benchmark for Syntactic Evaluation in Indic Languages ↗](https://aclanthology.org/2021.mrl-1.14/)**Rajaswa Patil, Jasleen Dhillon, Siddhant Mahurkar et al.*1 citation*
20. **[Clustering Monolingual Vocabularies to Improve Cross-Lingual Generalization ↗](https://aclanthology.org/2021.mrl-1.3/)**Riccardo Bassani, Anders Søgaard, Tejaswini Deoskar
21. **[DMix: Distance Constrained Interpolative Mixup ↗](https://aclanthology.org/2021.mrl-1.21/)**Ramit Sawhney, Megh Thakkar, Shrey Pandit et al.
22. **[Identifying the Importance of Content Overlap for Better Cross-lingual Embedding Mappings ↗](https://aclanthology.org/2021.mrl-1.9/)**Réka Cserháti, Gábor Berend
23. **[Regularising Fisher Information Improves Cross-lingual Generalisation ↗](https://aclanthology.org/2021.mrl-1.20/)**Asa Cooper Stickland, Iain Murray
24. **[Well-Defined Morphology is Sentence-Level Morphology ↗](https://aclanthology.org/2021.mrl-1.23/)**Omer Goldman, Reut Tsarfaty

## Papers with our summary in our library (3)

The most cited first (OpenAlex citations plus our library's).

1. **[Small Data? No Problem! Exploring the Viability of Pretrained Multilingual Language Models for Low-resourced Languages](https://md.research.elamur.ai/free/en/papers/ogueji-2021-small-data-no-problem-exploring/) [Workshop on Multilingual Representation Learning](https://md.research.elamur.ai/free/en/venues/mrl/)**Kelechi Ogueji, Yuxin Zhu, Jimmy Lin*2021 · 266 citations*
2. **[Language Models are Few-shot Multilingual Learners](https://md.research.elamur.ai/free/en/papers/winata-2021-language-models-are-few-shot/) [Workshop on Multilingual Representation Learning](https://md.research.elamur.ai/free/en/venues/mrl/)**Genta Indra Winata, Andrea Madotto, Zhaojiang Lin, et al.*2021 · 174 citations*
3. **[Multilingual and Multilabel Emotion Recognition using Virtual Adversarial Training](https://md.research.elamur.ai/free/en/papers/gupta-2021-multilingual-multilabel-emotion-recognition-virtual/) [Workshop on Multilingual Representation Learning](https://md.research.elamur.ai/free/en/venues/mrl/)**Vikram Gupta*2021 · 5 citations*

## Top topics

Topics of its works in our library, with the number of works on each.

[Multilingual & cross-lingual NLP (3)](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · [Language models & pretraining (2)](https://md.research.elamur.ai/free/en/topics/language-models/) · [Sentiment & emotion (1)](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/) · [Low-resource languages (1)](https://md.research.elamur.ai/free/en/topics/low-resource-languages/)

## Fields

[Arts and Humanities (3)](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science (3)](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Psychology (1)](https://md.research.elamur.ai/free/en/shelves/psychology/)

## Top authors

Authors with a page who published here most often: their works here, and the citations of those works.

[🧑‍🔬**Jimmy Lin**1 work here · 266 citations](https://md.research.elamur.ai/free/en/authors/jimmy-lin/) · [🧑‍🔬**Andrea Madotto**1 work here · 174 citations](https://md.research.elamur.ai/free/en/authors/andrea-madotto/) · [🧑‍🔬**Genta Indra Winata**1 work here · 174 citations](https://md.research.elamur.ai/free/en/authors/genta-indra-winata/) · [🧑‍🔬**Jason Yosinski**1 work here · 174 citations](https://md.research.elamur.ai/free/en/authors/jason-yosinski/) · [🧑‍🔬**Pascale Fung**1 work here · 174 citations](https://md.research.elamur.ai/free/en/authors/pascale-fung/) · [🧑‍🔬**Rosanne Liu**1 work here · 174 citations](https://md.research.elamur.ai/free/en/authors/rosanne-liu/) · [🧑‍🔬**Zhaojiang Lin**1 work here · 174 citations](https://md.research.elamur.ai/free/en/authors/zhaojiang-lin/)

## Top institutions

Institutions on the bylines of its works here, by the number of works.

[🏢**Google** Mountain View · United States 1 work here](https://md.research.elamur.ai/free/en/companies/google/) · [🎓**University of Waterloo** Waterloo · Canada 1 work here](https://md.research.elamur.ai/free/en/universities/university-of-waterloo/) · [🎓**Hong Kong University of Science and Technology** Hong Kong · China 1 work here](https://md.research.elamur.ai/free/en/universities/hong-kong-university-of-science-and-technology/)

Place and dates from the event's site or the ACL Anthology; works and citations from OpenAlex and our library.

- [next → Workshop on Multilingual Representation Learning 2024](https://md.research.elamur.ai/free/en/venues/mrl/2024/)
- [↑ back to Workshop on Multilingual Representation Learning](https://md.research.elamur.ai/free/en/venues/mrl/)