---
title: "Workshop on Representation Learning for NLP 2021 — all"
description: "All 32 papers of Workshop on Representation Learning for NLP 2021, the most cited first; those with our summary link to it."
canonical: "https://research.elamur.ai/free/en/venues/repl4nlp/2021/papers/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/venues/repl4nlp/2021/papers/)

[home](https://md.research.elamur.ai/free/en/) / [venues](https://md.research.elamur.ai/free/en/venues/) / [Workshop on Representation Learning for…](https://md.research.elamur.ai/free/en/venues/repl4nlp/) / [2021](https://md.research.elamur.ai/free/en/venues/repl4nlp/2021/) / papers

# Workshop on Representation Learning for NLP 2021: all accepted papers

32 papers · the most cited first · [← Workshop on Representation Learning for NLP 2021](https://md.research.elamur.ai/free/en/venues/repl4nlp/2021/)

1. **[In-Batch Negatives for Knowledge Distillation with Tightly-Coupled Teachers for Dense Retrieval ↗](https://aclanthology.org/2021.repl4nlp-1.17/)**Sheng-Chieh Lin, Jheng-Hong Yang, Jimmy Lin*122 citations*
2. **[Larger-Scale Transformers for Multilingual Masked Language Modeling](https://md.research.elamur.ai/free/en/papers/goyal-2021-larger-scale-transformers-multilingual-masked/)**Naman Goyal, Jingfei Du, Myle Ott et al.*83 citations · our summary*
3. **[Scaling Deep Contrastive Learning Batch Size under Memory Limited Setup](https://md.research.elamur.ai/free/en/papers/gao-2021-scaling-deep-contrastive-learning-batch/)**Luyu Gao, Yunyi Zhang, Jiawei Han et al.*64 citations · our summary*
4. **[Entity and Evidence Guided Document-Level Relation Extraction ↗](https://aclanthology.org/2021.repl4nlp-1.30/)**Kevin Huang, Peng Qi, Guangtao Wang et al.*39 citations*
5. **[Deriving Contextualised Semantic Features from BERT (and Other Transformer Model) Embeddings ↗](https://aclanthology.org/2021.repl4nlp-1.26/)**Jacob Turton, Robert Elliott Smith, David Vinson*29 citations*
6. **[Preserving Cross-Linguality of Pre-trained Models via Continual Learning ↗](https://aclanthology.org/2021.repl4nlp-1.8/)**Zihan Liu, Genta Indra Winata, Andrea Madotto et al.*14 citations*
7. **[Inductively Representing Out-of-Knowledge-Graph Entities by Optimal Estimation Under Translational Assumptions ↗](https://aclanthology.org/2021.repl4nlp-1.10/)**Damai Dai, Hua Zheng, Fuli Luo et al.*13 citations*
8. **[Syntactic Perturbations Reveal Representational Correlates of Hierarchical Phrase Structure in Pretrained Language Models ↗](https://aclanthology.org/2021.repl4nlp-1.27/)**Matteo Alleman, Jonathan Mamou, Miguel A Del Rio et al.*11 citations*
9. **[NPVec1: Word Embeddings for Nepali - Construction and Evaluation ↗](https://aclanthology.org/2021.repl4nlp-1.18/)**Pravesh Koirala, Nobal B. Niraula*10 citations*
10. **[Probing Multilingual Language Models for Discourse ↗](https://aclanthology.org/2021.repl4nlp-1.2/)**Murathan Kurfalı, Robert Östling*10 citations*
11. **[Revisiting Pretraining with Adapters ↗](https://aclanthology.org/2021.repl4nlp-1.11/)**Seungwon Kim, Alex Shum, Nathan Susanj et al.*9 citations*
12. **[Structure-aware Sentence Encoder in Bert-Based Siamese Network ↗](https://aclanthology.org/2021.repl4nlp-1.7/)**Qiwei Peng, David Weir, Julie Weeds*7 citations*
13. **[X2Parser: Cross-Lingual and Cross-Domain Framework for Task-Oriented Compositional Semantic Parsing ↗](https://aclanthology.org/2021.repl4nlp-1.13/)**Zihan Liu, Genta Indra Winata, Peng Xu et al.*7 citations*
14. **[Comprehension Based Question Answering using Bloom's Taxonomy ↗](https://aclanthology.org/2021.repl4nlp-1.3/)**Pritish Sahu, Michael Cogswell, Ajay Divakaran et al.*6 citations*
15. **[An Overview of Uncertainty Calibration for Text Classification and the Role of Distillation ↗](https://aclanthology.org/2021.repl4nlp-1.29/)**Han Guo, Ramakanth Pasunuru, Mohit Bansal*5 citations*
16. **[Direction is what you need: Improving Word Embedding Compression in Large Language Models ↗](https://aclanthology.org/2021.repl4nlp-1.32/)**Klaudia Bałazy, Mohammadreza Banaei, Rémi Lebret et al.*5 citations*
17. **[Zero-shot Sequence Labeling for Transformer-based Sentence Classifiers ↗](https://aclanthology.org/2021.repl4nlp-1.20/)**Kamil Bujel, Helen Yannakoudakis, Marek Rei*5 citations*
18. **[Knodle: Modular Weakly Supervised Learning with PyTorch ↗](https://aclanthology.org/2021.repl4nlp-1.12/)**Anastasiia Sedova, Andreas Stephan, Marina Speranskaya et al.*4 citations*
19. **[Knowledge Informed Semantic Parsing for Conversational Question Answering ↗](https://aclanthology.org/2021.repl4nlp-1.24/)**Raghuveer Thirukovalluru, Mukund Sridhar, Dung Thai et al.*4 citations*
20. **[Improving Cross-lingual Text Classification with Zero-shot Instance-Weighting ↗](https://aclanthology.org/2021.repl4nlp-1.1/)**Irene Li, Prithviraj Sen, Huaiyu Zhu et al.*3 citations*
21. **[Learning Sparse Sentence Encoding without Supervision: An Exploration of Sparsity in Variational Autoencoders ↗](https://aclanthology.org/2021.repl4nlp-1.5/)**Victor Prokhorov, Yingzhen Li, Ehsan Shareghi et al.*3 citations*
22. **[Unsupervised Representation Disentanglement of Text: An Evaluation on Synthetic Datasets ↗](https://aclanthology.org/2021.repl4nlp-1.14/)**Lan Zhang, Victor Prokhorov, Ehsan Shareghi*3 citations*
23. **[Box-To-Box Transformations for Modeling Joint Hierarchies ↗](https://aclanthology.org/2021.repl4nlp-1.28/)**Shib Sankar Dasgupta, Xiang Lorraine Li, Michael Boratko et al.*2 citations*
24. **[Deriving Word Vectors from Contextualized Language Models using Topic-Aware Mention Selection ↗](https://aclanthology.org/2021.repl4nlp-1.19/)**Yixiao Wang, Zied Bouraoui, Luis Espinosa Anke et al.*2 citations*
25. **[Predicting the Success of Domain Adaptation in Text Similarity ↗](https://aclanthology.org/2021.repl4nlp-1.21/)**Nick Pogrebnyakov, Shohreh Shaghaghian*2 citations*
26. **[Text Style Transfer: Leveraging a Style Classifier on Entangled Latent Representations ↗](https://aclanthology.org/2021.repl4nlp-1.9/)**Xiaoyan Li, Sun Sun, Yunli Wang*2 citations*
27. **[Probing Cross-Modal Representations in Multi-Step Relational Reasoning ↗](https://aclanthology.org/2021.repl4nlp-1.16/)**Iuliia Parfenova, Desmond Elliott, Raquel Fernández et al.*1 citation*
28. **[Simultaneously Self-Attending to Text and Entities for Knowledge-Informed Text Representations ↗](https://aclanthology.org/2021.repl4nlp-1.25/)**Dung Thai, Raghuveer Thirukovalluru, Trapit Bansal et al.*1 citation*
29. **[Syntagmatic Word Embeddings for Unsupervised Learning of Selectional Preferences ↗](https://aclanthology.org/2021.repl4nlp-1.22/)**Renjith P. Ravindran, Akshay Badola, Narayana Kavi Murthy*1 citation*
30. **[Temporal-aware Language Representation Learning From Crowdsourced Labels ↗](https://aclanthology.org/2021.repl4nlp-1.6/)**Yang Hao, Xiao Zhai, Wenbiao Ding et al.*1 citation*
31. **[Bayesian Model-Agnostic Meta-Learning with Matrix-Valued Kernels for Quality Estimation ↗](https://aclanthology.org/2021.repl4nlp-1.23/)**Abiola Obamuyide, Marina Fomicheva, Lucia Specia
32. **[Learn The Big Picture: Representation Learning for Clustering ↗](https://aclanthology.org/2021.repl4nlp-1.15/)**Sumanta Kashyapi, Laura Dietz
- [← back to](https://md.research.elamur.ai/free/en/venues/repl4nlp/2021/) — Workshop on Representation Learning for NLP 2021