---
title: "Towards Debiasing Sentence Representations — Liang 2020"
description: "Contextual sentence encoders such as BERT and ELMo absorb social stereotypes from their training text."
authors: ["Paul Pu Liang", "Irene Mengze Li", "Emily Zheng", "Yao Chong Lim", "Ruslan Salakhutdinov", "Louis-Philippe Morency"]
year: 2020
venue: "Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics"
source: "https://aclanthology.org/2020.acl-main.488/"
doi: "10.18653/v1/2020.acl-main.488"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/liang-2020-debiasing-sentence-representations/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liang-2020-debiasing-sentence-representations/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/6/) / Towards Debiasing Sentence Representations

# Towards Debiasing Sentence Representations

**Authors:** [Paul Pu Liang](https://md.research.elamur.ai/free/en/authors/paul-pu-liang/), Irene Mengze Li, Emily Zheng, Yao Chong Lim, [Ruslan Salakhutdinov](https://md.research.elamur.ai/free/en/authors/ruslan-salakhutdinov/), [Louis-Philippe Morency](https://md.research.elamur.ai/free/en/authors/louis-philippe-morency/) · **Year:** 2020 · **Venue:** Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2020.acl-main.488/) · [PDF](https://aclanthology.org/2020.acl-main.488.pdf) · [DOI 10.18653/v1/2020.acl-main.488](https://doi.org/10.18653/v1/2020.acl-main.488) · [OpenAlex](https://openalex.org/W3035591180)

**Citations:** 147 citations (openalex-snapshot · 2026-10-14) · [112](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Contextual sentence encoders such as BERT and ELMo absorb social stereotypes from their training text. Earlier debiasing methods targeted static word embeddings, and retraining huge sentence encoders each time a new bias is found is impractical. The authors propose SENT-DEBIAS, a post-hoc method that extends Hard-Debias (Bolukbasi et al., 2016) from words to sentences.

They begin with lists of attribute words: gender pairs and three-way religion tuples (Jewish/Christian/Muslim). These words are placed into naturally occurring sentences taken from several corpora covering written and spoken, formal and informal text. Swapping the attribute term produces parallel sentence sets. These sentences are encoded and centered, and PCA extracts a bias subspace. Any new representation is then cleaned by subtracting its projection onto that subspace.

On BERT and ELMo, the method lowers measured bias. Gains are larger when the templates are numerous and varied rather than short hand-written patterns. Downstream accuracy changes only slightly. The work matters because it offers an inexpensive, retraining-free route to fairer widely used sentence representations.

## Key points
- SENT-DEBIAS has four stages: define attribute words, contextualize them into sentences, estimate the bias subspace with PCA, and remove each representation's projection onto it.
- Sentence templates come from WikiText-2, SST, Reddit, MELD and POM. Together they span encyclopedic text, movie reviews, forum posts, TV-comedy dialogue and spoken opinion videos.
- Bias is assessed with association-style metrics (WEAT/SEAT, MAC). The authors caution that these metrics can reveal bias but cannot prove its absence.
- Downstream results before and after debiasing:
  - BERT: SST-2 92.7→89.1, CoLA 57.6→55.4, QNLI 91.3→90.6.
  - ELMo: SST-2 89.6→90.0, CoLA 39.1→37.1.
- Stated limitations:
  - Debiasing is applied to all sentences, including non-neutral ones.
  - The bias subspace must be re-estimated whenever BERT is fine-tuned.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

112 papers of our library cite it (of the 140673 whose bibliographies we read); 11 of them have a page here, 101 not yet.

- [Language (Technology) is Power: A Critical Survey of “Bias” in NLP](https://md.research.elamur.ai/free/en/papers/blodgett-2020-language-technology-is-power-critical/)
- [Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation](https://md.research.elamur.ai/free/en/papers/dinan-2020-queens-are-powerful-too-mitigating/)
- [Bias and Fairness in Large Language Models: A Survey](https://md.research.elamur.ai/free/en/papers/gallegos-2023-bias-fairness-large-language-models/)
- [Auto-Debias: Debiasing Masked Language Models with Automated Biased Prompts](https://md.research.elamur.ai/free/en/papers/guo-2022-auto-debias-debiasing-masked-language/)
- [Towards Understanding and Mitigating Social Biases in Language Models](https://md.research.elamur.ai/free/en/papers/liang-2021-towards-understanding-mitigating-social-biases/)
- [An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models](https://md.research.elamur.ai/free/en/papers/meade-2022-empirical-survey-effectiveness-debiasing-techniques/)
- [CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models](https://md.research.elamur.ai/free/en/papers/nangia-2020-crows-pairs-challenge-dataset-measuring/)
- [Text and Code Embeddings by Contrastive Pre-Training](https://md.research.elamur.ai/free/en/papers/neelakantan-2022-text-code-embeddings-contrastive-pre/)
- [“I'm sorry to hear that”: Finding New Biases in Language Models with a Holistic Descriptor Dataset](https://md.research.elamur.ai/free/en/papers/smith-2022-i-m-sorry-hear-that/)
- [Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models](https://md.research.elamur.ai/free/en/papers/srivastava-2022-imitation-game-quantifying-extrapolating-capabilities/)
- [LaMDA: Language Models for Dialog Applications](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{liang2020debiasing,
  title = {{Towards Debiasing Sentence Representations}},
  author = {Liang, Paul Pu and Li, Irene Mengze and Zheng, Emily and Lim, Yao Chong and Salakhutdinov, Ruslan and Morency, Louis-Philippe},
  booktitle = {Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics},
  year = {2020},
  doi = {10.18653/v1/2020.acl-main.488},
  url = {https://doi.org/10.18653/v1/2020.acl-main.488}
}
```

- [← previous Towards Controllable Biases in Language Generation](https://md.research.elamur.ai/free/en/papers/sheng-2020-controllable-biases-language-generation/)
- [next → Towards Emotion-aided Multi-modal Dialogue Act Classification](https://md.research.elamur.ai/free/en/papers/saha-2020-emotion-aided-multi-modal-dialogue/)
- [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/6/)

## References

51 references, 22 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Hervé Abdi and Lynne J. Williams. 2010. Principal component analysis. WIREs Comput. Stat., 2(4):433–459. [find](https://scholar.google.com/scholar?q=Herve%CC%81+Abdi+and+Lynne+J%2E+Williams%2E+2010%2E+Principal+component+analysis%2E+WIREs+Comput%2E+Stat%2E%2C+2%284%29%3A433%E2%80%93459%2E)
2. Emily Alsentzer, John Murphy, William Boag, Wei-Hung Weng, Di Jindi, Tristan Naumann, and Matthew McDermott. 2019. Publicly available clinical BERT embeddings. In Proceedings of the 2nd Clinical Natural Language Processing Workshop, pages 72–78, Minneapolis, Minnesota, USA. Association for Computati… [find](https://scholar.google.com/scholar?q=Emily+Alsentzer%2C+John+Murphy%2C+William+Boag%2C+Wei%2DHung+Weng%2C+Di+Jindi%2C+Tristan+Naumann%2C+and+Matthew+McDermott%2E+2019%2E+Publicly+available+clinical+BERT+embeddings%2E+In+Proceedings+of+the+2nd+Clinical+Natur) [our card](https://md.research.elamur.ai/free/en/papers/alsentzer-2019-publicly-available-clinical-bert-embeddings/)
3. David Bamman, A. Seza Doğruöz, Jacob Eisenstein, Dirk Hovy, David Jurgens, Brendan O’Connor, Alice Oh, Oren Tsur, and Svitlana Volkova. 2016. Proceedings of the first workshop on NLP and computational social science. [find](https://scholar.google.com/scholar?q=David+Bamman%2C+A%2E+Seza+Dog%CC%86ruo%CC%88z%2C+Jacob+Eisenstein%2C+Dirk+Hovy%2C+David+Jurgens%2C+Brendan+O%E2%80%99Connor%2C+Alice+Oh%2C+Oren+Tsur%2C+and+Svitlana+Volkova%2E+2016%2E+Proceedings+of+the+first+workshop+on+NLP+and+computation)
4. Solon Barocas and Andrew D Selbst. 2016. Big data’s disparate impact. Calif. L. Rev., 104:671. [find](https://scholar.google.com/scholar?q=Solon+Barocas+and+Andrew+D+Selbst%2E+2016%2E+Big+data%E2%80%99s+disparate+impact%2E+Calif%2E+L%2E+Rev%2E%2C+104%3A671%2E)
5. Christine Basta, Marta R. Costa-jussà, and Noe Casas. 2019. Evaluating the underlying gender bias in contextualized word embeddings. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing, pages 33–39, Florence, Italy. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Christine+Basta%2C+Marta+R%2E+Costa%2Djussa%CC%80%2C+and+Noe+Casas%2E+2019%2E+Evaluating+the+underlying+gender+bias+in+contextualized+word+embeddings%2E+In+Proceedings+of+the+First+Workshop+on+Gender+Bias+in+Natural+Lan) [our card](https://md.research.elamur.ai/free/en/papers/basta-2019-evaluating-underlying-gender-bias-contextualized/)
6. Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2016. Enriching word vectors with subword information. arXiv preprint arXiv:1607.04606. [find](https://scholar.google.com/scholar?q=Piotr+Bojanowski%2C+Edouard+Grave%2C+Armand+Joulin%2C+and+Tomas+Mikolov%2E+2016%2E+Enriching+word+vectors+with+subword+information%2E+arXiv+preprint+arXiv%3A1607%2E04606%2E)
7. Tolga Bolukbasi, Kai-Wei Chang, James Y Zou, Venkatesh Saligrama, and Adam T Kalai. 2016. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings. In Proc. of NIPS, pages 4349–4357. [find](https://scholar.google.com/scholar?q=Tolga+Bolukbasi%2C+Kai%2DWei+Chang%2C+James+Y+Zou%2C+Venkatesh+Saligrama%2C+and+Adam+T+Kalai%2E+2016%2E+Man+is+to+computer+programmer+as+woman+is+to+homemaker%3F+Debiasing+word+embeddings%2E+In+Proc%2E+of+NIPS%2C+pages+434) [our card](https://md.research.elamur.ai/free/en/papers/bolukbasi-2016-man-computer-programmer-woman-homemaker/)
8. Shikha Bordia and Samuel R. Bowman. 2019. Identifying and reducing gender bias in word-level language models. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 7–15, Minneapolis, Minnesota. Associati… [find](https://scholar.google.com/scholar?q=Shikha+Bordia+and+Samuel+R%2E+Bowman%2E+2019%2E+Identifying+and+reducing+gender+bias+in+word%2Dlevel+language+models%2E+In+Proceedings+of+the+2019+Conference+of+the+North+American+Chapter+of+the+Association+for) [our card](https://md.research.elamur.ai/free/en/papers/bordia-2019-identifying-reducing-gender-bias-word/)
9. Aylin Caliskan, Joanna J Bryson, and Arvind Narayanan. 2017. Semantics derived automatically from language corpora contain human-like biases. Science. [find](https://scholar.google.com/scholar?q=Aylin+Caliskan%2C+Joanna+J+Bryson%2C+and+Arvind+Narayanan%2E+2017%2E+Semantics+derived+automatically+from+language+corpora+contain+human%2Dlike+biases%2E+Science%2E)
10. Robert Dale. 2019. Law and word order: Nlp in legal tech. Natural Language Engineering, 25(1):211– 217. [find](https://scholar.google.com/scholar?q=Robert+Dale%2E+2019%2E+Law+and+word+order%3A+Nlp+in+legal+tech%2E+Natural+Language+Engineering%2C+25%281%29%3A211%E2%80%93+217%2E)
11. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,… [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+and+Kristina+Toutanova%2E+2019%2E+BERT%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In+Proceedings+of+the+2019+Conference+of+the+N)
12. Sahaj Garg, Vincent Perot, Nicole Limtiaco, Ankur Taly, Ed H. Chi, and Alex Beutel. 2019. Counterfactual fairness in text classification through robustness. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, AIES ’19, page 219–226, New York, NY, USA. Association for Computing… [find](https://scholar.google.com/scholar?q=Sahaj+Garg%2C+Vincent+Perot%2C+Nicole+Limtiaco%2C+Ankur+Taly%2C+Ed+H%2E+Chi%2C+and+Alex+Beutel%2E+2019%2E+Counterfactual+fairness+in+text+classification+through+robustness%2E+In+Proceedings+of+the+2019+AAAI%2FACM+Confere)
13. Hila Gonen and Yoav Goldberg. 2019. Lipstick on a pig: Debiasing methods cover up systematic gender biases in word embeddings but do not remove them. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol… [find](https://scholar.google.com/scholar?q=Hila+Gonen+and+Yoav+Goldberg%2E+2019%2E+Lipstick+on+a+pig%3A+Debiasing+methods+cover+up+systematic+gender+biases+in+word+embeddings+but+do+not+remove+them%2E+In+Proceedings+of+the+2019+Conference+of+the+North) [our card](https://md.research.elamur.ai/free/en/papers/gonen-2019-lipstick-pig-debiasing-methods-cover/)
14. Anthony Greenwald, T Poehlman, Eric Luis Uhlmann, and Mahzarin Banaji. 2009. Understanding and using the implicit association test: Iii. meta-analysis of predictive validity. [find](https://scholar.google.com/scholar?q=Anthony+Greenwald%2C+T+Poehlman%2C+Eric+Luis+Uhlmann%2C+and+Mahzarin+Banaji%2E+2009%2E+Understanding+and+using+the+implicit+association+test%3A+Iii%2E+meta%2Danalysis+of+predictive+validity%2E)
15. Kexin Huang, Jaan Altosaar, and Rajesh Ranganath. 2019. Clinicalbert: Modeling clinical notes and predicting hospital readmission. CoRR, abs/1904.05342. [find](https://scholar.google.com/scholar?q=Kexin+Huang%2C+Jaan+Altosaar%2C+and+Rajesh+Ranganath%2E+2019%2E+Clinicalbert%3A+Modeling+clinical+notes+and+predicting+hospital+readmission%2E+CoRR%2C+abs%2F1904%2E05342%2E) [our card](https://md.research.elamur.ai/free/en/papers/huang-2019-clinicalbert-modeling-clinical-notes-predicting/)
16. Svetlana Kiritchenko and Saif Mohammad. 2018. Examining gender and race bias in two hundred sentiment analysis systems. In Proceedings of the Seventh Joint Conference on Lexical and Computational Semantics, pages 43–53, New Orleans, Louisiana. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Svetlana+Kiritchenko+and+Saif+Mohammad%2E+2018%2E+Examining+gender+and+race+bias+in+two+hundred+sentiment+analysis+systems%2E+In+Proceedings+of+the+Seventh+Joint+Conference+on+Lexical+and+Computational+Sema) [our card](https://md.research.elamur.ai/free/en/papers/kiritchenko-2018-examining-gender-race-bias-two/)
17. Keita Kurita, Nidhi Vyas, Ayush Pareek, Alan W Black, and Yulia Tsvetkov. 2019. Measuring bias in contextualized word representations. In Proceedings of the First Workshop on Gender Bias in Natural Language Processing, pages 166–172, Florence, Italy. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Keita+Kurita%2C+Nidhi+Vyas%2C+Ayush+Pareek%2C+Alan+W+Black%2C+and+Yulia+Tsvetkov%2E+2019%2E+Measuring+bias+in+contextualized+word+representations%2E+In+Proceedings+of+the+First+Workshop+on+Gender+Bias+in+Natural+La) [our card](https://md.research.elamur.ai/free/en/papers/kurita-2019-measuring-bias-contextualized-word-representations/)
18. Brian Larson. 2017. Gender as a variable in natural-language processing: Ethical considerations. In Proceedings of the First ACL Workshop on Ethics in Natural Language Processing, pages 1–11, Valencia, Spain. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Brian+Larson%2E+2017%2E+Gender+as+a+variable+in+natural%2Dlanguage+processing%3A+Ethical+considerations%2E+In+Proceedings+of+the+First+ACL+Workshop+on+Ethics+in+Natural+Language+Processing%2C+pages+1%E2%80%9311%2C+Valencia)
19. Anne Lauscher and Goran Glavaš. 2019. Are we consistently biased? multidimensional analysis of biases in distributional word vectors. In *SEM 2019. [find](https://scholar.google.com/scholar?q=Anne+Lauscher+and+Goran+Glavas%CC%8C%2E+2019%2E+Are+we+consistently+biased%3F+multidimensional+analysis+of+biases+in+distributional+word+vectors%2E+In+%2ASEM+2019%2E)
20. Paul Pu Liang, Yao Chong Lim, Yao-Hung Hubert Tsai, Ruslan Salakhutdinov, and Louis-Philippe Morency. 2019. Strong and simple baselines for multimodal utterance embeddings. In NAACL-HLT, pages 2599–2609, Minneapolis, Minnesota. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Paul+Pu+Liang%2C+Yao+Chong+Lim%2C+Yao%2DHung+Hubert+Tsai%2C+Ruslan+Salakhutdinov%2C+and+Louis%2DPhilippe+Morency%2E+2019%2E+Strong+and+simple+baselines+for+multimodal+utterance+embeddings%2E+In+NAACL%2DHLT%2C+pages+2599%E2%80%9326)
21. Paul Pu Liang, Ziyin Liu, AmirAli Bagher Zadeh, and Louis-Philippe Morency. 2018. Multimodal language analysis with recurrent multistage fusion. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Paul+Pu+Liang%2C+Ziyin+Liu%2C+AmirAli+Bagher+Zadeh%2C+and+Louis%2DPhilippe+Morency%2E+2018%2E+Multimodal+language+analysis+with+recurrent+multistage+fusion%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Meth)
22. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized BERT pretraining approach. CoRR, abs/1907.11692. [find](https://scholar.google.com/scholar?q=Yinhan+Liu%2C+Myle+Ott%2C+Naman+Goyal%2C+Jingfei+Du%2C+Mandar+Joshi%2C+Danqi+Chen%2C+Omer+Levy%2C+Mike+Lewis%2C+Luke+Zettlemoyer%2C+and+Veselin+Stoyanov%2E+2019%2E+Roberta%3A+A+robustly+optimized+BERT+pretraining+approach%2E+C)
23. Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research, 9:2579–2605. [find](https://scholar.google.com/scholar?q=Laurens+van+der+Maaten+and+Geoffrey+Hinton%2E+2008%2E+Visualizing+data+using+t%2DSNE%2E+Journal+of+Machine+Learning+Research%2C+9%3A2579%E2%80%932605%2E)
24. Thomas Manzini, Lim Yao Chong, Alan W Black, and Yulia Tsvetkov. 2019. Black is to criminal as caucasian is to police: Detecting and removing multiclass bias in word embeddings. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Huma… [find](https://scholar.google.com/scholar?q=Thomas+Manzini%2C+Lim+Yao+Chong%2C+Alan+W+Black%2C+and+Yulia+Tsvetkov%2E+2019%2E+Black+is+to+criminal+as+caucasian+is+to+police%3A+Detecting+and+removing+multiclass+bias+in+word+embeddings%2E+In+Proceedings+of+the+) [our card](https://md.research.elamur.ai/free/en/papers/manzini-2019-black-is-criminal-as-caucasian/)
25. Chandler May, Alex Wang, Shikha Bordia, Samuel R. Bowman, and Rachel Rudinger. 2019. On measuring social biases in sentence encoders. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and… [find](https://scholar.google.com/scholar?q=Chandler+May%2C+Alex+Wang%2C+Shikha+Bordia%2C+Samuel+R%2E+Bowman%2C+and+Rachel+Rudinger%2E+2019%2E+On+measuring+social+biases+in+sentence+encoders%2E+In+Proceedings+of+the+2019+Conference+of+the+North+American+Chapte) [our card](https://md.research.elamur.ai/free/en/papers/may-2019-measuring-social-biases-sentence-encoders/)
26. Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. 2017a. Pointer sentinel mixture models. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net. [find](https://scholar.google.com/scholar?q=Stephen+Merity%2C+Caiming+Xiong%2C+James+Bradbury%2C+and+Richard+Socher%2E+2017a%2E+Pointer+sentinel+mixture+models%2E+In+5th+International+Conference+on+Learning+Representations%2C+ICLR+2017%2C+Toulon%2C+France%2C+April) [our card](https://md.research.elamur.ai/free/en/papers/merity-2016-pointer-sentinel-mixture-models/)
27. Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. 2017b. Pointer sentinel mixture models. In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net. [find](https://scholar.google.com/scholar?q=Stephen+Merity%2C+Caiming+Xiong%2C+James+Bradbury%2C+and+Richard+Socher%2E+2017b%2E+Pointer+sentinel+mixture+models%2E+In+5th+International+Conference+on+Learning+Representations%2C+ICLR+2017%2C+Toulon%2C+France%2C+April) [our card](https://md.research.elamur.ai/free/en/papers/merity-2016-pointer-sentinel-mixture-models/)
28. Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. In 1st International Conference on Learning Representations, ICLR 2013, Scottsdale, Arizona, USA, May 2-4, 2013, Workshop Track Proceedings. [find](https://scholar.google.com/scholar?q=Tomas+Mikolov%2C+Kai+Chen%2C+Greg+Corrado%2C+and+Jeffrey+Dean%2E+2013%2E+Efficient+estimation+of+word+representations+in+vector+space%2E+In+1st+International+Conference+on+Learning+Representations%2C+ICLR+2013%2C+Sco)
29. Ji Ho Park, Jamin Shin, and Pascale Fung. 2018. Reducing gender bias in abusive language detection. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2799–2804, Brussels, Belgium. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ji+Ho+Park%2C+Jamin+Shin%2C+and+Pascale+Fung%2E+2018%2E+Reducing+gender+bias+in+abusive+language+detection%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+279) [our card](https://md.research.elamur.ai/free/en/papers/park-2018-reducing-gender-bias-abusive-language/)
30. Sunghyun Park, Han Suk Shim, Moitreya Chatterjee, Kenji Sagae, and Louis-Philippe Morency. 2014. Computational analysis of persuasiveness in social multimedia: A novel dataset and multimodal prediction approach. In ICMI. [find](https://scholar.google.com/scholar?q=Sunghyun+Park%2C+Han+Suk+Shim%2C+Moitreya+Chatterjee%2C+Kenji+Sagae%2C+and+Louis%2DPhilippe+Morency%2E+2014%2E+Computational+analysis+of+persuasiveness+in+social+multimedia%3A+A+novel+dataset+and+multimodal+predictio)
31. Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In EMNLP. [find](https://scholar.google.com/scholar?q=Jeffrey+Pennington%2C+Richard+Socher%2C+and+Christopher+Manning%2E+2014%2E+Glove%3A+Global+vectors+for+word+representation%2E+In+EMNLP%2E)
32. Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolog… [find](https://scholar.google.com/scholar?q=Matthew+Peters%2C+Mark+Neumann%2C+Mohit+Iyyer%2C+Matt+Gardner%2C+Christopher+Clark%2C+Kenton+Lee%2C+and+Luke+Zettlemoyer%2E+2018%2E+Deep+contextualized+word+representations%2E+In+Proceedings+of+the+2018+Conference+of+t)
33. Soujanya Poria, Devamanyu Hazarika, Navonil Majumder, Gautam Naik, Erik Cambria, and Rada Mihalcea. 2019. MELD: A multimodal multi-party dataset for emotion recognition in conversations. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 527– 536, Flore… [find](https://scholar.google.com/scholar?q=Soujanya+Poria%2C+Devamanyu+Hazarika%2C+Navonil+Majumder%2C+Gautam+Naik%2C+Erik+Cambria%2C+and+Rada+Mihalcea%2E+2019%2E+MELD%3A+A+multimodal+multi%2Dparty+dataset+for+emotion+recognition+in+conversations%2E+In+Proceeding) [our card](https://md.research.elamur.ai/free/en/papers/poria-2018-meld-multimodal-multi-party-dataset/)
34. Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019. Language models are unsupervised multitask learners. [find](https://scholar.google.com/scholar?q=Alec+Radford%2C+Jeff+Wu%2C+Rewon+Child%2C+David+Luan%2C+Dario+Amodei%2C+and+Ilya+Sutskever%2E+2019%2E+Language+models+are+unsupervised+multitask+learners%2E)
35. Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016. SQuAD: 100,000+ questions for machine comprehension of text. In EMNLP. [find](https://scholar.google.com/scholar?q=Pranav+Rajpurkar%2C+Jian+Zhang%2C+Konstantin+Lopyrev%2C+and+Percy+Liang%2E+2016%2E+SQuAD%3A+100%2C000%2B+questions+for+machine+comprehension+of+text%2E+In+EMNLP%2E) [our card](https://md.research.elamur.ai/free/en/papers/rajpurkar-2016-squad-100-000-questions-machine/)
36. Richard Socher, Alex Perelygin, Jean Wu, Jason Chuang, Christopher D. Manning, Andrew Ng, and Christopher Potts. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In EMNLP. [find](https://scholar.google.com/scholar?q=Richard+Socher%2C+Alex+Perelygin%2C+Jean+Wu%2C+Jason+Chuang%2C+Christopher+D%2E+Manning%2C+Andrew+Ng%2C+and+Christopher+Potts%2E+2013%2E+Recursive+deep+models+for+semantic+compositionality+over+a+sentiment+treebank%2E+In)
37. Chen Sun, Austin Oliver Myers, Carl Vondrick, Kevin Murphy, and Cordelia Schmid. 2019a. Videobert: A joint model for video and language representation learning. CoRR, abs/1904.01766. [find](https://scholar.google.com/scholar?q=Chen+Sun%2C+Austin+Oliver+Myers%2C+Carl+Vondrick%2C+Kevin+Murphy%2C+and+Cordelia+Schmid%2E+2019a%2E+Videobert%3A+A+joint+model+for+video+and+language+representation+learning%2E+CoRR%2C+abs%2F1904%2E01766%2E) [our card](https://md.research.elamur.ai/free/en/papers/sun-2019-videobert-joint-model-video-language/)
38. Tony Sun, Andrew Gaut, Shirlyn Tang, Yuxin Huang, Mai ElSherief, Jieyu Zhao, Diba Mirza, Elizabeth Belding, Kai-Wei Chang, and William Yang Wang. 2019b. Mitigating gender bias in natural language processing: Literature review. In ACL. [find](https://scholar.google.com/scholar?q=Tony+Sun%2C+Andrew+Gaut%2C+Shirlyn+Tang%2C+Yuxin+Huang%2C+Mai+ElSherief%2C+Jieyu+Zhao%2C+Diba+Mirza%2C+Elizabeth+Belding%2C+Kai%2DWei+Chang%2C+and+William+Yang+Wang%2E+2019b%2E+Mitigating+gender+bias+in+natural+language+proc) [our card](https://md.research.elamur.ai/free/en/papers/sun-2019-mitigating-gender-bias-natural-language/)
39. Nathaniel Swinger, Maria De-Arteaga, Neil Thomas Heffernan IV, Mark DM Leiserson, and Adam Tauman Kalai. 2019. What are the biases in my word embedding? In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, AIES ’19, page 305–311, New York, NY, USA. Association for Computing Mac… [find](https://scholar.google.com/scholar?q=Nathaniel+Swinger%2C+Maria+De%2DArteaga%2C+Neil+Thomas+Heffernan+IV%2C+Mark+DM+Leiserson%2C+and+Adam+Tauman+Kalai%2E+2019%2E+What+are+the+biases+in+my+word+embedding%3F+In+Proceedings+of+the+2019+AAAI%2FACM+Conference+)
40. Jack Urbanek, Angela Fan, Siddharth Karamcheti, Saachi Jain, Samuel Humeau, Emily Dinan, Tim Rocktaschel, Douwe Kiela, Arthur Szlam, and Jason Weston. 2019. Learning to speak and act in a fantasy text adventure game. CoRR, abs/1903.03094. [find](https://scholar.google.com/scholar?q=Jack+Urbanek%2C+Angela+Fan%2C+Siddharth+Karamcheti%2C+Saachi+Jain%2C+Samuel+Humeau%2C+Emily+Dinan%2C+Tim+Rocktaschel%2C+Douwe+Kiela%2C+Arthur+Szlam%2C+and+Jason+Weston%2E+2019%2E+Learning+to+speak+and+act+in+a+fantasy+text)
41. Sumithra Velupillai, Hanna Suominen, Maria Liakata, Angus Roberts, Anoop D. Shah, Katherine Morley, David Osborn, Joseph Hayes, Robert Stewart, Johnny Downs, Wendy Chapman, and Rina Dutta. 2018. Using clinical natural language processing for health outcomes research: Overview and actionable suggesti… [find](https://scholar.google.com/scholar?q=Sumithra+Velupillai%2C+Hanna+Suominen%2C+Maria+Liakata%2C+Angus+Roberts%2C+Anoop+D%2E+Shah%2C+Katherine+Morley%2C+David+Osborn%2C+Joseph+Hayes%2C+Robert+Stewart%2C+Johnny+Downs%2C+Wendy+Chapman%2C+and+Rina+Dutta%2E+2018%2E+Using)
42. Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel Bowman. 2018. GLUE: A multi-task benchmark and analysis platform for natural language understanding. In BlackboxNLP. [find](https://scholar.google.com/scholar?q=Alex+Wang%2C+Amanpreet+Singh%2C+Julian+Michael%2C+Felix+Hill%2C+Omer+Levy%2C+and+Samuel+Bowman%2E+2018%2E+GLUE%3A+A+multi%2Dtask+benchmark+and+analysis+platform+for+natural+language+understanding%2E+In+BlackboxNLP%2E) [our card](https://md.research.elamur.ai/free/en/papers/wang-2018-glue-multi-task-benchmark-analysis/)
43. Chenguang Wang, Mu Li, and Alexander J. Smola. 2019. Language models with transformers. CoRR, abs/1904.09408. — [arXiv:1904.09408](https://arxiv.org/abs/1904.09408) [find](https://scholar.google.com/scholar?q=Chenguang+Wang%2C+Mu+Li%2C+and+Alexander+J%2E+Smola%2E+2019%2E+Language+models+with+transformers%2E+CoRR%2C+abs%2F1904%2E09408%2E+%E2%80%94+%5BarXiv%3A1904%2E09408%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1904%2E09408%29)
44. Alex Warstadt, Amanpreet Singh, and Samuel R Bowman. 2018. Neural network acceptability judgments. arXiv preprint arXiv:1805.12471. [find](https://scholar.google.com/scholar?q=Alex+Warstadt%2C+Amanpreet+Singh%2C+and+Samuel+R+Bowman%2E+2018%2E+Neural+network+acceptability+judgments%2E+arXiv+preprint+arXiv%3A1805%2E12471%2E)
45. Shijie Wu and Mark Dredze. 2019. Beto, bentz, becas: The surprising cross-lingual effectiveness of BERT. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pages 833–844,… [find](https://scholar.google.com/scholar?q=Shijie+Wu+and+Mark+Dredze%2E+2019%2E+Beto%2C+bentz%2C+becas%3A+The+surprising+cross%2Dlingual+effectiveness+of+BERT%2E+In+Proceedings+of+the+2019+Conference+on+Empirical+Methods+in+Natural+Language+Processing+and+t) [our card](https://md.research.elamur.ai/free/en/papers/wu-2019-beto-bentz-becas-surprising-cross/)
46. Rowan Zellers, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019. From recognition to cognition: Visual commonsense reasoning. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR). [find](https://scholar.google.com/scholar?q=Rowan+Zellers%2C+Yonatan+Bisk%2C+Ali+Farhadi%2C+and+Yejin+Choi%2E+2019%2E+From+recognition+to+cognition%3A+Visual+commonsense+reasoning%2E+In+The+IEEE+Conference+on+Computer+Vision+and+Pattern+Recognition+%28CVPR%29%2E)
47. Brian Hu Zhang, Blake Lemoine, and Margaret Mitchell. 2018. Mitigating unwanted biases with adversarial learning. In AIES. [find](https://scholar.google.com/scholar?q=Brian+Hu+Zhang%2C+Blake+Lemoine%2C+and+Margaret+Mitchell%2E+2018%2E+Mitigating+unwanted+biases+with+adversarial+learning%2E+In+AIES%2E)
48. Jieyu Zhao, Tianlu Wang, Mark Yatskar, Ryan Cotterell, Vicente Ordonez, and Kai-Wei Chang. 2019. Gender bias in contextualized word embeddings. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1… [find](https://scholar.google.com/scholar?q=Jieyu+Zhao%2C+Tianlu+Wang%2C+Mark+Yatskar%2C+Ryan+Cotterell%2C+Vicente+Ordonez%2C+and+Kai%2DWei+Chang%2E+2019%2E+Gender+bias+in+contextualized+word+embeddings%2E+In+Proceedings+of+the+2019+Conference+of+the+North+Ameri) [our card](https://md.research.elamur.ai/free/en/papers/zhao-2019-gender-bias-contextualized-word-embeddings/)
49. Jieyu Zhao, Tianlu Wang, Mark Yatskar, Vicente Ordonez, and Kai-Wei Chang. 2017. Men also like shopping: Reducing gender bias amplification using corpus-level constraints. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2979–2989, Copenhagen, Denmark.… [find](https://scholar.google.com/scholar?q=Jieyu+Zhao%2C+Tianlu+Wang%2C+Mark+Yatskar%2C+Vicente+Ordonez%2C+and+Kai%2DWei+Chang%2E+2017%2E+Men+also+like+shopping%3A+Reducing+gender+bias+amplification+using+corpus%2Dlevel+constraints%2E+In+Proceedings+of+the+2017+C) [our card](https://md.research.elamur.ai/free/en/papers/zhao-2017-men-also-like-shopping-reducing/)
50. Jieyu Zhao, Yichao Zhou, Zeyu Li, Wei Wang, and Kai-Wei Chang. 2018. Learning gender-neutral word embeddings. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4847–4853, Brussels, Belgium. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jieyu+Zhao%2C+Yichao+Zhou%2C+Zeyu+Li%2C+Wei+Wang%2C+and+Kai%2DWei+Chang%2E+2018%2E+Learning+gender%2Dneutral+word+embeddings%2E+In+Proceedings+of+the+2018+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C) [our card](https://md.research.elamur.ai/free/en/papers/zhao-2018-learning-gender-neutral-word-embeddings/)
51. Pei Zhou, Weijia Shi, Jieyu Zhao, Kuan-Hao Huang, Muhao Chen, Ryan Cotterell, and Kai-Wei Chang. 2019. Examining gender bias in languages with grammatical gender. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on N… [find](https://scholar.google.com/scholar?q=Pei+Zhou%2C+Weijia+Shi%2C+Jieyu+Zhao%2C+Kuan%2DHao+Huang%2C+Muhao+Chen%2C+Ryan+Cotterell%2C+and+Kai%2DWei+Chang%2E+2019%2E+Examining+gender+bias+in+languages+with+grammatical+gender%2E+In+Proceedings+of+the+2019+Conference)