---
title: "Who cites Deep Contextualized Word Representations"
description: "3,240 papers of the Elamur Research library cite «Deep Contextualized Word Representations», found in their bibliographies · page 1 of 4 · 1–100; the most…"
canonical: "https://research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [Deep Contextualized Word Representations](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/) / cited by

# Who cites «Deep Contextualized Word Representations»

3,240 papers of our library cite it (of the 140,884 whose bibliographies we read) · 388 with a page here, the most cited first · page 1 of 4 · 1–100 · [← the paper](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/)

**1** [2](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/page/2/) [3](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/page/3/) [4](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/page/4/) [next →](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/page/2/)

1. [**BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding**Jacob Devlin, Ming-Wei Chang, Kenton Lee, et al.*2019 · 23,422 citations*](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)
2. [**Transformers: State-of-the-Art Natural Language Processing**Thomas Wolf, Lysandre Debut, Victor Sanh, et al.*2020 · 15,591 citations*](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/)
3. [**BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension**Mike Lewis, Yinhan Liu, Naman Goyal, et al.*2020 · 12,752 citations*](https://md.research.elamur.ai/free/en/papers/lewis-2020-bart-denoising-sequence-sequence-pre/)
4. [**Chain-of-Thought Prompting Elicits Reasoning in Large Language Models**Jason Wei, Xuezhi Wang, Dale Schuurmans, et al.*2022 · 11,278 citations*](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/)
5. [**Learning Transferable Visual Models From Natural Language Supervision**Alec Radford, Jong Wook Kim, Chris Hallacy, et al.*2021 · 8,295 citations*](https://md.research.elamur.ai/free/en/papers/radford-2021-learning-transferable-visual-models-natural/)
6. [**BioBERT: a pre-trained biomedical language representation model for biomedical text mining**Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, et al.*2019 · 8,281 citations*](https://md.research.elamur.ai/free/en/papers/lee-2019-biobert-pre-trained-biomedical-language/)
7. [**Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer**Colin Raffel, Noam Shazeer, Adam Roberts, et al.*2019 · 7,433 citations*](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/)
8. [**GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding**Alex Wang, Amanpreet Singh, Julian Michael, et al.*2018 · 7,141 citations*](https://md.research.elamur.ai/free/en/papers/wang-2018-glue-multi-task-benchmark-analysis/)
9. [**Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing**Pengfei Liu, Weizhe Yuan, Jinlan Fu, et al.*2021 · 5,375 citations*](https://md.research.elamur.ai/free/en/papers/liu-2021-pre-train-prompt-predict-systematic/)
10. [**Energy and Policy Considerations for Deep Learning in NLP**Emma Strubell, Ananya Ganesh, Andrew McCallum*2019 · 4,049 citations*](https://md.research.elamur.ai/free/en/papers/strubell-2019-energy-policy-considerations-deep-learning/)
11. [**XLNet: Generalized Autoregressive Pretraining for Language Understanding**Zhilin Yang, Zihang Dai, Yiming Yang, et al.*2019 · 3,740 citations*](https://md.research.elamur.ai/free/en/papers/yang-2019-xlnet-generalized-autoregressive-pretraining-language/)
12. [**SciBERT: A Pretrained Language Model for Scientific Text**Iz Beltagy, Kyle Lo, Arman Cohan*2019 · 3,548 citations*](https://md.research.elamur.ai/free/en/papers/beltagy-2019-scibert-pretrained-language-model-scientific/)
13. [**HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units**Wei-Ning Hsu, Benjamin Bolte, Yao-Hung Hubert Tsai, et al.*2021 · 3,441 citations*](https://md.research.elamur.ai/free/en/papers/hsu-2021-hubert-self-supervised-speech-representation/)
14. [**Know What You Don't Know: Unanswerable Questions for SQuAD**Pranav Rajpurkar, Robin Jia, Percy Liang*2018 · 3,360 citations*](https://md.research.elamur.ai/free/en/papers/rajpurkar-2018-know-what-you-don-t/)
15. [**On the Opportunities and Risks of Foundation Models**Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.*2021 · 3,044 citations*](https://md.research.elamur.ai/free/en/papers/bommasani-2021-opportunities-risks-foundation-models/)
16. [**Language Models as Knowledge Bases?**Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, et al.*2019 · 2,977 citations*](https://md.research.elamur.ai/free/en/papers/petroni-2019-language-models-as-knowledge-bases/)
17. [**CodeBERT: A Pre-Trained Model for Programming and Natural Languages**Zhangyin Feng, Daya Guo, Duyu Tang, et al.*2020 · 2,954 citations*](https://md.research.elamur.ai/free/en/papers/feng-2020-codebert-pre-trained-model-programming/)
18. [**A Survey of Large Language Models**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,847 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/)
19. [**LXMERT: Learning Cross-Modality Encoder Representations from Transformers**Hao Tan, Mohit Bansal*2019 · 2,714 citations*](https://md.research.elamur.ai/free/en/papers/tan-2019-lxmert-learning-cross-modality-encoder/)
20. [**Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing**Yu Gu; Robert Tinn; Hao Cheng; Michael Lucas; Naoto Usuyama; Xiaodong Liu; Tristan Naumann; Jianfeng Gao;, Hoifung Poon*2020 · 2,636 citations*](https://md.research.elamur.ai/free/en/papers/gu-2020-domain-specific-language-model-pretraining/)
21. [**SpanBERT: Improving Pre-training by Representing and Predicting Spans**Mandar Joshi, Danqi Chen, Yinhan Liu, et al.*2019 · 2,580 citations*](https://md.research.elamur.ai/free/en/papers/joshi-2019-spanbert-improving-pre-training-representing/)
22. [**Evaluating Large Language Models Trained on Code**Mark Chen, Jerry Tworek, Heewoo Jun, et al.*2021 · 2,529 citations*](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/)
23. [**UNITER: UNiversal Image-TExt Representation Learning**Yen-Chun Chen, Linjie Li, Licheng Yu, et al.*2019 · 2,344 citations*](https://md.research.elamur.ai/free/en/papers/chen-2019-uniter-universal-image-text-representation/)
24. [**ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks**Jiasen Lu, Dhruv Batra, Devi Parikh, et al.*2019 · 2,217 citations*](https://md.research.elamur.ai/free/en/papers/lu-2019-vilbert-pretraining-task-agnostic-visiolinguistic/)
25. [**SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems**Alex Wang, Yada Pruksachatkun, Nikita Nangia, et al.*2019 · 2,187 citations*](https://md.research.elamur.ai/free/en/papers/wang-2019-superglue-stickier-benchmark-general-purpose/)
26. [**How Multilingual is Multilingual BERT?**Telmo Pires, Eva Schlinger, Dan Garrette*2019 · 2,095 citations*](https://md.research.elamur.ai/free/en/papers/pires-2019-how-multilingual-is-multilingual-bert/)
27. [**BERT Rediscovers the Classical NLP Pipeline**Ian Tenney, Dipanjan Das, Ellie Pavlick*2019 · 1,993 citations*](https://md.research.elamur.ai/free/en/papers/tenney-2019-bert-rediscovers-classical-nlp-pipeline/)
28. [**AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts**Taylor Shin, Yasaman Razeghi, Robert L. Logan IV, et al.*2020 · 1,879 citations*](https://md.research.elamur.ai/free/en/papers/shin-2020-autoprompt-eliciting-knowledge-language-models/)
29. [**Unsupervised Data Augmentation for Consistency Training**Qizhe Xie, Zihang Dai, Eduard Hovy, et al.*2019 · 1,837 citations*](https://md.research.elamur.ai/free/en/papers/xie-2019-unsupervised-data-augmentation-consistency-training/)
30. [**AllenNLP: A Deep Semantic Natural Language Processing Platform**Matt Gardner, Joel Grus, Mark Neumann, et al.*2018 · 1,804 citations*](https://md.research.elamur.ai/free/en/papers/gardner-2018-allennlp-deep-semantic-natural-language/)
31. [**COMET: A Neural Framework for MT Evaluation**Ricardo Rei, Craig Stewart, Ana C Farinha, et al.*2020 · 1,784 citations*](https://md.research.elamur.ai/free/en/papers/rei-2020-comet-neural-framework-mt-evaluation/)
32. [**ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT**Omar Khattab, Matei Zaharia*2020 · 1,776 citations*](https://md.research.elamur.ai/free/en/papers/khattab-2020-colbert-efficient-effective-passage/)
33. [**Pre-trained Models for Natural Language Processing: A Survey**Xipeng Qiu, Tianxiang Sun, Yige Xu, et al.*2020 · 1,740 citations*](https://md.research.elamur.ai/free/en/papers/qiu-2020-pre-trained-models-natural-language/)
34. [**Longformer: The Long-Document Transformer**Iz Beltagy, Matthew E. Peters, Arman Cohan*2020 · 1,737 citations*](https://md.research.elamur.ai/free/en/papers/beltagy-2020-longformer-long-document-transformer/)
35. [**Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering**Gautier Izacard, Edouard Grave*2021 · 1,674 citations*](https://md.research.elamur.ai/free/en/papers/izacard-2021-leveraging-passage-retrieval-generative-models/)
36. [**Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey**Bonan Min, Hayley Ross, Elior Sulem, et al.*2021 · 1,548 citations*](https://md.research.elamur.ai/free/en/papers/min-2021-recent-advances-natural-language-processing/)
37. [**Unifying Large Language Models and Knowledge Graphs: A Roadmap**Shirui Pan, Linhao Luo, Yufei Wang, et al.*2023 · 1,545 citations*](https://md.research.elamur.ai/free/en/papers/pan-2023-unifying-large-language-models-knowledge/)
38. [**VisualBERT: A Simple and Performant Baseline for Vision and Language**Liunian Harold Li, Mark Yatskar, Da Yin, et al.*2019 · 1,510 citations*](https://md.research.elamur.ai/free/en/papers/li-2019-visualbert-simple-performant-baseline-vision/)
39. [**Multi-Task Deep Neural Networks for Natural Language Understanding**Xiaodong Liu, Pengcheng He, Weizhu Chen, et al.*2019 · 1,501 citations*](https://md.research.elamur.ai/free/en/papers/liu-2019-multi-task-deep-neural-networks/)
40. [**How Can We Know What Language Models Know?**Zhengbao Jiang, Frank F. Xu, Jun Araki, et al.*2020 · 1,493 citations*](https://md.research.elamur.ai/free/en/papers/jiang-2020-how-can-we-know-what/)
41. [**Contextual String Embeddings for Sequence Labeling**Alan Akbik, Duncan Blythe, Roland Vollgraf*2018 · 1,390 citations*](https://md.research.elamur.ai/free/en/papers/akbik-2018-contextual-string-embeddings-sequence-labeling/)
42. [**Unified Language Model Pre-training for Natural Language Understanding and Generation**Li Dong, Nan Yang, Wenhui Wang, et al.*2019 · 1,389 citations*](https://md.research.elamur.ai/free/en/papers/dong-2019-unified-language-model-pre-training/)
43. [**wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations**Alexei Baevski, Henry Zhou, Abdelrahman Mohamed, et al.*2020 · 1,355 citations*](https://md.research.elamur.ai/free/en/papers/baevski-2020-wav2vec-2-0-framework-self/)
44. [**LaMDA: Language Models for Dialog Applications**Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.*2022 · 1,314 citations*](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/)
45. [**VideoBERT: A Joint Model for Video and Language Representation Learning**Chen Sun, Austin Myers, Carl Vondrick, et al.*2019 · 1,305 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-videobert-joint-model-video-language/)
46. [**BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions**Christopher Clark, Kenton Lee, Ming-Wei Chang, et al.*2019 · 1,299 citations*](https://md.research.elamur.ai/free/en/papers/clark-2019-boolq-exploring-surprising-difficulty-natural/)
47. [**AraBERT: Transformer-based Model for Arabic Language Understanding**Wissam Antoun, Fady Baly, Hazem Hajj*2020 · 1,297 citations*](https://md.research.elamur.ai/free/en/papers/antoun-2020-arabert-transformer-based-model-arabic/)
48. [**A Comprehensive Overview of Large Language Models**Humza Naveed, Asad Ullah Khan, Shi Qiu, et al.*2023 · 1,286 citations*](https://md.research.elamur.ai/free/en/papers/naveed-2023-comprehensive-overview-large-language-models/)
49. [**COMET: Commonsense Transformers for Automatic Knowledge Graph Construction**Antoine Bosselut, Hannah Rashkin, Maarten Sap, et al.*2019 · 1,282 citations*](https://md.research.elamur.ai/free/en/papers/bosselut-2019-comet-commonsense-transformers-automatic-knowledge/)
50. [**CTRL: A Conditional Transformer Language Model for Controllable Generation**Nitish Shirish Keskar, Bryan McCann, Lav R. Varshney, et al.*2019 · 1,273 citations*](https://md.research.elamur.ai/free/en/papers/keskar-2019-ctrl-conditional-transformer-language-model/)
51. [**The Rise and Potential of Large Language Model Based Agents: A Survey**Zhiheng Xi, Wenxiang Chen, Xin Guo, et al.*2023 · 1,262 citations*](https://md.research.elamur.ai/free/en/papers/xi-2023-rise-potential-large-language/)
52. [**CamemBERT: a Tasty French Language Model**Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, et al.*2019 · 1,262 citations*](https://md.research.elamur.ai/free/en/papers/martin-2019-camembert-tasty-french-language-model/)
53. [**Latent Retrieval for Weakly Supervised Open Domain Question Answering**Kenton Lee, Ming-Wei Chang, Kristina Toutanova*2019 · 1,234 citations*](https://md.research.elamur.ai/free/en/papers/lee-2019-latent-retrieval-weakly-supervised-open/)
54. [**A Structural Probe for Finding Syntax in Word Representations**John Hewitt, Christopher D. Manning*2019 · 1,228 citations*](https://md.research.elamur.ai/free/en/papers/hewitt-2019-structural-probe-finding-syntax-word/)
55. [**Publicly Available Clinical BERT Embeddings**Emily Alsentzer, John R. Murphy, Willie Boag, et al.*2019 · 1,209 citations*](https://md.research.elamur.ai/free/en/papers/alsentzer-2019-publicly-available-clinical-bert-embeddings/)
56. [**Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity**Yao Lu, Max Bartolo, Alastair Moore, et al.*2022 · 1,187 citations*](https://md.research.elamur.ai/free/en/papers/lu-2022-fantastically-ordered-prompts-where-find/)
57. [**PubMedQA: A Dataset for Biomedical Research Question Answering**Qiao Jin, Bhuwan Dhingra, Zhengping Liu, et al.*2019 · 1,152 citations*](https://md.research.elamur.ai/free/en/papers/jin-2019-pubmedqa-dataset-biomedical-research-question/)
58. [**CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledge**Alon Talmor, Jonathan Herzig, Nicholas Lourie, et al.*2019 · 1,146 citations*](https://md.research.elamur.ai/free/en/papers/talmor-2019-commonsenseqa-question-answering-challenge-targeting/)
59. [**Program Synthesis with Large Language Models**Jacob Austin, Augustus Odena, Maxwell Nye, et al.*2021 · 1,136 citations*](https://md.research.elamur.ai/free/en/papers/austin-2021-program-synthesis-large-language-models/)
60. [**StereoSet: Measuring stereotypical bias in pretrained language models**Moin Nadeem, Anna Bethke, Siva Reddy*2021 · 1,131 citations*](https://md.research.elamur.ai/free/en/papers/nadeem-2021-stereoset-measuring-stereotypical-bias-pretrained/)
61. [**MASS: Masked Sequence to Sequence Pre-training for Language Generation**Kaitao Song, Xu Tan, Tao Qin, et al.*2019 · 1,109 citations*](https://md.research.elamur.ai/free/en/papers/song-2019-mass-masked-sequence-sequence-pre/)
62. [**SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)**Marcos Zampieri, Shervin Malmasi, Preslav Nakov, et al.*2019 · 1,109 citations*](https://md.research.elamur.ai/free/en/papers/zampieri-2019-semeval-2019-task-6-identifying/)
63. [**QuAC: Question Answering in Context**Eunsol Choi, He He, Mohit Iyyer, et al.*2018 · 1,057 citations*](https://md.research.elamur.ai/free/en/papers/choi-2018-quac-question-answering-context/)
64. [**Linguistic Knowledge and Transferability of Contextual Representations**Nelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.*2019 · 1,011 citations*](https://md.research.elamur.ai/free/en/papers/liu-2019-linguistic-knowledge-transferability-contextual-representations/)
65. [**K-BERT: Enabling Language Representation with Knowledge Graph**Weijie Liu, Peng Zhou, Zhe Zhao, et al.*2019 · 1,006 citations*](https://md.research.elamur.ai/free/en/papers/liu-2019-k-bert-enabling-language-representation/)
66. [**MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices**Zhiqing Sun, Hongkun Yu, Xiaodan Song, et al.*2020 · 1,003 citations*](https://md.research.elamur.ai/free/en/papers/sun-2020-mobilebert-compact-task-agnostic-bert/)
67. [**ERNIE 2.0: A Continual Pre-training Framework for Language Understanding**Yu Sun, Shuohuan Wang, Yukun Li, et al.*2019 · 976 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-ernie-2-0-continual/)
68. [**ERNIE: Enhanced Representation through Knowledge Integration**Yu Sun, Shuohuan Wang, Yukun Li, et al.*2019 · 949 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-ernie-enhanced-representation-through-knowledge/)
69. [**DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs**Dheeru Dua, Yizhong Wang, Pradeep Dasigi, et al.*2019 · 941 citations*](https://md.research.elamur.ai/free/en/papers/dua-2019-drop-reading-comprehension-benchmark-requiring/)
70. [**Patient Knowledge Distillation for BERT Model Compression**Siqi Sun, Yu Cheng, Zhe Gan, et al.*2019 · 939 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-patient-knowledge-distillation-bert-model/)
71. [**Bottom-Up Abstractive Summarization**Sebastian Gehrmann, Yuntian Deng, Alexander Rush*2018 · 939 citations*](https://md.research.elamur.ai/free/en/papers/gehrmann-2018-bottom-up-abstractive-summarization/)
72. [**Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction**Yi Luan, Luheng He, Mari Ostendorf, et al.*2018 · 933 citations*](https://md.research.elamur.ai/free/en/papers/luan-2018-multi-task-identification-entities-relations/)
73. [**Extracting Training Data from Large Language Models**Nicholas Carlini, Florian Tramer, Eric Wallace, et al.*2020 · 901 citations*](https://md.research.elamur.ai/free/en/papers/carlini-2020-extracting-training-data-large-language/)
74. [**CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models**Nikita Nangia, Clara Vania, Rasika Bhalerao, et al.*2020 · 886 citations*](https://md.research.elamur.ai/free/en/papers/nangia-2020-crows-pairs-challenge-dataset-measuring/)
75. [**TaPas: Weakly Supervised Table Parsing via Pre-training**Jonathan Herzig, Pawel Krzysztof Nowak, Thomas Müller, et al.*2020 · 844 citations*](https://md.research.elamur.ai/free/en/papers/herzig-2020-tapas-weakly-supervised-table-parsing/)
76. [**A Unified MRC Framework for Named Entity Recognition**Xiaoya Li, Jingrong Feng, Yuxian Meng, et al.*2020 · 833 citations*](https://md.research.elamur.ai/free/en/papers/li-2020-unified-mrc-framework-named-entity/)
77. [**MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance**Wei Zhao, Maxime Peyrard, Fei Liu, et al.*2019 · 822 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2019-moverscore-text-generation-evaluating-contextualized/)
78. [**Entity, Relation, and Event Extraction with Contextualized Span Representations**David Wadden, Ulme Wennberg, Yi Luan, et al.*2019 · 818 citations*](https://md.research.elamur.ai/free/en/papers/wadden-2019-entity-relation-event-extraction-contextualized/)
79. [**Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond**Jingfeng Yang, Hongye Jin, Ruixiang Tang, et al.*2023 · 806 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-harnessing-power-llms-practice-survey/)
80. [**Learning Deep Transformer Models for Machine Translation**Qiang Wang, Bei Li, Tong Xiao, et al.*2019 · 798 citations*](https://md.research.elamur.ai/free/en/papers/wang-2019-learning-deep-transformer-models-machine/)
81. [**ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission**Kexin Huang, Jaan Altosaar, Rajesh Ranganath*2019 · 788 citations*](https://md.research.elamur.ai/free/en/papers/huang-2019-clinicalbert-modeling-clinical-notes-predicting/)
82. [**On Measuring Social Biases in Sentence Encoders**Chandler May, Alex Wang, Shikha Bordia, et al.*2019 · 761 citations*](https://md.research.elamur.ai/free/en/papers/may-2019-measuring-social-biases-sentence-encoders/)
83. [**Constituency Parsing with a Self-Attentive Encoder**Nikita Kitaev, Dan Klein*2018 · 759 citations*](https://md.research.elamur.ai/free/en/papers/kitaev-2018-constituency-parsing-self-attentive-encoder/)
84. [**EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Tasks**Jason Wei, Kai Zou*2019 · 750 citations*](https://md.research.elamur.ai/free/en/papers/wei-2019-eda-easy-data-augmentation-techniques/)
85. [**Integrating Multimodal Information in Large Pretrained Transformers**Wasifur Rahman, Md Kamrul Hasan, Sangwu Lee, et al.*2020 · 742 citations*](https://md.research.elamur.ai/free/en/papers/rahman-2020-integrating-multimodal-information-large-pretrained/)
86. [**Dice Loss for Data-imbalanced NLP Tasks**Xiaoya Li, Xiaofei Sun, Yuxian Meng, et al.*2020 · 734 citations*](https://md.research.elamur.ai/free/en/papers/li-2020-dice-loss-data-imbalanced-nlp/)
87. [**IndicNLPSuite: Monolingual Corpora, Evaluation Benchmarks and Pre-trained Multilingual Language Models for Indian Languages**Divyanshu Kakwani, Anoop Kunchukuttan, Satish Golla, et al.*2020 · 730 citations*](https://md.research.elamur.ai/free/en/papers/kakwani-2020-indicnlpsuite-monolingual-corpora-evaluation-benchmarks/)
88. [**Mitigating Gender Bias in Natural Language Processing: Literature Review**Tony Sun, Andrew Gaut, Shirlyn Tang, et al.*2019 · 716 citations*](https://md.research.elamur.ai/free/en/papers/sun-2019-mitigating-gender-bias-natural-language/)
89. [**Transfer Learning in Natural Language Processing**Sebastian Ruder, Matthew E. Peters, Swabha Swayamdipta, et al.*2019 · 700 citations*](https://md.research.elamur.ai/free/en/papers/ruder-2019-transfer-learning-natural-language-processing/)
90. [**GLTR: Statistical Detection and Visualization of Generated Text**Sebastian Gehrmann, Hendrik Strobelt, Alexander M. Rush*2019 · 691 citations*](https://md.research.elamur.ai/free/en/papers/gehrmann-2019-gltr-statistical-detection-visualization-generated/)
91. [**SPECTER: Document-level Representation Learning using Citation-informed Transformers**Arman Cohan, Sergey Feldman, Iz Beltagy, et al.*2020 · 690 citations*](https://md.research.elamur.ai/free/en/papers/cohan-2020-specter-document-level-representation-learning/)
92. [**TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data**Pengcheng Yin, Graham Neubig, Wen-tau Yih, et al.*2020 · 690 citations*](https://md.research.elamur.ai/free/en/papers/yin-2020-tabert-pretraining-joint-understanding-textual/)
93. [**Explain Yourself! Leveraging Language Models for Commonsense Reasoning**Nazneen Fatema Rajani, Bryan McCann, Caiming Xiong, et al.*2019 · 690 citations*](https://md.research.elamur.ai/free/en/papers/rajani-2019-explain-yourself-leveraging-language-models/)
94. [**DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation**Yizhe Zhang, Siqi Sun, Michel Galley, et al.*2019 · 684 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2019-dialogpt-large-scale-generative-pre/)
95. [**Well-Read Students Learn Better: On the Importance of Pre-training Compact Models**Iulia Turc, Ming-Wei Chang, Kenton Lee, et al.*2019 · 671 citations*](https://md.research.elamur.ai/free/en/papers/turc-2019-well-read-students-learn-better/)
96. [**K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters**Ruize Wang, Duyu Tang, Nan Duan, et al.*2020 · 662 citations*](https://md.research.elamur.ai/free/en/papers/wang-2020-k-adapter-infusing-knowledge-pre/)
97. [**CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Data**Guillaume Wenzek, Marie-Anne Lachaux, Alexis Conneau, et al.*2020 · 650 citations*](https://md.research.elamur.ai/free/en/papers/wenzek-2020-ccnet-extracting-high-quality-monolingual/)
98. [**FLAIR: An Easy-to-Use Framework for State-of-the-Art NLP**Alan Akbik, Tanja Bergmann, Duncan Blythe, et al.*2019 · 645 citations*](https://md.research.elamur.ai/free/en/papers/akbik-2019-flair-easy-use-framework-state/)
99. [**Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyond**Mikel Artetxe, Holger Schwenk*2018 · 627 citations*](https://md.research.elamur.ai/free/en/papers/artetxe-2018-massively-multilingual-sentence-embeddings-zero/)
100. [**Efficient Intent Detection with Dual Sentence Encoders**Iñigo Casanueva, Tadas Temčinas, Daniela Gerz, et al.*2020 · 622 citations*](https://md.research.elamur.ai/free/en/papers/casanueva-2020-efficient-intent-detection-dual-sentence/)

**1** [2](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/page/2/) [3](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/page/3/) [4](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/page/4/) [next →](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/cited-by/page/2/)

- [← back to](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/) — Deep Contextualized Word Representations