---
title: "Who cites REALM: Retrieval-Augmented — 1,085 citing papers"
description: "1,085 papers of the Elamur Research library cite «REALM: Retrieval-Augmented Language Model Pre-Training», found in their bibliographies…"
canonical: "https://research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/cited-by/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/cited-by/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [REALM: Retrieval-Augmented Language Model…](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/) / cited by

# Who cites «REALM: Retrieval-Augmented Language Model Pre-Training»

1,085 papers of our library cite it (of the 149,439 whose bibliographies we read) · 260 with a page here, the most cited first · page 1 of 3 · 1–100 · [← back to «REALM: Retrieval-Augmented Language Model Pre-Training»](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/)

**1** [2](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/cited-by/page/2/) [3](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/cited-by/page/3/) [next →](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/cited-by/page/2/)

1. [**Language Models are Few-Shot Learners arXiv:2005.14165**Tom B. Brown, Benjamin Mann, Nick Ryder, et al.*2020 · 14,178 citations*](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
2. [**Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks arXiv:2005.11401**Patrick Lewis, Ethan Perez, Aleksandra Piktus, et al.*2020 · 6,256 citations*](https://md.research.elamur.ai/free/en/papers/lewis-2020-retrieval-augmented-generation-knowledge-intensive/)
3. **[Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing](https://md.research.elamur.ai/free/en/papers/liu-2021-pre-train-prompt-predict-systematic/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Pengfei Liu, Weizhe Yuan, Jinlan Fu, et al.*2021 · 5,423 citations*
4. **[Dense Passage Retrieval for Open-Domain Question Answering](https://md.research.elamur.ai/free/en/papers/karpukhin-2020-dense-passage-retrieval-open-domain/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Vladimir Karpukhin, Barlas Oguz, Sewon Min, et al.*2020 · 5,421 citations*
5. [**PaLM: Scaling Language Modeling with Pathways arXiv:2204.02311**Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.*2022 · 4,753 citations*](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)
6. **[A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions](https://md.research.elamur.ai/free/en/papers/huang-2023-survey-hallucination-large-language-models/) [ACM Transactions on Information Systems](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-information-systems/)**Lei Huang, Weijiang Yu, Weitao Ma, et al.*2023 · 3,231 citations*
7. [**On the Opportunities and Risks of Foundation Models arXiv:2108.07258**Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.*2021 · 3,160 citations*](https://md.research.elamur.ai/free/en/papers/bommasani-2021-opportunities-risks-foundation-models/)
8. **[A Survey of Large Language Models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/) [Frontiers of Computer Science](https://md.research.elamur.ai/free/en/venues/frontiers-of-computer-science/)**Wayne Xin Zhao, Kun Zhou, Junyi Li, et al.*2023 · 2,875 citations*
9. [**Emergent Abilities of Large Language Models arXiv:2206.07682**Jason Wei, Yi Tay, Rishi Bommasani, et al.*2022 · 2,269 citations*](https://md.research.elamur.ai/free/en/papers/wei-2022-emergent-abilities-large-language-models/)
10. **[Toolformer: Language Models Can Teach Themselves to Use Tools](https://md.research.elamur.ai/free/en/papers/schick-2023-toolformer-language-models-can-teach/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, et al.*2023 · 2,065 citations*
11. **[Training Compute-Optimal Large Language Models](https://md.research.elamur.ai/free/en/papers/hoffmann-2022-training-compute-optimal-large-language/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, et al.*2022 · 2,032 citations*
12. **[Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering](https://md.research.elamur.ai/free/en/papers/izacard-2021-leveraging-passage-retrieval-generative-models/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Gautier Izacard, Edouard Grave*2021 · 1,692 citations*
13. [**Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context arXiv:2403.05530**Gemini Team, Petko Georgiev, Ving Ian Lei, et al.*2024 · 1,589 citations*](https://md.research.elamur.ai/free/en/papers/gemini-team-2024-gemini-1-5-unlocking-multimodal/)
14. **[Unifying Large Language Models and Knowledge Graphs: A Roadmap](https://md.research.elamur.ai/free/en/papers/pan-2023-unifying-large-language-models-knowledge/) [IEEE Transactions on Knowledge and Data Engineering](https://md.research.elamur.ai/free/en/venues/ieee-transactions-on-knowledge-and-data-engineering/)**Shirui Pan, Linhao Luo, Yufei Wang, et al.*2023 · 1,551 citations*
15. [**LaMDA: Language Models for Dialog Applications arXiv:2201.08239**Romal Thoppilan, Daniel De Freitas, Jamie Hall, et al.*2022 · 1,344 citations*](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/)
16. **[Big Bird: Transformers for Longer Sequences](https://md.research.elamur.ai/free/en/papers/zaheer-2020-big-bird-transformers-longer-sequences/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Manzil Zaheer, Guru Guruganesh, Avinava Dubey, et al.*2020 · 1,023 citations*
17. **[A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models](https://md.research.elamur.ai/free/en/papers/fan-2024-survey-rag-meeting-llms-towards/) [ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD)](https://md.research.elamur.ai/free/en/venues/acm-sigkdd-conference-on-knowledge-discovery-and-data-mining-kdd/)**Wenqi Fan; Yujuan Ding; Liangbo Ning; Shijie Wang; Hengyun Li; Dawei Yin; Tat-Seng Chua;, Qing Li*2024 · 1,010 citations*
18. **[C-Pack: Packed Resources For General Chinese Embeddings](https://md.research.elamur.ai/free/en/papers/xiao-2023-c-pack-packed-resources/) [International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)](https://md.research.elamur.ai/free/en/venues/international-acm-sigir-conference-on-research-and-development-in-information/)**Shitao Xiao, Zheng Liu, Peitian Zhang, et al.*2023 · 922 citations*
19. **[Active Retrieval Augmented Generation](https://md.research.elamur.ai/free/en/papers/jiang-2023-active-retrieval-augmented-generation/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Zhengbao Jiang, Frank Xu, Luyu Gao, et al.*2023 · 872 citations*
20. [**Unsupervised Dense Information Retrieval with Contrastive Learning arXiv:2112.09118**Gautier Izacard, Mathilde Caron, Lucas Hosseini, et al.*2021 · 836 citations*](https://md.research.elamur.ai/free/en/papers/izacard-2021-unsupervised-dense-information-retrieval-contrastive/)
21. **[In-Context Retrieval-Augmented Language Models](https://md.research.elamur.ai/free/en/papers/ram-2023-context-retrieval-augmented-language-models/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Ori Ram, Yoav Levine, Itay Dalmedigos, et al.*2023 · 793 citations*
22. **[Learning To Retrieve Prompts for In-Context Learning](https://md.research.elamur.ai/free/en/papers/rubin-2021-learning-retrieve-prompts-context-learning/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Ohad Rubin, Jonathan Herzig, Jonathan Berant*2021 · 724 citations*
23. [**WebGPT: Browser-assisted question-answering with human feedback arXiv:2112.09332**Reiichiro Nakano, Jacob Hilton, Suchir Balaji, et al.*2021 · 721 citations*](https://md.research.elamur.ai/free/en/papers/nakano-2021-webgpt-browser-assisted-question-answering/)
24. **[Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions](https://md.research.elamur.ai/free/en/papers/trivedi-2022-interleaving-retrieval-chain-thought-reasoning/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Harsh Trivedi, Niranjan Balasubramanian, Tushar Khot, et al.*2022 · 716 citations*
25. [**Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval arXiv:2007.00808**Lee Xiong, Chenyan Xiong, Ye Li, et al.*2020 · 688 citations*](https://md.research.elamur.ai/free/en/papers/xiong-2020-approximate-nearest-neighbor-negative-contrastive/)
26. **[KILT: a Benchmark for Knowledge Intensive Language Tasks](https://md.research.elamur.ai/free/en/papers/petroni-2020-kilt-benchmark-knowledge-intensive-language/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Fabio Petroni, Aleksandra Piktus, Angela Fan, et al.*2020 · 678 citations*
27. [**Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection arXiv:2310.11511**Akari Asai, Zeqiu Wu, Yizhong Wang, et al.*2023 · 677 citations*](https://md.research.elamur.ai/free/en/papers/asai-2023-self-rag-learning-retrieve-generate/)
28. [**Atlas: Few-shot Learning with Retrieval Augmented Language Models arXiv:2208.03299**Gautier Izacard, Patrick Lewis, Maria Lomeli, et al.*2022 · 673 citations*](https://md.research.elamur.ai/free/en/papers/izacard-2022-atlas-few-shot-learning-retrieval/)
29. **[Benchmarking Large Language Models in Retrieval-Augmented Generation](https://md.research.elamur.ai/free/en/papers/chen-2023-benchmarking-large-language-models-retrieval/) [Proceedings of the AAAI Conference on Artificial Intelligence](https://md.research.elamur.ai/free/en/venues/proceedings-of-the-aaai-conference-on-artificial-intelligence/)**Jiawei Chen, Hongyu Lin, Xianpei Han, et al.*2023 · 629 citations*
30. **[RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering](https://md.research.elamur.ai/free/en/papers/qu-2021-rocketqa-optimized-training-approach-dense/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Yingqi Qu, Yuchen Ding, Jing Liu, et al.*2021 · 603 citations*
31. [**Improving Factuality and Reasoning in Language Models through Multiagent Debate arXiv:2305.14325**Yilun Du, Shuang Li, Antonio Torralba, et al.*2023 · 587 citations*](https://md.research.elamur.ai/free/en/papers/du-2023-improving-factuality-reasoning-language-models/)
32. **[SPLADE: Sparse Lexical and Expansion Model for First Stage Ranking](https://md.research.elamur.ai/free/en/papers/formal-2021-splade-sparse-lexical-expansion/) [International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)](https://md.research.elamur.ai/free/en/venues/international-acm-sigir-conference-on-research-and-development-in-information/)**Thibault Formal, Benjamin Piwowarski, Stéphane Clinchant*2021 · 512 citations*
33. [**REPLUG: Retrieval-Augmented Black-Box Language Models arXiv:2301.12652**Weijia Shi, Sewon Min, Michihiro Yasunaga, et al.*2023 · 492 citations*](https://md.research.elamur.ai/free/en/papers/shi-2023-replug-retrieval-augmented-black-box/)
34. **[Enabling Large Language Models to Generate Text with Citations](https://md.research.elamur.ai/free/en/papers/gao-2023-enabling-large-language-models-generate/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Tianyu Gao, Howard Yen, Jiatong Yu, et al.*2023 · 485 citations*
35. **[ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction](https://md.research.elamur.ai/free/en/papers/santhanam-2022-colbertv2-effective-efficient-retrieval-lightweight/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Keshav Santhanam, Omar Khattab, Jon Saad-Falcon, et al.*2022 · 485 citations*
36. **[LinkBERT: Pretraining Language Models with Document Links](https://md.research.elamur.ai/free/en/papers/yasunaga-2022-linkbert-pretraining-language-models-document/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Michihiro Yasunaga, Jure Leskovec, Percy Liang*2022 · 458 citations*
37. **[GPT-NER: Named Entity Recognition via Large Language Models](https://md.research.elamur.ai/free/en/papers/wang-2025-gpt-ner-named-entity-recognition/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Shuhe Wang, Xiaofei Sun, Xiaoya Li, et al.*2025 · 436 citations*
38. [**Long Range Arena: A Benchmark for Efficient Transformers arXiv:2011.04006**Yi Tay, Mostafa Dehghani, Samira Abnar, et al.*2020 · 414 citations*](https://md.research.elamur.ai/free/en/papers/tay-2020-long-range-arena-benchmark-efficient/)
39. **[Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering](https://md.research.elamur.ai/free/en/papers/siriwardhana-2023-improving-domain-adaptation-retrieval-augmented/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Shamane Siriwardhana, Rivindu Weerasekera, Elliott Wen, et al.*2023 · 403 citations*
40. [**Retrieval Augmentation Reduces Hallucination in Conversation arXiv:2104.07567**Kurt Shuster, Spencer Poff, Moya Chen, et al.*2021 · 392 citations*](https://md.research.elamur.ai/free/en/papers/shuster-2021-retrieval-augmentation-reduces-hallucination-conversation/)
41. **[Query Rewriting in Retrieval-Augmented Large Language Models](https://md.research.elamur.ai/free/en/papers/ma-2023-query-rewriting-retrieval-augmented-large/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Xinbei Ma, Yeyun Gong, Pengcheng He, et al.*2023 · 384 citations*
42. [**Towards General Text Embeddings with Multi-stage Contrastive Learning arXiv:2308.03281**Zehan Li, Xin Zhang, Yanzhao Zhang, et al.*2023 · 384 citations*](https://md.research.elamur.ai/free/en/papers/li-2023-towards-general-text-embeddings-multi/)
43. **[A Dataset of Information-Seeking Questions and Answers Anchored in Research Papers](https://md.research.elamur.ai/free/en/papers/dasigi-2021-dataset-information-seeking-questions-answers/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Pradeep Dasigi, Kyle Lo, Iz Beltagy, et al.*2021 · 384 citations*
44. **[Tool Learning with Foundation Models](https://md.research.elamur.ai/free/en/papers/qin-2023-tool-learning-foundation-models/) [ACM Computing Surveys](https://md.research.elamur.ai/free/en/venues/acm-computing-surveys/)**Yujia Qin, Shengding Hu, Yankai Lin, et al.*2023 · 383 citations*
45. [**Augmented Language Models: a Survey arXiv:2302.07842**Grégoire Mialon, Roberto Dessì, Maria Lomeli, et al.*2023 · 369 citations*](https://md.research.elamur.ai/free/en/papers/mialon-2023-augmented-language-models-survey/)
46. [**Revisiting Few-sample BERT Fine-tuning arXiv:2006.05987**Tianyi Zhang, Felix Wu, Arzoo Katiyar, et al.*2020 · 368 citations*](https://md.research.elamur.ai/free/en/papers/zhang-2020-revisiting-few-sample-bert-fine/)
47. [**Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback arXiv:2302.12813**Baolin Peng, Michel Galley, Pengcheng He, et al.*2023 · 363 citations*](https://md.research.elamur.ai/free/en/papers/peng-2023-check-facts-try-again-improving/)
48. **[RARR: Researching and Revising What Language Models Say, Using Language Models](https://md.research.elamur.ai/free/en/papers/gao-2023-rarr-researching-revising-what-language/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Luyu Gao, Zhuyun Dai, Panupong Pasupat, et al.*2023 · 359 citations*
49. **[Towards Mitigating LLM Hallucination via Self Reflection](https://md.research.elamur.ai/free/en/papers/ji-2023-mitigating-llm-hallucination-self-reflection/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Ziwei Ji, Tiezheng Yu, Yan Xu, et al.*2023 · 354 citations*
50. **[Internet-Augmented Dialogue Generation](https://md.research.elamur.ai/free/en/papers/komeili-2022-internet-augmented-dialogue-generation/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Mojtaba Komeili, Kurt Shuster, Jason Weston*2022 · 354 citations*
51. **[Time-Aware Language Models as Temporal Knowledge Bases](https://md.research.elamur.ai/free/en/papers/dhingra-2022-time-aware-language-models-as/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Bhuwan Dhingra, Jeremy R. Cole, Julian Martin Eisenschlos, et al.*2022 · 349 citations*
52. **[Large Language Models for Information Retrieval: A Survey](https://md.research.elamur.ai/free/en/papers/zhu-2023-large-language-models-information-retrieval/) [ACM Transactions on Information Systems](https://md.research.elamur.ai/free/en/venues/acm-transactions-on-information-systems/)**Yutao Zhu; Huaying Yuan; Shuting Wang; Jiongnan Liu; Wenhan Liu; Chenlong Deng; Haonan Chen; Zheng Liu; Zhicheng Dou;, Ji-Rong Wen*2023 · 339 citations*
53. **[Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrieval](https://md.research.elamur.ai/free/en/papers/gao-2022-unsupervised-corpus-aware-language-model/) [Annual Meeting of the Association for Computational Linguistics (ACL)](https://md.research.elamur.ai/free/en/venues/acl/)**Luyu Gao, Jamie Callan*2022 · 328 citations*
54. [**CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing arXiv:2305.11738**Zhibin Gou, Zhihong Shao, Yeyun Gong, et al.*2023 · 326 citations*](https://md.research.elamur.ai/free/en/papers/gou-2023-critic-large-language-models-self/)
55. [**Text and Code Embeddings by Contrastive Pre-Training arXiv:2201.10005**Arvind Neelakantan, Tao Xu, Raul Puri, et al.*2022 · 323 citations*](https://md.research.elamur.ai/free/en/papers/neelakantan-2022-text-code-embeddings-contrastive-pre/)
56. **[The Power of Noise: Redefining Retrieval for RAG Systems](https://md.research.elamur.ai/free/en/papers/cuconasu-2024-power-noise-redefining-retrieval-rag/) [International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)](https://md.research.elamur.ai/free/en/venues/international-acm-sigir-conference-on-research-and-development-in-information/)**Florin Cuconasu, Giovanni Trappolini, Federico Siciliano, et al.*2024 · 312 citations*
57. [**The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision) arXiv:2309.17421**Zhengyuan Yang, Linjie Li, Kevin Lin, et al.*2023 · 311 citations*](https://md.research.elamur.ai/free/en/papers/yang-2023-dawn-lmms-preliminary-explorations-gpt/)
58. [**Retrieval-Augmented Generation for AI-Generated Content: A Survey arXiv:2402.19473**Penghao Zhao, Hailin Zhang, Qinhan Yu, et al.*2024 · 301 citations*](https://md.research.elamur.ai/free/en/papers/zhao-2024-retrieval-augmented-generation-ai-generated/)
59. [**Challenges and Applications of Large Language Models arXiv:2307.10169**Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.*2023 · 301 citations*](https://md.research.elamur.ai/free/en/papers/kaddour-2023-challenges-applications-large-language-models/)
60. **[Entity-Based Knowledge Conflicts in Question Answering](https://md.research.elamur.ai/free/en/papers/longpre-2021-entity-based-knowledge-conflicts-question/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Shayne Longpre, Kartik Perisetla, Anthony Chen, et al.*2021 · 298 citations*
61. **[PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them](https://md.research.elamur.ai/free/en/papers/lewis-2021-paq-65-million-probably-asked/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Patrick Lewis, Yuxiang Wu, Linqing Liu, et al.*2021 · 288 citations*
62. [**DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines arXiv:2310.03714**Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, et al.*2023 · 285 citations*](https://md.research.elamur.ai/free/en/papers/khattab-2023-dspy-compiling-declarative-language-model/)
63. [**Ragas: Automated Evaluation of Retrieval Augmented Generation arXiv:2309.15217**Shahul Es, Jithin James, Luis Espinosa-Anke, et al.*2023 · 283 citations*](https://md.research.elamur.ai/free/en/papers/es-2023-ragas-automated-evaluation-retrieval-augmented/)
64. [**Corrective Retrieval Augmented Generation arXiv:2401.15884**Shi-Qi Yan, Jia-Chen Gu, Yun Zhu, et al.*2024 · 273 citations*](https://md.research.elamur.ai/free/en/papers/yan-2024-corrective-retrieval-augmented-generation/)
65. [**Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools arXiv:2405.20362**Varun Magesh, Faiz Surani, Matthew Dahl, et al.*2024 · 271 citations*](https://md.research.elamur.ai/free/en/papers/magesh-2024-hallucination-free-assessing-reliability-leading/)
66. [**LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models arXiv:2309.12307**Yukang Chen, Shengju Qian, Haotian Tang, et al.*2023 · 268 citations*](https://md.research.elamur.ai/free/en/papers/chen-2023-longlora-efficient-fine-tuning-long/)
67. **[Condenser: a Pre-training Architecture for Dense Retrieval](https://md.research.elamur.ai/free/en/papers/gao-2021-condenser-pre-training-architecture-dense/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Luyu Gao, Jamie Callan*2021 · 261 citations*
68. [**Multimodal Few-Shot Learning with Frozen Language Models arXiv:2106.13884**Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, et al.*2021 · 258 citations*](https://md.research.elamur.ai/free/en/papers/tsimpoukelli-2021-multimodal-few-shot-learning-frozen/)
69. **[RocketQAv2: A Joint Training Method for Dense Passage Retrieval and Passage Re-ranking](https://md.research.elamur.ai/free/en/papers/ren-2021-rocketqav2-joint-training-method-dense/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ruiyang Ren, Yingqi Qu, Jing Liu, et al.*2021 · 256 citations*
70. **[LeanDojo: Theorem Proving with Retrieval-Augmented Language Models](https://md.research.elamur.ai/free/en/papers/yang-2023-leandojo-theorem-proving-retrieval-augmented/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Kaiyu Yang, Aidan M. Swope, Alex Gu, et al.*2023 · 253 citations*
71. **[Knowledge Graph Based Synthetic Corpus Generation for Knowledge-Enhanced Language Model Pre-training](https://md.research.elamur.ai/free/en/papers/agarwal-2021-knowledge-graph-based-synthetic-corpus/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Oshin Agarwal, Heming Ge, Siamak Shakeri, et al.*2021 · 239 citations*
72. [**TrustLLM: Trustworthiness in Large Language Models arXiv:2401.05561**Yue Huang, Lichao Sun, Haoran Wang, et al.*2024 · 237 citations*](https://md.research.elamur.ai/free/en/papers/huang-2024-trustllm-trustworthiness-large-language-models/)
73. [**How Context Affects Language Models' Factual Predictions arXiv:2005.04611**Fabio Petroni, Patrick Lewis, Aleksandra Piktus, et al.*2020 · 234 citations*](https://md.research.elamur.ai/free/en/papers/petroni-2020-context-affects-language-models-factual/)
74. **[Hurdles to Progress in Long-form Question Answering](https://md.research.elamur.ai/free/en/papers/krishna-2021-hurdles-progress-long-form-question/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Kalpesh Krishna, Aurko Roy, Mohit Iyyer*2021 · 233 citations*
75. **[GeneGPT: Augmenting Large Language Models with Domain Tools for Improved Access to Biomedical Information](https://md.research.elamur.ai/free/en/papers/jin-2023-genegpt-augmenting-large-language-models/) [Bioinformatics](https://md.research.elamur.ai/free/en/venues/bioinformatics/)**Qiao Jin, Yifan Yang, Qingyu Chen, et al.*2023 · 223 citations*
76. [**Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment arXiv:2308.05374**Yang Liu; Yuanshun Yao; Jean-Francois Ton; Xiaoying Zhang; Ruocheng Guo; Hao Cheng; Yegor Klochkov; Muhammad Faaiz Taufiq;, Hang Li*2023 · 223 citations*](https://md.research.elamur.ai/free/en/papers/liu-2023-trustworthy-llms-survey-guideline-evaluating/)
77. **[Transformer Memory as a Differentiable Search Index](https://md.research.elamur.ai/free/en/papers/tay-2022-transformer-memory-differentiable-search-index/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Yi Tay, Vinh Q. Tran, Mostafa Dehghani, et al.*2022 · 223 citations*
78. [**NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models arXiv:2405.17428**Chankyu Lee, Rajarshi Roy, Mengyao Xu, et al.*2024 · 222 citations*](https://md.research.elamur.ai/free/en/papers/lee-2024-nv-embed-improved-techniques-training/)
79. [**Teaching language models to support answers with verified quotes arXiv:2203.11147**Jacob Menick, Maja Trebacz, Vladimir Mikulik, et al.*2022 · 218 citations*](https://md.research.elamur.ai/free/en/papers/menick-2022-teaching-language-models-support-answers/)
80. [**Prompting GPT-3 To Be Reliable arXiv:2210.09150**Chenglei Si, Zhe Gan, Zhengyuan Yang, et al.*2022 · 210 citations*](https://md.research.elamur.ai/free/en/papers/si-2022-prompting-gpt-3-reliable/)
81. [**Internet-augmented language models through few-shot prompting for open-domain question answering arXiv:2203.05115**Angeliki Lazaridou, Elena Gribovskaya, Wojciech Stokowiec, et al.*2022 · 209 citations*](https://md.research.elamur.ai/free/en/papers/lazaridou-2022-internet-augmented-language-models-through/)
82. **[Entities as Experts: Sparse Memory Access with Entity Supervision](https://md.research.elamur.ai/free/en/papers/fevry-2020-entities-as-experts-sparse-memory/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Thibault Févry, Livio Baldini Soares, Nicholas FitzGerald, et al.*2020 · 208 citations*
83. **[MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text](https://md.research.elamur.ai/free/en/papers/chen-2022-murag-multimodal-retrieval-augmented-generator/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Wenhu Chen, Hexiang Hu, Xi Chen, et al.*2022 · 199 citations*
84. [**COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining arXiv:2102.08473**Yu Meng, Chenyan Xiong, Payal Bajaj, et al.*2021 · 198 citations*](https://md.research.elamur.ai/free/en/papers/meng-2021-coco-lm-correcting-contrasting-text/)
85. [**Making Retrieval-Augmented Language Models Robust to Irrelevant Context arXiv:2310.01558**Ori Yoran, Tomer Wolfson, Ori Ram, et al.*2023 · 195 citations*](https://md.research.elamur.ai/free/en/papers/yoran-2023-making-retrieval-augmented-language-models/)
86. [**RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrieval arXiv:2401.18059**Parth Sarthi, Salman Abdullah, Aditi Tuli, et al.*2024 · 193 citations*](https://md.research.elamur.ai/free/en/papers/sarthi-2024-raptor-recursive-abstractive-processing-tree/)
87. **[Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language Models](https://md.research.elamur.ai/free/en/papers/tirumala-2022-memorization-overfitting-analyzing-training-dynamics/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Kushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, et al.*2022 · 190 citations*
88. [**Pre-training via Paraphrasing arXiv:2006.15020**Mike Lewis, Marjan Ghazvininejad, Gargi Ghosh, et al.*2020 · 187 citations*](https://md.research.elamur.ai/free/en/papers/lewis-2020-pre-training-paraphrasing/)
89. **[Re2G: Retrieve, Rerank, Generate](https://md.research.elamur.ai/free/en/papers/glass-2022-re2g-retrieve-rerank-generate/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Michael Glass, Gaetano Rossiello, Md Faisal Mahbub Chowdhury, et al.*2022 · 184 citations*
90. **[Knowledge Conflicts for LLMs: A Survey](https://md.research.elamur.ai/free/en/papers/xu-2024-knowledge-conflicts-llms-survey/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Rongwu Xu, Zehan Qi, Zhijiang Guo, et al.*2024 · 182 citations*
91. **[Adapting Language Models to Compress Contexts](https://md.research.elamur.ai/free/en/papers/chevalier-2023-adapting-language-models-compress-contexts/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Alexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.*2023 · 182 citations*
92. [**Open Question Answering over Tables and Text arXiv:2010.10439**Wenhu Chen, Ming-Wei Chang, Eva Schlinger, et al.*2020 · 182 citations*](https://md.research.elamur.ai/free/en/papers/chen-2020-open-question-answering-over-tables/)
93. **[RealTime QA: What's the Answer Right Now?](https://md.research.elamur.ai/free/en/papers/kasai-2022-realtime-qa-s-answer-right/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Jungo Kasai, Keisuke Sakaguchi, Yoichi Takahashi, et al.*2022 · 181 citations*
94. **[Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models](https://md.research.elamur.ai/free/en/papers/kassner-2021-multilingual-lama-investigating-knowledge-multilingual/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Nora Kassner, Philipp Dufter, Hinrich Schütze*2021 · 180 citations*
95. **[Planning with Learned Entity Prompts for Abstractive Summarization](https://md.research.elamur.ai/free/en/papers/narayan-2021-planning-learned-entity-prompts-abstractive/) [Transactions of the Association for Computational Linguistics (TACL)](https://md.research.elamur.ai/free/en/venues/tacl/)**Shashi Narayan, Yao Zhao, Joshua Maynez, et al.*2021 · 180 citations*
96. **[On the Risk of Misinformation Pollution with Large Language Models](https://md.research.elamur.ai/free/en/papers/pan-2023-risk-misinformation-pollution-large-language/) [Findings of the Association for Computational Linguistics](https://md.research.elamur.ai/free/en/venues/findings/)**Yikang Pan, Liangming Pan, Wenhu Chen, et al.*2023 · 179 citations*
97. [**Generative Representational Instruction Tuning arXiv:2402.09906**Niklas Muennighoff, Hongjin Su, Liang Wang, et al.*2024 · 172 citations*](https://md.research.elamur.ai/free/en/papers/muennighoff-2024-generative-representational-instruction-tuning/)
98. **[Simple Entity-Centric Questions Challenge Dense Retrievers](https://md.research.elamur.ai/free/en/papers/sciavolino-2021-simple-entity-centric-questions-challenge/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Christopher Sciavolino, Zexuan Zhong, Jinhyuk Lee, et al.*2021 · 169 citations*
99. [**Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts arXiv:2305.13300**Jian Xie, Kai Zhang, Jiangjie Chen, et al.*2023 · 168 citations*](https://md.research.elamur.ai/free/en/papers/xie-2023-adaptive-chameleon-stubborn-sloth-revealing/)
100. **[Factuality Enhanced Language Models for Open-Ended Text Generation](https://md.research.elamur.ai/free/en/papers/lee-2022-factuality-enhanced-language-models-open/) [Conference on Neural Information Processing Systems (NeurIPS)](https://md.research.elamur.ai/free/en/venues/neural-information-processing-systems/)**Nayeon Lee, Wei Ping, Peng Xu, et al.*2022 · 168 citations*

**1** [2](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/cited-by/page/2/) [3](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/cited-by/page/3/) [next →](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/cited-by/page/2/)

- [← back to](https://md.research.elamur.ai/free/en/papers/guu-2020-realm-retrieval-augmented-language-model/) — REALM: Retrieval-Augmented Language Model Pre-Training
