---
title: "Learning to Filter Context for Retrieval-Augmented Generation"
description: "The authors propose FILCO, which cuts retrieved passages down to the sentences that… 2.8 points. 42 references, cited by 80 papers here."
authors: ["Zhiruo Wang", "Jun Araki", "Zhengbao Jiang", "Md Rizwan Parvez", "Graham Neubig"]
year: 2023
venue: "arXiv:2311.08377"
source: "https://arxiv.org/abs/2311.08377"
doi: "10.48550/arxiv.2311.08377"
arxiv: "2311.08377"
licence: "CC BY-SA 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by-sa/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wang-2023-learning-filter-context-retrieval-augmented/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wang-2023-learning-filter-context-retrieval-augmented/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/page/6/) / Learning to Filter Context for Retrieval-Augmented Generation

# Learning to Filter Context for Retrieval-Augmented Generation

**Authors:** [Zhiruo Wang](https://md.research.elamur.ai/free/en/authors/zhiruo-wang/), [Jun Araki](https://md.research.elamur.ai/free/en/authors/jun-araki/), [Zhengbao Jiang](https://md.research.elamur.ai/free/en/authors/zhengbao-jiang/), [Md Rizwan Parvez](https://md.research.elamur.ai/free/en/authors/md-rizwan-parvez/) and [Graham Neubig](https://md.research.elamur.ai/free/en/authors/graham-neubig/) · **Year:** 2023 · **Venue:** arXiv:2311.08377 · **Licence:** [CC BY-SA 4.0 (arXiv)](http://creativecommons.org/licenses/by-sa/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2311.08377) · [PDF](https://arxiv.org/pdf/2311.08377) · [DOI 10.48550/arxiv.2311.08377](https://doi.org/10.48550/arxiv.2311.08377) · [arXiv 2311.08377](https://arxiv.org/abs/2311.08377) · [OpenAlex](https://openalex.org/W4388717437)

**Citations:** 8 citations (OpenAlex, 2026-10-14) · [80](https://md.research.elamur.ai/free/en/papers/wang-2023-learning-filter-context-retrieval-augmented/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
Retrieval-augmented generators usually receive the top retrieved passages wholesale. Retrievers are imperfect, so this input often includes irrelevant or distracting sentences, even inside passages that do contain the answer. The result can be hallucination or copying from the wrong text. The authors propose FILCO, which cuts retrieved passages down to the sentences that actually help.

During training, a "silver" sentence is chosen with one of three criteria:
- **StrInc:** whether the sentence contains the output string.
- **Lexical:** unigram F1 overlap with the output, or with the query for fact verification.
- **CXMI:** how much the sentence raises the generator's probability of producing the correct output.

A filter model learns to predict this sentence from the query and passages. A generator is then trained on the filtered context. At test time, the filter's prediction replaces the full context.

Experiments with FLAN-T5 and LLAMA 2 covered six Wikipedia-based datasets spanning QA, fact verification and dialog. FILCO beat both full-context and passage-level filtering on all six while making prompts substantially shorter. This suggests that sentence-level filtering is a cheap, effective way to improve the faithfulness and efficiency of RAG.

## Key points
- **Datasets:** NaturalQuestions (NQ), TriviaQA (TQA), HotpotQA, ELI5, FEVER and Wizard of Wikipedia (WoW). Passages were split into sentences with the spaCy tokenizer.
- **Average gains:** about 2.8 points with FLAN-T5 and 3.0 points with LLAMA 2. Prompt length dropped by roughly 44–64%.
- **Best filter per task:** StrInc worked best for extractive QA, Lexical for dialog generation, and CXMI for multi-hop, long-form QA and fact verification.
- **Top-5 multi-passage setting:** FILCO outperformed full-context and passage-filtering baselines by 1.2–14.2 points across all tasks.
- **Compute:** generating from filtered content needs at least 4.7× less computation in training and inference. Code is released at github.com/zorazrw/filco.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (6): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 1,282 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 523 works

🧭 Topics (1): [🔍 Information retrieval & search](https://md.research.elamur.ai/free/en/topics/information-retrieval/) · 145 works

## Cite

Cite as: Zhiruo Wang, Jun Araki, Zhengbao Jiang, Md Rizwan Parvez and Graham Neubig. 2023. Learning to Filter Context for Retrieval-Augmented Generation. arXiv:2311.08377.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{wang2023learning,
  title = {{Learning to Filter Context for Retrieval-Augmented Generation}},
  author = {Zhiruo Wang, Jun Araki, Zhengbao Jiang, Md Rizwan Parvez and Graham Neubig},
  year = {2023},
  doi = {10.48550/arxiv.2311.08377},
  eprint = {2311.08377},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2311.08377}
}
```

- [← previous A Long Way to Go: Investigating Length Correlations in RLHF](https://md.research.elamur.ai/free/en/papers/singhal-2023-long-way-go-investigating-length/)
- [next → NLPositionality: Characterizing Design Biases of Datasets and Models](https://md.research.elamur.ai/free/en/papers/santy-2023-nlpositionality-characterizing-design-biases-datasets/)
- [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/page/6/)

## References

42 references, 27 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Uri Alon, Frank F. Xu, Junxian He, Sudipta Sengupta, Dan Roth, and Graham Neubig. 2022. Neuro-symbolic language modeling with automaton-augmented retrieval. In ICML 2022 Workshop on Knowledge Retrieval and Language Models. [find](https://scholar.google.com/scholar?q=Uri+Alon%2C+Frank+F%2E+Xu%2C+Junxian+He%2C+Sudipta+Sengupta%2C+Dan+Roth%2C+and+Graham+Neubig%2E+2022%2E+Neuro%2Dsymbolic+language+modeling+with+automaton%2Daugmented+retrieval%2E+In+ICML+2022+Workshop+on+Knowledge+Retrieva)
2. Akari Asai, Matt Gardner, and Hannaneh Hajishirzi. 2022. [Evidentiality-guided generation for knowledge-intensive NLP tasks](https://md.research.elamur.ai/free/en/papers/asai-2022-evidentiality-guided-generation-knowledge-intensive/). In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 2226–2243, Seattle, Uni…
3. Eunsol Choi, Jennimaria Palomaki, Matthew Lamm, Tom Kwiatkowski, Dipanjan Das, and Michael Collins. 2021. [Decontextualization: Making sentences stand-alone](https://md.research.elamur.ai/free/en/papers/choi-2021-decontextualization-making-sentences-stand-alone/). Transactions of the Association for Computational Linguistics, 9:447–461.
4. [Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, Dasha Valter, Sharan…](https://md.research.elamur.ai/free/en/papers/chung-2022-scaling-instruction-finetuned-language-models/)
5. Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli, and Jason Weston. 2019. Wizard of Wikipedia: Knowledge-powered conversational agents. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Emily+Dinan%2C+Stephen+Roller%2C+Kurt+Shuster%2C+Angela+Fan%2C+Michael+Auli%2C+and+Jason+Weston%2E+2019%2E+Wizard+of+Wikipedia%3A+Knowledge%2Dpowered+conversational+agents%2E+In+International+Conference+on+Learning+Repre)
6. Zi-Yi Dou, Pengfei Liu, Hiroaki Hayashi, Zhengbao Jiang, and Graham Neubig. 2021. [GSum: A general framework for guided neural abstractive summarization](https://md.research.elamur.ai/free/en/papers/dou-2021-gsum-general-framework-guided-neural/). In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,…
7. Angela Fan, Yacine Jernite, Ethan Perez, David Grangier, Jason Weston, and Michael Auli. 2019. [ELI5: Long form question answering](https://md.research.elamur.ai/free/en/papers/fan-2019-eli5-long-form-question-answering/). In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3558–3567, Florence, Italy. Association for Computational Linguistics.
8. Yair Feldman and Ran El-Yaniv. 2019. Multi-hop paragraph retrieval for [open-domain question answering](https://md.research.elamur.ai/free/en/papers/chen-2020-open-domain-question-answering/). In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 2296– 2309, Florence, Italy. Association for Computational Linguistics.
9. Patrick Fernandes, Kayo Yin, Graham Neubig, and André F. T. Martins. 2021. Measuring and increasing context usage in context-aware machine translation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural La… [find](https://scholar.google.com/scholar?q=Patrick+Fernandes%2C+Kayo+Yin%2C+Graham+Neubig%2C+and+Andr%C3%A9+F%2E+T%2E+Martins%2E+2021%2E+Measuring+and+increasing+context+usage+in+context%2Daware+machine+translation%2E+In+Proceedings+of+the+59th+Annual+Meeting+of+the)
10. Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Ming-Wei Chang. 2020. REALM: Retrieval-augmented language model pre-training. In International Conference on Machine Learning. JMLR.org. [find](https://scholar.google.com/scholar?q=Kelvin+Guu%2C+Kenton+Lee%2C+Zora+Tung%2C+Panupong+Pasupat%2C+and+Ming%2DWei+Chang%2E+2020%2E+REALM%3A+Retrieval%2Daugmented+language+model+pre%2Dtraining%2E+In+International+Conference+on+Machine+Learning%2E+JMLR%2Eorg%2E)
11. Edward J Hu, yelong shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022. [LoRA: Low-rank adaptation of large language models](https://md.research.elamur.ai/free/en/papers/hu-2021-lora-low-rank-adaptation-large/). In International Conference on Learning Representations.
12. Gautier Izacard and Edouard Grave. 2021. [Leveraging passage retrieval with generative models for open domain question answering](https://md.research.elamur.ai/free/en/papers/izacard-2021-leveraging-passage-retrieval-generative-models/). In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 874–880, Online. Association for Computa…
13. Zhengbao Jiang, Frank F. Xu, Luyu Gao, Zhiqing Sun, Qian Liu, Jane Dwivedi-Yu, Yiming Yang, Jamie Callan, and Graham Neubig. 2023. Active retrieval augmented generation. arXiv preprint arXiv:2305.06983. [find](https://scholar.google.com/scholar?q=Zhengbao+Jiang%2C+Frank+F%2E+Xu%2C+Luyu+Gao%2C+Zhiqing+Sun%2C+Qian+Liu%2C+Jane+Dwivedi%2DYu%2C+Yiming+Yang%2C+Jamie+Callan%2C+and+Graham+Neubig%2E+2023%2E+Active+retrieval+augmented+generation%2E+arXiv+preprint+arXiv%3A2305%2E0698)
14. Mandar Joshi, Eunsol Choi, Daniel Weld, and Luke Zettlemoyer. 2017. [TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension](https://md.research.elamur.ai/free/en/papers/joshi-2017-triviaqa-large-scale-distantly-supervised/). In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1601–1611, Vancouver…
15. Ehsan Kamalloo, Nouha Dziri, Charles LA Clarke, and Davood Rafiei. 2023. [Evaluating open-domain question answering in the era of large language models](https://md.research.elamur.ai/free/en/papers/kamalloo-2023-evaluating-open-domain-question-answering/). arXiv preprint arXiv:2305.06984.
16. Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020. [Dense passage retrieval for open-domain question answering](https://md.research.elamur.ai/free/en/papers/karpukhin-2020-dense-passage-retrieval-open-domain/). In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6769–6781, Onli…
17. Urvashi Khandelwal, Angela Fan, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. 2021. Nearest neighbor machine translation. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Urvashi+Khandelwal%2C+Angela+Fan%2C+Dan+Jurafsky%2C+Luke+Zettlemoyer%2C+and+Mike+Lewis%2E+2021%2E+Nearest+neighbor+machine+translation%2E+In+International+Conference+on+Learning+Representations%2E)
18. Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. 2020. Generalization through memorization: Nearest neighbor language models. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Urvashi+Khandelwal%2C+Omer+Levy%2C+Dan+Jurafsky%2C+Luke+Zettlemoyer%2C+and+Mike+Lewis%2E+2020%2E+Generalization+through+memorization%3A+Nearest+neighbor+language+models%2E+In+International+Conference+on+Learning+Repr)
19. Tomáš Kočiský, Jonathan Schwarz, Phil Blunsom, Chris Dyer, Karl Moritz Hermann, Gábor Melis, and Edward Grefenstette. 2018. [The NarrativeQA reading comprehension challenge](https://md.research.elamur.ai/free/en/papers/kocisky-2018-narrativeqa-reading-comprehension-challenge/). Transactions of the Association for Computational Linguistics, 6:317–328.
20. Mojtaba Komeili, Kurt Shuster, and Jason Weston. 2022. [Internet-augmented dialogue generation](https://md.research.elamur.ai/free/en/papers/komeili-2022-internet-augmented-dialogue-generation/). In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 8460–8478, Dublin, Ireland. Association for Computational Linguistics.
21. Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019. [Natural…](https://md.research.elamur.ai/free/en/papers/kwiatkowski-2019-natural-questions-benchmark-question-answering/)
22. Jinhyuk Lee, Alexander Wettig, and Danqi Chen. 2021. Phrase retrieval learns passage retrieval, too. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 3661– 3672, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jinhyuk+Lee%2C+Alexander+Wettig%2C+and+Danqi+Chen%2E+2021%2E+Phrase+retrieval+learns+passage+retrieval%2C+too%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+36)
23. Kenton Lee, Ming-Wei Chang, and Kristina Toutanova. 2019. [Latent retrieval for weakly supervised open domain question answering](https://md.research.elamur.ai/free/en/papers/lee-2019-latent-retrieval-weakly-supervised-open/). In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 6086–6096, Florence, Italy. Association for Computational Linguistics.
24. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020. Retrieval-Augmented Generation for knowledge-intensive NLP tasks. In Advances in Neural Information Proc… [find](https://scholar.google.com/scholar?q=Patrick+Lewis%2C+Ethan+Perez%2C+Aleksandra+Piktus%2C+Fabio+Petroni%2C+Vladimir+Karpukhin%2C+Naman+Goyal%2C+Heinrich+K%C3%BCttler%2C+Mike+Lewis%2C+Wen%2Dtau+Yih%2C+Tim+Rockt%C3%A4schel%2C+Sebastian+Riedel%2C+and+Douwe+Kiela%2E+2020%2E+Retr)
25. Alex Mallen, Akari Asai, Victor Zhong, Rajarshi Das, Daniel Khashabi, and Hannaneh Hajishirzi. 2023. When not to trust language models: Investigating effectiveness of parametric and non-parametric memories. arXiv preprint arXiv:2212.10511. [find](https://scholar.google.com/scholar?q=Alex+Mallen%2C+Akari+Asai%2C+Victor+Zhong%2C+Rajarshi+Das%2C+Daniel+Khashabi%2C+and+Hannaneh+Hajishirzi%2E+2023%2E+When+not+to+trust+language+models%3A+Investigating+effectiveness+of+parametric+and+non%2Dparametric+mem)
26. Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, and Weizhu Chen. 2021. Reader-guided passage reranking for [open-domain question answering](https://md.research.elamur.ai/free/en/papers/chen-2020-open-domain-question-answering/). In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 344–350, Online. Association for Computationa…
27. Grégoire Mialon, Roberto Dessì, Maria Lomeli, Christoforos Nalmpantis, Ram Pasunuru, Roberta Raileanu, Baptiste Rozière, Timo Schick, Jane Dwivedi-Yu, Asli Celikyilmaz, Edouard Grave, Yann LeCun, and Thomas Scialom. 2023. [Augmented language models: a survey](https://md.research.elamur.ai/free/en/papers/mialon-2023-augmented-language-models-survey/). arXiv preprint arXiv:2302.07842.
28. Anastasios Nentidis, Anastasia Krithara, Georgios Paliouras, Eulàlia Farré-Maduell, Salvador Lima-López, and Martin Krallinger. 2023. Bioasq at clef2023: The eleventh edition of the large-scale biomedical semantic indexing and question answering challenge. In Advances in Information Retrieval. [find](https://scholar.google.com/scholar?q=Anastasios+Nentidis%2C+Anastasia+Krithara%2C+Georgios+Paliouras%2C+Eul%C3%A0lia+Farr%C3%A9%2DMaduell%2C+Salvador+Lima%2DL%C3%B3pez%2C+and+Martin+Krallinger%2E+2023%2E+Bioasq+at+clef2023%3A+The+eleventh+edition+of+the+large%2Dscale+biomed)
29. Rodrigo Nogueira and Kyunghyun Cho. 2020. [Passage re-ranking with bert](https://md.research.elamur.ai/free/en/papers/nogueira-2019-passage-re-ranking-bert/). arXiv preprint arXiv:1901.04085.
30. Fabio Petroni, Aleksandra Piktus, Angela Fan, Patrick Lewis, Majid Yazdani, Nicola De Cao, James Thorne, Yacine Jernite, Vladimir Karpukhin, Jean Maillard, Vassilis Plachouras, Tim Rocktäschel, and Sebastian Riedel. 2021. [KILT: a benchmark for knowledge intensive language tasks](https://md.research.elamur.ai/free/en/papers/petroni-2020-kilt-benchmark-knowledge-intensive-language/). In Proceedings of th…
31. Hemant Pugaliya, James Route, Kaixin Ma, Yixuan Geng, and Eric Nyberg. 2019. Bend but don’t break? multi-challenge stress test for QA models. In Proceedings of the 2nd Workshop on Machine Reading for Question Answering, pages 125–136, Hong Kong, China. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Hemant+Pugaliya%2C+James+Route%2C+Kaixin+Ma%2C+Yixuan+Geng%2C+and+Eric+Nyberg%2E+2019%2E+Bend+but+don%E2%80%99t+break%3F+multi%2Dchallenge+stress+test+for+QA+models%2E+In+Proceedings+of+the+2nd+Workshop+on+Machine+Reading+for+)
32. Freda Shi, Xinyun Chen, Kanishka Misra, Nathan Scales, David Dohan, Ed Chi, Nathanael Schärli, and Denny Zhou. 2023. [Large language models can be easily distracted by irrelevant context](https://md.research.elamur.ai/free/en/papers/shi-2023-large-language-models-easily-distracted/). arXiv preprint arXiv:2302.00093.
33. Kurt Shuster, Spencer Poff, Moya Chen, Douwe Kiela, and Jason Weston. 2021. [Retrieval augmentation reduces hallucination in conversation](https://md.research.elamur.ai/free/en/papers/shuster-2021-retrieval-augmentation-reduces-hallucination-conversation/). In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 3784–3803, Punta Cana, Dominican Republic. Association for Computational Linguisti…
34. James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018. [FEVER: a large-scale dataset for fact extraction and VERification](https://md.research.elamur.ai/free/en/papers/thorne-2018-fever-large-scale-dataset-fact/). In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vo…
35. Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288. [find](https://scholar.google.com/scholar?q=Hugo+Touvron%2C+Louis+Martin%2C+Kevin+Stone%2C+Peter+Albert%2C+Amjad+Almahairi%2C+Yasmine+Babaei%2C+Nikolay+Bashlykov%2C+Soumya+Batra%2C+Prajjwal+Bhargava%2C+Shruti+Bhosale%2C+et+al%2E+2023%2E+Llama+2%3A+Open+foundation+and+fi)
36. Adam Trischler, Tong Wang, Xingdi Yuan, Justin Harris, Alessandro Sordoni, Philip Bachman, and Kaheer Suleman. 2017. [NewsQA: A machine comprehension dataset](https://md.research.elamur.ai/free/en/papers/trischler-2017-newsqa-machine-comprehension-dataset/). In Proceedings of the 2nd Workshop on Representation Learning for NLP, pages 191–200, Vancouver, Canada. Association for Computational Linguis…
37. Shuohang Wang, Mo Yu, Xiaoxiao Guo, Zhiguo Wang, Tim Klinger, Wei Zhang, Shiyu Chang, Gerry Tesauro, Bowen Zhou, and Jing Jiang. 2018. R3: Reinforced ranker-reader for open-domain question answering. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 32. [find](https://scholar.google.com/scholar?q=Shuohang+Wang%2C+Mo+Yu%2C+Xiaoxiao+Guo%2C+Zhiguo+Wang%2C+Tim+Klinger%2C+Wei+Zhang%2C+Shiyu+Chang%2C+Gerry+Tesauro%2C+Bowen+Zhou%2C+and+Jing+Jiang%2E+2018%2E+R3%3A+Reinforced+ranker%2Dreader+for+open%2Ddomain+question+answering%2E+)
38. Zhiguo Wang, Patrick Ng, Xiaofei Ma, Ramesh Nallapati, and Bing Xiang. 2019. [Multi-passage BERT: A globally normalized BERT model for open-domain question answering](https://md.research.elamur.ai/free/en/papers/wang-2019-multi-passage-bert-globally-normalized/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference o…
39. [Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pier-ric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lho…](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/)
40. Ying Xu, Dakuo Wang, Mo Yu, Daniel Ritchie, Bingsheng Yao, Tongshuang Wu, Zheng Zhang, Toby Li, Nora Bradford, Branda Sun, Tran Hoang, Yisi Sang, Yufang Hou, Xiaojuan Ma, Diyi Yang, Nanyun Peng, Zhou Yu, and Mark Warschauer. 2022. [Fantastic questions and where to find them: FairytaleQA – an authenti…](https://md.research.elamur.ai/free/en/papers/xu-2022-fantastic-questions-where-find-them/)
41. Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, and Christopher D. Manning. 2018. [HotpotQA: A dataset for diverse, explainable multi-hop question answering](https://md.research.elamur.ai/free/en/papers/yang-2018-hotpotqa-dataset-diverse-explainable-multi/). In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2369…
42. Lei Yu, Karl Moritz Hermann, Phil Blunsom, and Stephen Pulman. 2014. Deep learning for answer sentence selection. arXiv preprint arXiv:1412.1632. [find](https://scholar.google.com/scholar?q=Lei+Yu%2C+Karl+Moritz+Hermann%2C+Phil+Blunsom%2C+and+Stephen+Pulman%2E+2014%2E+Deep+learning+for+answer+sentence+selection%2E+arXiv+preprint+arXiv%3A1412%2E1632%2E)

*Updated 24 October 2026*