---
title: "KG-FiD — paper by Yu et al. (2022) — summary and ideas"
description: "The authors propose KG-FiD to address both. 1.5 EM. 33 references, cited by 58 papers here."
authors: ["Donghan Yu", "Chenguang Zhu", "Yuwei Fang", "Wenhao Yu", "Shuohang Wang", "Yichong Xu", "Xiang Ren", "Yiming Yang", "Michael Zeng"]
year: 2022
venue: "Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2022.acl-long.340/"
doi: "10.18653/v1/2022.acl-long.340"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/yu-2022-kg-fid-infusing-knowledge-graph/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/yu-2022-kg-fid-infusing-knowledge-graph/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2022](https://md.research.elamur.ai/free/en/papers/2022/page/3/) / KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

# KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering

**Authors:** Donghan Yu, [Chenguang Zhu](https://md.research.elamur.ai/free/en/authors/chenguang-zhu/), [Yuwei Fang](https://md.research.elamur.ai/free/en/authors/yuwei-fang/), [Wenhao Yu](https://md.research.elamur.ai/free/en/authors/wenhao-yu/), [Shuohang Wang](https://md.research.elamur.ai/free/en/authors/shuohang-wang/), [Yichong Xu](https://md.research.elamur.ai/free/en/authors/yichong-xu/), [Xiang Ren](https://md.research.elamur.ai/free/en/authors/xiang-ren/), [Yiming Yang](https://md.research.elamur.ai/free/en/authors/yiming-yang/) and [Michael Zeng](https://md.research.elamur.ai/free/en/authors/michael-zeng/) · **Year:** 2022 · **Venue:** [Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2022](https://md.research.elamur.ai/free/en/venues/acl/2022/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2022.acl-long.340/) · [PDF](https://aclanthology.org/2022.acl-long.340.pdf) · [DOI 10.18653/v1/2022.acl-long.340](https://doi.org/10.18653/v1/2022.acl-long.340) · [OpenAlex](https://openalex.org/W3207796810)

**Citations:** 57 citations (OpenAlex, 2026-10-14) · [58](https://md.research.elamur.ai/free/en/papers/yu-2022-kg-fid-infusing-knowledge-graph/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
The paper targets two weaknesses of Fusion-in-Decoder (FiD), a leading open-domain QA system that pairs a DPR retriever with a generative reader. First, FiD handles each retrieved passage in isolation and ignores how passages relate to one another. Second, it is expensive, because the reader processes about 100 passages for every question. The authors propose KG-FiD to address both. For each question, it builds a small graph over the retrieved passages: two passages are linked when the Wikipedia articles they come from map to Wikidata entities that share a direct relation. A graph neural network then re-ranks the passages in two stages:
- **Stage 1** uses DPR embeddings to filter a larger candidate pool.
- **Stage 2** uses intermediate-layer representations from the reader encoder and is trained jointly with answer generation.

Only the top passages continue through the upper encoder layers and the decoder. On Natural Questions and TriviaQA, KG-FiD matches FiD at under 40% of its compute, or beats it by up to about 1.5 EM at similar cost. This shows that structured knowledge can make retrieval-augmented QA both more accurate and cheaper.

## Key points
- **Data and graph construction:** English Wikipedia is split into 100-word passages and aligned with English Wikidata entities. The passage graph is built per question rather than over all 20M+ passages.
- **Large-model results:** FiD (N1=100) scores 51.9 EM on NQ and 68.7 on TriviaQA. KG-FiD with L1=24 reaches 53.4 and 69.8 at roughly 0.90x the FLOPs.
- **Efficiency:** With L1=6, KG-FiD scores 52.0 on NQ and 68.9 on TriviaQA at 0.38x the FLOPs. Latency on NQ drops from 1.65 s to 0.70 s per question. By contrast, simply feeding FiD 40 passages lowers NQ EM to 50.3.
- **Ablation:** Removing either re-ranking stage reduces EM. Stage 1 contributes more in the base model, while stage 2 contributes more in the large model.
- **Retrieval quality:** GNN re-ranking improves Hits@K over plain DPR on the NQ test set for K ∈ {10, 20, 50, 100}.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Carnegie Mellon University](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) — University, Pittsburgh, United States · 365 works · 158,048 citations
- [Microsoft](https://md.research.elamur.ai/free/en/companies/microsoft/) — Company, Redmond, United States · 240 works · 123,537 citations
- [University of Southern California](https://md.research.elamur.ai/free/en/universities/university-of-southern-california/) — University, Los Angeles, United States · 104 works · 33,876 citations
- [University of Notre Dame](https://md.research.elamur.ai/free/en/universities/university-of-notre-dame/) — University, Notre Dame, United States · 24 works · 36,415 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,085 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,888 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 1,282 works

🧭 Topics (2): [❓ Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/) · 243 works · [🕸️ Knowledge graphs & ontologies](https://md.research.elamur.ai/free/en/topics/knowledge-graphs/) · 103 works

## Cite

Cite as: Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang and Michael Zeng. 2022. KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{yu2022kg,
  title = {{KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering}},
  author = {Donghan Yu, Chenguang Zhu, Yuwei Fang, Wenhao Yu, Shuohang Wang, Yichong Xu, Xiang Ren, Yiming Yang and Michael Zeng},
  booktitle = {Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2022},
  doi = {10.18653/v1/2022.acl-long.340},
  url = {https://doi.org/10.18653/v1/2022.acl-long.340}
}
```

- [← previous Calibrating Factual Knowledge in Pretrained Language Models](https://md.research.elamur.ai/free/en/papers/dong-2022-calibrating-factual-knowledge-pretrained-language/)
- [next → Making Science Simple: Corpora for the Lay Summarisation of Scientific Literature](https://md.research.elamur.ai/free/en/papers/goldsack-2022-making-science-simple-corpora-lay/)
- [↑ back to papers of 2022](https://md.research.elamur.ai/free/en/papers/2022/page/3/)

## References

33 references, 22 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Akari Asai, Kazuma Hashimoto, Hannaneh Hajishirzi, Richard Socher, and Caiming Xiong. 2020. [Learning to retrieve reasoning paths over wikipedia graph for question answering](https://md.research.elamur.ai/free/en/papers/asai-2019-learning-retrieve-reasoning-paths-over/). In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.n…
2. Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013. [Semantic parsing on Freebase from question-answer pairs](https://md.research.elamur.ai/free/en/papers/berant-2013-semantic-parsing-freebase-question-answer/). In Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, pages 1533–1544, Seattle, Washington, USA. Association for Computational Linguistics.
3. Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter,… — [Language Models are Few-Shot Learners](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
4. Danqi Chen, Adam Fisch, Jason Weston, and Antoine Bordes. 2017. [Reading Wikipedia to answer open-domain questions](https://md.research.elamur.ai/free/en/papers/chen-2017-reading-wikipedia-answer-open-domain/). In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1870–1879, Vancouver, Canada. Association for Computational Lin…
5. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. [BERT: Pre-training of deep bidirectional transformers for language understanding](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/). In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,…
6. Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Ming-Wei Chang. 2020. Realm: Retrieval-augmented language model pre-training. arXiv preprint arXiv:2002.08909. [find](https://scholar.google.com/scholar?q=Kelvin+Guu%2C+Kenton+Lee%2C+Zora+Tung%2C+Panupong+Pasupat%2C+and+Ming%2DWei+Chang%2E+2020%2E+Realm%3A+Retrieval%2Daugmented+language+model+pre%2Dtraining%2E+arXiv+preprint+arXiv%3A2002%2E08909%2E)
7. Srinivasan Iyer, Sewon Min, Yashar Mehdad, and Wen-tau Yih. 2021. [RECONSIDER: Improved re-ranking using span-focused cross-attention for open domain question answering](https://md.research.elamur.ai/free/en/papers/chen-2020-open-domain-question-answering/). In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Languag…
8. Gautier Izacard and Edouard Grave. 2020. Distilling knowledge from reader to retriever for question answering. arXiv preprint arXiv:2012.04584. — [arXiv:2012.04584](https://arxiv.org/abs/2012.04584) [find](https://scholar.google.com/scholar?q=Gautier+Izacard+and+Edouard+Grave%2E+2020%2E+Distilling+knowledge+from+reader+to+retriever+for+question+answering%2E+arXiv+preprint+arXiv%3A2012%2E04584%2E+%E2%80%94+%5BarXiv%3A2012%2E04584%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2012%2E04584%29)
9. Gautier Izacard and Edouard Grave. 2021. [Leveraging passage retrieval with generative models for open domain question answering](https://md.research.elamur.ai/free/en/papers/izacard-2021-leveraging-passage-retrieval-generative-models/). In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 874–880, Online. Association for Computa…
10. Jeff Johnson, Matthijs Douze, and Hervé Jégou. 2019. [Billion-scale similarity search with gpus](https://md.research.elamur.ai/free/en/papers/johnson-2017-billion-scale-similarity-search-gpus/). IEEE Transactions on Big Data.
11. Mandar Joshi, Eunsol Choi, Daniel Weld, and Luke Zettlemoyer. 2017. [TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension](https://md.research.elamur.ai/free/en/papers/joshi-2017-triviaqa-large-scale-distantly-supervised/). In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1601–1611, Vancouver…
12. Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020. [Dense passage retrieval for open-domain question answering](https://md.research.elamur.ai/free/en/papers/karpukhin-2020-dense-passage-retrieval-open-domain/). In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6769–6781, Onli…
13. Thomas N. Kipf and Max Welling. 2017. [Semi-supervised classification with graph convolutional networks](https://md.research.elamur.ai/free/en/papers/kipf-2016-semi-supervised-classification-graph-convolutional/). In 5th International Conference on Learning Representations, ICLR 2017, Toulon, France, April 24-26, 2017, Conference Track Proceedings. OpenReview.net.
14. Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019. [Natural…](https://md.research.elamur.ai/free/en/papers/kwiatkowski-2019-natural-questions-benchmark-question-answering/)
15. Patrick S. H. Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020. Retrieval-augmented generation for knowledge-intensive NLP tasks. In Advances in Neural Informatio… [find](https://scholar.google.com/scholar?q=Patrick+S%2E+H%2E+Lewis%2C+Ethan+Perez%2C+Aleksandra+Piktus%2C+Fabio+Petroni%2C+Vladimir+Karpukhin%2C+Naman+Goyal%2C+Heinrich+K%C3%BCttler%2C+Mike+Lewis%2C+Wen%2Dtau+Yih%2C+Tim+Rockt%C3%A4schel%2C+Sebastian+Riedel%2C+and+Douwe+Kiela%2E+2020)
16. Ilya Loshchilov and Frank Hutter. 2019. Decoupled weight decay regularization. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net. [find](https://scholar.google.com/scholar?q=Ilya+Loshchilov+and+Frank+Hutter%2E+2019%2E+Decoupled+weight+decay+regularization%2E+In+7th+International+Conference+on+Learning+Representations%2C+ICLR+2019%2C+New+Orleans%2C+LA%2C+USA%2C+May+6%2D9%2C+2019%2E+OpenReview%2En)
17. Yuning Mao, Pengcheng He, Xiaodong Liu, Yelong Shen, Jianfeng Gao, Jiawei Han, and Weizhu Chen. 2021. Reader-guided passage reranking for [open-domain question answering](https://md.research.elamur.ai/free/en/papers/chen-2020-open-domain-question-answering/). In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 344–350, Online. Association for Computationa…
18. Sewon Min, Danqi Chen, Luke Zettlemoyer, and Hannaneh Hajishirzi. 2019. [Knowledge guided text retrieval and reading for open domain question answering](https://md.research.elamur.ai/free/en/papers/chen-2020-open-domain-question-answering/). arXiv preprint arXiv:1911.03868.
19. Rodrigo Nogueira and Kyunghyun Cho. 2019. [Passage re-ranking with bert](https://md.research.elamur.ai/free/en/papers/nogueira-2019-passage-re-ranking-bert/). arXiv preprint arXiv:1901.04085.
20. Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Schlichtkrull, Sonal Gupta, Yashar Mehdad, and Scott Yih. 2020. Unified [open-domain question answering](https://md.research.elamur.ai/free/en/papers/chen-2020-open-domain-question-answering/) with structured and unstructured knowledge. arXiv preprint arXiv:2012.14610.
21. Yingqi Qu, Yuchen Ding, Jing Liu, Kai Liu, Ruiyang Ren, Wayne Xin Zhao, Daxiang Dong, Hua Wu, and Haifeng Wang. 2021. [RocketQA: An optimized training approach to dense passage retrieval for open-domain question answering](https://md.research.elamur.ai/free/en/papers/qu-2021-rocketqa-optimized-training-approach-dense/). In Proceedings of the 2021 Conference of the North American Chapter of the Ass…
22. Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2019. [Exploring the limits of transfer learning with a unified text-to-text transformer](https://md.research.elamur.ai/free/en/papers/raffel-2019-exploring-limits-transfer-learning-unified/). arXiv preprint arXiv:1910.10683.
23. Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016. [SQuAD: 100,000+ questions for machine comprehension of text](https://md.research.elamur.ai/free/en/papers/rajpurkar-2016-squad-100-000-questions-machine/). In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 2383–2392, Austin, Texas. Association for Computational Linguistics.
24. Adam Roberts, Colin Raffel, and Noam Shazeer. 2020. How much knowledge can you pack into the parameters of a language model? In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 5418–5426, Online. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Adam+Roberts%2C+Colin+Raffel%2C+and+Noam+Shazeer%2E+2020%2E+How+much+knowledge+can+you+pack+into+the+parameters+of+a+language+model%3F+In+Proceedings+of+the+2020+Conference+on+Empirical+Methods+in+Natural+Langu)
25. Devendra Sachan, Mostofa Patwary, Mohammad Shoeybi, Neel Kant, Wei Ping, William L. Hamilton, and Bryan Catanzaro. 2021. [End-to-end training of neural retrievers for open-domain question answering](https://md.research.elamur.ai/free/en/papers/sachan-2021-end-end-training-neural-retrievers/). In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11t…
26. Haitian Sun, Tania Bedrax-Weiss, and William Cohen. 2019. PullNet: Open domain question answering with iterative retrieval on knowledge bases and text. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Lang… [find](https://scholar.google.com/scholar?q=Haitian+Sun%2C+Tania+Bedrax%2DWeiss%2C+and+William+Cohen%2E+2019%2E+PullNet%3A+Open+domain+question+answering+with+iterative+retrieval+on+knowledge+bases+and+text%2E+In+Proceedings+of+the+2019+Conference+on+Empiric)
27. Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Kathryn Mazaitis, Ruslan Salakhutdinov, and William Cohen. 2018. Open domain question answering using early fusion of knowledge bases and text. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 4231–4242, Brus… [find](https://scholar.google.com/scholar?q=Haitian+Sun%2C+Bhuwan+Dhingra%2C+Manzil+Zaheer%2C+Kathryn+Mazaitis%2C+Ruslan+Salakhutdinov%2C+and+William+Cohen%2E+2018%2E+Open+domain+question+answering+using+early+fusion+of+knowledge+bases+and+text%2E+In+Proceedin)
28. Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018. Graph attention networks. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net. [find](https://scholar.google.com/scholar?q=Petar+Velickovic%2C+Guillem+Cucurull%2C+Arantxa+Casanova%2C+Adriana+Romero%2C+Pietro+Li%C3%B2%2C+and+Yoshua+Bengio%2E+2018%2E+Graph+attention+networks%2E+In+6th+International+Conference+on+Learning+Representations%2C+ICLR+2)
29. Petar Velickovic, William Fedus, William L. Hamilton, Pietro Liò, Yoshua Bengio, and R. Devon Hjelm. 2019. Deep graph infomax. In 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA, May 6-9, 2019. OpenReview.net. [find](https://scholar.google.com/scholar?q=Petar+Velickovic%2C+William+Fedus%2C+William+L%2E+Hamilton%2C+Pietro+Li%C3%B2%2C+Yoshua+Bengio%2C+and+R%2E+Devon+Hjelm%2E+2019%2E+Deep+graph+infomax%2E+In+7th+International+Conference+on+Learning+Representations%2C+ICLR+2019%2C+N)
30. Denny Vrandečić and Markus Krötzsch. 2014. Wikidata: a free collaborative knowledgebase. Communications of the ACM, 57(10):78–85. [find](https://scholar.google.com/scholar?q=Denny+Vrandec%CC%8Cic%CC%81+and+Markus+Kr%C3%B6tzsch%2E+2014%2E+Wikidata%3A+a+free+collaborative+knowledgebase%2E+Communications+of+the+ACM%2C+57%2810%29%3A78%E2%80%9385%2E)
31. Shuohang Wang, Mo Yu, Xiaoxiao Guo, Zhiguo Wang, Tim Klinger, Wei Zhang, Shiyu Chang, Gerry Tesauro, Bowen Zhou, and Jing Jiang. 2018. R 3: Reinforced ranker-reader for open-domain question answering. In Thirty-Second AAAI Conference on Artificial Intelligence. [find](https://scholar.google.com/scholar?q=Shuohang+Wang%2C+Mo+Yu%2C+Xiaoxiao+Guo%2C+Zhiguo+Wang%2C+Tim+Klinger%2C+Wei+Zhang%2C+Shiyu+Chang%2C+Gerry+Tesauro%2C+Bowen+Zhou%2C+and+Jing+Jiang%2E+2018%2E+R+3%3A+Reinforced+ranker%2Dreader+for+open%2Ddomain+question+answering%2E)
32. Zhiguo Wang, Patrick Ng, Xiaofei Ma, Ramesh Nallapati, and Bing Xiang. 2019. [Multi-passage BERT: A globally normalized BERT model for open-domain question answering](https://md.research.elamur.ai/free/en/papers/wang-2019-multi-passage-bert-globally-normalized/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference o…
33. Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pier-ric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, et al. 2019. [Huggingface’s transformers: State-ofthe-art natural language processing](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/). arXiv preprint arXiv:1910.03771.

*Updated 24 October 2026*