---
title: "Complex Claim Verification with Evidence Retrieved in the Wild — paper by Chen et al. (2024)"
description: "Chen et al. build what they describe as the first realistic pipeline for verifying real political claims with raw… 56 references, cited by 63 papers here."
authors: ["Jifan Chen", "Grace Kim", "Aniruddh Sriram", "Greg Durrett", "Eunsol Choi"]
year: 2024
venue: "Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)"
source: "https://aclanthology.org/2024.naacl-long.196/"
doi: "10.18653/v1/2024.naacl-long.196"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/chen-2024-complex-claim-verification-evidence-retrieved/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/chen-2024-complex-claim-verification-evidence-retrieved/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/4/) / Complex Claim Verification with Evidence Retrieved in the Wild

# Complex Claim Verification with Evidence Retrieved in the Wild

**Authors:** [Jifan Chen](https://md.research.elamur.ai/free/en/authors/jifan-chen/), [Grace Kim](https://md.research.elamur.ai/free/en/authors/grace-kim/), Aniruddh Sriram, [Greg Durrett](https://md.research.elamur.ai/free/en/authors/greg-durrett/) and [Eunsol Choi](https://md.research.elamur.ai/free/en/authors/eunsol-choi/) · **Year:** 2024 · **Venue:** [Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/naacl/) ([NAACL 2024](https://md.research.elamur.ai/free/en/venues/naacl/2024/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2024.naacl-long.196/) · [PDF](https://aclanthology.org/2024.naacl-long.196.pdf) · [DOI 10.18653/v1/2024.naacl-long.196](https://doi.org/10.18653/v1/2024.naacl-long.196) · [OpenAlex](https://openalex.org/W4401042906)

**Citations:** 21 citations (OpenAlex, 2026-10-14) · [63](https://md.research.elamur.ai/free/en/papers/chen-2024-complex-claim-verification-evidence-retrieved/cited-by/) in our library, of the 141,840 papers whose bibliographies we read

## Summary
Automated fact-checking systems are usually tested under unrealistic retrieval conditions. Some get no evidence at all, some get evidence curated by human fact-checkers, and some search the open web, where they can pick up later articles that already debunk the claim. Chen et al. build what they describe as the first realistic pipeline for verifying real political claims with raw web evidence. Search is limited to pages published before the claim was made, and fact-checking websites are excluded. The pipeline has five stages:

1. Decompose the claim into yes/no subquestions using text-davinci-003.
2. Retrieve documents with Bing Search.
3. Narrow the results to the most relevant passages using BM25.
4. Generate summaries focused on the claim.
5. Classify veracity.

On the CLAIMDECOMP dataset, this time-restricted setting proved much harder than unrestricted retrieval. Even so, web evidence improved veracity prediction over using the claim alone, and decomposition beat searching with the raw claim. Human evaluation found the summaries mostly faithful and relevant, but they rarely covered every aspect of a claim. The authors conclude that finding sufficient evidence is the main bottleneck, which argues for human-in-the-loop tools that support fact-checkers.

## Key points
- **Data:** CLAIMDECOMP contains 1,200 complex real-world political claims, with veracity labels from professional fact-checkers.
- **Decomposition:** each claim becomes 10 yes/no subquestions, generated by few-shot prompting of text-davinci-003. In a pilot comparison, these were more diverse and comprehensive than questions from a fine-tuned T5-3b model.
- **Retrieval funnel:**
  - Bing returns 10 filtered documents per subquestion, about 45 documents (roughly 70k words) per claim.
  - Second-stage BM25 retrieval plus summarization cuts this to about 4 documents (around 250 words).
  - Roughly one-third of URLs could not be scraped because of paywalls, PDFs or anti-scraping measures.
- **Human evaluation:**
  - 36 of 50 claims had at least one unanswerable subquestion.
  - About 36% of subquestions overall were unanswerable.
  - Among the 14 claims that could be fully addressed, only 1 summary contained a major factual error.
- **Resources and scope:** code and data are released on GitHub (jifan-chen/Fact-checking-via-Raw-Evidence). The work covers English political claims only.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [The University of Texas at Austin](https://md.research.elamur.ai/free/en/universities/the-university-of-texas-at-austin/) — University, Austin, United States · 72 works · 55,722 citations

📚 Shelves (7): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works · [🤝 Social Sciences](https://md.research.elamur.ai/free/en/shelves/social-sciences/) · 744 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 523 works · [🤝 Sociology and Political Science](https://md.research.elamur.ai/free/en/shelves/social-sciences/sociology-and-political-science/) · 221 works

## Cite

Cite as: Jifan Chen, Grace Kim, Aniruddh Sriram, Greg Durrett and Eunsol Choi. 2024. Complex Claim Verification with Evidence Retrieved in the Wild. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{chen2024complex,
  title = {{Complex Claim Verification with Evidence Retrieved in the Wild}},
  author = {Jifan Chen, Grace Kim, Aniruddh Sriram, Greg Durrett and Eunsol Choi},
  booktitle = {Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)},
  year = {2024},
  doi = {10.18653/v1/2024.naacl-long.196},
  url = {https://doi.org/10.18653/v1/2024.naacl-long.196}
}
```

- [← previous When Is Multilinguality a Curse? Language Modeling for 250 High- and Low-Resource Languages](https://md.research.elamur.ai/free/en/papers/chang-2024-when-is-multilinguality-curse-language/)
- [next → Detoxifying Large Language Models via Knowledge Editing](https://md.research.elamur.ai/free/en/papers/wang-2024-detoxifying-large-language-models-knowledge/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/4/)

## References

56 references, 33 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Tariq Alhindi, Savvas Petridis, and Smaranda Muresan. 2018. Where is your evidence: Improving fact-checking by justification modeling. In Proceedings of the First Workshop on Fact Extraction and VERification (FEVER), pages 85–90, Brussels, Belgium. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/alhindi-2018-where-is-your-evidence-improving/)
2. Pepa Atanasova, Jakob Grue Simonsen, Christina Lioma, and Isabelle Augenstein. 2020. Generating fact checking explanations. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7352–7364, Online. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/atanasova-2020-generating-fact-checking-explanations/)
3. Isabelle Augenstein, Christina Lioma, Dongsheng Wang, Lucas Chaves Lima, Casper Hansen, Christian Hansen, and Jakob Grue Simonsen. 2019. MultiFC: A real-world multi-domain dataset for evidence-based fact checking of claims. In Proceedings of the 2019 Conference on Empirical Methods in Natural Langua… [our card](https://md.research.elamur.ai/free/en/papers/augenstein-2019-multifc-real-world-multi-domain/)
4. Gagan Bansal, Tongshuang Wu, Joyce Zhou, Raymond Fok, Besmira Nushi, Ece Kamar, Marco Tulio Ribeiro, and Daniel Weld. 2021. Does the Whole Exceed Its Parts? The Effect of AI Explanations on Complementary Team Performance. In Proceedings of the 2021 CHI Conference on Human Factors in Computing System… [find](https://scholar.google.com/scholar?q=Gagan+Bansal%2C+Tongshuang+Wu%2C+Joyce+Zhou%2C+Raymond+Fok%2C+Besmira+Nushi%2C+Ece+Kamar%2C+Marco+Tulio+Ribeiro%2C+and+Daniel+Weld%2E+2021%2E+Does+the+Whole+Exceed+Its+Parts%3F+The+Effect+of+AI+Explanations+on+Complement)
5. Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. 2021. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258. [our card](https://md.research.elamur.ai/free/en/papers/bommasani-2021-opportunities-risks-foundation-models/)
6. Erik Brand, Kevin Roitero, Michael Soprano, Afshin Rahimi, and Gianluca Demartini. 2022. A neural model to jointly predict and explain truthfulness of statements. ACM Journal of Data and Information Quality, 15(1):1–19. [https://goodsystems.utexas.edu/](https://goodsystems.utexas.edu/) [↗](https://goodsystems.utexas.edu/)
7. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. Advances in neural information processing systems, 33:1877–1901. [our card](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
8. Danqi Chen, Adam Fisch, Jason Weston, and Antoine Bordes. 2017. Reading Wikipedia to answer open-domain questions. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1870–1879, Vancouver, Canada. Association for Computational Lin… [our card](https://md.research.elamur.ai/free/en/papers/chen-2017-reading-wikipedia-answer-open-domain/)
9. Jifan Chen, Aniruddh Sriram, Eunsol Choi, and Greg Durrett. 2022a. Generating literal and implied sub-questions to fact-check complex claims. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 3495–3516, Abu Dhabi, United Arab Emirates. Association for C… [find](https://scholar.google.com/scholar?q=Jifan+Chen%2C+Aniruddh+Sriram%2C+Eunsol+Choi%2C+and+Greg+Durrett%2E+2022a%2E+Generating+literal+and+implied+sub%2Dquestions+to+fact%2Dcheck+complex+claims%2E+In+Proceedings+of+the+2022+Conference+on+Empirical+Methods)
10. Sihao Chen, Senaka Buthpitiya, Alex Fabrikant, Dan Roth, and Tal Schuster. 2022b. PropSegmEnt: A Large-Scale Corpus for Proposition-Level Segmentation and Entailment Recognition. arXiv eprint arxiv:2212.10750. [find](https://scholar.google.com/scholar?q=Sihao+Chen%2C+Senaka+Buthpitiya%2C+Alex+Fabrikant%2C+Dan+Roth%2C+and+Tal+Schuster%2E+2022b%2E+PropSegmEnt%3A+A+Large%2DScale+Corpus+for+Proposition%2DLevel+Segmentation+and+Entailment+Recognition%2E+arXiv+eprint+arxiv%3A22)
11. Eunsol Choi, Jennimaria Palomaki, Matthew Lamm, Tom Kwiatkowski, Dipanjan Das, and Michael Collins. 2021. Decontextualization: Making sentences stand-alone. Transactions of the Association for Computational Linguistics, 9:447–461. [our card](https://md.research.elamur.ai/free/en/papers/choi-2021-decontextualization-making-sentences-stand-alone/)
12. Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al. 2022. Palm: Scaling language modeling with pathways. arXiv preprint arXiv:2204.02311. [our card](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/)
13. Sebastian Dungs, Ahmet Aker, Norbert Fuhr, and Kalina Bontcheva. 2018. Can rumour stance alone predict veracity? In Proceedings of the 27th International Conference on Computational Linguistics, pages 3360–3370, Santa Fe, New Mexico, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sebastian+Dungs%2C+Ahmet+Aker%2C+Norbert+Fuhr%2C+and+Kalina+Bontcheva%2E+2018%2E+Can+rumour+stance+alone+predict+veracity%3F+In+Proceedings+of+the+27th+International+Conference+on+Computational+Linguistics%2C+pages)
14. Angela Fan, Claire Gardent, Chloé Braud, and Antoine Bordes. 2021. Augmenting transformers with KNN-based composite memory for dialog. Transactions of the Association for Computational Linguistics, 9:82– 99. chapter of the association for computational linguistics: Human language technologies. ACL. [find](https://scholar.google.com/scholar?q=Angela+Fan%2C+Claire+Gardent%2C+Chlo%C3%A9+Braud%2C+and+Antoine+Bordes%2E+2021%2E+Augmenting+transformers+with+KNN%2Dbased+composite+memory+for+dialog%2E+Transactions+of+the+Association+for+Computational+Linguistics%2C+9%3A)
15. Luyu Gao, Zhuyun Dai, Panupong Pasupat, Anthony Chen, Arun Tejasvi Chaganty, Yicheng Fan, Vincent Zhao, N. Lao, Hongrae Lee, Da-Cheng Juan, and Kelvin Guu. 2022. Rarr: Researching and revising what language models say, using language models. [our card](https://md.research.elamur.ai/free/en/papers/gao-2023-rarr-researching-revising-what-language/)
16. Mor Geva, Daniel Khashabi, Elad Segal, Tushar Khot, Dan Roth, and Jonathan Berant. 2021. Did aristotle use a laptop? a question answering benchmark with implicit reasoning strategies. Transactions of the Association for Computational Linguistics, 9:346– 361. [find](https://scholar.google.com/scholar?q=Mor+Geva%2C+Daniel+Khashabi%2C+Elad+Segal%2C+Tushar+Khot%2C+Dan+Roth%2C+and+Jonathan+Berant%2E+2021%2E+Did+aristotle+use+a+laptop%3F+a+question+answering+benchmark+with+implicit+reasoning+strategies%2E+Transactions+of+)
17. Max Glockner, Yufang Hou, and Iryna Gurevych. 2022. Missing counter-evidence renders NLP fact-checking unrealistic for misinformation. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 5916–5936, Abu Dhabi, United Arab Emirates. Association for Computat… [find](https://scholar.google.com/scholar?q=Max+Glockner%2C+Yufang+Hou%2C+and+Iryna+Gurevych%2E+2022%2E+Missing+counter%2Devidence+renders+NLP+fact%2Dchecking+unrealistic+for+misinformation%2E+In+Proceedings+of+the+2022+Conference+on+Empirical+Methods+in+Nat)
18. Tanya Goyal, Junyi Jessy Li, and Greg Durrett. 2022. News Summarization and Evaluation in the Era of GPT-3. arXiv eprint arxiv:2209.12356. [find](https://scholar.google.com/scholar?q=Tanya+Goyal%2C+Junyi+Jessy+Li%2C+and+Greg+Durrett%2E+2022%2E+News+Summarization+and+Evaluation+in+the+Era+of+GPT%2D3%2E+arXiv+eprint+arxiv%3A2209%2E12356%2E)
19. Lucas Graves. 2018. Understanding the Promise and Limits of Automated Fact-Checking. Technical report, Reuters Institute, University of Oxford. [find](https://scholar.google.com/scholar?q=Lucas+Graves%2E+2018%2E+Understanding+the+Promise+and+Limits+of+Automated+Fact%2DChecking%2E+Technical+report%2C+Reuters+Institute%2C+University+of+Oxford%2E)
20. Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat, and Mingwei Chang. 2020. Retrieval augmented language model pre-training. In International conference on machine learning, pages 3929–3938. PMLR. [find](https://scholar.google.com/scholar?q=Kelvin+Guu%2C+Kenton+Lee%2C+Zora+Tung%2C+Panupong+Pasupat%2C+and+Mingwei+Chang%2E+2020%2E+Retrieval+augmented+language+model+pre%2Dtraining%2E+In+International+conference+on+machine+learning%2C+pages+3929%E2%80%933938%2E+PMLR%2E)
21. Andreas Hanselowski, Christian Stab, Claudia Schulz, Zile Li, and Iryna Gurevych. 2019. A richly annotated corpus for different tasks in automated fact-checking. In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), pages 493–503, Hong Kong, China. Association for… [our card](https://md.research.elamur.ai/free/en/papers/hanselowski-2019-richly-annotated-corpus-different-tasks/)
22. Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen. 2020. DeBERTa: Decoding-enhanced BERT with Disentangled Attention. In International Conference on Learning Representations. [our card](https://md.research.elamur.ai/free/en/papers/he-2020-deberta-decoding-enhanced-bert-disentangled/)
23. Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, and Greg Durrett. 2023. WiCE: Real-World Entailment for Claims in Wikipedia. arXiv eprint arxiv:2303.01432. [our card](https://md.research.elamur.ai/free/en/papers/kamoi-2023-wice-real-world-entailment-claims/)
24. Angela Fan, Aleksandra Piktus, Fabio Petroni, Guillaume Wenzek, Marzieh Saeidi, Andreas Vlachos, Antoine Bordes, and Sebastian Riedel. 2020. Generating fact checking briefs. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 7147–7161, Online. As… [find](https://scholar.google.com/scholar?q=Angela+Fan%2C+Aleksandra+Piktus%2C+Fabio+Petroni%2C+Guillaume+Wenzek%2C+Marzieh+Saeidi%2C+Andreas+Vlachos%2C+Antoine+Bordes%2C+and+Sebastian+Riedel%2E+2020%2E+Generating+fact+checking+briefs%2E+In+Proceedings+of+the+2020)
25. Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020. Dense passage retrieval for open-domain question answering. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 6769–6781, Onli… [our card](https://md.research.elamur.ai/free/en/papers/karpukhin-2020-dense-passage-retrieval-open-domain/)
26. William Ferreira and Andreas Vlachos. 2016. Emergent: a novel data-set for stance classification. In Proceedings of the 2016 conference of the North American Urvashi Khandelwal, Omer Levy, Dan Jurafsky, Luke Zettlemoyer, and Mike Lewis. 2020. Generalization through memorization: Nearest neighbor lan… [our card](https://md.research.elamur.ai/free/en/papers/ferreira-2016-emergent-novel-data-set-stance/)
27. Omar Khattab, Christopher Potts, and Matei Zaharia. 2021. Relevance-guided supervision for OpenQA with ColBERT. Transactions of the Association for Computational Linguistics, 9:929–944. [our card](https://md.research.elamur.ai/free/en/papers/khattab-2021-relevance-guided-supervision-openqa-colbert/)
28. Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019. Natural… [our card](https://md.research.elamur.ai/free/en/papers/kwiatkowski-2019-natural-questions-benchmark-question-answering/)
29. Mosh Levy, Alon Jacoby, and Yoav Goldberg. 2024. Same task, more tokens: the impact of input length on the reasoning performance of large language models. arXiv preprint arXiv:2402.14848. [our card](https://md.research.elamur.ai/free/en/papers/levy-2024-same-task-more-tokens-impact/)
30. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems, 33:9459–9474. [find](https://scholar.google.com/scholar?q=Patrick+Lewis%2C+Ethan+Perez%2C+Aleksandra+Piktus%2C+Fabio+Petroni%2C+Vladimir+Karpukhin%2C+Naman+Goyal%2C+Heinrich+K%C3%BCttler%2C+Mike+Lewis%2C+Wen%2Dtau+Yih%2C+Tim+Rockt%C3%A4schel%2C+et+al%2E+2020%2E+Retrieval%2Daugmented+generation+f)
31. Chloe Lim. 2018. Checking how fact-checkers check. Research & Politics, 5(3):2053168018786848. [find](https://scholar.google.com/scholar?q=Chloe+Lim%2E+2018%2E+Checking+how+fact%2Dcheckers+check%2E+Research+%26+Politics%2C+5%283%29%3A2053168018786848%2E)
32. Nelson F Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, and Percy Liang. 2024. Lost in the middle: How language models use long contexts. Transactions of the Association for Computational Linguistics, 12:157–173. [our card](https://md.research.elamur.ai/free/en/papers/liu-2023-lost-middle-language-models-use/)
33. Yixin Liu, Alexander R. Fabbri, Pengfei Liu, Yilun Zhao, Linyong Nan, Ruilin Han, Simeng Han, Shafiq Joty, Chien-Sheng Wu, Caiming Xiong, and Dragomir Radev. 2022. Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation. arXiv eprint arxiv:2212.07981. [our card](https://md.research.elamur.ai/free/en/papers/liu-2022-revisiting-gold-standard-grounding-summarization/)
34. Sewon Min, Victor Zhong, Luke Zettlemoyer, and Hannaneh Hajishirzi. 2019. Multi-hop reading comprehension through question decomposition and rescoring. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 6097–6109, Florence, Italy. Association for Comput… [our card](https://md.research.elamur.ai/free/en/papers/min-2019-multi-hop-reading-comprehension-through/)
35. Nikita Moghe, Siddhartha Arora, Suman Banerjee, and Mitesh M. Khapra. 2018. Towards exploiting background knowledge for building conversation systems. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2322–2332, Brussels, Belgium. Association for Comput… [our card](https://md.research.elamur.ai/free/en/papers/moghe-2018-exploiting-background-knowledge-building-conversation/)
36. Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shantanu Jain, Vineet Kosaraju, William Saunders, et al. 2021. WebGPT: Browser-assisted question-answering with human feedback. arXiv preprint arXiv:2112.09332. [our card](https://md.research.elamur.ai/free/en/papers/nakano-2021-webgpt-browser-assisted-question-answering/)
37. Preslav Nakov, David Corney, Maram Hasanain, Firoj Alam, Tamer Elsayed, Alberto Barr’on-Cedeno, Paolo Papotti, Shaden Shaar, and Giovanni Da San Martino. 2021. Automated fact-checking for assisting human fact-checkers. In Proceedings of the Thirtieth International Joint Conference on Artificial Inte… [find](https://scholar.google.com/scholar?q=Preslav+Nakov%2C+David+Corney%2C+Maram+Hasanain%2C+Firoj+Alam%2C+Tamer+Elsayed%2C+Alberto+Barr%E2%80%99on%2DCedeno%2C+Paolo+Papotti%2C+Shaden+Shaar%2C+and+Giovanni+Da+San+Martino%2E+2021%2E+Automated+fact%2Dchecking+for+assisting+hu)
38. Nedjma Ousidhoum, Zhangdie Yuan, and Andreas Vlachos. 2022. Varifocal question generation for fact-checking. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 2532–2544, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Nedjma+Ousidhoum%2C+Zhangdie+Yuan%2C+and+Andreas+Vlachos%2E+2022%2E+Varifocal+question+generation+for+fact%2Dchecking%2E+In+Proceedings+of+the+2022+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+)
39. Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training language models to follow instructions with human feedback. arXiv preprint arXiv:2203.02155. [our card](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/)
40. Ethan Perez, Patrick Lewis, Wen-tau Yih, Kyunghyun Cho, and Douwe Kiela. 2020. Unsupervised question decomposition for question answering. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 8864–8880, Online. Association for Computational Linguis… [our card](https://md.research.elamur.ai/free/en/papers/perez-2020-unsupervised-question-decomposition-question-answering/)
41. Verónica Pérez-Rosas, Bennett Kleinberg, Alexandra Lefevre, and Rada Mihalcea. 2018. Automatic detection of fake news. In Proceedings of the 27th International Conference on Computational Linguistics, pages 3391–3401, Santa Fe, New Mexico, USA. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/rosas-2018-automatic-detection-fake-news/)
42. Kashyap Popat, Subhabrata Mukherjee, Jannik Strötgen, and Gerhard Weikum. 2017. Where the truth lies: Explaining the credibility of emerging claims on the web and social media. In Proceedings of the 26th International Conference on World Wide Web Companion, pages 1003–1012. International World Wide… [find](https://scholar.google.com/scholar?q=Kashyap+Popat%2C+Subhabrata+Mukherjee%2C+Jannik+Str%C3%B6tgen%2C+and+Gerhard+Weikum%2E+2017%2E+Where+the+truth+lies%3A+Explaining+the+credibility+of+emerging+claims+on+the+web+and+social+media%2E+In+Proceedings+of+the+2)
43. Kashyap Popat, Subhabrata Mukherjee, Andrew Yates, and Gerhard Weikum. 2018. DeClarE: Debunking fake news and false claims using evidence-aware deep learning. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 22–32, Brussels, Belgium. Association for Co… [our card](https://md.research.elamur.ai/free/en/papers/popat-2018-declare-debunking-fake-news-false/)
44. Peng Qi, Xiaowen Lin, Leo Mehr, Zijian Wang, and Christopher D. Manning. 2019. Answering complex open-domain questions through iterative query generation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural L… [our card](https://md.research.elamur.ai/free/en/papers/qi-2019-answering-complex-open-domain-questions/)
45. Ori Ram, Yoav Levine, Itay Dalmedigos, Dor Muhlgay, Amnon Shashua, Kevin Leyton-Brown, and Yoav Shoham. 2023. In-context retrieval-augmented language models. arXiv preprint arXiv:2302.00083. [find](https://scholar.google.com/scholar?q=Ori+Ram%2C+Yoav+Levine%2C+Itay+Dalmedigos%2C+Dor+Muhlgay%2C+Amnon+Shashua%2C+Kevin+Leyton%2DBrown%2C+and+Yoav+Shoham%2E+2023%2E+In%2Dcontext+retrieval%2Daugmented+language+models%2E+arXiv+preprint+arXiv%3A2302%2E00083%2E)
46. Hannah Rashkin, Eunsol Choi, Jin Yea Jang, Svitlana Volkova, and Yejin Choi. 2017. Truth of varying shades: Analyzing language in fake news and political fact-checking. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 2931–2937, Copenhagen, Denmark. As… [our card](https://md.research.elamur.ai/free/en/papers/rashkin-2017-truth-varying-shades-analyzing-language/)
47. Devendra Sachan, Mike Lewis, Mandar Joshi, Armen Aghajanyan, Wen-tau Yih, Joelle Pineau, and Luke Zettlemoyer. 2022. Improving passage retrieval with zero-shot question generation. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 3781–3797, Abu Dhabi,… [our card](https://md.research.elamur.ai/free/en/papers/sachan-2022-improving-passage-retrieval-zero-shot/)
48. Svitlana Volkova, Kyle Shaffer, Jin Yea Jang, and Nathan Hodas. 2017. Separating facts from fiction: Linguistic models to classify suspicious and trusted news posts on Twitter. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages… [find](https://scholar.google.com/scholar?q=Svitlana+Volkova%2C+Kyle+Shaffer%2C+Jin+Yea+Jang%2C+and+Nathan+Hodas%2E+2017%2E+Separating+facts+from+fiction%3A+Linguistic+models+to+classify+suspicious+and+trusted+news+posts+on+Twitter%2E+In+Proceedings+of+the+5)
49. William Yang Wang. 2017. “liar, liar pants on fire”: A new benchmark dataset for fake news detection. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 422–426, Vancouver, Canada. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/wang-2017-liar-liar-pants-fire-new/)
50. Tomer Wolfson, Mor Geva, Ankit Gupta, Matt Gardner, Yoav Goldberg, Daniel Deutch, and Jonathan Berant. 2020. Break it down: A question understanding benchmark. Transactions of the Association for Computational Linguistics, 8:183–198. [our card](https://md.research.elamur.ai/free/en/papers/wolfson-2020-break-it-down-question-understanding/)
51. Michael Schlichtkrull, Zhijiang Guo, and Andreas Vlachos. 2023. Averitec: A dataset for real-world claim verification with evidence from the web. Advances in Neural Information Processing Systems, Datasets and Benchmarks Track, 36. [find](https://scholar.google.com/scholar?q=Michael+Schlichtkrull%2C+Zhijiang+Guo%2C+and+Andreas+Vlachos%2E+2023%2E+Averitec%3A+A+dataset+for+real%2Dworld+claim+verification+with+evidence+from+the+web%2E+Advances+in+Neural+Information+Processing+Systems%2C+Dat)
52. Tianyi Zhang, Faisal Ladhak, Esin Durmus, Percy Liang, Kathleen McKeown, and Tatsunori B. Hashimoto. 2023. Benchmarking Large Language Models for News Summarization. arXiv eprint arxiv:2301.13848. [our card](https://md.research.elamur.ai/free/en/papers/zhang-2024-benchmarking-large-language-models-news/)
53. Weijia Shi, Sewon Min, Michihiro Yasunaga, Minjoon Seo, Rich James, Mike Lewis, Luke Zettlemoyer, and Wen-tau Yih. 2023. REPLUG: Retrieval-Augmented Black-Box Language Models. arXiv preprint arXiv:2301.12652. [our card](https://md.research.elamur.ai/free/en/papers/shi-2023-replug-retrieval-augmented-black-box/)
54. Zexuan Zhong, Tao Lei, and Danqi Chen. 2022. Training language models with memory augmentation. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 5657–5673, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zexuan+Zhong%2C+Tao+Lei%2C+and+Danqi+Chen%2E+2022%2E+Training+language+models+with+memory+augmentation%2E+In+Proceedings+of+the+2022+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+5657%E2%80%9356)
55. Prakhar Singh, Anubrata Das, Junyi Jessy Li, and Matthew Lease. 2021. The case for claim difficulty assessment in automatic fact checking. arXiv preprint arXiv:2109.09689. — [arXiv:2109.09689](https://arxiv.org/abs/2109.09689) [find](https://scholar.google.com/scholar?q=Prakhar+Singh%2C+Anubrata+Das%2C+Junyi+Jessy+Li%2C+and+Matthew+Lease%2E+2021%2E+The+case+for+claim+difficulty+assessment+in+automatic+fact+checking%2E+arXiv+preprint+arXiv%3A2109%2E09689%2E+%E2%80%94+%5BarXiv%3A2109%2E09689%5D%28https%3A%2F)
56. Dominik Stammbach and Elliott Ash. 2020. e-fever: Explanations and summaries for automated fact checking. Proceedings of the 2020 Truth and Trust Online (TTO 2020), pages 32–43. [find](https://scholar.google.com/scholar?q=Dominik+Stammbach+and+Elliott+Ash%2E+2020%2E+e%2Dfever%3A+Explanations+and+summaries+for+automated+fact+checking%2E+Proceedings+of+the+2020+Truth+and+Trust+Online+%28TTO+2020%29%2C+pages+32%E2%80%9343%2E)

*Updated 24 October 2026*