---
title: "Fact or Fiction: Verifying Scientific Claims — Wadden 2020"
description: "Research output grows quickly, and during crises like COVID-19 it is hard to judge whether a scientific statement holds up."
authors: ["David Wadden", "Shanchuan Lin", "Kyle Lo", "Lucy Lu Wang", "Madeleine van Zuylen", "Arman Cohan", "Hannaneh Hajishirzi"]
year: 2020
venue: "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)"
source: "https://aclanthology.org/2020.emnlp-main.609/"
doi: "10.18653/v1/2020.emnlp-main.609"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/wadden-2020-fact-or-fiction-verifying-scientific/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/wadden-2020-fact-or-fiction-verifying-scientific/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/) / Fact or Fiction: Verifying Scientific Claims

# Fact or Fiction: Verifying Scientific Claims

**Authors:** [David Wadden](https://md.research.elamur.ai/free/en/authors/david-wadden/), [Shanchuan Lin](https://md.research.elamur.ai/free/en/authors/shanchuan-lin/), [Kyle Lo](https://md.research.elamur.ai/free/en/authors/kyle-lo/), [Lucy Lu Wang](https://md.research.elamur.ai/free/en/authors/lucy-lu-wang/), [Madeleine van Zuylen](https://md.research.elamur.ai/free/en/authors/madeleine-van-zuylen/), [Arman Cohan](https://md.research.elamur.ai/free/en/authors/arman-cohan/), [Hannaneh Hajishirzi](https://md.research.elamur.ai/free/en/authors/hannaneh-hajishirzi/) · **Year:** 2020 · **Venue:** Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2020.emnlp-main.609/) · [PDF](https://aclanthology.org/2020.emnlp-main.609.pdf) · [DOI 10.18653/v1/2020.emnlp-main.609](https://doi.org/10.18653/v1/2020.emnlp-main.609) · [OpenAlex](https://openalex.org/W3023035014)

**Citations:** 372 citations (openalex-snapshot · 2026-10-14) · [334](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Research output grows quickly, and during crises like COVID-19 it is hard to judge whether a scientific statement holds up. Wadden et al. define a new task, scientific claim verification. Given a claim, a system must find research abstracts that SUPPORTS or REFUTES it and identify the rationale sentences that justify each decision. To study this task, they built SciFact. Experts turned naturally occurring citation sentences (citances) from S2ORC papers into atomic claims. These citances came from papers citing articles in well-regarded biomedical journals. The experts then labeled the cited abstracts and marked the rationales.

As a baseline, the authors present VeriSci, a three-stage pipeline:
- abstract retrieval,
- BERT-based rationale selection,
- label prediction (SUPPORTS, REFUTES or NOINFO).

Domain adaptation to scientific text gives clearly better results than relying only on models trained on Wikipedia (FEVER) or political news claims. A pilot on CORD-19 shows the system can surface useful evidence for real COVID-19 claims. SciFact matters because it is a difficult benchmark that requires background knowledge and reasoning over specialized literature.

## Key points
- **Dataset size:** SciFact contains 1,409 expert-written claims checked against a corpus of 5,183 abstracts. For each citance, five distractor abstracts are added; these are papers cited elsewhere in the same citing article.
- **Task design:** Claims are judged per claim-abstract pair rather than assigned a global truth value. Every SUPPORTS or REFUTES decision needs at least one minimal rationale.
- **COVID-19 case study:** A medical student wrote 36 claims, and VeriSci retrieved evidence from CORD-19. The output was judged plausible for 23 of the 36 claims.
- **Error analysis:** The authors name five capabilities that models still lack: scientific background knowledge, directionality (increases vs. decreases), numerical and statistical reasoning, cause and effect, and coreference.
- **Availability:** Data and code are at github.com/allenai/scifact, with a leaderboard and demo at scifact.apps.allenai.org. SciFact is also included in the ERASER benchmark.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

334 papers of our library cite it (of the 140673 whose bibliographies we read); 19 of them have a page here, 315 not yet.

- [Task-aware Retrieval with Instructions](https://md.research.elamur.ai/free/en/papers/asai-2023-task-aware-retrieval-instructions/)
- [RARR: Researching and Revising What Language Models Say, Using Language Models](https://md.research.elamur.ai/free/en/papers/gao-2023-rarr-researching-revising-what-language/)
- [A Survey on Automated Fact-Checking](https://md.research.elamur.ai/free/en/papers/guo-2022-survey-automated-fact-checking/)
- [TrustLLM: Trustworthiness in Large Language Models](https://md.research.elamur.ai/free/en/papers/huang-2024-trustllm-trustworthiness-large-language-models/)
- [Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2](https://md.research.elamur.ai/free/en/papers/ivison-2023-camels-changing-climate-enhancing-lm/)
- [LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization](https://md.research.elamur.ai/free/en/papers/krishna-2023-longeval-guidelines-human-evaluation-faithfulness/)
- [The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models](https://md.research.elamur.ai/free/en/papers/li-2024-dawn-after-dark-empirical-study/)
- [SciCiteVal: A Multi-Domain Dataset for Scientific Citation Verification](https://md.research.elamur.ai/free/en/papers/liu-2026-sciciteval-multi-domain-dataset-scientific/)
- [FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation](https://md.research.elamur.ai/free/en/papers/min-2023-factscore-fine-grained-atomic-evaluation/)
- [Nomic Embed: Training a Reproducible Long Context Text Embedder](https://md.research.elamur.ai/free/en/papers/nussbaum-2024-nomic-embed-training-reproducible-long/)
- [Fact-Checking Complex Claims with Program-Guided Reasoning](https://md.research.elamur.ai/free/en/papers/pan-2023-fact-checking-complex-claims-program/)
- [COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemic](https://md.research.elamur.ai/free/en/papers/saakyan-2021-covid-fact-fact-extraction-verification/)
- [ColBERTv2: Effective and Efficient Retrieval via Lightweight Late Interaction](https://md.research.elamur.ai/free/en/papers/santhanam-2022-colbertv2-effective-efficient-retrieval-lightweight/)
- [MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queries](https://md.research.elamur.ai/free/en/papers/tang-2024-multihop-rag-benchmarking-retrieval-augmented/)
- [BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models](https://md.research.elamur.ai/free/en/papers/thakur-2021-beir-heterogenous-benchmark-zero/)
- [GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval](https://md.research.elamur.ai/free/en/papers/wang-2022-gpl-generative-pseudo-labeling-unsupervised/)
- [Text Embeddings by Weakly-Supervised Contrastive Pre-training](https://md.research.elamur.ai/free/en/papers/wang-2022-text-embeddings-weakly-supervised-contrastive/)
- [Query2doc: Query Expansion with Large Language Models](https://md.research.elamur.ai/free/en/papers/wang-2023-query2doc-query-expansion-large-language/)
- [Benchmarking Retrieval-Augmented Generation for Medicine](https://md.research.elamur.ai/free/en/papers/xiong-2024-benchmarking-retrieval-augmented-generation-medicine/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{wadden2020fact,
  title = {{Fact or Fiction: Verifying Scientific Claims}},
  author = {Wadden, David and Lin, Shanchuan and Lo, Kyle and Wang, Lucy Lu and Zuylen, Madeleine van and Cohan, Arman and Hajishirzi, Hannaneh},
  booktitle = {Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP)},
  year = {2020},
  doi = {10.18653/v1/2020.emnlp-main.609},
  url = {https://doi.org/10.18653/v1/2020.emnlp-main.609}
}
```

- [← previous Facilitating the Communication of Politeness through Fine-Grained Paraphrasing](https://md.research.elamur.ai/free/en/papers/fu-2020-facilitating-communication-politeness-through-fine/)
- [next → Factual Error Correction for Abstractive Summarization Models](https://md.research.elamur.ai/free/en/papers/cao-2020-factual-error-correction-abstractive-summarization/)
- [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/page/3/)

## References

42 references, 17 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Ramy Baly, Mitra Mohtarami, James Glass, Lluı́s Màrquez, Alessandro Moschitti, and Preslav Nakov. 2018. Integrating stance detection and fact checking in a unified corpus. In NAACL. [find](https://scholar.google.com/scholar?q=Ramy+Baly%2C+Mitra+Mohtarami%2C+James+Glass%2C+Llu%C4%B1%CC%81s+Ma%CC%80rquez%2C+Alessandro+Moschitti%2C+and+Preslav+Nakov%2E+2018%2E+Integrating+stance+detection+and+fact+checking+in+a+unified+corpus%2E+In+NAACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/baly-2018-integrating-stance-detection-fact-checking/)
2. Alberto Barrón-Cedeño, Tamer Elsayed, Reem Suwaileh, Lluı́s Màrquez i Villodre, Pepa Atanasova, Wajdi Zaghouani, Spas Kyuchukov, Giovanni Da San Martino, and Preslav Nakov. 2018. Overview of the clef-2018 checkthat! lab on automatic identification and verification of political claims. task 2: Fac… [find](https://scholar.google.com/scholar?q=Alberto+Barro%CC%81n%2DCeden%CC%83o%2C+Tamer+Elsayed%2C+Reem+Suwaileh%2C+Llu%C4%B1%CC%81s+Ma%CC%80rquez+i+Villodre%2C+Pepa+Atanasova%2C+Wajdi+Zaghouani%2C+Spas+Kyuchukov%2C+Giovanni+Da+San+Martino%2C+and+Preslav+Nakov%2E+2018%2E+Overview+of+the+cl)
3. Elaine Beller, Justin Clark, Guy Tsafnat, Clive Elliott Adams, Heinz Diehl, Hans Lund, Mourad Ouzzani, Kristina Thayer, James Thomas, Tari Turner, J. S. Xia, Karen A. Robinson, and Paul P Glasziou. 2018. Making progress with the automation of systematic reviews: principles of the international colla… [find](https://scholar.google.com/scholar?q=Elaine+Beller%2C+Justin+Clark%2C+Guy+Tsafnat%2C+Clive+Elliott+Adams%2C+Heinz+Diehl%2C+Hans+Lund%2C+Mourad+Ouzzani%2C+Kristina+Thayer%2C+James+Thomas%2C+Tari+Turner%2C+J%2E+S%2E+Xia%2C+Karen+A%2E+Robinson%2C+and+Paul+P+Glasziou%2E+20)
4. Iz Beltagy, Kyle Lo, and Arman Cohan. 2019. Scibert: A pretrained language model for scientific text. In EMNLP. [find](https://scholar.google.com/scholar?q=Iz+Beltagy%2C+Kyle+Lo%2C+and+Arman+Cohan%2E+2019%2E+Scibert%3A+A+pretrained+language+model+for+scientific+text%2E+In+EMNLP%2E) [our card](https://md.research.elamur.ai/free/en/papers/beltagy-2019-scibert-pretrained-language-model-scientific/)
5. Iz Beltagy, Matthew E. Peters, and Arman Cohan. 2020. Longformer: The long-document transformer. ArXiv, abs/2004.05150. [find](https://scholar.google.com/scholar?q=Iz+Beltagy%2C+Matthew+E%2E+Peters%2C+and+Arman+Cohan%2E+2020%2E+Longformer%3A+The+long%2Ddocument+transformer%2E+ArXiv%2C+abs%2F2004%2E05150%2E)
6. Taylor Berg-Kirkpatrick, David Burkett, and Dan Klein. 2012. An empirical investigation of statistical significance in nlp. In EMNLP. [find](https://scholar.google.com/scholar?q=Taylor+Berg%2DKirkpatrick%2C+David+Burkett%2C+and+Dan+Klein%2E+2012%2E+An+empirical+investigation+of+statistical+significance+in+nlp%2E+In+EMNLP%2E)
7. Sihao Chen, Daniel Khashabi, Wenpeng Yin, Chris Callison-Burch, and Dan Roth. 2019. Seeing things from a different angle: Discovering diverse perspectives about claims. In NAACL. [find](https://scholar.google.com/scholar?q=Sihao+Chen%2C+Daniel+Khashabi%2C+Wenpeng+Yin%2C+Chris+Callison%2DBurch%2C+and+Dan+Roth%2E+2019%2E+Seeing+things+from+a+different+angle%3A+Discovering+diverse+perspectives+about+claims%2E+In+NAACL%2E)
8. Arman Cohan, Luca Soldaini, and Nazli Goharian. 2015. Matching citation text and cited spans in biomedical literature: a search-oriented approach. In NAACL. [find](https://scholar.google.com/scholar?q=Arman+Cohan%2C+Luca+Soldaini%2C+and+Nazli+Goharian%2E+2015%2E+Matching+citation+text+and+cited+spans+in+biomedical+literature%3A+a+search%2Doriented+approach%2E+In+NAACL%2E)
9. Kevin Bretonnel Cohen, Hoa Trang Dang, Anita de Waard, Prabha Yadav, and Lucy Vanderwende. 2014. [find](https://scholar.google.com/scholar?q=Kevin+Bretonnel+Cohen%2C+Hoa+Trang+Dang%2C+Anita+de+Waard%2C+Prabha+Yadav%2C+and+Lucy+Vanderwende%2E+2014%2E)
10. Tac 2014 biomedical summarization track. [https://tac.nist.gov/2014/BiomedSumm/](https://tac.nist.gov/2014/BiomedSumm/) . [↗](https://tac.nist.gov/2014/BiomedSumm/)
11. Leon Derczynski, Kalina Bontcheva, Maria Liakata, Rob Procter, Geraldine Wong Sak Hoi, and Arkaitz Zubiaga. 2017. SemEval-2017 task 8: RumourEval: Determining rumour veracity and support for rumours. In SemEval. [find](https://scholar.google.com/scholar?q=Leon+Derczynski%2C+Kalina+Bontcheva%2C+Maria+Liakata%2C+Rob+Procter%2C+Geraldine+Wong+Sak+Hoi%2C+and+Arkaitz+Zubiaga%2E+2017%2E+SemEval%2D2017+task+8%3A+RumourEval%3A+Determining+rumour+veracity+and+support+for+rumours%2E+) [our card](https://md.research.elamur.ai/free/en/papers/derczynski-2017-semeval-2017-task-8-rumoureval/)
12. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In NAACL. [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+and+Kristina+Toutanova%2E+2019%2E+Bert%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+In+NAACL%2E)
13. Jay DeYoung, Sarthak Jain, Nazneen Fatema Rajani, Eric Lehman, Caiming Xiong, Richard Socher, and Byron C. Wallace. 2020a. Eraser: A benchmark to evaluate rationalized nlp models. In ACL. [find](https://scholar.google.com/scholar?q=Jay+DeYoung%2C+Sarthak+Jain%2C+Nazneen+Fatema+Rajani%2C+Eric+Lehman%2C+Caiming+Xiong%2C+Richard+Socher%2C+and+Byron+C%2E+Wallace%2E+2020a%2E+Eraser%3A+A+benchmark+to+evaluate+rationalized+nlp+models%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/deyoung-2020-eraser-benchmark-evaluate-rationalized-nlp/)
14. Jay DeYoung, Eric Lehman, Ben Nye, Iain James Marshall, and Byron C. Wallace. 2020b. Evidence inference 2.0: More data, better models. In BioNLP@ACL. [find](https://scholar.google.com/scholar?q=Jay+DeYoung%2C+Eric+Lehman%2C+Ben+Nye%2C+Iain+James+Marshall%2C+and+Byron+C%2E+Wallace%2E+2020b%2E+Evidence+inference+2%2E0%3A+More+data%2C+better+models%2E+In+BioNLP%40ACL%2E)
15. Rotem Dror, Gili Baumer, Segev Shlomov, and Roi Reichart. 2018. The hitchhiker’s guide to testing statistical significance in natural language processing. In ACL. [find](https://scholar.google.com/scholar?q=Rotem+Dror%2C+Gili+Baumer%2C+Segev+Shlomov%2C+and+Roi+Reichart%2E+2018%2E+The+hitchhiker%E2%80%99s+guide+to+testing+statistical+significance+in+natural+language+processing%2E+In+ACL%2E)
16. Bradley Efron and Robert Tibshirani. 1993. An introduction to the bootstrap. [find](https://scholar.google.com/scholar?q=Bradley+Efron+and+Robert+Tibshirani%2E+1993%2E+An+introduction+to+the+bootstrap%2E)
17. William Ferreira and Andreas Vlachos. 2016. Emergent: a novel data-set for stance classification. In NAACL. [find](https://scholar.google.com/scholar?q=William+Ferreira+and+Andreas+Vlachos%2E+2016%2E+Emergent%3A+a+novel+data%2Dset+for+stance+classification%2E+In+NAACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/ferreira-2016-emergent-novel-data-set-stance/)
18. Yu Gu, Robert Tinn, Hao Cheng, M. Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, and Hoifung Poon. 2020. Domain-specific language model pretraining for biomedical natural language processing. ArXiv, abs/2007.15779. [find](https://scholar.google.com/scholar?q=Yu+Gu%2C+Robert+Tinn%2C+Hao+Cheng%2C+M%2E+Lucas%2C+Naoto+Usuyama%2C+Xiaodong+Liu%2C+Tristan+Naumann%2C+Jianfeng+Gao%2C+and+Hoifung+Poon%2E+2020%2E+Domain%2Dspecific+language+model+pretraining+for+biomedical+natural+language+) [our card](https://md.research.elamur.ai/free/en/papers/gu-2020-domain-specific-language-model-pretraining/)
19. Suchin Gururangan, Ana Marasovic, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, and Noah A. Smith. 2020. Don’t stop pretraining: Adapt language models to domains and tasks. In ACL. [find](https://scholar.google.com/scholar?q=Suchin+Gururangan%2C+Ana+Marasovic%2C+Swabha+Swayamdipta%2C+Kyle+Lo%2C+Iz+Beltagy%2C+Doug+Downey%2C+and+Noah+A%2E+Smith%2E+2020%2E+Don%E2%80%99t+stop+pretraining%3A+Adapt+language+models+to+domains+and+tasks%2E+In+ACL%2E)
20. Suchin Gururangan, Swabha Swayamdipta, Omer Levy, Roy Schwartz, Samuel R. Bowman, and Noah A. Smith. 2018. Annotation artifacts in natural language inference data. In NAACL. [find](https://scholar.google.com/scholar?q=Suchin+Gururangan%2C+Swabha+Swayamdipta%2C+Omer+Levy%2C+Roy+Schwartz%2C+Samuel+R%2E+Bowman%2C+and+Noah+A%2E+Smith%2E+2018%2E+Annotation+artifacts+in+natural+language+inference+data%2E+In+NAACL%2E)
21. Andreas Hanselowski, Christian Stab, Claudia Schulz, Zile Li, and Iryna Gurevych. 2019. A richly annotated corpus for different tasks in automated fact-checking. In CoNLL. [find](https://scholar.google.com/scholar?q=Andreas+Hanselowski%2C+Christian+Stab%2C+Claudia+Schulz%2C+Zile+Li%2C+and+Iryna+Gurevych%2E+2019%2E+A+richly+annotated+corpus+for+different+tasks+in+automated+fact%2Dchecking%2E+In+CoNLL%2E)
22. Kokil Jaidka, Muthu Kumar Chandrasekaran, Devanshu Jain, and Min-Yen Kan. 2017. The cl-scisumm shared task 2017: Results and key insights. In BIRNDL@JCDL. [find](https://scholar.google.com/scholar?q=Kokil+Jaidka%2C+Muthu+Kumar+Chandrasekaran%2C+Devanshu+Jain%2C+and+Min%2DYen+Kan%2E+2017%2E+The+cl%2Dscisumm+shared+task+2017%3A+Results+and+key+insights%2E+In+BIRNDL%40JCDL%2E)
23. Qiao Jin, Bhuwan Dhingra, Zhengping Liu, William W. Cohen, and Xinghua Lu. 2019. Pubmedqa: A dataset for biomedical research question answering. In EMNLP. [find](https://scholar.google.com/scholar?q=Qiao+Jin%2C+Bhuwan+Dhingra%2C+Zhengping+Liu%2C+William+W%2E+Cohen%2C+and+Xinghua+Lu%2E+2019%2E+Pubmedqa%3A+A+dataset+for+biomedical+research+question+answering%2E+In+EMNLP%2E) [our card](https://md.research.elamur.ai/free/en/papers/jin-2019-pubmedqa-dataset-biomedical-research-question/)
24. Eric Lehman, Jay DeYoung, Regina Barzilay, and Byron C. Wallace. 2019. Inferring which medical treatments work from reports of clinical trials. In NAACL. [find](https://scholar.google.com/scholar?q=Eric+Lehman%2C+Jay+DeYoung%2C+Regina+Barzilay%2C+and+Byron+C%2E+Wallace%2E+2019%2E+Inferring+which+medical+treatments+work+from+reports+of+clinical+trials%2E+In+NAACL%2E)
25. Tao Lei, Regina Barzilay, and Tommi S. Jaakkola. 2016. Rationalizing neural predictions. In ACL. [find](https://scholar.google.com/scholar?q=Tao+Lei%2C+Regina+Barzilay%2C+and+Tommi+S%2E+Jaakkola%2E+2016%2E+Rationalizing+neural+predictions%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/lei-2016-rationalizing-neural-predictions/)
26. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. ArXiv, abs/1907.11692. [find](https://scholar.google.com/scholar?q=Yinhan+Liu%2C+Myle+Ott%2C+Naman+Goyal%2C+Jingfei+Du%2C+Mandar+Joshi%2C+Danqi+Chen%2C+Omer+Levy%2C+Mike+Lewis%2C+Luke+Zettlemoyer%2C+and+Veselin+Stoyanov%2E+2019%2E+Roberta%3A+A+robustly+optimized+bert+pretraining+approach%2E+A)
27. Kyle Lo, Lucy Lu Wang, Mark Neumann, Rodney Kinney, and Daniel S. Weld. 2020. S2ORC: The Semantic Scholar Open Research Corpus. In ACL. [find](https://scholar.google.com/scholar?q=Kyle+Lo%2C+Lucy+Lu+Wang%2C+Mark+Neumann%2C+Rodney+Kinney%2C+and+Daniel+S%2E+Weld%2E+2020%2E+S2ORC%3A+The+Semantic+Scholar+Open+Research+Corpus%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/lo-2019-s2orc-semantic-scholar-open-research/)
28. Yi Luan, Luheng He, Mari Ostendorf, and Hannaneh Hajishirzi. 2018. Multi-task identification of entities, relations, and coreference for scientific knowledge graph construction. In EMNLP. [find](https://scholar.google.com/scholar?q=Yi+Luan%2C+Luheng+He%2C+Mari+Ostendorf%2C+and+Hannaneh+Hajishirzi%2E+2018%2E+Multi%2Dtask+identification+of+entities%2C+relations%2C+and+coreference+for+scientific+knowledge+graph+construction%2E+In+EMNLP%2E) [our card](https://md.research.elamur.ai/free/en/papers/luan-2018-multi-task-identification-entities-relations/)
29. Andreas Vlachos and Sebastian Riedel. 2014. Fact checking: Task definition and dataset construction. In ACL Workshop on Language Technologies and Computational Social Science. [find](https://scholar.google.com/scholar?q=Andreas+Vlachos+and+Sebastian+Riedel%2E+2014%2E+Fact+checking%3A+Task+definition+and+dataset+construction%2E+In+ACL+Workshop+on+Language+Technologies+and+Computational+Social+Science%2E) [our card](https://md.research.elamur.ai/free/en/papers/vlachos-2014-fact-checking-task-definition-dataset/)
30. Iain James Marshall, Joël Kuiper, Edward Banner, and Byron C. Wallace. 2017. Automating biomedical evidence synthesis: Robotreviewer. ACL. [find](https://scholar.google.com/scholar?q=Iain+James+Marshall%2C+Joe%CC%88l+Kuiper%2C+Edward+Banner%2C+and+Byron+C%2E+Wallace%2E+2017%2E+Automating+biomedical+evidence+synthesis%3A+Robotreviewer%2E+ACL%2E)
31. Lucy Lu Wang, Kyle Lo, Yoganand Chandrasekhar, Russell Reas, Jiangjiang Yang, Darrin Eide, Kathryn Funk, Rodney Kinney, Ziyang Liu, William. Merrill, Paul Mooney, Dewey A. Murdick, Devvret Rishi, Jerry Sheehan, Zhihong Shen, Brandon Stilson, Alex D. Wade, Kuansan Wang, Christopher Wilhelm, Boya Xie,… [find](https://scholar.google.com/scholar?q=Lucy+Lu+Wang%2C+Kyle+Lo%2C+Yoganand+Chandrasekhar%2C+Russell+Reas%2C+Jiangjiang+Yang%2C+Darrin+Eide%2C+Kathryn+Funk%2C+Rodney+Kinney%2C+Ziyang+Liu%2C+William%2E+Merrill%2C+Paul+Mooney%2C+Dewey+A%2E+Murdick%2C+Devvret+Rishi%2C+Jerr) [our card](https://md.research.elamur.ai/free/en/papers/wang-2020-cord-19-covid-19-open/)
32. Iain James Marshall and Byron C. Wallace. 2019. Toward systematic review automation: a practical guide to using machine learning tools in research synthesis. Systematic Reviews, 8. [find](https://scholar.google.com/scholar?q=Iain+James+Marshall+and+Byron+C%2E+Wallace%2E+2019%2E+Toward+systematic+review+automation%3A+a+practical+guide+to+using+machine+learning+tools+in+research+synthesis%2E+Systematic+Reviews%2C+8%2E)
33. Preslav I Nakov, Ariel S Schwartz, and Marti Hearst. 2004. Citances: Citation sentences for semantic analysis of bioscience text. In SIGIR workshop on Search and Discovery in Bioinformatics. [find](https://scholar.google.com/scholar?q=Preslav+I+Nakov%2C+Ariel+S+Schwartz%2C+and+Marti+Hearst%2E+2004%2E+Citances%3A+Citation+sentences+for+semantic+analysis+of+bioscience+text%2E+In+SIGIR+workshop+on+Search+and+Discovery+in+Bioinformatics%2E)
34. Benjamin Nye, Junyi Jessy Li, Roma Patel, Yinfei Yang, Iain James Marshall, Ani Nenkova, and Byron C. Wallace. 2018. A corpus with multi-level annotations of patients, interventions and outcomes to support language processing for medical literature. In ACL. [find](https://scholar.google.com/scholar?q=Benjamin+Nye%2C+Junyi+Jessy+Li%2C+Roma+Patel%2C+Yinfei+Yang%2C+Iain+James+Marshall%2C+Ani+Nenkova%2C+and+Byron+C%2E+Wallace%2E+2018%2E+A+corpus+with+multi%2Dlevel+annotations+of+patients%2C+interventions+and+outcomes+to+su) [our card](https://md.research.elamur.ai/free/en/papers/nye-2018-corpus-multi-level-annotations-patients/)
35. William Yang Wang. 2017. “liar, liar pants on fire”: A new benchmark dataset for fake news detection. In ACL. [find](https://scholar.google.com/scholar?q=William+Yang+Wang%2E+2017%2E+%E2%80%9Cliar%2C+liar+pants+on+fire%E2%80%9D%3A+A+new+benchmark+dataset+for+fake+news+detection%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/wang-2017-liar-liar-pants-fire-new/)
36. Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pier-ric Cistac, Tim Rault, R’emi Louf, Morgan Funtow-icz, and Jamie Brew. 2019. Huggingface’s transformers: State-of-the-art natural language processing. ArXiv, abs/1910.03771. [find](https://scholar.google.com/scholar?q=Thomas+Wolf%2C+Lysandre+Debut%2C+Victor+Sanh%2C+Julien+Chaumond%2C+Clement+Delangue%2C+Anthony+Moi%2C+Pier%2Dric+Cistac%2C+Tim+Rault%2C+R%E2%80%99emi+Louf%2C+Morgan+Funtow%2Dicz%2C+and+Jamie+Brew%2E+2019%2E+Huggingface%E2%80%99s+transformers%3A+S) [our card](https://md.research.elamur.ai/free/en/papers/wolf-2020-transformers-state-art-natural-language/)
37. Kashyap Popat, Subhabrata Mukherjee, Jannik Strötgen, and Gerhard Weikum. 2017. Where the truth lies: Explaining the credibility of emerging claims on the web and social media. In WWW. [find](https://scholar.google.com/scholar?q=Kashyap+Popat%2C+Subhabrata+Mukherjee%2C+Jannik+Stro%CC%88tgen%2C+and+Gerhard+Weikum%2E+2017%2E+Where+the+truth+lies%3A+Explaining+the+credibility+of+emerging+claims+on+the+web+and+social+media%2E+In+WWW%2E)
38. Tal Schuster, Darsh J. Shah, Yun Jie Serene Yeo, Daniel Filizzola, Enrico Santus, and Regina Barzilay. 2019. Towards debiasing fact verification models. In EMNLP. [find](https://scholar.google.com/scholar?q=Tal+Schuster%2C+Darsh+J%2E+Shah%2C+Yun+Jie+Serene+Yeo%2C+Daniel+Filizzola%2C+Enrico+Santus%2C+and+Regina+Barzilay%2E+2019%2E+Towards+debiasing+fact+verification+models%2E+In+EMNLP%2E) [our card](https://md.research.elamur.ai/free/en/papers/schuster-2019-debiasing-fact-verification-models/)
39. Amir Soleimani, Christof Monz, and Marcel Worring. 2019. Bert for evidence retrieval and claim verification. In European Conference on Information Retrieval. [find](https://scholar.google.com/scholar?q=Amir+Soleimani%2C+Christof+Monz%2C+and+Marcel+Worring%2E+2019%2E+Bert+for+evidence+retrieval+and+claim+verification%2E+In+European+Conference+on+Information+Retrieval%2E)
40. James Thorne, Andreas Vlachos, Christos Christodoulopoulos, and Arpit Mittal. 2018. Fever: a large-scale dataset for fact extraction and verification. In NAACL. [find](https://scholar.google.com/scholar?q=James+Thorne%2C+Andreas+Vlachos%2C+Christos+Christodoulopoulos%2C+and+Arpit+Mittal%2E+2018%2E+Fever%3A+a+large%2Dscale+dataset+for+fact+extraction+and+verification%2E+In+NAACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/thorne-2018-fever-large-scale-dataset-fact/)
41. Guy Tsafnat, Paul P Glasziou, Miew Keen Choong, Adam G. Dunn, Filippo Galgani, and Enrico W. Coiera. 2014. Systematic review automation technologies. Systematic Reviews, 3:74 – 74. [find](https://scholar.google.com/scholar?q=Guy+Tsafnat%2C+Paul+P+Glasziou%2C+Miew+Keen+Choong%2C+Adam+G%2E+Dunn%2C+Filippo+Galgani%2C+and+Enrico+W%2E+Coiera%2E+2014%2E+Systematic+review+automation+technologies%2E+Systematic+Reviews%2C+3%3A74+%E2%80%93+74%2E)
42. George Tsatsaronis, Georgios Balikas, Prodromos Malakasiotis, Ioannis Partalas, Matthias Zschunke, Michael R. Alvers, Dirk Weissenborn, Anastasia Krithara, Sergios Petridis, Dimitris Polychronopoulos, Yannis Almirantis, John Pavlopoulos, Nicolas Baskiotis, Patrick Gallinari, Thierry Artières, Axel-… [find](https://scholar.google.com/scholar?q=George+Tsatsaronis%2C+Georgios+Balikas%2C+Prodromos+Malakasiotis%2C+Ioannis+Partalas%2C+Matthias+Zschunke%2C+Michael+R%2E+Alvers%2C+Dirk+Weissenborn%2C+Anastasia+Krithara%2C+Sergios+Petridis%2C+Dimitris+Polychronopoulos%2C)