---
title: "SciRAG — paper by Ding et al. (2026) — summary and ideas"
description: "Scientific output keeps growing quickly, and existing retrieval-augmented generation (RAG) tools for… 25 references, cited by 3 papers here."
authors: ["Hang Ding", "Yilun Zhao", "Tiansheng Hu", "Zihang Wang", "Manasi Patwardhan", "Arman Cohan"]
year: 2026
venue: "Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.eacl-long.303/"
doi: "10.18653/v1/2026.eacl-long.303"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/ding-2026-scirag-adaptive-citation-aware-outline/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/ding-2026-scirag-adaptive-citation-aware-outline/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/2/) / SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific Literature

# SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific Literature

**Authors:** [Hang Ding](https://md.research.elamur.ai/free/en/authors/hang-ding/), [Yilun Zhao](https://md.research.elamur.ai/free/en/authors/yilun-zhao/), [Tiansheng Hu](https://md.research.elamur.ai/free/en/authors/tiansheng-hu/), Zihang Wang, [Manasi Patwardhan](https://md.research.elamur.ai/free/en/authors/manasi-patwardhan/) and [Arman Cohan](https://md.research.elamur.ai/free/en/authors/arman-cohan/) · **Year:** 2026 · **Venue:** [Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/eacl/) ([EACL 2026](https://md.research.elamur.ai/free/en/venues/eacl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.eacl-long.303/) · [PDF](https://aclanthology.org/2026.eacl-long.303.pdf) · [DOI 10.18653/v1/2026.eacl-long.303](https://doi.org/10.18653/v1/2026.eacl-long.303) · [OpenAlex](https://openalex.org/W7140088961)

**Citations:** 4 citations (OpenAlex, 2026-10-14) · [3](https://md.research.elamur.ai/free/en/papers/ding-2026-scirag-adaptive-citation-aware-outline/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Scientific output keeps growing quickly, and existing retrieval-augmented generation (RAG) tools for literature QA have four main weaknesses. They treat citations as flat text, retrieve in a rigid single pass, stitch snippets together without an overall plan, and are often closed and costly. SciRAG is an open-source framework that tackles these problems with three linked components:

- **Adaptive retrieval:** a controller chooses between deep sequential exploration and parallel handling of sub-questions.
- **Citation-aware symbolic reasoning:** the system follows both forward and backward citation links, groups papers into contribution chains (theory, experiment, method, application), and uses these chains to rerank evidence.
- **Outline-guided synthesis:** the system drafts a plan, critiques intermediate answers, fetches missing evidence, and then merges results bottom-up while keeping provenance links.

The authors evaluated SciRAG on open-retrieval benchmarks, including ScholarQA, SciFact, PubMedQA and QASA. It outperformed strong systems such as OpenScholar and PaperQA2 on factual accuracy and synthesis quality, and expert raters preferred its answers. The work matters because it shows that structured use of citation graphs and explicit answer planning make literature synthesis more reliable and verifiable.

## Key points
- The full SciRAG system scores 84.1 on SciFact, 69.0 on ScholarQA-CS and 4.79 on ScholarQA-MULTI.
- Replacing the symbolic reranker with a dense reranker lowers these scores by 10.7, 10.4 and 0.34. Removing the outline planner lowers them by 8.0, 16.9 and 0.72.
- Both sequential-only and parallel-only retrieval perform worse than the adaptive mix, with drops of roughly 7–11 points on SciFact and ScholarQA-CS.
- Retrieval tree depth works best at 1–2 levels. For example, PubMedQA rises from 76.2 at depth 0 to 84.1 at depth 2, and quality falls at depths 3–4 because irrelevant citations add noise.
- The system is built on general-purpose LLMs (GPT-4o, Llama-3.1) and is released at github.com/yale-nlp/SciRAG. Its stated limitations are computational overhead and a small pool of human annotators.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Shanghai Jiao Tong University](https://md.research.elamur.ai/free/en/universities/shanghai-jiao-tong-university/) — University, Shanghai, China · 149 works · 16,161 citations
- [Yale University](https://md.research.elamur.ai/free/en/universities/yale-university/) — University, New Haven, United States · 95 works · 12,765 citations
- [New York University Shanghai](https://md.research.elamur.ai/free/en/universities/new-york-university-shanghai/) — University, Shanghai, China · 8 works · 523 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works

🧭 Topics (1): [🔍 Information retrieval & search](https://md.research.elamur.ai/free/en/topics/information-retrieval/) · 473 works

## Cite

Cite as: Hang Ding, Yilun Zhao, Tiansheng Hu, Zihang Wang, Manasi Patwardhan and Arman Cohan. 2026. SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific Literature. Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{ding2026scirag,
  title = {{SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific Literature}},
  author = {Hang Ding, Yilun Zhao, Tiansheng Hu, Zihang Wang, Manasi Patwardhan and Arman Cohan},
  booktitle = {Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.eacl-long.303},
  url = {https://doi.org/10.18653/v1/2026.eacl-long.303}
}
```

- [← previous Scaling Collaborative Effort with Agents](https://md.research.elamur.ai/free/en/papers/shen-2026-scaling-collaborative-effort-agents/)
- [next → Stop When Enough: Adaptive Early-Stopping for Chain-of-Thought Reasoning](https://md.research.elamur.ai/free/en/papers/sun-2026-stop-when-enough-adaptive-early/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/2/)

## References

25 references, 8 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Shubham Agarwal, Issam H Laradji, Laurent Charlin, and Christopher Pal. 2024. Litllm: A toolkit for scientific literature review. arXiv preprint arXiv:2402.01788. [find](https://scholar.google.com/scholar?q=Shubham+Agarwal%2C+Issam+H+Laradji%2C+Laurent+Charlin%2C+and+Christopher+Pal%2E+2024%2E+Litllm%3A+A+toolkit+for+scientific+literature+review%2E+arXiv+preprint+arXiv%3A2402%2E01788%2E)
2. Akari Asai, Jacqueline He, Rulin Shao, Weijia Shi, Amanpreet Singh, Joseph Chee Chang, Kyle Lo, Luca Soldaini, Sergey Feldman, Mike D’arcy, et al. 2024. Openscholar: Synthesizing scientific literature with retrieval-augmented lms. arXiv preprint arXiv:2411.14199. [find](https://scholar.google.com/scholar?q=Akari+Asai%2C+Jacqueline+He%2C+Rulin+Shao%2C+Weijia+Shi%2C+Amanpreet+Singh%2C+Joseph+Chee+Chang%2C+Kyle+Lo%2C+Luca+Soldaini%2C+Sergey+Feldman%2C+Mike+D%E2%80%99arcy%2C+et+al%2E+2024%2E+Openscholar%3A+Synthesizing+scientific+literature)
3. Jinheon Baek, Sujay Kumar Jauhar, Silviu Cucerzan, and Sung Ju Hwang. 2025. [Researchagent: Iterative research idea generation over scientific literature with large language models](https://md.research.elamur.ai/free/en/papers/baek-2024-researchagent-iterative-research-idea/).
4. Iz Beltagy, Kyle Lo, and Arman Cohan. 2019. [Scibert: A pretrained language model for scientific text](https://md.research.elamur.ai/free/en/papers/beltagy-2019-scibert-pretrained-language-model-scientific/).
5. Lutz Bornmann and Hans-Dieter Daniel. 2008. What do citation counts measure? a review of studies on citing behavior. Journal of Documentation, 64(1):45–80. [find](https://scholar.google.com/scholar?q=Lutz+Bornmann+and+Hans%2DDieter+Daniel%2E+2008%2E+What+do+citation+counts+measure%3F+a+review+of+studies+on+citing+behavior%2E+Journal+of+Documentation%2C+64%281%29%3A45%E2%80%9380%2E)
6. Lutz Bornmann and Rüdiger Mutz. 2015. Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references. Journal of the association for information science and technology, 66(11):2215–2222. [find](https://scholar.google.com/scholar?q=Lutz+Bornmann+and+R%C3%BCdiger+Mutz%2E+2015%2E+Growth+rates+of+modern+science%3A+A+bibliometric+analysis+based+on+the+number+of+publications+and+cited+references%2E+Journal+of+the+association+for+information+scien)
7. Crossref. 2024. Crossref metadata statistics. [https://www.crossref.org/](https://www.crossref.org/). Accessed: 2025-09-29. [↗](https://www.crossref.org/)
8. Xinyan Guan, Jiali Zeng, Fandong Meng, Chunlei Xin, Yaojie Lu, Hongyu Lin, Xianpei Han, Le Sun, and Jie Zhou. 2025. Deeprag: Thinking to retrieval step by step for large language models. arXiv preprint arXiv:2502.01142. [find](https://scholar.google.com/scholar?q=Xinyan+Guan%2C+Jiali+Zeng%2C+Fandong+Meng%2C+Chunlei+Xin%2C+Yaojie+Lu%2C+Hongyu+Lin%2C+Xianpei+Han%2C+Le+Sun%2C+and+Jie+Zhou%2E+2025%2E+Deeprag%3A+Thinking+to+retrieval+step+by+step+for+large+language+models%2E+arXiv+preprin)
9. Yuntong Hu, Zhihan Lei, Zhongjie Dai, Allen Zhang, Abhinav Angirekula, Zheng Zhang, and Liang Zhao. 2025. Cg-rag: Research question answering by citation graph retrieval-augmented llms. [find](https://scholar.google.com/scholar?q=Yuntong+Hu%2C+Zhihan+Lei%2C+Zhongjie+Dai%2C+Allen+Zhang%2C+Abhinav+Angirekula%2C+Zheng+Zhang%2C+and+Liang+Zhao%2E+2025%2E+Cg%2Drag%3A+Research+question+answering+by+citation+graph+retrieval%2Daugmented+llms%2E)
10. Qian Huang, Jian Vora, Percy Liang, and Jure Leskovec. 2023. [Mlagentbench: Evaluating language agents on machine learning experimentation](https://md.research.elamur.ai/free/en/papers/huang-2023-mlagentbench-evaluating-language-agents/). In International Conference on Machine Learning.
11. Qiao Jin, Bhuwan Dhingra, Zhengping Liu, William Cohen, and Xinghua Lu. 2019. [PubMedQA: A dataset for biomedical research question answering](https://md.research.elamur.ai/free/en/papers/jin-2019-pubmedqa-dataset-biomedical-research-question/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Proce…
12. Seungone Kim, Juyoung Suk, Shayne Longpre, Bill Yuchen Lin, Jamin Shin, Sean Welleck, Graham Neubig, Moontae Lee, Kyungjae Lee, and Minjoon Seo. 2024. [Prometheus 2: An open source language model specialized in evaluating other language models](https://md.research.elamur.ai/free/en/papers/kim-2024-prometheus-2-open-source-language/). In Proceedings of the 2024 Conference on Empirical Metho…
13. Yoonjoo Lee, Kyungjae Lee, Sunghyun Park, Dasol Hwang, Jaehyeon Kim, Hong-In Lee, and Moontae Lee. 2023. QASA: Advanced question answering on scientific articles. In Proceedings of the 40th International Conference on Machine Learning, volume 202 of Proceedings of Machine Learning Research, pages 19… [find](https://scholar.google.com/scholar?q=Yoonjoo+Lee%2C+Kyungjae+Lee%2C+Sunghyun+Park%2C+Dasol+Hwang%2C+Jaehyeon+Kim%2C+Hong%2DIn+Lee%2C+and+Moontae+Lee%2E+2023%2E+QASA%3A+Advanced+question+answering+on+scientific+articles%2E+In+Proceedings+of+the+40th+Internatio)
14. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020. [Retrieval-augmented generation for knowledge-intensive nlp tasks](https://md.research.elamur.ai/free/en/papers/lewis-2020-retrieval-augmented-generation-knowledge-intensive/). Advances in neural information processing systems, 33:9459–9474.
15. OpenAI, :, Aaron Hurst, Adam Lerer, Adam P. Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, Aleksander M adry, Alex Baker-Whitcomb, Alex Beutel, Alex Borzunov, Alex Carney, Alex Chow, Alex Kirillov, Alex Nichol, Alex Paino, Alex Renzin, Alex… — [GPT-4o System Card](https://md.research.elamur.ai/free/en/papers/openai-2024-gpt-4o-system-card/)
16. Amanpreet Singh, Joseph Chee Chang, Chloe Anastasiades, Dany Haddad, Aakanksha Naik, Amber Tanaka, Angele Zamarron, Cecile Nguyen, Jena D. Hwang, Jason Dunkleberger, Matt Latzke, Smita Rao, Jaron Lochner, Rob Evans, Rodney Kinney, Daniel S. Weld, Doug Downey, and Sergey Feldman. 2025. Ai2 scholar qa… [find](https://scholar.google.com/scholar?q=Amanpreet+Singh%2C+Joseph+Chee+Chang%2C+Chloe+Anastasiades%2C+Dany+Haddad%2C+Aakanksha+Naik%2C+Amber+Tanaka%2C+Angele+Zamarron%2C+Cecile+Nguyen%2C+Jena+D%2E+Hwang%2C+Jason+Dunkleberger%2C+Matt+Latzke%2C+Smita+Rao%2C+Jaron+Loch)
17. Shruti Singh, Nandan Sarkar, and Arman Cohan. 2024. SciDQA: A deep reading comprehension dataset over scientific papers. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 20908–20923, Miami, Florida, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Shruti+Singh%2C+Nandan+Sarkar%2C+and+Arman+Cohan%2E+2024%2E+SciDQA%3A+A+deep+reading+comprehension+dataset+over+scientific+papers%2E+In+Proceedings+of+the+2024+Conference+on+Empirical+Methods+in+Natural+Language+)
18. Michael D. Skarlinski, Sam Cox, Jon M. Laurent, James D. Braza, Michaela Hinks, Michael J. Hammerling, Manvitha Ponnapati, Samuel G. Rodriques, and Andrew D. White. 2024. Language agents achieve superhuman synthesis of scientific knowledge. [find](https://scholar.google.com/scholar?q=Michael+D%2E+Skarlinski%2C+Sam+Cox%2C+Jon+M%2E+Laurent%2C+James+D%2E+Braza%2C+Michaela+Hinks%2C+Michael+J%2E+Hammerling%2C+Manvitha+Ponnapati%2C+Samuel+G%2E+Rodriques%2C+and+Andrew+D%2E+White%2E+2024%2E+Language+agents+achieve+super)
19. Minyang Tian, Luyu Gao, Shizhuo Dylan Zhang, Xinan Chen, Cunwei Fan, Xuefei Guo, Roland Haas, Pan Ji, Kittithat Krongchon, Yao Li, Shengyan Liu, Di Luo, Yutao Ma, Hao Tong, Kha Trinh, Chenyu Tian, Zihan Wang, Bohao Wu, Yanyu Xiong, Shengzhu Yin, Minhui Zhu, Kilian Lieret, Yanxin Lu, Genglin Liu, Yuf… [find](https://scholar.google.com/scholar?q=Minyang+Tian%2C+Luyu+Gao%2C+Shizhuo+Dylan+Zhang%2C+Xinan+Chen%2C+Cunwei+Fan%2C+Xuefei+Guo%2C+Roland+Haas%2C+Pan+Ji%2C+Kittithat+Krongchon%2C+Yao+Li%2C+Shengyan+Liu%2C+Di+Luo%2C+Yutao+Ma%2C+Hao+Tong%2C+Kha+Trinh%2C+Chenyu+Tian%2C+Zih)
20. David Wadden, Shanchuan Lin, Kyle Lo, Lucy Lu Wang, Madeleine van Zuylen, Arman Cohan, and Hannaneh Hajishirzi. 2020. [Fact or fiction: Verifying scientific claims](https://md.research.elamur.ai/free/en/papers/wadden-2020-fact-or-fiction-verifying-scientific/). In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 7534–7550, Online. Association…
21. Liang Wang, Haonan Chen, Nan Yang, Xiaolong Huang, Zhicheng Dou, and Furu Wei. 2025. Chain-of-retrieval augmented generation. [find](https://scholar.google.com/scholar?q=Liang+Wang%2C+Haonan+Chen%2C+Nan+Yang%2C+Xiaolong+Huang%2C+Zhicheng+Dou%2C+and+Furu+Wei%2E+2025%2E+Chain%2Dof%2Dretrieval+augmented+generation%2E)
22. Zonglin Yang, Xinya Du, Junxian Li, Jie Zheng, Soujanya Poria, and Erik Cambria. 2024. Large language models for automated open-domain scientific hypotheses discovery. [find](https://scholar.google.com/scholar?q=Zonglin+Yang%2C+Xinya+Du%2C+Junxian+Li%2C+Jie+Zheng%2C+Soujanya+Poria%2C+and+Erik+Cambria%2E+2024%2E+Large+language+models+for+automated+open%2Ddomain+scientific+hypotheses+discovery%2E)
23. Jiasheng Zhang, Jialin Chen, Ali Maatouk, Ngoc Bui, Qianqian Xie, Leandros Tassiulas, Jie Shao, Hua Xu, and Rex Ying. 2024. Litfm: A retrieval augmented structure-aware foundation model for citation graphs. arXiv preprint arXiv:2409.12177. — [arXiv:2409.12177](https://arxiv.org/abs/2409.12177) [find](https://scholar.google.com/scholar?q=Jiasheng+Zhang%2C+Jialin+Chen%2C+Ali+Maatouk%2C+Ngoc+Bui%2C+Qianqian+Xie%2C+Leandros+Tassiulas%2C+Jie+Shao%2C+Hua+Xu%2C+and+Rex+Ying%2E+2024%2E+Litfm%3A+A+retrieval+augmented+structure%2Daware+foundation+model+for+citation+g)
24. Yuxiang Zheng, Shichao Sun, Lin Qiu, Dongyu Ru, Cheng Jiayang, Xuefeng Li, Jifan Lin, Binjie Wang, Yun Luo, Renjie Pan, et al. 2024. Openresearcher: Unleashing ai for accelerated scientific research. arXiv preprint arXiv:2408.06941. [find](https://scholar.google.com/scholar?q=Yuxiang+Zheng%2C+Shichao+Sun%2C+Lin+Qiu%2C+Dongyu+Ru%2C+Cheng+Jiayang%2C+Xuefeng+Li%2C+Jifan+Lin%2C+Binjie+Wang%2C+Yun+Luo%2C+Renjie+Pan%2C+et+al%2E+2024%2E+Openresearcher%3A+Unleashing+ai+for+accelerated+scientific+research%2E+)
25. Ziyuan Zhuang, Zhiyang Zhang, Sitao Cheng, Fangkai Yang, Jia Liu, Shujian Huang, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, and Qi Zhang. 2024. Efficientrag: Efficient retriever for multi-hop question answering. arXiv preprint arXiv:2408.04259. [find](https://scholar.google.com/scholar?q=Ziyuan+Zhuang%2C+Zhiyang+Zhang%2C+Sitao+Cheng%2C+Fangkai+Yang%2C+Jia+Liu%2C+Shujian+Huang%2C+Qingwei+Lin%2C+Saravan+Rajmohan%2C+Dongmei+Zhang%2C+and+Qi+Zhang%2E+2024%2E+Efficientrag%3A+Efficient+retriever+for+multi%2Dhop+quest)

*Updated 31 October 2026*