---
title: "Graph Chain-of-Thought — paper by Jin et al. (2024)"
description: "First, they build GRBench, a benchmark of manually designed question templates. 49 references, cited by 48 papers here."
authors: ["Bowen Jin", "Chulin Xie", "Jiawei Zhang", "Kashob Kumar Roy", "Yu Zhang", "Zheng Li", "Ruirui Li", "Xianfeng Tang", "Suhang Wang", "Yu Meng", "Jiawei Han"]
year: 2024
venue: "Findings of the Association for Computational Linguistics: ACL 2024"
source: "https://aclanthology.org/2024.findings-acl.11/"
doi: "10.18653/v1/2024.findings-acl.11"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/jin-2024-graph-chain-thought-augmenting-large/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/jin-2024-graph-chain-thought-augmenting-large/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/3/) / Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs

# Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs

**Authors:** [Bowen Jin](https://md.research.elamur.ai/free/en/authors/bowen-jin/), [Chulin Xie](https://md.research.elamur.ai/free/en/authors/chulin-xie/), Jiawei Zhang, Kashob Kumar Roy, [Yu Zhang](https://md.research.elamur.ai/free/en/authors/yu-zhang/), [Zheng Li](https://md.research.elamur.ai/free/en/authors/zheng-li/), Ruirui Li, Xianfeng Tang, Suhang Wang, [Yu Meng](https://md.research.elamur.ai/free/en/authors/yu-meng/) and [Jiawei Han](https://md.research.elamur.ai/free/en/authors/jiawei-han/) · **Year:** 2024 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2024](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2024](https://md.research.elamur.ai/free/en/venues/findings/2024/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2024.findings-acl.11/) · [PDF](https://aclanthology.org/2024.findings-acl.11.pdf) · [DOI 10.18653/v1/2024.findings-acl.11](https://doi.org/10.18653/v1/2024.findings-acl.11) · [OpenAlex](https://openalex.org/W4402671091)

**Citations:** 41 citations (OpenAlex, 2026-10-14) · 48 in our library, of the 141,840 papers whose bibliographies we read

## Summary
LLMs often hallucinate on knowledge-heavy questions. Standard retrieval augmentation treats each document as a separate unit, so it misses knowledge carried by links between texts, such as citations, co-purchases or legal references. Turning whole neighbourhoods into text is also impractical, because subgraphs grow exponentially with each hop and quickly overflow the context. The authors address this in two ways. First, they build GRBench, a benchmark of manually designed question templates. GPT-4 rephrases the templates, and answers are derived automatically from ten text-attributed graphs covering academia, e-commerce, literature, healthcare and law. Second, they propose Graph-CoT, which lets the model explore the graph step by step instead of reading it all at once. In each round, the LLM:
- reasons about what it already knows and what it still needs,
- issues graph operations such as locating nodes or checking neighbours,
- receives the results from executing those operations.

Rounds repeat until the model reaches an answer. Across three LLM backbones, Graph-CoT consistently beats the baselines. This suggests that iterative graph traversal is a practical way to ground LLMs in structured, interconnected knowledge.

## Key points
- GRBench has 1,740 questions over 10 graphs from 5 domains, with three difficulty levels:
  - easy: single-hop lookups,
  - medium: multi-hop reasoning,
  - hard: inductive reasoning that uses the graph as context.
- The graphs come from DBLP and Microsoft Academic Graph (six disciplines, including CS, Biology and Physics), Amazon product data, Goodreads, Hetionet (disease graph) and CourtListener (legal). The largest ones reach roughly 84M nodes (Freelaw) and about 313M edges (Amazon).
- Four computer science Ph.D. students wrote the question templates, and GPT-4 generated varied phrasings for each one.
- In each Graph-CoT iteration, the model reasons, then interacts with the graph, then receives the executed results. Code is available at github.com/PeterGriffinJin/Graph-CoT.
- The authors list several limitations and directions for future work:
  - question diversity is limited by the manual template design,
  - the backbones are API models that cannot practically be fine-tuned,
  - tree- or graph-based reasoning paradigms are suggested as next steps.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Illinois Urbana-Champaign](https://md.research.elamur.ai/free/en/universities/university-of-illinois-urbana-champaign/) — University, Urbana, United States · 108 works · 67,432 citations
- [Amazon](https://md.research.elamur.ai/free/en/companies/amazon/) — Company, Seattle, United States · 70 works · 39,977 citations
- [University of Virginia](https://md.research.elamur.ai/free/en/universities/university-of-virginia/) — University, Charlottesville, United States · 18 works · 8,786 citations
- [Pennsylvania State University](https://md.research.elamur.ai/free/en/universities/pennsylvania-state-university/) — University, State College, United States · 22 works · 4,878 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 9,086 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 8,889 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 9,296 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 9,206 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 1,282 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 1,343 works · [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 510 works

## Cite

Cite as: Bowen Jin, Chulin Xie, Jiawei Zhang, Kashob Kumar Roy, Yu Zhang, Zheng Li, Ruirui Li, Xianfeng Tang, Suhang Wang, Yu Meng and Jiawei Han. 2024. Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs. Findings of the Association for Computational Linguistics: ACL 2024.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{jin2024graph,
  title = {{Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs}},
  author = {Bowen Jin, Chulin Xie, Jiawei Zhang, Kashob Kumar Roy, Yu Zhang, Zheng Li, Ruirui Li, Xianfeng Tang, Suhang Wang, Yu Meng and Jiawei Han},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2024},
  year = {2024},
  doi = {10.18653/v1/2024.findings-acl.11},
  url = {https://doi.org/10.18653/v1/2024.findings-acl.11}
}
```

- [← previous Retrieval Head Mechanistically Explains Long-Context Factuality](https://md.research.elamur.ai/free/en/papers/wu-2024-retrieval-head-mechanistically-explains-long/)
- [next → Optimizing Instructions and Demonstrations for Multi-Stage Language Model Programs](https://md.research.elamur.ai/free/en/papers/ong-2024-optimizing-instructions-demonstrations-multi-stage/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/3/)

## References

49 references, 19 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abubakar Abid, Maheen Farooqi, and James Zou. 2021. [Persistent anti-muslim bias in large language models](https://md.research.elamur.ai/free/en/papers/abid-2021-persistent-anti-muslim-bias-large/). In AIES.
2. Xiaomei Bai, Mengyang Wang, Ivan Lee, Zhuo Yang, Xiangjie Kong, and Feng Xia. 2019. Scientific paper recommendation: A survey. Ieee Access, 7:9324– 9339. [find](https://scholar.google.com/scholar?q=Xiaomei+Bai%2C+Mengyang+Wang%2C+Ivan+Lee%2C+Zhuo+Yang%2C+Xiangjie+Kong%2C+and+Feng+Xia%2E+2019%2E+Scientific+paper+recommendation%3A+A+survey%2E+Ieee+Access%2C+7%3A9324%E2%80%93+9339%2E)
3. Maciej Besta, Nils Blach, Ales Kubicek, Robert Gerstenberger, Lukas Gianinazzi, Joanna Gajda, Tomasz Lehmann, Michal Podstawski, Hubert Niewiadomski, Piotr Nyczyk, et al. 2023. Graph of thoughts: Solving elaborate problems with large language models. arXiv preprint arXiv:2308.09687. [find](https://scholar.google.com/scholar?q=Maciej+Besta%2C+Nils+Blach%2C+Ales+Kubicek%2C+Robert+Gerstenberger%2C+Lukas+Gianinazzi%2C+Joanna+Gajda%2C+Tomasz+Lehmann%2C+Michal+Podstawski%2C+Hubert+Niewiadomski%2C+Piotr+Nyczyk%2C+et+al%2E+2023%2E+Graph+of+thoughts%3A+Solv)
4. Si Chen, Pengfei Wang, Wei Fang, Xingchen Deng, and Feng Zhang. 2019. Learning to predict charges for judgment with legal graph. In Artificial Neural Networks and Machine Learning–ICANN 2019: Text and Time Series: 28th International Conference on Artificial Neural Networks, Munich, Germany, Septembe… [find](https://scholar.google.com/scholar?q=Si+Chen%2C+Pengfei+Wang%2C+Wei+Fang%2C+Xingchen+Deng%2C+and+Feng+Zhang%2E+2019%2E+Learning+to+predict+charges+for+judgment+with+legal+graph%2E+In+Artificial+Neural+Networks+and+Machine+Learning%E2%80%93ICANN+2019%3A+Text+and)
5. Zhikai Chen, Haitao Mao, Hang Li, Wei Jin, Hongzhi Wen, Xiaochi Wei, Shuaiqiang Wang, Dawei Yin, Wenqi Fan, Hui Liu, et al. 2023. Exploring the potential of large language models (llms) in learning on graphs. arXiv preprint arXiv:2307.03393. — [arXiv:2307.03393](https://arxiv.org/abs/2307.03393) [find](https://scholar.google.com/scholar?q=Zhikai+Chen%2C+Haitao+Mao%2C+Hang+Li%2C+Wei+Jin%2C+Hongzhi+Wen%2C+Xiaochi+Wei%2C+Shuaiqiang+Wang%2C+Dawei+Yin%2C+Wenqi+Fan%2C+Hui+Liu%2C+et+al%2E+2023%2E+Exploring+the+potential+of+large+language+models+%28llms%29+in+learning+on)
6. Eli Chien, Wei-Cheng Chang, Cho-Jui Hsieh, Hsiang-Fu Yu, Jiong Zhang, Olgica Milenkovic, and Inderjit S Dhillon. 2021. Node feature extraction by self-supervised multi-scale neighborhood prediction. arXiv preprint arXiv:2111.00064. — [arXiv:2111.00064](https://arxiv.org/abs/2111.00064) [find](https://scholar.google.com/scholar?q=Eli+Chien%2C+Wei%2DCheng+Chang%2C+Cho%2DJui+Hsieh%2C+Hsiang%2DFu+Yu%2C+Jiong+Zhang%2C+Olgica+Milenkovic%2C+and+Inderjit+S+Dhillon%2E+2021%2E+Node+feature+extraction+by+self%2Dsupervised+multi%2Dscale+neighborhood+prediction%2E+a)
7. Zhengming Ding, Sheng Li, Ming Shao, and Yun Fu. 2018. Graph adaptive knowledge transfer for unsupervised domain adaptation. In Proceedings of the European Conference on Computer Vision (ECCV), pages 37–52. [find](https://scholar.google.com/scholar?q=Zhengming+Ding%2C+Sheng+Li%2C+Ming+Shao%2C+and+Yun+Fu%2E+2018%2E+Graph+adaptive+knowledge+transfer+for+unsupervised+domain+adaptation%2E+In+Proceedings+of+the+European+Conference+on+Computer+Vision+%28ECCV%29%2C+pages+)
8. Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Zhiyong Wu, Baobao Chang, Xu Sun, Jingjing Xu, and Zhifang Sui. 2022. [A survey for in-context learning](https://md.research.elamur.ai/free/en/papers/dong-2023-survey-context-learning/). arXiv preprint arXiv:2301.00234.
9. Keyu Duan, Qian Liu, Tat-Seng Chua, Shuicheng Yan, Wei Tsang Ooi, Qizhe Xie, and Junxian He. 2023. Simteg: A frustratingly simple approach improves textual graph learning. arXiv preprint arXiv:2308.02565. — [arXiv:2308.02565](https://arxiv.org/abs/2308.02565) [find](https://scholar.google.com/scholar?q=Keyu+Duan%2C+Qian+Liu%2C+Tat%2DSeng+Chua%2C+Shuicheng+Yan%2C+Wei+Tsang+Ooi%2C+Qizhe+Xie%2C+and+Junxian+He%2E+2023%2E+Simteg%3A+A+frustratingly+simple+approach+improves+textual+graph+learning%2E+arXiv+preprint+arXiv%3A2308%2E02)
10. Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, and Haofen Wang. 2023. [Retrieval-augmented generation for large language models: A survey](https://md.research.elamur.ai/free/en/papers/gao-2023-retrieval-augmented-generation-large-language/). arXiv preprint arXiv:2312.10997.
11. Bowen Jin, Wentao Zhang, Yu Zhang, Yu Meng, Xinyang Zhang, Qi Zhu, and Jiawei Han. 2023b. Patton: Language model pretraining on text-rich networks. arXiv preprint arXiv:2305.12268. [find](https://scholar.google.com/scholar?q=Bowen+Jin%2C+Wentao+Zhang%2C+Yu+Zhang%2C+Yu+Meng%2C+Xinyang+Zhang%2C+Qi+Zhu%2C+and+Jiawei+Han%2E+2023b%2E+Patton%3A+Language+model+pretraining+on+text%2Drich+networks%2E+arXiv+preprint+arXiv%3A2305%2E12268%2E)
12. Bowen Jin, Yu Zhang, Qi Zhu, and Jiawei Han. 2023c. Heterformer: Transformer-based deep node representation learning on heterogeneous text-rich networks. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 1020–1031. [find](https://scholar.google.com/scholar?q=Bowen+Jin%2C+Yu+Zhang%2C+Qi+Zhu%2C+and+Jiawei+Han%2E+2023c%2E+Heterformer%3A+Transformer%2Dbased+deep+node+representation+learning+on+heterogeneous+text%2Drich+networks%2E+In+Proceedings+of+the+29th+ACM+SIGKDD+Conferen)
13. Jeff Johnson, Matthijs Douze, and Hervé Jégou. 2019. [Billion-scale similarity search with GPUs](https://md.research.elamur.ai/free/en/papers/johnson-2017-billion-scale-similarity-search-gpus/). IEEE Transactions on Big Data, 7(3):535–547.
14. Vladimir Karpukhin, Barlas Oğuz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020. [Dense passage retrieval for open-domain question answering](https://md.research.elamur.ai/free/en/papers/karpukhin-2020-dense-passage-retrieval-open-domain/). arXiv preprint arXiv:2004.04906.
15. Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems, 33:9459–9474. [find](https://scholar.google.com/scholar?q=Patrick+Lewis%2C+Ethan+Perez%2C+Aleksandra+Piktus%2C+Fabio+Petroni%2C+Vladimir+Karpukhin%2C+Naman+Goyal%2C+Heinrich+K%C3%BCttler%2C+Mike+Lewis%2C+Wen%2Dtau+Yih%2C+Tim+Rockt%C3%A4schel%2C+et+al%2E+2020%2E+Retrieval%2Daugmented+generation+f)
16. Paul Pu Liang, Chiyu Wu, Louis-Philippe Morency, and Ruslan Salakhutdinov. 2021. [Towards understanding and mitigating social biases in language models](https://md.research.elamur.ai/free/en/papers/liang-2021-towards-understanding-mitigating-social-biases/). In ICML.
17. Nelson F Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, and Percy Liang. 2023. [Lost in the middle: How language models use long contexts](https://md.research.elamur.ai/free/en/papers/liu-2023-lost-middle-language-models-use/). arXiv preprint arXiv:2307.03172.
18. Ruining He and Julian McAuley. 2016. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In proceedings of the 25th international conference on world wide web, pages 507–517. [find](https://scholar.google.com/scholar?q=Ruining+He+and+Julian+McAuley%2E+2016%2E+Ups+and+downs%3A+Modeling+the+visual+evolution+of+fashion+trends+with+one%2Dclass+collaborative+filtering%2E+In+proceedings+of+the+25th+international+conference+on+world)
19. Ivan Herman and M Scott Marshall. 2000. Graphxml—an xml-based graph description format. In International Symposium on Graph Drawing, pages 52–62. Springer. [find](https://scholar.google.com/scholar?q=Ivan+Herman+and+M+Scott+Marshall%2E+2000%2E+Graphxml%E2%80%94an+xml%2Dbased+graph+description+format%2E+In+International+Symposium+on+Graph+Drawing%2C+pages+52%E2%80%9362%2E+Springer%2E)
20. Daniel Scott Himmelstein, Antoine Lizee, Christine Hessler, Leo Brueggeman, Sabrina L Chen, Dexter Hadley, Ari Green, Pouya Khankhanian, and Sergio E Baranzini. 2017. Systematic integration of biomedical knowledge prioritizes drugs for repurposing. Elife, 6:e26726. [find](https://scholar.google.com/scholar?q=Daniel+Scott+Himmelstein%2C+Antoine+Lizee%2C+Christine+Hessler%2C+Leo+Brueggeman%2C+Sabrina+L+Chen%2C+Dexter+Hadley%2C+Ari+Green%2C+Pouya+Khankhanian%2C+and+Sergio+E+Baranzini%2E+2017%2E+Systematic+integration+of+biomedi)
21. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. [Training language models to follow instructions with human feedback](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/). Advances in Neural Information Processing Systems, 35:27730–27744.
22. Vipula Rawte, Amit Sheth, and Amitava Das. 2023. [A survey of hallucination in large foundation models](https://md.research.elamur.ai/free/en/papers/rawte-2023-survey-hallucination-large-foundation-models/). arXiv preprint arXiv:2309.05922.
23. Gautier Izacard and Edouard Grave. 2020. [Leveraging passage retrieval with generative models for open domain question answering](https://md.research.elamur.ai/free/en/papers/izacard-2021-leveraging-passage-retrieval-generative-models/).
24. Ali Sadeghian, Laksshman Sundaram, Daisy Zhe Wang, William F Hamilton, Karl Branting, and Craig Pfeifer. 2018. Automatic semantic edge labeling over legal citation graphs. Artificial Intelligence and Law, 26:127–144. [find](https://scholar.google.com/scholar?q=Ali+Sadeghian%2C+Laksshman+Sundaram%2C+Daisy+Zhe+Wang%2C+William+F+Hamilton%2C+Karl+Branting%2C+and+Craig+Pfeifer%2E+2018%2E+Automatic+semantic+edge+labeling+over+legal+citation+graphs%2E+Artificial+Intelligence+and+)
25. Albert Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, et al. 2024. Mixtral of experts. arXiv preprint arXiv:2401.04088. [find](https://scholar.google.com/scholar?q=Albert+Jiang%2C+Alexandre+Sablayrolles%2C+Antoine+Roux%2C+Arthur+Mensch%2C+Blanche+Savary%2C+Chris+Bamford%2C+et+al%2E+2024%2E+Mixtral+of+experts%2E+arXiv+preprint+arXiv%3A2401%2E04088%2E)
26. Kurt Shuster, Spencer Poff, Moya Chen, Douwe Kiela, and Jason Weston. 2021. [Retrieval augmentation reduces hallucination in conversation](https://md.research.elamur.ai/free/en/papers/shuster-2021-retrieval-augmentation-reduces-hallucination-conversation/). arXiv preprint arXiv:2104.07567.
27. Bowen Jin, Gang Liu, Chi Han, Meng Jiang, Heng Ji, and Jiawei Han. 2023a. Large language models on graphs: A comprehensive survey. arXiv preprint arXiv:2312.02783. [find](https://scholar.google.com/scholar?q=Bowen+Jin%2C+Gang+Liu%2C+Chi+Han%2C+Meng+Jiang%2C+Heng+Ji%2C+and+Jiawei+Han%2E+2023a%2E+Large+language+models+on+graphs%3A+A+comprehensive+survey%2E+arXiv+preprint+arXiv%3A2312%2E02783%2E)
28. Jie Tang, Jing Zhang, Limin Yao, Juanzi Li, Li Zhang, and Zhong Su. 2008. Arnetminer: Extraction and mining of academic social networks. In KDD’08, pages 990–998. [find](https://scholar.google.com/scholar?q=Jie+Tang%2C+Jing+Zhang%2C+Limin+Yao%2C+Juanzi+Li%2C+Li+Zhang%2C+and+Zhong+Su%2E+2008%2E+Arnetminer%3A+Extraction+and+mining+of+academic+social+networks%2E+In+KDD%E2%80%9908%2C+pages+990%E2%80%93998%2E)
29. Yijun Tian, Huan Song, Zichen Wang, Haozhu Wang, Ziqing Hu, Fang Wang, Nitesh V Chawla, and Panpan Xu. 2023. Graph neural prompting with large language models. arXiv preprint arXiv:2309.15427. — [arXiv:2309.15427](https://arxiv.org/abs/2309.15427) [find](https://scholar.google.com/scholar?q=Yijun+Tian%2C+Huan+Song%2C+Zichen+Wang%2C+Haozhu+Wang%2C+Ziqing+Hu%2C+Fang+Wang%2C+Nitesh+V+Chawla%2C+and+Panpan+Xu%2E+2023%2E+Graph+neural+prompting+with+large+language+models%2E+arXiv+preprint+arXiv%3A2309%2E15427%2E+%E2%80%94+%5BarXi)
30. Guangzhong Sun, and Xing Xie. 2021. Graphformers: Gnn-nested transformers for representation learning on textual graph. Advances in Neural Information Processing Systems, 34:28798–28810. [find](https://scholar.google.com/scholar?q=Guangzhong+Sun%2C+and+Xing+Xie%2E+2021%2E+Graphformers%3A+Gnn%2Dnested+transformers+for+representation+learning+on+textual+graph%2E+Advances+in+Neural+Information+Processing+Systems%2C+34%3A28798%E2%80%9328810%2E)
31. SM Tonmoy, SM Zaman, Vinija Jain, Anku Rani, Vipula Rawte, Aman Chadha, and Amitava Das. 2024. [A comprehensive survey of hallucination mitigation techniques in large language models](https://md.research.elamur.ai/free/en/papers/tonmoy-2024-comprehensive-survey-hallucination-mitigation-techniques/). arXiv preprint arXiv:2401.01313.
32. Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L Griffiths, Yuan Cao, and Karthik Narasimhan. 2023. Tree of thoughts: Deliberate problem solving with large language models. arXiv preprint arXiv:2305.10601. [find](https://scholar.google.com/scholar?q=Shunyu+Yao%2C+Dian+Yu%2C+Jeffrey+Zhao%2C+Izhak+Shafran%2C+Thomas+L+Griffiths%2C+Yuan+Cao%2C+and+Karthik+Narasimhan%2E+2023%2E+Tree+of+thoughts%3A+Deliberate+problem+solving+with+large+language+models%2E+arXiv+preprint+ar)
33. Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288. [find](https://scholar.google.com/scholar?q=Hugo+Touvron%2C+Louis+Martin%2C+Kevin+Stone%2C+Peter+Albert%2C+Amjad+Almahairi%2C+Yasmine+Babaei%2C+Nikolay+Bashlykov%2C+Soumya+Batra%2C+Prajjwal+Bhargava%2C+Shruti+Bhosale%2C+et+al%2E+2023%2E+Llama+2%3A+Open+foundation+and+fi)
34. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2022. [React: Synergizing reasoning and acting in language models](https://md.research.elamur.ai/free/en/papers/yao-2022-react-synergizing-reasoning-acting-language/). arXiv preprint arXiv:2210.03629.
35. Mengting Wan and Julian McAuley. 2018. Item recommendation on monotonic behavior chains. In Proceedings of the 12th ACM conference on recommender systems, pages 86–94. [find](https://scholar.google.com/scholar?q=Mengting+Wan+and+Julian+McAuley%2E+2018%2E+Item+recommendation+on+monotonic+behavior+chains%2E+In+Proceedings+of+the+12th+ACM+conference+on+recommender+systems%2C+pages+86%E2%80%9394%2E)
36. Ruosong Ye, Caiqi Zhang, Runhui Wang, Shuyuan Xu, and Yongfeng Zhang. 2023. Natural language is all a graph needs. arXiv preprint arXiv:2308.07134. [find](https://scholar.google.com/scholar?q=Ruosong+Ye%2C+Caiqi+Zhang%2C+Runhui+Wang%2C+Shuyuan+Xu%2C+and+Yongfeng+Zhang%2E+2023%2E+Natural+language+is+all+a+graph+needs%2E+arXiv+preprint+arXiv%3A2308%2E07134%2E)
37. Muhan Zhang and Yixin Chen. 2018. Link prediction based on graph neural networks. Advances in neural information processing systems, 31. [find](https://scholar.google.com/scholar?q=Muhan+Zhang+and+Yixin+Chen%2E+2018%2E+Link+prediction+based+on+graph+neural+networks%2E+Advances+in+neural+information+processing+systems%2C+31%2E)
38. Kuansan Wang, Zhihong Shen, Chiyuan Huang, Chieh-Han Wu, Yuxiao Dong, and Anshul Kanakia. 2020. Microsoft academic graph: When experts are not enough. Quantitative Science Studies, 1(1):396–413. [find](https://scholar.google.com/scholar?q=Kuansan+Wang%2C+Zhihong+Shen%2C+Chiyuan+Huang%2C+Chieh%2DHan+Wu%2C+Yuxiao+Dong%2C+and+Anshul+Kanakia%2E+2020%2E+Microsoft+academic+graph%3A+When+experts+are+not+enough%2E+Quantitative+Science+Studies%2C+1%281%29%3A396%E2%80%93413%2E)
39. Yu Zhang, Bowen Jin, Qi Zhu, Yu Meng, and Jiawei Han. 2023a. The effect of metadata on scientific literature tagging: A cross-field cross-model study. In WWW’23, pages 1626–1637. [find](https://scholar.google.com/scholar?q=Yu+Zhang%2C+Bowen+Jin%2C+Qi+Zhu%2C+Yu+Meng%2C+and+Jiawei+Han%2E+2023a%2E+The+effect+of+metadata+on+scientific+literature+tagging%3A+A+cross%2Dfield+cross%2Dmodel+study%2E+In+WWW%E2%80%9923%2C+pages+1626%E2%80%931637%2E)
40. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). Advances in Neural Information Processing Systems, 35:24824–24837.
41. Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, et al. 2023b. [Siren’s song in the ai ocean: A survey on hallucination in large language models](https://md.research.elamur.ai/free/en/papers/zhang-2023-siren-s-song-ai-ocean/). arXiv preprint arXiv:2309.01219.
42. Yuanhao Wu, Juno Zhu, Siliang Xu, Kashun Shum, Cheng Niu, Randy Zhong, Juntong Song, and Tong Zhang. 2023. [Ragtruth: A hallucination corpus for developing trustworthy retrieval-augmented language models](https://md.research.elamur.ai/free/en/papers/niu-2024-ragtruth-hallucination-corpus-developing-trustworthy/). arXiv preprint arXiv:2401.00396.
43. Jianan Zhao, Meng Qu, Chaozhuo Li, Hao Yan, Qian Liu, Rui Li, Xing Xie, and Jian Tang. 2022. Learning on large-scale text-attributed graphs via variational inference. arXiv preprint arXiv:2210.14709. — [arXiv:2210.14709](https://arxiv.org/abs/2210.14709) [find](https://scholar.google.com/scholar?q=Jianan+Zhao%2C+Meng+Qu%2C+Chaozhuo+Li%2C+Hao+Yan%2C+Qian+Liu%2C+Rui+Li%2C+Xing+Xie%2C+and+Jian+Tang%2E+2022%2E+Learning+on+large%2Dscale+text%2Dattributed+graphs+via+variational+inference%2E+arXiv+preprint+arXiv%3A2210%2E14709%2E+)
44. Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and S Yu Philip. 2020. [A comprehensive survey on graph neural networks](https://md.research.elamur.ai/free/en/papers/wu-2019-comprehensive-survey-graph-neural-networks/). IEEE transactions on neural networks and learning systems, 32(1):4–24.
45. Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al. 2023. [A survey of large language models](https://md.research.elamur.ai/free/en/papers/zhao-2023-survey-large-language-models/). arXiv preprint arXiv:2303.18223.
46. Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, et al. 2023. [The rise and potential of large language model based agents: A survey](https://md.research.elamur.ai/free/en/papers/xi-2023-rise-potential-large-language/). arXiv preprint arXiv:2309.07864.
47. Shunxin Xiao, Shiping Wang, Yuanfei Dai, and Wenzhong Guo. 2022. Graph neural networks in node classification: survey and evaluation. Machine Vision and Applications, 33:1–19. [find](https://scholar.google.com/scholar?q=Shunxin+Xiao%2C+Shiping+Wang%2C+Yuanfei+Dai%2C+and+Wenzhong+Guo%2E+2022%2E+Graph+neural+networks+in+node+classification%3A+survey+and+evaluation%2E+Machine+Vision+and+Applications%2C+33%3A1%E2%80%9319%2E)
48. Siheng Xiong, Ali Payani, Ramana Kompella, and Faramarz Fekri. 2024. Large language models can learn temporal reasoning. arXiv preprint arXiv:2401.06853. [find](https://scholar.google.com/scholar?q=Siheng+Xiong%2C+Ali+Payani%2C+Ramana+Kompella%2C+and+Faramarz+Fekri%2E+2024%2E+Large+language+models+can+learn+temporal+reasoning%2E+arXiv+preprint+arXiv%3A2401%2E06853%2E)
49. Junhan Yang, Zheng Liu, Shitao Xiao, Chaozhuo Li, Defu Lian, Sanjay Agrawal, Amit Singh, [find](https://scholar.google.com/scholar?q=Junhan+Yang%2C+Zheng+Liu%2C+Shitao+Xiao%2C+Chaozhuo+Li%2C+Defu+Lian%2C+Sanjay+Agrawal%2C+Amit+Singh%2C)

*Updated 24 October 2026*