---
title: "G-HiRel — paper by Pan et al. (2026) — summary and ideas"
description: "Large language models struggle when facts change after training: retraining or editing weights is expensive and scales poorly… 56 references."
authors: ["Yudai Pan", "Jiajie Hong", "Tianzhe Zhao", "Lingyun Song", "Lingling Zhang", "Yixin Chen", "Xuequn Shang"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.1561/"
doi: "10.18653/v1/2026.findings-acl.1561"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/pan-2026-g-hirel-enhancing-adaption-knowledge/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/pan-2026-g-hirel-enhancing-adaption-knowledge/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/31/) / G-HiRel: Enhancing the Adaption to Knowledge Updating for Large Language Model Reasoning

# G-HiRel: Enhancing the Adaption to Knowledge Updating for Large Language Model Reasoning

**Authors:** Yudai Pan, Jiajie Hong, [Tianzhe Zhao](https://md.research.elamur.ai/free/en/authors/tianzhe-zhao/), Lingyun Song, [Lingling Zhang](https://md.research.elamur.ai/free/en/authors/lingling-zhang/), Yixin Chen and Xuequn Shang · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.1561/) · [PDF](https://aclanthology.org/2026.findings-acl.1561.pdf) · [DOI 10.18653/v1/2026.findings-acl.1561](https://doi.org/10.18653/v1/2026.findings-acl.1561) · [OpenAlex](https://openalex.org/W7166811701)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Large language models struggle when facts change after training: retraining or editing weights is expensive and scales poorly, and in-context injection of edited facts often fails on multi-hop questions. G-HiRel addresses multi-hop reasoning under knowledge editing by using a knowledge graph as an updatable external memory. Its central idea is to rely on relation-only paths, such as religion → foundedBy, rather than on specific intermediate entities. Relation chains stay stable when individual facts are edited.

The pipeline has three stages:
- An LLM extracts a KG, and edits are applied to it by replacing or adding tail entities.
- Hierarchical instructions derived from the question drive a multi-layer, multi-step expansion that builds an edited subgraph. Candidate relational paths are ranked by semantic similarity to the question.
- The top paths are instantiated as reasoning paths and passed to the LLM to produce an answer.

On three multi-hop editing benchmarks, the authors report gains in accuracy and interpretability over prior state-of-the-art methods. This matters for keeping LLM-based systems current without touching model weights.

## Key points
- Evaluation uses multi-hop QA benchmarks with edited facts, including MQuAKE-CF-3k and MQuAKE-T. Code is available at github.com/HJJ-designed/G-HiRel.
- Ablations show that every component contributes: hierarchical instructions (HI), semantics-based relational path selection (RPS), multi-layer expansion (ML) and multi-step expansion (MS). Removing HI hurts the most.
- Keeping the top T = 3 relational paths per step worked best. Fewer paths miss key evidence, and more paths add noise.
- MiniLM-L6-v3 was the best path encoder, ahead of DeBERTa-v3-Large, RoBERTa-Large and the Flan-T5-Large encoder. Flan-T5-Large was the best layer-transition discriminator, outperforming LLMs such as GPT-4o-mini, Vicuna-7B and GPT-J-6B.
- The stated limitation is that the system has no backtracking once a reasoning path goes astray. This also explains why question decomposition performed worse than guiding retrieval with the full question.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Xi'an Jiaotong University](https://md.research.elamur.ai/free/en/universities/xi-an-jiaotong-university/) — University, Xi'an, China · 22 works · 36,046 citations
- [Northwestern Polytechnical University](https://md.research.elamur.ai/free/en/universities/northwestern-polytechnical-university/) — University, Xi'an, China · 13 works · 67 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

🧭 Topics (2): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works · [🧮 Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) · 1,426 works

## Cite

Cite as: Yudai Pan, Jiajie Hong, Tianzhe Zhao, Lingyun Song, Lingling Zhang, Yixin Chen and Xuequn Shang. 2026. G-HiRel: Enhancing the Adaption to Knowledge Updating for Large Language Model Reasoning. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{pan2026g,
  title = {{G-HiRel: Enhancing the Adaption to Knowledge Updating for Large Language Model Reasoning}},
  author = {Yudai Pan, Jiajie Hong, Tianzhe Zhao, Lingyun Song, Lingling Zhang, Yixin Chen and Xuequn Shang},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.1561},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.1561}
}
```

- [← previous G&P2P: A Multi-Source Approach to Grapheme-to-Phoneme Conversion](https://md.research.elamur.ai/free/en/papers/peng-2026-g-p2p-multi-source-approach/)
- [next → GaLa: Hypergraph-Guided Visual Language Models for Procedural Planning](https://md.research.elamur.ai/free/en/papers/wang-2026-gala-hypergraph-guided-visual-language/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/31/)

## References

56 references, 14 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, and 1 others. 2023. [Gpt-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). arXiv preprint arXiv:2303.08774.
2. Xiao Bi, Deli Chen, Guanting Chen, Shanhuang Chen, Damai Dai, Chengqi Deng, Honghui Ding, Kai Dong, Qiushi Du, Zhe Fu, Huazuo Gao, Kaige Gao, Wenjun Gao, Ruiqi Ge, Kang Guan, Daya Guo, Jianzhong Guo, Guangbo Hao, Zhewen Hao, and 67 others. 2024. Deepseek LLM: scaling open-source language models with… [find](https://scholar.google.com/scholar?q=Xiao+Bi%2C+Deli+Chen%2C+Guanting+Chen%2C+Shanhuang+Chen%2C+Damai+Dai%2C+Chengqi+Deng%2C+Honghui+Ding%2C+Kai+Dong%2C+Qiushi+Du%2C+Zhe+Fu%2C+Huazuo+Gao%2C+Kaige+Gao%2C+Wenjun+Gao%2C+Ruiqi+Ge%2C+Kang+Guan%2C+Daya+Guo%2C+Jianzhong+Guo%2C+)
3. Shulin Cao, Jiaxin Shi, Liangming Pan, Lunyiu Nie, Yutong Xiang, Lei Hou, Juanzi Li, Bin He, and Hanwang Zhang. 2022. Kqa pro: A dataset with explicit compositional programs for complex question answering over knowledge base. In Proceedings of the 60th Annual Meeting of the Association for Computati… [find](https://scholar.google.com/scholar?q=Shulin+Cao%2C+Jiaxin+Shi%2C+Liangming+Pan%2C+Lunyiu+Nie%2C+Yutong+Xiang%2C+Lei+Hou%2C+Juanzi+Li%2C+Bin+He%2C+and+Hanwang+Zhang%2E+2022%2E+Kqa+pro%3A+A+dataset+with+explicit+compositional+programs+for+complex+question+answe)
4. Liyi Chen, Panrong Tong, Zhongming Jin, Ying Sun, Jieping Ye, and Hui Xiong. 2024a. Plan-on-graph: Self-correcting adaptive planning of large language model on knowledge graphs. Advances in Neural Information Processing Systems, 37:37665–37691. [find](https://scholar.google.com/scholar?q=Liyi+Chen%2C+Panrong+Tong%2C+Zhongming+Jin%2C+Ying+Sun%2C+Jieping+Ye%2C+and+Hui+Xiong%2E+2024a%2E+Plan%2Don%2Dgraph%3A+Self%2Dcorrecting+adaptive+planning+of+large+language+model+on+knowledge+graphs%2E+Advances+in+Neural+Inf)
5. Ruirui Chen, Weifeng Jiang, Chengwei Qin, Ishaan Singh Rawal, Cheston Tan, Dongkyu Choi, Bo Xiong, and Bo Ai. 2024b. Llm-based multi-hop question answering with knowledge graph integration in evolving environments. In Findings of the Association for Computational Linguistics: EMNLP, pages 14438–1445… [find](https://scholar.google.com/scholar?q=Ruirui+Chen%2C+Weifeng+Jiang%2C+Chengwei+Qin%2C+Ishaan+Singh+Rawal%2C+Cheston+Tan%2C+Dongkyu+Choi%2C+Bo+Xiong%2C+and+Bo+Ai%2E+2024b%2E+Llm%2Dbased+multi%2Dhop+question+answering+with+knowledge+graph+integration+in+evolving)
6. Siyuan Cheng, Ningyu Zhang, Bozhong Tian, Xi Chen, Qingbin Liu, and Huajun Chen. 2024a. Editing language model-based knowledge graph embeddings. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 17835–17843. [find](https://scholar.google.com/scholar?q=Siyuan+Cheng%2C+Ningyu+Zhang%2C+Bozhong+Tian%2C+Xi+Chen%2C+Qingbin+Liu%2C+and+Huajun+Chen%2E+2024a%2E+Editing+language+model%2Dbased+knowledge+graph+embeddings%2E+In+Proceedings+of+the+AAAI+Conference+on+Artificial+Int)
7. Xin Cheng, Di Luo, Xiuying Chen, Lemao Liu, Dongyan Zhao, and Rui Yan. 2024b. [Lift yourself up: Retrieval-augmented text generation with self-memory](https://md.research.elamur.ai/free/en/papers/cheng-2023-lift-yourself-up-retrieval-augmented/). Advances in Neural Information Processing Systems, 36.
8. Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023. Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality. [find](https://scholar.google.com/scholar?q=Wei%2DLin+Chiang%2C+Zhuohan+Li%2C+Zi+Lin%2C+Ying+Sheng%2C+Zhanghao+Wu%2C+Hao+Zhang%2C+Lianmin+Zheng%2C+Siyuan+Zhuang%2C+Yonghao+Zhuang%2C+Joseph+E%2E+Gonzalez%2C+Ion+Stoica%2C+and+Eric+P%2E+Xing%2E+2023%2E+Vicuna%3A+An+open%2Dsource+cha)
9. Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, and 1 others. 2023. [Palm: Scaling language modeling with pathways](https://md.research.elamur.ai/free/en/papers/chowdhery-2022-palm-scaling-language-modeling-pathways/). Journal of Machine Learning Research, 24(240):1–113.
10. Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Alex Castro-Ros, Marie Pellat, Kevin Robinson, and 16 others. 2024.… [find](https://scholar.google.com/scholar?q=Hyung+Won+Chung%2C+Le+Hou%2C+Shayne+Longpre%2C+Barret+Zoph%2C+Yi+Tay%2C+William+Fedus%2C+Yunxuan+Li%2C+Xuezhi+Wang%2C+Mostafa+Dehghani%2C+Siddhartha+Brahma%2C+Albert+Webson%2C+Shixiang+Shane+Gu%2C+Zhuyun+Dai%2C+Mirac+Suzgun%2C+X)
11. Junnan Dong, Qinggang Zhang, Chuang Zhou, Hao Chen, Daochen Zha, and Xiao Huang. 2024. Cost-efficient knowledge-based question answering with large language models. In Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, NeurIPS 2024,… [find](https://scholar.google.com/scholar?q=Junnan+Dong%2C+Qinggang+Zhang%2C+Chuang+Zhou%2C+Hao+Chen%2C+Daochen+Zha%2C+and+Xiao+Huang%2E+2024%2E+Cost%2Defficient+knowledge%2Dbased+question+answering+with+large+language+models%2E+In+Advances+in+Neural+Information+P)
12. Junfeng Fang, Houcheng Jiang, Kun Wang, Yunshan Ma, Shi Jie, Xiang Wang, Xiangnan He, and Tat-Seng Chua. 2024. Alphaedit: Null-space constrained knowledge editing for language models. arXiv preprint arXiv:2410.02355. [find](https://scholar.google.com/scholar?q=Junfeng+Fang%2C+Houcheng+Jiang%2C+Kun+Wang%2C+Yunshan+Ma%2C+Shi+Jie%2C+Xiang+Wang%2C+Xiangnan+He%2C+and+Tat%2DSeng+Chua%2E+2024%2E+Alphaedit%3A+Null%2Dspace+constrained+knowledge+editing+for+language+models%2E+arXiv+preprint+a)
13. Junfeng Fang, Houcheng Jiang, Kun Wang, Yunshan Ma, Jie Shi, Xiang Wang, Xiangnan He, and Tat-Seng Chua. 2025. Alphaedit: Null-space constrained model editing for language models. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Junfeng+Fang%2C+Houcheng+Jiang%2C+Kun+Wang%2C+Yunshan+Ma%2C+Jie+Shi%2C+Xiang+Wang%2C+Xiangnan+He%2C+and+Tat%2DSeng+Chua%2E+2025%2E+Alphaedit%3A+Null%2Dspace+constrained+model+editing+for+language+models%2E+In+The+Thirteenth+In)
14. Jiazhan Feng, Chongyang Tao, Xiubo Geng, Tao Shen, Can Xu, Guodong Long, Dongyan Zhao, and Daxin Jiang. 2024. Synergistic interplay between search and large language models for information retrieval. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1… [find](https://scholar.google.com/scholar?q=Jiazhan+Feng%2C+Chongyang+Tao%2C+Xiubo+Geng%2C+Tao+Shen%2C+Can+Xu%2C+Guodong+Long%2C+Dongyan+Zhao%2C+and+Daxin+Jiang%2E+2024%2E+Synergistic+interplay+between+search+and+large+language+models+for+information+retrieval%2E+)
15. Michael R. Glass, Gaetano Rossiello, Md. Faisal Mahbub Chowdhury, Ankita Naik, Pengshan Cai, and Alfio Gliozzo. 2022. [Re2g: Retrieve, rerank, generate](https://md.research.elamur.ai/free/en/papers/glass-2022-re2g-retrieve-rerank-generate/). In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, N…
16. Hengrui Gu, Kaixiong Zhou, Xiaotian Han, Ninghao Liu, Ruobing Wang, and Xin Wang. 2024. Pokemqa: Programmable knowledge editing for multi-hop question answering. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Tha… [find](https://scholar.google.com/scholar?q=Hengrui+Gu%2C+Kaixiong+Zhou%2C+Xiaotian+Han%2C+Ninghao+Liu%2C+Ruobing+Wang%2C+and+Xin+Wang%2E+2024%2E+Pokemqa%3A+Programmable+knowledge+editing+for+multi%2Dhop+question+answering%2E+In+Proceedings+of+the+62nd+Annual+Meet)
17. Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, and 1 others. 2025. [Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2025-deepseek-r1-incentivizing-reasoning-capability/). arXiv preprint arXiv:2501.12948.
18. Haoyu Han, Yaochen Xie, Hui Liu, Xianfeng Tang, Sreyashi Nag, William Headden, Yang Li, Chen Luo, Shuiwang Ji, Qi He, and 1 others. 2025. Reasoning with graphs: Structuring implicit knowledge to enhance llms reasoning. In Findings of the Association for Computational Linguistics: ACL 2025, pages 256… [find](https://scholar.google.com/scholar?q=Haoyu+Han%2C+Yaochen+Xie%2C+Hui+Liu%2C+Xianfeng+Tang%2C+Sreyashi+Nag%2C+William+Headden%2C+Yang+Li%2C+Chen+Luo%2C+Shuiwang+Ji%2C+Qi+He%2C+and+1+others%2E+2025%2E+Reasoning+with+graphs%3A+Structuring+implicit+knowledge+to+enhan)
19. Pengcheng He, Jianfeng Gao, and Weizhu Chen. 2023. [Debertav3: Improving deberta using electra-style pre-training with gradient-disentangled embedding sharing](https://md.research.elamur.ai/free/en/papers/he-2021-debertav3-improving-deberta-using-electra/). In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net.
20. Xiaopeng Li, Shasha Li, Shezheng Song, Jing Yang, Jun Ma, and Jie Yu. 2024. Pmet: Precise model editing in a transformer. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 18564–18572. [find](https://scholar.google.com/scholar?q=Xiaopeng+Li%2C+Shasha+Li%2C+Shezheng+Song%2C+Jing+Yang%2C+Jun+Ma%2C+and+Jie+Yu%2E+2024%2E+Pmet%3A+Precise+model+editing+in+a+transformer%2E+In+Proceedings+of+the+AAAI+Conference+on+Artificial+Intelligence%2C+volume+38%2C+p)
21. Xujian Liang and Zhaoquan Gu. 2025. Fast think-on-graph: Wider, deeper and faster reasoning of large language model on knowledge graph. In AAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, pages 24558–24566. AAAI Press. [find](https://scholar.google.com/scholar?q=Xujian+Liang+and+Zhaoquan+Gu%2E+2025%2E+Fast+think%2Don%2Dgraph%3A+Wider%2C+deeper+and+faster+reasoning+of+large+language+model+on+knowledge+graph%2E+In+AAAI%2D25%2C+Sponsored+by+the+Association+for+the+Advancement+of+)
22. Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. [Roberta: A robustly optimized BERT pretraining approach](https://md.research.elamur.ai/free/en/papers/liu-2019-roberta-robustly-optimized-bert-pretraining/). CoRR, abs/1907.11692.
23. Yifan Lu, Yigeng Zhou, Jing Li, Yequan Wang, Xuebo Liu, Daojing He, Fangming Liu, and Min Zhang. 2025. Knowledge editing with dynamic knowledge graphs for multi-hop question answering. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 24741–24749. [find](https://scholar.google.com/scholar?q=Yifan+Lu%2C+Yigeng+Zhou%2C+Jing+Li%2C+Yequan+Wang%2C+Xuebo+Liu%2C+Daojing+He%2C+Fangming+Liu%2C+and+Min+Zhang%2E+2025%2E+Knowledge+editing+with+dynamic+knowledge+graphs+for+multi%2Dhop+question+answering%2E+In+Proceedings+)
24. Linhao Luo, Yuan-Fang Li, Gholamreza Haffari, and Shirui Pan. 2024a. Reasoning on graphs: Faithful and interpretable large language model reasoning. In The Twelfth International Conference on Learning Representations, ICLR. OpenReview.net. [find](https://scholar.google.com/scholar?q=Linhao+Luo%2C+Yuan%2DFang+Li%2C+Gholamreza+Haffari%2C+and+Shirui+Pan%2E+2024a%2E+Reasoning+on+graphs%3A+Faithful+and+interpretable+large+language+model+reasoning%2E+In+The+Twelfth+International+Conference+on+Learning)
25. Linhao Luo, Yuan-Fang Li, Gholamreza Haffari, and Shirui Pan. 2024b. Reasoning on graphs: Faithful and interpretable large language model reasoning. In The Twelfth International Conference on Learning Representations, ICLR. OpenReview.net. [find](https://scholar.google.com/scholar?q=Linhao+Luo%2C+Yuan%2DFang+Li%2C+Gholamreza+Haffari%2C+and+Shirui+Pan%2E+2024b%2E+Reasoning+on+graphs%3A+Faithful+and+interpretable+large+language+model+reasoning%2E+In+The+Twelfth+International+Conference+on+Learning)
26. Yun Luo, Zhen Yang, Fandong Meng, Yafu Li, Jie Zhou, and Yue Zhang. 2023. An empirical study of catastrophic forgetting in large language models during continual fine-tuning. arXiv preprint arXiv:2308.08747. [find](https://scholar.google.com/scholar?q=Yun+Luo%2C+Zhen+Yang%2C+Fandong+Meng%2C+Yafu+Li%2C+Jie+Zhou%2C+and+Yue+Zhang%2E+2023%2E+An+empirical+study+of+catastrophic+forgetting+in+large+language+models+during+continual+fine%2Dtuning%2E+arXiv+preprint+arXiv%3A2308)
27. Mingyu Derek Ma, Xiaoxuan Wang, Po-Nien Kung, P Jeffrey Brantingham, Nanyun Peng, and Wei Wang. 2023. Star: Improving low-resource information extraction by structure-to-text data generation with large language models. In NeurIPS 2023 Workshop on Synthetic Data Generation with Generative AI. [find](https://scholar.google.com/scholar?q=Mingyu+Derek+Ma%2C+Xiaoxuan+Wang%2C+Po%2DNien+Kung%2C+P+Jeffrey+Brantingham%2C+Nanyun+Peng%2C+and+Wei+Wang%2E+2023%2E+Star%3A+Improving+low%2Dresource+information+extraction+by+structure%2Dto%2Dtext+data+generation+with+larg)
28. Aman Madaan, Niket Tandon, Peter Clark, and Yiming Yang. 2022. Memory-assisted prompt editing to improve GPT-3 after deployment. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP, pages 2833–2861. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Aman+Madaan%2C+Niket+Tandon%2C+Peter+Clark%2C+and+Yiming+Yang%2E+2022%2E+Memory%2Dassisted+prompt+editing+to+improve+GPT%2D3+after+deployment%2E+In+Proceedings+of+the+2022+Conference+on+Empirical+Methods+in+Natural+L)
29. Costas Mavromatis and George Karypis. 2024. GNN-RAG: graph neural retrieval for large language model reasoning. CoRR, abs/2405.20139. [find](https://scholar.google.com/scholar?q=Costas+Mavromatis+and+George+Karypis%2E+2024%2E+GNN%2DRAG%3A+graph+neural+retrieval+for+large+language+model+reasoning%2E+CoRR%2C+abs%2F2405%2E20139%2E)
30. Kevin Meng, Arnab Sen Sharma, Alex J. Andonian, Yonatan Belinkov, and David Bau. 2023. Mass-editing memory in a transformer. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net. [find](https://scholar.google.com/scholar?q=Kevin+Meng%2C+Arnab+Sen+Sharma%2C+Alex+J%2E+Andonian%2C+Yonatan+Belinkov%2C+and+David+Bau%2E+2023%2E+Mass%2Dediting+memory+in+a+transformer%2E+In+The+Eleventh+International+Conference+on+Learning+Representations%2C+ICLR+)
31. Eric Mitchell, Charles Lin, Antoine Bosselut, Chelsea Finn, and Christopher D. Manning. 2022. Fast model editing at scale. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25-29, 2022. OpenReview.net. [find](https://scholar.google.com/scholar?q=Eric+Mitchell%2C+Charles+Lin%2C+Antoine+Bosselut%2C+Chelsea+Finn%2C+and+Christopher+D%2E+Manning%2E+2022%2E+Fast+model+editing+at+scale%2E+In+The+Tenth+International+Conference+on+Learning+Representations%2C+ICLR+2022%2C)
32. João Monteiro, Pierre-André Noël, Étienne Marcotte, Sai Rajeswar Mudumba, Valentina Zantedeschi, David Vázquez, Nicolas Chapados, Chris Pal, and Perouz Taslakian. 2024. Repliqa: A question-answering dataset for benchmarking llms on unseen reference content. In Advances in Neural Information Processi… [find](https://scholar.google.com/scholar?q=Jo%C3%A3o+Monteiro%2C+Pierre%2DAndr%C3%A9+No%C3%ABl%2C+%C3%89tienne+Marcotte%2C+Sai+Rajeswar+Mudumba%2C+Valentina+Zantedeschi%2C+David+V%C3%A1zquez%2C+Nicolas+Chapados%2C+Chris+Pal%2C+and+Perouz+Taslakian%2E+2024%2E+Repliqa%3A+A+question%2Danswering+d)
33. Shiwen Ni, Dingwei Chen, Chengming Li, Xiping Hu, Ruifeng Xu, and Min Yang. 2024. Forgetting before learning: Utilizing parametric arithmetic for knowledge updating in large language models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Pa… [find](https://scholar.google.com/scholar?q=Shiwen+Ni%2C+Dingwei+Chen%2C+Chengming+Li%2C+Xiping+Hu%2C+Ruifeng+Xu%2C+and+Min+Yang%2E+2024%2E+Forgetting+before+learning%3A+Utilizing+parametric+arithmetic+for+knowledge+updating+in+large+language+models%2E+In+Procee)
34. Yunjia Qi, Hao Peng, Xiaozhi Wang, Bin Xu, Lei Hou, and Juanzi Li. 2024. ADELIE: aligning large language models on information extraction. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP 2024, Miami, FL, USA, November 12-16, 2024, pages 7371–7387. Ass… [find](https://scholar.google.com/scholar?q=Yunjia+Qi%2C+Hao+Peng%2C+Xiaozhi+Wang%2C+Bin+Xu%2C+Lei+Hou%2C+and+Juanzi+Li%2E+2024%2E+ADELIE%3A+aligning+large+language+models+on+information+extraction%2E+In+Proceedings+of+the+2024+Conference+on+Empirical+Methods+in)
35. Nils Reimers and Iryna Gurevych. 2019. [Sentence-bert: Sentence embeddings using siamese bert-networks](https://md.research.elamur.ai/free/en/papers/reimers-2019-sentence-bert-sentence-embeddings-siamese/). In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing.
36. Thomas Scialom, Tuhin Chakrabarty, and Smaranda Muresan. 2022. Fine-tuned language models are continual learners. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP, pages 6107–6122. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Thomas+Scialom%2C+Tuhin+Chakrabarty%2C+and+Smaranda+Muresan%2E+2022%2E+Fine%2Dtuned+language+models+are+continual+learners%2E+In+Proceedings+of+the+2022+Conference+on+Empirical+Methods+in+Natural+Language+Process)
37. Zhihong Shao, Yeyun Gong, Yelong Shen, Minlie Huang, Nan Duan, and Weizhu Chen. 2023. [Enhancing retrieval-augmented large language models with iterative retrieval-generation synergy](https://md.research.elamur.ai/free/en/papers/shao-2023-enhancing-retrieval-augmented-large-language/). In Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023, pages 9248–…
38. Yucheng Shi, Qiaoyu Tan, Xuansheng Wu, Shaochen Zhong, Kaixiong Zhou, and Ninghao Liu. 2024a. Retrieval-enhanced knowledge editing in language models for multi-hop question answering. In Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, pages 2056–2066. [find](https://scholar.google.com/scholar?q=Yucheng+Shi%2C+Qiaoyu+Tan%2C+Xuansheng+Wu%2C+Shaochen+Zhong%2C+Kaixiong+Zhou%2C+and+Ninghao+Liu%2E+2024a%2E+Retrieval%2Denhanced+knowledge+editing+in+language+models+for+multi%2Dhop+question+answering%2E+In+Proceedings+o)
39. Yucheng Shi, Qiaoyu Tan, Xuansheng Wu, Shaochen Zhong, Kaixiong Zhou, and Ninghao Liu. 2024b. Retrieval-enhanced knowledge editing in language models for multi-hop question answering. In Proceedings of the 33rd ACM International Conference on Information and Knowledge Management, CIKM, pages 2056–20… [find](https://scholar.google.com/scholar?q=Yucheng+Shi%2C+Qiaoyu+Tan%2C+Xuansheng+Wu%2C+Shaochen+Zhong%2C+Kaixiong+Zhou%2C+and+Ninghao+Liu%2E+2024b%2E+Retrieval%2Denhanced+knowledge+editing+in+language+models+for+multi%2Dhop+question+answering%2E+In+Proceedings+o)
40. Jiashuo Sun, Chengjin Xu, Lumingyuan Tang, Saizhuo Wang, Chen Lin, Yeyun Gong, Lionel M. Ni, Heung-Yeung Shum, and Jian Guo. 2024. Think-on-graph: Deep and responsible reasoning of large language model on knowledge graph. In The Twelfth International Conference on Learning Representations, ICLR. [find](https://scholar.google.com/scholar?q=Jiashuo+Sun%2C+Chengjin+Xu%2C+Lumingyuan+Tang%2C+Saizhuo+Wang%2C+Chen+Lin%2C+Yeyun+Gong%2C+Lionel+M%2E+Ni%2C+Heung%2DYeung+Shum%2C+and+Jian+Guo%2E+2024%2E+Think%2Don%2Dgraph%3A+Deep+and+responsible+reasoning+of+large+language+mode)
41. Qiaoyu Tang, Jiawei Chen, Zhuoqun Li, Bowen Yu, Yaojie Lu, Cheng Fu, Haiyang Yu, Hongyu Lin, Fei Huang, Ben He, Xianpei Han, Le Sun, and Yongbin Li. 2024. Self-retrieval: End-to-end information retrieval with one large language model. In Advances in Neural Information Processing Systems 38: Annual C… [find](https://scholar.google.com/scholar?q=Qiaoyu+Tang%2C+Jiawei+Chen%2C+Zhuoqun+Li%2C+Bowen+Yu%2C+Yaojie+Lu%2C+Cheng+Fu%2C+Haiyang+Yu%2C+Hongyu+Lin%2C+Fei+Huang%2C+Ben+He%2C+Xianpei+Han%2C+Le+Sun%2C+and+Yongbin+Li%2E+2024%2E+Self%2Dretrieval%3A+End%2Dto%2Dend+information+retrie)
42. Komal K. Teru, Etienne G. Denis, and William L. Hamilton. 2020. Inductive relation prediction by subgraph reasoning. In Proceedings of the 37th International Conference on Machine Learning, ICML, volume 119 of Proceedings of Machine Learning Research, pages 9448–9457. PMLR. [find](https://scholar.google.com/scholar?q=Komal+K%2E+Teru%2C+Etienne+G%2E+Denis%2C+and+William+L%2E+Hamilton%2E+2020%2E+Inductive+relation+prediction+by+subgraph+reasoning%2E+In+Proceedings+of+the+37th+International+Conference+on+Machine+Learning%2C+ICML%2C+volu)
43. Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, and 1 others. 2022. [Lamda: Language models for dialog applications](https://md.research.elamur.ai/free/en/papers/thoppilan-2022-lamda-language-models-dialog-applications/). arXiv preprint arXiv:2201.08239.
44. Denny Vrandečić and Markus Krötzsch. 2014. [Wikidata: a free collaborative knowledgebase](https://md.research.elamur.ai/free/en/papers/vrandecic-2014-wikidata-free-collaborative-knowledgebase/). Communications of the ACM, 57(10):78–85.
45. Ben Wang and Aran Komatsuzaki. 2021. GPT-J-6B: A 6 Billion Parameter Autoregressive Language Model. [https://github.com/kingoflolz/](https://github.com/kingoflolz/) mesh-transformer-jax. [↗](https://github.com/kingoflolz/)
46. Peng Wang, Zexi Li, Ningyu Zhang, Ziwen Xu, Yunzhi Yao, Yong Jiang, Pengjun Xie, Fei Huang, and Huajun Chen. 2024a. Wise: Rethinking the knowledge memory for lifelong model editing of large language models. Advances in Neural Information Processing Systems, 37:53764–53797. [find](https://scholar.google.com/scholar?q=Peng+Wang%2C+Zexi+Li%2C+Ningyu+Zhang%2C+Ziwen+Xu%2C+Yunzhi+Yao%2C+Yong+Jiang%2C+Pengjun+Xie%2C+Fei+Huang%2C+and+Huajun+Chen%2E+2024a%2E+Wise%3A+Rethinking+the+knowledge+memory+for+lifelong+model+editing+of+large+language+m)
47. Song Wang, Yaochen Zhu, Haochen Liu, Zaiyi Zheng, Chen Chen, and Jundong Li. 2024b. Knowledge editing for [large language models: A survey](https://md.research.elamur.ai/free/en/papers/minaee-2024-large-language-models-survey/). ACM Computing Surveys, 57(3):1–37.
48. Xiaohan Wang, Shengyu Mao, Shumin Deng, Yunzhi Yao, Yue Shen, Lei Liang, Jinjie Gu, Huajun Chen, and Ningyu Zhang. 2024c. Editing conceptual knowledge for large language models. In Findings of the Association for Computational Linguistics: EMNLP 2024, Miami, Florida, USA, November 12-16, 2024, pages… [find](https://scholar.google.com/scholar?q=Xiaohan+Wang%2C+Shengyu+Mao%2C+Shumin+Deng%2C+Yunzhi+Yao%2C+Yue+Shen%2C+Lei+Liang%2C+Jinjie+Gu%2C+Huajun+Chen%2C+and+Ningyu+Zhang%2E+2024c%2E+Editing+conceptual+knowledge+for+large+language+models%2E+In+Findings+of+the+Ass)
49. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). Advances in neural information processing systems, 35:24824– 24837.
50. Xiaobao Wu, Liangming Pan, William Yang Wang, and Anh Tuan Luu. 2024. AKEW: Assessing knowledge editing in the wild. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. [find](https://scholar.google.com/scholar?q=Xiaobao+Wu%2C+Liangming+Pan%2C+William+Yang+Wang%2C+and+Anh+Tuan+Luu%2E+2024%2E+AKEW%3A+Assessing+knowledge+editing+in+the+wild%2E+In+Proceedings+of+the+2024+Conference+on+Empirical+Methods+in+Natural+Language+Proc)
51. Guanming Xiong, Junwei Bao, and Wen Zhao. 2024. Interactive-kbqa: Multi-turn interactions for knowledge base question answering with large language models. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 10561–10582. [find](https://scholar.google.com/scholar?q=Guanming+Xiong%2C+Junwei+Bao%2C+and+Wen+Zhao%2E+2024%2E+Interactive%2Dkbqa%3A+Multi%2Dturn+interactions+for+knowledge+base+question+answering+with+large+language+models%2E+In+Proceedings+of+the+62nd+Annual+Meeting+of)
52. Rongwu Xu, Zehan Qi, Zhijiang Guo, Cunxiang Wang, Hongru Wang, Yue Zhang, and Wei Xu. 2024. [Knowledge conflicts for llms: A survey](https://md.research.elamur.ai/free/en/papers/xu-2024-knowledge-conflicts-llms-survey/). In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, EMNLP, pages 8541– 8565. Association for Computational Linguistics.
53. Lang Yu, Qin Chen, Jie Zhou, and Liang He. 2024. Melo: Enhancing model editing with neuron-indexed dynamic lora. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 19449–19457. [find](https://scholar.google.com/scholar?q=Lang+Yu%2C+Qin+Chen%2C+Jie+Zhou%2C+and+Liang+He%2E+2024%2E+Melo%3A+Enhancing+model+editing+with+neuron%2Dindexed+dynamic+lora%2E+In+Proceedings+of+the+AAAI+Conference+on+Artificial+Intelligence%2C+volume+38%2C+pages+1944)
54. Ce Zheng, Lei Li, Qingxiu Dong, Yuxuan Fan, Zhiyong Wu, Jingjing Xu, and Baobao Chang. 2023. Can we edit factual knowledge by in-context learning? In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP, pages 4862–4876. Association for Computational Linguist… [find](https://scholar.google.com/scholar?q=Ce+Zheng%2C+Lei+Li%2C+Qingxiu+Dong%2C+Yuxuan+Fan%2C+Zhiyong+Wu%2C+Jingjing+Xu%2C+and+Baobao+Chang%2E+2023%2E+Can+we+edit+factual+knowledge+by+in%2Dcontext+learning%3F+In+Proceedings+of+the+2023+Conference+on+Empirical+Me)
55. Zexuan Zhong, Zhengxuan Wu, Christopher D. Manning, Christopher Potts, and Danqi Chen. 2023. Mquake: Assessing knowledge editing in language models via multi-hop questions. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10… [find](https://scholar.google.com/scholar?q=Zexuan+Zhong%2C+Zhengxuan+Wu%2C+Christopher+D%2E+Manning%2C+Christopher+Potts%2C+and+Danqi+Chen%2E+2023%2E+Mquake%3A+Assessing+knowledge+editing+in+language+models+via+multi%2Dhop+questions%2E+In+Proceedings+of+the+2023+)
56. Xiangrong Zhu, Yuexiang Xie, Yi Liu, Yaliang Li, and Wei Hu. 2025. Knowledge graph-guided retrieval augmented generation. In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)… [find](https://scholar.google.com/scholar?q=Xiangrong+Zhu%2C+Yuexiang+Xie%2C+Yi+Liu%2C+Yaliang+Li%2C+and+Wei+Hu%2E+2025%2E+Knowledge+graph%2Dguided+retrieval+augmented+generation%2E+In+Proceedings+of+the+2025+Conference+of+the+Nations+of+the+Americas+Chapter+o)

*Updated 1 November 2026*