---
title: "ICR Probe — paper by Zhang et al. (2025) — summary and ideas"
description: "However, most of them examine one static, high-dimensional (about 4000-d) representation and… 31 references, cited by 10 papers here."
authors: ["Zhenliang Zhang", "Xinyu Hu", "Huixuan Zhang", "Junzhe Zhang", "Xiaojun Wan"]
year: 2025
venue: "Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2025.acl-long.880/"
doi: "10.18653/v1/2025.acl-long.880"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhang-2025-icr-probe-tracking-hidden-state/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhang-2025-icr-probe-tracking-hidden-state/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/7/) / ICR Probe: Tracking Hidden State Dynamics for Reliable Hallucination Detection in LLMs

# ICR Probe: Tracking Hidden State Dynamics for Reliable Hallucination Detection in LLMs

**Authors:** [Zhenliang Zhang](https://md.research.elamur.ai/free/en/authors/zhenliang-zhang/), [Xinyu Hu](https://md.research.elamur.ai/free/en/authors/xinyu-hu/), [Huixuan Zhang](https://md.research.elamur.ai/free/en/authors/huixuan-zhang/), [Junzhe Zhang](https://md.research.elamur.ai/free/en/authors/junzhe-zhang/) and [Xiaojun Wan](https://md.research.elamur.ai/free/en/authors/xiaojun-wan/) · **Year:** 2025 · **Venue:** [Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2025](https://md.research.elamur.ai/free/en/venues/acl/2025/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2025.acl-long.880/) · [PDF](https://aclanthology.org/2025.acl-long.880.pdf) · [DOI 10.18653/v1/2025.acl-long.880](https://doi.org/10.18653/v1/2025.acl-long.880) · [OpenAlex](https://openalex.org/W4412945019)

**Citations:** 4 citations (OpenAlex, 2026-10-14) · [10](https://md.research.elamur.ai/free/en/papers/zhang-2025-icr-probe-tracking-hidden-state/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Hallucination detectors that read an LLM's hidden states are appealing because they need no reference answers or repeated sampling. However, most of them examine one static, high-dimensional (about 4000-d) representation and ignore how that representation changes from layer to layer. Zhang et al. instead focus on the update itself.

Their ICR Score (Information Contribution to Residual Stream) estimates, for each layer and token, whether the residual-stream update is driven mainly by self-attention (context) or by the FFN (parametric knowledge). The update vector is projected onto the hidden states of context tokens and softmax-normalised. It is then compared with head-averaged attention scores using Jensen-Shannon Divergence.

The ICR Probe takes ICR Scores from all layers as a compact input and outputs a hallucination probability. The authors test it on three open-source LLMs and several datasets, including HaluEval and SQuAD. It outperforms earlier hidden-state baselines while using considerably fewer parameters, and ablations and case studies clarify how it works.

The broader point is that layer-wise update dynamics give a cheaper and more informative detection signal than raw embeddings.

## Key points
- **Score interpretation:** a low ICR Score means the update follows the attention distribution, so MHSA dominates. A high score means the update diverges from attention, so the FFN dominates. JSD is computed over the top-k most-attended tokens.
- **Stability:** mean ICR curves across four datasets show narrow standard-deviation bands. This suggests a stable residual-stream pattern that holds across datasets.
- **Token-level analysis:** detection works best on answer-critical tokens. For example, hallucinated "hectares" and "Vietnam" received low correctness probabilities (0.04 and 0.19). Frequent tokens such as "The" or "." behave like noise and cause misdetections.
- **Limitations:** the method requires access to hidden states, so it only works with open-source models. It detects hallucinations but does not mitigate them, and more complex generation tasks remain untested.
- **Availability:** code is at github.com/XavierZhang2002/ICR_Probe. The paper was published at ACL 2025 (Long Papers), pp. 17986–18002.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

## Cite

Cite as: Zhenliang Zhang, Xinyu Hu, Huixuan Zhang, Junzhe Zhang and Xiaojun Wan. 2025. ICR Probe: Tracking Hidden State Dynamics for Reliable Hallucination Detection in LLMs. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhang2025icr,
  title = {{ICR Probe: Tracking Hidden State Dynamics for Reliable Hallucination Detection in LLMs}},
  author = {Zhenliang Zhang, Xinyu Hu, Huixuan Zhang, Junzhe Zhang and Xiaojun Wan},
  booktitle = {Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2025},
  doi = {10.18653/v1/2025.acl-long.880},
  url = {https://doi.org/10.18653/v1/2025.acl-long.880}
}
```

- [← previous Enhancing Mathematical Reasoning in LLMs by Stepwise Correction](https://md.research.elamur.ai/free/en/papers/wu-2025-enhancing-mathematical-reasoning-llms-stepwise/)
- [next → IOPO: Empowering LLMs with Complex Instruction Following via Input-Output Preference Optimization](https://md.research.elamur.ai/free/en/papers/zhang-2025-iopo-empowering-llms-complex-instruction/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/7/)

## References

31 references, 16 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. AI@Meta. 2024. Llama 3 model card. [find](https://scholar.google.com/scholar?q=AI%40Meta%2E+2024%2E+Llama+3+model+card%2E)
2. Amos Azaria and Tom Mitchell. 2023. [The Internal State of an LLM Knows When It‘s Lying](https://md.research.elamur.ai/free/en/papers/azaria-2023-internal-state-llm-knows-when/). In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 967–976, Singapore. Association for Computational Linguistics.
3. Sky CH-Wang, Benjamin Van Durme, Jason Eisner, and Chris Kedzie. 2024. Do androids know they‘re only dreaming of electric sheep? In Findings of the Association for Computational Linguistics: ACL 2024, pages 4401–4420, Bangkok, Thailand. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Sky+CH%2DWang%2C+Benjamin+Van+Durme%2C+Jason+Eisner%2C+and+Chris+Kedzie%2E+2024%2E+Do+androids+know+they%E2%80%98re+only+dreaming+of+electric+sheep%3F+In+Findings+of+the+Association+for+Computational+Linguistics%3A+ACL+2024%2C)
4. Chao Chen, Kai Liu, Ze Chen, Yi Gu, Yue Wu, Mingyuan Tao, Zhihang Fu, and Jieping Ye. 2024a. [Inside: Llms’ internal states retain the power of hallucination detection](https://md.research.elamur.ai/free/en/papers/chen-2024-inside-llms-internal-states-retain/).
5. Chao Chen, Kai Liu, Ze Chen, Yi Gu, Yue Wu, Mingyuan Tao, Zhihang Fu, and Jieping Ye. 2024b. [Inside: Llms’ internal states retain the power of hallucination detection](https://md.research.elamur.ai/free/en/papers/chen-2024-inside-llms-internal-states-retain/). ArXiv, abs/2402.03744.
6. Shiqi Chen, Miao Xiong, Junteng Liu, ZhengXuan Wu, Teng Xiao, Siyang Gao, and Junxian He. 2024c. In-context sharpness as alerts: An inner representation perspective for hallucination mitigation. In Proceedings of the 41st International Conference on Machine Learning, Proceedings of Machine Learning… [find](https://scholar.google.com/scholar?q=Shiqi+Chen%2C+Miao+Xiong%2C+Junteng+Liu%2C+ZhengXuan+Wu%2C+Teng+Xiao%2C+Siyang+Gao%2C+and+Junxian+He%2E+2024c%2E+In%2Dcontext+sharpness+as+alerts%3A+An+inner+representation+perspective+for+hallucination+mitigation%2E+In+Pr)
7. Lorenz Kuhn, Yarin Gal, and Sebastian Farquhar. 2023. [Semantic uncertainty: Linguistic invariances for uncertainty estimation in natural language generation](https://md.research.elamur.ai/free/en/papers/kuhn-2023-semantic-uncertainty-linguistic-invariances-uncertainty/). arXiv preprint arXiv:2302.09664.
8. Yung-Sung Chuang, Yujia Xie, Hongyin Luo, Yoon Kim, James R. Glass, and Pengcheng He. 2024. [Dola: Decoding by contrasting layers improves factuality in large language models](https://md.research.elamur.ai/free/en/papers/chuang-2023-dola-decoding-contrasting-layers-improves/). In The Twelfth International Conference on Learning Representations.
9. Junyi Li, Xiaoxue Cheng, Xin Zhao, Jian-Yun Nie, and Ji-Rong Wen. 2023. [HaluEval: A large-scale hallucination evaluation benchmark for large language models](https://md.research.elamur.ai/free/en/papers/li-2023-halueval-large-scale-hallucination-evaluation/). In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 6449–6464, Singapore. Association for Computa…
10. Nelson Elhage, Neel Nanda, Catherine Olsson, Tom Henighan, Nicholas Joseph, Ben Mann, Amanda Askell, Yuntao Bai, Anna Chen, Tom Conerly, Nova DasSarma, Dawn Drain, Deep Ganguli, Zac Hatfield-Dodds, Danny Hernandez, Andy Jones, Jackson Kernion, Liane Lovitt, Kamal Ndousse, Dario Amodei, Tom Brown, Ja… [find](https://scholar.google.com/scholar?q=Nelson+Elhage%2C+Neel+Nanda%2C+Catherine+Olsson%2C+Tom+Henighan%2C+Nicholas+Joseph%2C+Ben+Mann%2C+Amanda+Askell%2C+Yuntao+Bai%2C+Anna+Chen%2C+Tom+Conerly%2C+Nova+DasSarma%2C+Dawn+Drain%2C+Deep+Ganguli%2C+Zac+Hatfield%2DDodds%2C+Da)
11. Mor Geva, Jasmijn Bastings, Katja Filippova, and Amir Globerson. 2023. Dissecting recall of factual associations in auto-regressive language models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 12216–12235, Singapore. Association for Computational… [find](https://scholar.google.com/scholar?q=Mor+Geva%2C+Jasmijn+Bastings%2C+Katja+Filippova%2C+and+Amir+Globerson%2E+2023%2E+Dissecting+recall+of+factual+associations+in+auto%2Dregressive+language+models%2E+In+Proceedings+of+the+2023+Conference+on+Empirical+)
12. Mor Geva, Roei Schuster, Jonathan Berant, and Omer Levy. 2021. Transformer feed-forward layers are key-value memories. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 5484–5495, Online and Punta Cana, Dominican Republic. Association for Computational… [find](https://scholar.google.com/scholar?q=Mor+Geva%2C+Roei+Schuster%2C+Jonathan+Berant%2C+and+Omer+Levy%2E+2021%2E+Transformer+feed%2Dforward+layers+are+key%2Dvalue+memories%2E+In+Proceedings+of+the+2021+Conference+on+Empirical+Methods+in+Natural+Language+Pr)
13. Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qianglong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, and Ting Liu. 2025. [A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions](https://md.research.elamur.ai/free/en/papers/huang-2023-survey-hallucination-large-language-models/). ACM Trans. Inf. Syst., 43(2).
14. Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. 2023. [Survey of hallucination in natural language generation](https://md.research.elamur.ai/free/en/papers/ji-2022-survey-hallucination-natural-language-generation/). ACM Comput. Surv., 55(12).
15. Mandar Joshi, Eunsol Choi, Daniel Weld, and Luke Zettlemoyer. 2017. [TriviaQA: A large scale distantly supervised challenge dataset for reading comprehension](https://md.research.elamur.ai/free/en/papers/joshi-2017-triviaqa-large-scale-distantly-supervised/). In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1601–1611, Vancouver…
16. Jannik Kossen, Jiatong Han, Muhammed Razzak, Lisa Schut, Shreshth A. Malik, and Yarin Gal. 2024. Semantic entropy probes: Robust and cheap hallucination detection in llms. ArXiv, abs/2406.15927. — [arXiv:2406.15927](https://arxiv.org/abs/2406.15927) [find](https://scholar.google.com/scholar?q=Jannik+Kossen%2C+Jiatong+Han%2C+Muhammed+Razzak%2C+Lisa+Schut%2C+Shreshth+A%2E+Malik%2C+and+Yarin+Gal%2E+2024%2E+Semantic+entropy+probes%3A+Robust+and+cheap+hallucination+detection+in+llms%2E+ArXiv%2C+abs%2F2406%2E15927%2E+%E2%80%94+%5Bar)
17. J. Lin. 1991. Divergence measures based on the shannon entropy. IEEE Transactions on Information Theory, 37(1):145–151. [find](https://scholar.google.com/scholar?q=J%2E+Lin%2E+1991%2E+Divergence+measures+based+on+the+shannon+entropy%2E+IEEE+Transactions+on+Information+Theory%2C+37%281%29%3A145%E2%80%93151%2E)
18. Andrey Malinin and Mark Gales. 2020. Uncertainty Estimation in Autoregressive Structured Prediction. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Andrey+Malinin+and+Mark+Gales%2E+2020%2E+Uncertainty+Estimation+in+Autoregressive+Structured+Prediction%2E+In+International+Conference+on+Learning+Representations%2E)
19. Potsawee Manakul, Adian Liusie, and Mark Gales. 2023. SelfCheckGPT: Zero-resource black-box hallucination detection for generative large language models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 9004–9017, Singapore. Association for Computation… [find](https://scholar.google.com/scholar?q=Potsawee+Manakul%2C+Adian+Liusie%2C+and+Mark+Gales%2E+2023%2E+SelfCheckGPT%3A+Zero%2Dresource+black%2Dbox+hallucination+detection+for+generative+large+language+models%2E+In+Proceedings+of+the+2023+Conference+on+Empir)
20. Hadas Orgad, Michael Toker, Zorik Gekhman, Roi Reichart, Idan Szpektor, Hadas Kotek, and Yonatan Belinkov. 2024. [Llms know more than they show: On the intrinsic representation of llm hallucinations](https://md.research.elamur.ai/free/en/papers/orgad-2024-llms-know-more-than-they/). Preprint, arXiv:2410.02707.
21. Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016. [SQuAD: 100,000+ questions for machine comprehension of text](https://md.research.elamur.ai/free/en/papers/rajpurkar-2016-squad-100-000-questions-machine/). In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 2383–2392, Austin, Texas. Association for Computational Linguistics.
22. Jie Ren, Jiaming Luo, Yao Zhao, Kundan Krishna, Mohammad Saleh, Balaji Lakshminarayanan, and Peter J. Liu. 2022. [Out-of-Distribution Detection and Selective Generation for Conditional Language Models](https://md.research.elamur.ai/free/en/papers/ren-2022-out-distribution-detection-selective-generation/). In The Eleventh International Conference on Learning Representations.
23. Freda Shi, Xinyun Chen, Kanishka Misra, Nathan Scales, David Dohan, Ed Chi, Nathanael Schärli, and Denny Zhou. 2023. [Large language models can be easily distracted by irrelevant context](https://md.research.elamur.ai/free/en/papers/shi-2023-large-language-models-easily-distracted/). In Proceedings of the 40th International Conference on Machine Learning, ICML’23. JMLR.org.
24. Gaurang Sriramanan, Siddhant Bharti, Vinu Sankar Sadasivan, Shoumik Saha, Priyatham Kattakinda, and Soheil Feizi. 2024. LLM-Check: Investigating Detection of Hallucinations in Large Language Models. In Advances in Neural Information Processing Systems, volume 37, pages 34188–34216. Curran Associates… [find](https://scholar.google.com/scholar?q=Gaurang+Sriramanan%2C+Siddhant+Bharti%2C+Vinu+Sankar+Sadasivan%2C+Shoumik+Saha%2C+Priyatham+Kattakinda%2C+and+Soheil+Feizi%2E+2024%2E+LLM%2DCheck%3A+Investigating+Detection+of+Hallucinations+in+Large+Language+Models%2E+I)
25. Alessandro Stolfo, Yonatan Belinkov, and Mrinmaya Sachan. 2023. A mechanistic interpretation of arithmetic reasoning in language models using causal mediation analysis. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 7035–7052, Singapore. Association… [find](https://scholar.google.com/scholar?q=Alessandro+Stolfo%2C+Yonatan+Belinkov%2C+and+Mrinmaya+Sachan%2E+2023%2E+A+mechanistic+interpretation+of+arithmetic+reasoning+in+language+models+using+causal+mediation+analysis%2E+In+Proceedings+of+the+2023+Conf)
26. Sue Ronstrom, Susan Chan, Timothy Jordan, Ting Yu, Tom Eccles, Tom Hennigan, Tomas Kocisky, Tulsee Doshi, Vihan Jain, Vikas Yadav, Vilobh Meshram, Vishal Dharmadhikari, Warren Barkley, Wei Wei, Wenming Ye, Woohyun Han, Woosuk Kwon, Xiang Xu, Zhe Shen, Zhitao Gong, Zichuan Wei, Victor Cotruta, Phoebe… [find](https://scholar.google.com/scholar?q=Sue+Ronstrom%2C+Susan+Chan%2C+Timothy+Jordan%2C+Ting+Yu%2C+Tom+Eccles%2C+Tom+Hennigan%2C+Tomas+Kocisky%2C+Tulsee+Doshi%2C+Vihan+Jain%2C+Vikas+Yadav%2C+Vilobh+Meshram%2C+Vishal+Dharmadhikari%2C+Warren+Barkley%2C+Wei+Wei%2C+Wenmin)
27. ZhongXiang Sun, Xiaoxue Zang, Kai Zheng, Jun Xu, Xiao Zhang, Weijie Yu, Yang Song, and Han Li. 2024. ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretability. In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=ZhongXiang+Sun%2C+Xiaoxue+Zang%2C+Kai+Zheng%2C+Jun+Xu%2C+Xiao+Zhang%2C+Weijie+Yu%2C+Yang+Song%2C+and+Han+Li%2E+2024%2E+ReDeEP%3A+Detecting+Hallucination+in+Retrieval%2DAugmented+Generation+via+Mechanistic+Interpretability%2E)
28. Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, Johan Ferret, Peter Liu, Pouya Tafti, Abe Friesen, Michelle Casbon, Sabela Ramos, Ravin Kumar, Charline Le Lan, Sammy Jerome, Anton T… [find](https://scholar.google.com/scholar?q=Gemma+Team%2C+Morgane+Riviere%2C+Shreya+Pathak%2C+Pier+Giuseppe+Sessa%2C+Cassidy+Hardin%2C+Surya+Bhupatiraju%2C+L%C3%A9onard+Hussenot%2C+Thomas+Mesnard%2C+Bobak+Shahriari%2C+Alexandre+Ram%C3%A9%2C+Johan+Ferret%2C+Peter+Liu%2C+Pouya+Ta)
29. Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William Cohen, Ruslan Salakhutdinov, and Christopher D. Manning. 2018. [HotpotQA: A dataset for diverse, explainable multi-hop question answering](https://md.research.elamur.ai/free/en/papers/yang-2018-hotpotqa-dataset-diverse-explainable-multi/). In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2369…
30. Yuheng Zha, Yichi Yang, Ruichen Li, and Zhiting Hu. 2023. [Alignscore: Evaluating factual consistency with a unified alignment function](https://md.research.elamur.ai/free/en/papers/zha-2023-alignscore-evaluating-factual-consistency-unified/). arXiv preprint arXiv:2305.16739.
31. Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, et al. 2023. [Siren’s song in the ai ocean: a survey on hallucination in large language models](https://md.research.elamur.ai/free/en/papers/zhang-2023-siren-s-song-ai-ocean/). arXiv preprint arXiv:2309.01219.

*Updated 2 November 2026*