---
title: "Robust Uncertainty Quantification for Self-Evolving Large"
description: "The authors propose AR-NECP, which has two parts: Non-exchangeable CP: transformer-based… 48 references, cited by 2 papers here."
authors: ["Xiaofan Zhou", "Lu Cheng"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.388/"
doi: "10.18653/v1/2026.findings-acl.388"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhou-2026-robust-uncertainty-quantification-self-evolving/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhou-2026-robust-uncertainty-quantification-self-evolving/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/) / Robust Uncertainty Quantification for Self-Evolving Large Language Models via Continual Domain Pretraining

# Robust Uncertainty Quantification for Self-Evolving Large Language Models via Continual Domain Pretraining

**Authors:** Xiaofan Zhou and [Lu Cheng](https://md.research.elamur.ai/free/en/authors/lu-cheng/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.388/) · [PDF](https://aclanthology.org/2026.findings-acl.388.pdf) · [DOI 10.18653/v1/2026.findings-acl.388](https://doi.org/10.18653/v1/2026.findings-acl.388) · [OpenAlex](https://openalex.org/W7166808485)

**Citations:** 0 citations (OpenAlex, 2026-10-14) · [2](https://md.research.elamur.ai/free/en/papers/zhou-2026-robust-uncertainty-quantification-self-evolving/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
The paper tackles uncertainty quantification for LLMs that keep learning through continual domain pretraining (CDP), where a model is fine-tuned on one knowledge domain after another. Standard Conformal Prediction (CP) assumes calibration and test data are exchangeable. That assumption fails when test queries come from an unlabeled, unknown mix of domains, so coverage becomes uneven across domains. CP can also return very large, uninformative answer sets when the model meets questions it can no longer handle, for example after catastrophic forgetting.

The authors propose AR-NECP, which has two parts:
- **Non-exchangeable CP:** transformer-based clustering estimates the domain proportions in the test set, and the buffer calibration data are then reweighted or resampled to match.
- **Adaptive rejection CP:** a label-conditional mechanism, driven by normalized entropy, lets the model output "can't answer" when its competence shifts.

Experiments on TriviaQA, HotpotQA and MMLU (e.g., with Llama-3.1-8B-Instruct) show that coverage holds under domain shift and prediction sets get smaller. The gains are largest at high coverage levels. This matters for making self-evolving LLMs statistically trustworthy.

## Key points
- The authors describe this as the first CP study for LLMs under CDP. They provide theoretical analysis of coverage under domain distribution shift and of efficiency (Appendix A). Code is released at github.com/AlearZhou/CPCL.
- TriviaQA is split into five domains (sc, ht, sp, en, gg). Quantiles of the uncertainty scores differ noticeably between these domains, which motivates the method.
- Normalized entropy (NE) rejection gives smaller prediction sets than an MLP-confidence baseline. Examples:
  - whole distribution, α=0.05: 7.95 vs 8.66
  - en-dominated test set, α=0.10: 3.72 vs 4.51
- The domain-count estimator is accurate: mean relative error stays between 0.01 and 0.11 across domains and test shifts.
- Efficiency gains are small on MMLU, a 4-option task where oversized sets are not an issue. The authors list two limitations:
  - variance in the domain-count estimates
  - the need to resample calibration answers after every fine-tuning stage

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Illinois Chicago](https://md.research.elamur.ai/free/en/universities/university-of-illinois-chicago/) — University, Chicago, United States · 61 works · 20,107 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

🧭 Topics (1): [🧠 Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/) · 3,320 works

## Cite

Cite as: Xiaofan Zhou and Lu Cheng. 2026. Robust Uncertainty Quantification for Self-Evolving Large Language Models via Continual Domain Pretraining. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhou2026robust,
  title = {{Robust Uncertainty Quantification for Self-Evolving Large Language Models via Continual Domain Pretraining}},
  author = {Xiaofan Zhou and Lu Cheng},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.388},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.388}
}
```

- [← previous Ro-SLM: Onboard Small Language Models for Robot Task Planning and Operation Code Generation](https://md.research.elamur.ai/free/en/papers/wang-2026-ro-slm-onboard-small-language/)
- [next → SAE-FiRE: Enhancing Earnings Surprise Predictions Through Sparse Autoencoder Feature Selection](https://md.research.elamur.ai/free/en/papers/zhang-2026-sae-fire-enhancing-earnings-surprise/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/9/)

## References

48 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, and 1 others. 2023. [Gpt-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). arXiv preprint arXiv:2303.08774.
2. Aisha Alansari and Hamzah Luqman. 2025. Large language models hallucination: A comprehensive survey. arXiv preprint arXiv:2510.06265. — [arXiv:2510.06265](https://arxiv.org/abs/2510.06265) [find](https://scholar.google.com/scholar?q=Aisha+Alansari+and+Hamzah+Luqman%2E+2025%2E+Large+language+models+hallucination%3A+A+comprehensive+survey%2E+arXiv+preprint+arXiv%3A2510%2E06265%2E+%E2%80%94+%5BarXiv%3A2510%2E06265%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2510%2E06265%29)
3. Anastasios N Angelopoulos and Stephen Bates. 2021. A gentle introduction to conformal prediction and distribution-free uncertainty quantification. arXiv preprint arXiv:2107.07511. [find](https://scholar.google.com/scholar?q=Anastasios+N+Angelopoulos+and+Stephen+Bates%2E+2021%2E+A+gentle+introduction+to+conformal+prediction+and+distribution%2Dfree+uncertainty+quantification%2E+arXiv+preprint+arXiv%3A2107%2E07511%2E)
4. Margarida Campos, António Farinhas, Chrysoula Zerva, Mário AT Figueiredo, and André FT Martins. 2024. Conformal prediction for natural language processing: A survey. Transactions of the Association for Computational Linguistics, 12:1497–1516. [find](https://scholar.google.com/scholar?q=Margarida+Campos%2C+Ant%C3%B3nio+Farinhas%2C+Chrysoula+Zerva%2C+M%C3%A1rio+AT+Figueiredo%2C+and+Andr%C3%A9+FT+Martins%2E+2024%2E+Conformal+prediction+for+natural+language+processing%3A+A+survey%2E+Transactions+of+the+Association+fo)
5. Pierre Colombo, Telmo Pessoa Pires, Malik Boudiaf, Dominic Culver, Rui Melo, Caio Corro, Andre FT Martins, Fabrizio Esposito, Vera Lúcia Raposo, Sofia Morgado, and 1 others. 2024. Saullm-7b: A pioneering large language model for law. arXiv preprint arXiv:2403.03883. [find](https://scholar.google.com/scholar?q=Pierre+Colombo%2C+Telmo+Pessoa+Pires%2C+Malik+Boudiaf%2C+Dominic+Culver%2C+Rui+Melo%2C+Caio+Corro%2C+Andre+FT+Martins%2C+Fabrizio+Esposito%2C+Vera+L%C3%BAcia+Raposo%2C+Sofia+Morgado%2C+and+1+others%2E+2024%2E+Saullm%2D7b%3A+A+pioneer)
6. Rui Gao and Weiwei Liu. Model uncertainty quantification by conformal prediction in continual learning. In Forty-second International Conference on Machine Learning. [find](https://scholar.google.com/scholar?q=Rui+Gao+and+Weiwei+Liu%2E+Model+uncertainty+quantification+by+conformal+prediction+in+continual+learning%2E+In+Forty%2Dsecond+International+Conference+on+Machine+Learning%2E)
7. Yu Gui, Ying Jin, and Zhimei Ren. 2024. Conformal alignment: Knowing when to trust foundation models with guarantees. Advances in Neural Information Processing Systems, 37:73884–73919. [find](https://scholar.google.com/scholar?q=Yu+Gui%2C+Ying+Jin%2C+and+Zhimei+Ren%2E+2024%2E+Conformal+alignment%3A+Knowing+when+to+trust+foundation+models+with+guarantees%2E+Advances+in+Neural+Information+Processing+Systems%2C+37%3A73884%E2%80%9373919%2E)
8. Suchin Gururangan, Mike Lewis, Ari Holtzman, Noah A Smith, and Luke Zettlemoyer. 2021. Demix layers: Disentangling domains for modular language modeling. arXiv preprint arXiv:2108.05036. [find](https://scholar.google.com/scholar?q=Suchin+Gururangan%2C+Mike+Lewis%2C+Ari+Holtzman%2C+Noah+A+Smith%2C+and+Luke+Zettlemoyer%2E+2021%2E+Demix+layers%3A+Disentangling+domains+for+modular+language+modeling%2E+arXiv+preprint+arXiv%3A2108%2E05036%2E)
9. Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, and Noah A. Smith. 2020. Don’t stop pretraining: Adapt language models to domains and tasks. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 8342–8360, Online. A… [find](https://scholar.google.com/scholar?q=Suchin+Gururangan%2C+Ana+Marasovic%CC%81%2C+Swabha+Swayamdipta%2C+Kyle+Lo%2C+Iz+Beltagy%2C+Doug+Downey%2C+and+Noah+A%2E+Smith%2E+2020%2E+Don%E2%80%99t+stop+pretraining%3A+Adapt+language+models+to+domains+and+tasks%2E+In+Proceedings+of+)
10. Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2021b. [Measuring massive multitask language understanding](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-measuring-massive-multitask-language-understanding/). Proceedings of the International Conference on Learning Representations (ICLR).
11. Roger A Horn and Charles R Johnson. 2012. Matrix analysis. Cambridge university press. [find](https://scholar.google.com/scholar?q=Roger+A+Horn+and+Charles+R+Johnson%2E+2012%2E+Matrix+analysis%2E+Cambridge+university+press%2E)
12. Fanding Huang, Guanbo Huang, Xiao Fan, Yi He, Xiao Liang, Xiao Chen, Qinting Jiang, Faisal Nadeem Khan, Jingyan Jiang, and Zhi Wang. 2026. Semantic-space exploration and exploitation in rlvr for llm reasoning. Preprint, arXiv:2509.23808. [find](https://scholar.google.com/scholar?q=Fanding+Huang%2C+Guanbo+Huang%2C+Xiao+Fan%2C+Yi+He%2C+Xiao+Liang%2C+Xiao+Chen%2C+Qinting+Jiang%2C+Faisal+Nadeem+Khan%2C+Jingyan+Jiang%2C+and+Zhi+Wang%2E+2026%2E+Semantic%2Dspace+exploration+and+exploitation+in+rlvr+for+llm+r)
13. Quzhe Huang, Mingxu Tao, Chen Zhang, Zhenwei An, Cong Jiang, Zhibin Chen, Zirui Wu, and Yansong Feng. 2023. [Lawyer llama technical report](https://md.research.elamur.ai/free/en/papers/huang-2023-lawyer-llama-technical-report/). arXiv preprint arXiv:2305.15062.
14. Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix,… [find](https://scholar.google.com/scholar?q=Albert+Q%2E+Jiang%2C+Alexandre+Sablayrolles%2C+Arthur+Mensch%2C+Chris+Bamford%2C+Devendra+Singh+Chaplot%2C+Diego+de+las+Casas%2C+Florian+Bressand%2C+Gianna+Lengyel%2C+Guillaume+Lample%2C+Lucile+Saulnier%2C+L%C3%A9lio+Renard+Lav)
15. Mandar Joshi, Eunsol Choi, Daniel Weld, and Luke Zettlemoyer. 2017. [triviaqa: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension](https://md.research.elamur.ai/free/en/papers/joshi-2017-triviaqa-large-scale-distantly-supervised/). arXiv e-prints, arXiv:1705.03551.
16. Sung Jae Jung, Hajung Kim, and Kyoung Sang Jang. 2024. Llm based biological named entity recognition from scientific literature. In 2024 IEEE International Conference on Big Data and Smart Computing (Big-Comp), pages 433–435. IEEE. [find](https://scholar.google.com/scholar?q=Sung+Jae+Jung%2C+Hajung+Kim%2C+and+Kyoung+Sang+Jang%2E+2024%2E+Llm+based+biological+named+entity+recognition+from+scientific+literature%2E+In+2024+IEEE+International+Conference+on+Big+Data+and+Smart+Computing+%28)
17. Bhawesh Kumar, Charlie Lu, Gauri Gupta, Anil Palepu, David Bellamy, Ramesh Raskar, and Andrew Beam. 2023. Conformal prediction with large language models for multi-choice question answering. arXiv preprint arXiv:2305.18404. — [arXiv:2305.18404](https://arxiv.org/abs/2305.18404) [find](https://scholar.google.com/scholar?q=Bhawesh+Kumar%2C+Charlie+Lu%2C+Gauri+Gupta%2C+Anil+Palepu%2C+David+Bellamy%2C+Ramesh+Raskar%2C+and+Andrew+Beam%2E+2023%2E+Conformal+prediction+with+large+language+models+for+multi%2Dchoice+question+answering%2E+arXiv+pre)
18. Jiangtong Li, Yuxuan Bian, Guoxuan Wang, Yang Lei, Dawei Cheng, Zhijun Ding, and Changjun Jiang. 2023. Cfgpt: Chinese financial assistant with large language model. arXiv preprint arXiv:2309.10654. — [arXiv:2309.10654](https://arxiv.org/abs/2309.10654) [find](https://scholar.google.com/scholar?q=Jiangtong+Li%2C+Yuxuan+Bian%2C+Guoxuan+Wang%2C+Yang+Lei%2C+Dawei+Cheng%2C+Zhijun+Ding%2C+and+Changjun+Jiang%2E+2023%2E+Cfgpt%3A+Chinese+financial+assistant+with+large+language+model%2E+arXiv+preprint+arXiv%3A2309%2E10654%2E+%E2%80%94+)
19. Rujun Han, Xiang Ren, and Nanyun Peng. 2020. Econet: Effective continual pretraining of language models for event temporal reasoning. arXiv preprint arXiv:2012.15283. [find](https://scholar.google.com/scholar?q=Rujun+Han%2C+Xiang+Ren%2C+and+Nanyun+Peng%2E+2020%2E+Econet%3A+Effective+continual+pretraining+of+language+models+for+event+temporal+reasoning%2E+arXiv+preprint+arXiv%3A2012%2E15283%2E)
20. Shuo Li, Sangdon Park, Insup Lee, and Osbert Bastani. 2024. TRAQ: Trustworthy retrieval augmented question answering via conformal prediction. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1:… [find](https://scholar.google.com/scholar?q=Shuo+Li%2C+Sangdon+Park%2C+Insup+Lee%2C+and+Osbert+Bastani%2E+2024%2E+TRAQ%3A+Trustworthy+retrieval+augmented+question+answering+via+conformal+prediction%2E+In+Proceedings+of+the+2024+Conference+of+the+North+Americ)
21. Dan Hendrycks, Collin Burns, Steven Basart, Andrew Critch, Jerry Li, Dawn Song, and Jacob Steinhardt. 2021a. [Aligning ai with shared human values](https://md.research.elamur.ai/free/en/papers/hendrycks-2020-aligning-ai-shared-human-values/). Proceedings of the International Conference on Learning Representations (ICLR).
22. Kaizhao Liang. 2024. MMLU Auxiliary Trained Set Labelled by e5-mistral-7b-instruct. [https://huggingface.co/datasets/kz919/mmlu-auxiliary-train-e5-mistral-7b-instruct](https://huggingface.co/datasets/kz919/mmlu-auxiliary-train-e5-mistral-7b-instruct). Accessed: Date of Access. [↗](https://huggingface.co/datasets/kz919/mmlu-auxiliary-train-e5-mistral-7b-instruct)
23. Tuve Löfström, Henrik Boström, Henrik Linusson, and Ulf Johansson. 2015. Bias reduction through conditional conformal prediction. Intelligent Data Analysis, 19(6):1355–1375. [find](https://scholar.google.com/scholar?q=Tuve+L%C3%B6fstr%C3%B6m%2C+Henrik+Bostr%C3%B6m%2C+Henrik+Linusson%2C+and+Ulf+Johansson%2E+2015%2E+Bias+reduction+through+conditional+conformal+prediction%2E+Intelligent+Data+Analysis%2C+19%286%29%3A1355%E2%80%931375%2E)
24. Huanxin Sheng, Xinyi Liu, Hangfeng He, Jieyu Zhao, and Jian Kang. 2025. Analyzing uncertainty of llm-as-a-judge: Interval evaluations with conformal prediction. Preprint, arXiv:2509.18658. [find](https://scholar.google.com/scholar?q=Huanxin+Sheng%2C+Xinyi+Liu%2C+Hangfeng+He%2C+Jieyu+Zhao%2C+and+Jian+Kang%2E+2025%2E+Analyzing+uncertainty+of+llm%2Das%2Da%2Djudge%3A+Interval+evaluations+with+conformal+prediction%2E+Preprint%2C+arXiv%3A2509%2E18658%2E)
25. Yuheng Lu, Bingshuo Qian, Caixia Yuan, Huixing Jiang, and Xiaojie Wang. 2025. Controlled low-rank adaptation with subspace regularization for continued training on large language models. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers… [find](https://scholar.google.com/scholar?q=Yuheng+Lu%2C+Bingshuo+Qian%2C+Caixia+Yuan%2C+Huixing+Jiang%2C+and+Xiaojie+Wang%2E+2025%2E+Controlled+low%2Drank+adaptation+with+subspace+regularization+for+continued+training+on+large+language+models%2E+In+Proceeding)
26. Haizhou Shi, Zihao Xu, Hengyi Wang, Weiyi Qin, Wenyuan Wang, Yibin Wang, Zifeng Wang, Sayna Ebrahimi, and Hao Wang. 2024. Continual learning of large language models: A comprehensive survey. ACM Computing Surveys. [find](https://scholar.google.com/scholar?q=Haizhou+Shi%2C+Zihao+Xu%2C+Hengyi+Wang%2C+Weiyi+Qin%2C+Wenyuan+Wang%2C+Yibin+Wang%2C+Zifeng+Wang%2C+Sayna+Ebrahimi%2C+and+Hao+Wang%2E+2024%2E+Continual+learning+of+large+language+models%3A+A+comprehensive+survey%2E+ACM+Compu)
27. Shirong Ma, Shen Huang, Shulin Huang, Xiaobin Wang, Yangning Li, Hai-Tao Zheng, Pengjun Xie, Fei Huang, and Yong Jiang. 2023. Ecomgpt-ct: Continual pre-training of e-commerce large language models with semi-structured data. arXiv preprint arXiv:2312.15696. — [arXiv:2312.15696](https://arxiv.org/abs/2312.15696) [find](https://scholar.google.com/scholar?q=Shirong+Ma%2C+Shen+Huang%2C+Shulin+Huang%2C+Xiaobin+Wang%2C+Yangning+Li%2C+Hai%2DTao+Zheng%2C+Pengjun+Xie%2C+Fei+Huang%2C+and+Yong+Jiang%2E+2023%2E+Ecomgpt%2Dct%3A+Continual+pre%2Dtraining+of+e%2Dcommerce+large+language+models+wit)
28. Christopher Mohri and Tatsunori Hashimoto. 2024. Language models with conformal factuality guarantees. arXiv preprint arXiv:2402.10978. — [arXiv:2402.10978](https://arxiv.org/abs/2402.10978) [find](https://scholar.google.com/scholar?q=Christopher+Mohri+and+Tatsunori+Hashimoto%2E+2024%2E+Language+models+with+conformal+factuality+guarantees%2E+arXiv+preprint+arXiv%3A2402%2E10978%2E+%E2%80%94+%5BarXiv%3A2402%2E10978%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2402%2E10978%29)
29. Viktor Moskvoretskii, Maria Marina, Mikhail Salnikov, Nikolay Ivanov, Sergey Pletenev, Daria Galimzianova, Nikita Krayko, Vasily Konovalov, Irina Nikishina, and Alexander Panchenko. 2025. [Adaptive retrieval without self-knowledge? bringing uncertainty back home](https://md.research.elamur.ai/free/en/papers/moskvoretskii-2025-adaptive-retrieval-without-self-knowledge/). In Proceedings of the 63rd Annual Mee…
30. Yujia Qin, Cheng Qian, Xu Han, Yankai Lin, Huadong Wang, Ruobing Xie, Zhiyuan Liu, Maosong Sun, and Jie Zhou. 2023. Recyclable tuning for continual pre-training. arXiv preprint arXiv:2305.08702. [find](https://scholar.google.com/scholar?q=Yujia+Qin%2C+Cheng+Qian%2C+Xu+Han%2C+Yankai+Lin%2C+Huadong+Wang%2C+Ruobing+Xie%2C+Zhiyuan+Liu%2C+Maosong+Sun%2C+and+Jie+Zhou%2E+2023%2E+Recyclable+tuning+for+continual+pre%2Dtraining%2E+arXiv+preprint+arXiv%3A2305%2E08702%2E)
31. Yujia Qin, Jiajie Zhang, Yankai Lin, Zhiyuan Liu, Peng Li, Maosong Sun, and Jie Zhou. 2022. Elle: Efficient lifelong pre-training for emerging data. arXiv preprint arXiv:2203.06311. [find](https://scholar.google.com/scholar?q=Yujia+Qin%2C+Jiajie+Zhang%2C+Yankai+Lin%2C+Zhiyuan+Liu%2C+Peng+Li%2C+Maosong+Sun%2C+and+Jie+Zhou%2E+2022%2E+Elle%3A+Efficient+lifelong+pre%2Dtraining+for+emerging+data%2E+arXiv+preprint+arXiv%3A2203%2E06311%2E)
32. Victor Quach, Adam Fisch, Tal Schuster, Adam Yala, Jae Ho Sohn, Tommi S Jaakkola, and Regina Barzilay. 2023. Conformal language modeling. arXiv preprint arXiv:2306.10193. [find](https://scholar.google.com/scholar?q=Victor+Quach%2C+Adam+Fisch%2C+Tal+Schuster%2C+Adam+Yala%2C+Jae+Ho+Sohn%2C+Tommi+S+Jaakkola%2C+and+Regina+Barzilay%2E+2023%2E+Conformal+language+modeling%2E+arXiv+preprint+arXiv%3A2306%2E10193%2E)
33. Nitin Liladhar Rane, Abhijeet Tawde, Saurabh P Choudhary, and Jayesh Rane. 2023. Contribution and performance of chatgpt and other large language models (llm) for scientific and research advancements: a double-edged sword. International Research Journal of Modernization in Engineering Technology and… [find](https://scholar.google.com/scholar?q=Nitin+Liladhar+Rane%2C+Abhijeet+Tawde%2C+Saurabh+P+Choudhary%2C+and+Jayesh+Rane%2E+2023%2E+Contribution+and+performance+of+chatgpt+and+other+large+language+models+%28llm%29+for+scientific+and+research+advancements%3A)
34. Maxon Rubin-Toles, Maya Gambhir, Keshav Ramji, Aaron Roth, and Surbhi Goel. 2025. Conformal language model reasoning with coherent factuality. arXiv preprint arXiv:2505.17126. — [arXiv:2505.17126](https://arxiv.org/abs/2505.17126) [find](https://scholar.google.com/scholar?q=Maxon+Rubin%2DToles%2C+Maya+Gambhir%2C+Keshav+Ramji%2C+Aaron+Roth%2C+and+Surbhi+Goel%2E+2025%2E+Conformal+language+model+reasoning+with+coherent+factuality%2E+arXiv+preprint+arXiv%3A2505%2E17126%2E+%E2%80%94+%5BarXiv%3A2505%2E17126%5D%28htt)
35. Glenn Shafer and Vladimir Vovk. 2008. A tutorial on conformal prediction. Journal of Machine Learning Research, 9(3). [find](https://scholar.google.com/scholar?q=Glenn+Shafer+and+Vladimir+Vovk%2E+2008%2E+A+tutorial+on+conformal+prediction%2E+Journal+of+Machine+Learning+Research%2C+9%283%29%2E)
36. Jiayuan Su, Jing Luo, Hongwei Wang, and Lu Cheng. 2024. API is enough: Conformal prediction for large language models without logit-access. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 979–995, Miami, Florida, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jiayuan+Su%2C+Jing+Luo%2C+Hongwei+Wang%2C+and+Lu+Cheng%2E+2024%2E+API+is+enough%3A+Conformal+prediction+for+large+language+models+without+logit%2Daccess%2E+In+Findings+of+the+Association+for+Computational+Linguistics)
37. Gemma Team, Thomas Mesnard, Cassidy Hardin, Robert Dadashi, Surya Bhupatiraju, Shreya Pathak, Laurent Sifre, Morgane Rivière, Mihir Sanjay Kale, Juliette Love, and 1 others. 2024. Gemma: Open models based on gemini research and technology. arXiv preprint arXiv:2403.08295. [find](https://scholar.google.com/scholar?q=Gemma+Team%2C+Thomas+Mesnard%2C+Cassidy+Hardin%2C+Robert+Dadashi%2C+Surya+Bhupatiraju%2C+Shreya+Pathak%2C+Laurent+Sifre%2C+Morgane+Rivi%C3%A8re%2C+Mihir+Sanjay+Kale%2C+Juliette+Love%2C+and+1+others%2E+2024%2E+Gemma%3A+Open+models+b)
38. Ryan J Tibshirani, Rina Foygel Barber, Emmanuel Candes, and Aaditya Ramdas. 2019. Conformal prediction under covariate shift. Advances in neural information processing systems, 32. [find](https://scholar.google.com/scholar?q=Ryan+J+Tibshirani%2C+Rina+Foygel+Barber%2C+Emmanuel+Candes%2C+and+Aaditya+Ramdas%2E+2019%2E+Conformal+prediction+under+covariate+shift%2E+Advances+in+neural+information+processing+systems%2C+32%2E)
39. Mariya Toneva, Alessandro Sordoni, Remi Tachet des Combes, Adam Trischler, Yoshua Bengio, and Geoffrey J Gordon. 2018. An empirical study of example forgetting during deep neural network learning. arXiv preprint arXiv:1812.05159. — [arXiv:1812.05159](https://arxiv.org/abs/1812.05159) [find](https://scholar.google.com/scholar?q=Mariya+Toneva%2C+Alessandro+Sordoni%2C+Remi+Tachet+des+Combes%2C+Adam+Trischler%2C+Yoshua+Bengio%2C+and+Geoffrey+J+Gordon%2E+2018%2E+An+empirical+study+of+example+forgetting+during+deep+neural+network+learning%2E+arX)
40. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, and 1 others. 2023. [Llama: Open and efficient foundation language models](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/). arXiv preprint arXiv:2302.13971.
41. Jiaqi Wang, Enze Shi, Huawen Hu, Chong Ma, Yiheng Liu, Xuhui Wang, Yincheng Yao, Xuan Liu, Bao Ge, and Shu Zhang. 2025. Large language models for robotics: Opportunities, challenges, and perspectives. Journal of Automation and Intelligence, 4(1):52–64. [find](https://scholar.google.com/scholar?q=Jiaqi+Wang%2C+Enze+Shi%2C+Huawen+Hu%2C+Chong+Ma%2C+Yiheng+Liu%2C+Xuhui+Wang%2C+Yincheng+Yao%2C+Xuan+Liu%2C+Bao+Ge%2C+and+Shu+Zhang%2E+2025%2E+Large+language+models+for+robotics%3A+Opportunities%2C+challenges%2C+and+perspectives%2E)
42. Chaoyi Wu, Weixiong Lin, Xiaoman Zhang, Ya Zhang, Weidi Xie, and Yanfeng Wang. 2024. Pmc-llama: toward building open-source language models for medicine. Journal of the American Medical Informatics Association, 31(9):1833–1843. [find](https://scholar.google.com/scholar?q=Chaoyi+Wu%2C+Weixiong+Lin%2C+Xiaoman+Zhang%2C+Ya+Zhang%2C+Weidi+Xie%2C+and+Yanfeng+Wang%2E+2024%2E+Pmc%2Dllama%3A+toward+building+open%2Dsource+language+models+for+medicine%2E+Journal+of+the+American+Medical+Informatics+As)
43. Xinbo Wu and Lav R Varshney. 2024. Transformer-based causal language models perform clustering. arXiv preprint arXiv:2402.12151. [find](https://scholar.google.com/scholar?q=Xinbo+Wu+and+Lav+R+Varshney%2E+2024%2E+Transformer%2Dbased+causal+language+models+perform+clustering%2E+arXiv+preprint+arXiv%3A2402%2E12151%2E)
44. Shijia Xu, Zhou Wu, Xiaolong Jia, Yu Wang, Kai Liu, and April Xiaowen Dong. 2026. [Self-correcting rag: Enhancing faithfulness via mmkp context selection and nli-guided mcts](https://md.research.elamur.ai/free/en/papers/xu-2026-self-correcting-rag-enhancing-faithfulness/). Preprint, arXiv:2604.10734.
45. Yongyu Yan, Kui Xue, Xiaoming Shi, Qi Ye, Jingping Liu, and Tong Ruan. 2023. Af adapter: Continual pretraining for building chinese biomedical language model. In 2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pages 953– 957. IEEE. [find](https://scholar.google.com/scholar?q=Yongyu+Yan%2C+Kui+Xue%2C+Xiaoming+Shi%2C+Qi+Ye%2C+Jingping+Liu%2C+and+Tong+Ruan%2E+2023%2E+Af+adapter%3A+Continual+pretraining+for+building+chinese+biomedical+language+model%2E+In+2023+IEEE+International+Conference+on+)
46. Zhilin Yang, Peng Qi, Saizheng Zhang, Yoshua Bengio, William W. Cohen, Ruslan Salakhutdinov, and Christopher D. Manning. 2018. [HotpotQA: A dataset for diverse, explainable multi-hop question answering](https://md.research.elamur.ai/free/en/papers/yang-2018-hotpotqa-dataset-diverse-explainable-multi/). In Conference on Empirical Methods in Natural Language Processing (EMNLP).
47. Fanghua Ye, Mingming Yang, Jianhui Pang, Longyue Wang, Derek F. Wong, Emine Yilmaz, Shuming Shi, and Zhaopeng Tu. 2024. Benchmarking LLMs via uncertainty quantification. In The Thirty-eight Conference on NIPS Datasets and Benchmarks Track. [find](https://scholar.google.com/scholar?q=Fanghua+Ye%2C+Mingming+Yang%2C+Jianhui+Pang%2C+Longyue+Wang%2C+Derek+F%2E+Wong%2C+Emine+Yilmaz%2C+Shuming+Shi%2C+and+Zhaopeng+Tu%2E+2024%2E+Benchmarking+LLMs+via+uncertainty+quantification%2E+In+The+Thirty%2Deight+Conference)
48. Xiaofan Zhou, Baiting Chen, Yu Gui, and Lu Cheng. 2025. Conformal prediction: A data perspective. ACM Computing Surveys. [find](https://scholar.google.com/scholar?q=Xiaofan+Zhou%2C+Baiting+Chen%2C+Yu+Gui%2C+and+Lu+Cheng%2E+2025%2E+Conformal+prediction%3A+A+data+perspective%2E+ACM+Computing+Surveys%2E)

*Updated 31 October 2026*