---
title: "Preference-Aware Memory Update for Long-Term LLM Agents"
description: "The authors propose PAMU (Preference-Aware Memory Update), a plug-in module that needs no… 25 references, cited by 2 papers here."
authors: ["Haoran Sun", "Zekun Zhang", "Shaoning Zeng"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.38/"
doi: "10.18653/v1/2026.findings-acl.38"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/sun-2026-preference-aware-memory-update-long/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/sun-2026-preference-aware-memory-update-long/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/4/) / Preference-Aware Memory Update for Long-Term LLM Agents

# Preference-Aware Memory Update for Long-Term LLM Agents

**Authors:** [Haoran Sun](https://md.research.elamur.ai/free/en/authors/haoran-sun/), [Zekun Zhang](https://md.research.elamur.ai/free/en/authors/zekun-zhang/) and [Shaoning Zeng](https://md.research.elamur.ai/free/en/authors/shaoning-zeng/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.38/) · [PDF](https://aclanthology.org/2026.findings-acl.38.pdf) · [DOI 10.18653/v1/2026.findings-acl.38](https://doi.org/10.18653/v1/2026.findings-acl.38) · [OpenAlex](https://openalex.org/W4417157534)

**Citations:** 2 citations (OpenAlex, 2026-10-14) · [2](https://md.research.elamur.ai/free/en/papers/sun-2026-preference-aware-memory-update-long/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
Long-running LLM agents usually rely on memory systems such as MemoryBank, MemGPT, MemInsight or A-MEM. These systems mostly improve how memory is stored and retrieved. They pay little attention to keeping memory current as a user's preferences change over time. The authors propose PAMU (Preference-Aware Memory Update), a plug-in module that needs no fine-tuning and works with any underlying model. After each turn, PAMU builds a five-dimensional preference profile from the dialogue using off-the-shelf components: a RoBERTa tone classifier, an emotion classifier, an OpenIE-based information-density measure, a formality classifier and a normalized response-length score. For each dimension, it tracks a short-horizon sliding-window average and a long-horizon EMA and blends the two with a weight λ. When the gap between them crosses a threshold δ, PAMU treats this as a preference shift and rewrites the prompt and memory. Tested on five task scenarios of LoCoMo, PAMU improved output quality for five baseline memory systems. A case study also shows that it adapts in real time where the baselines lag. The work matters because it gives agents an interpretable, low-cost way to follow changes in what users want.

## Key points
- **Preference dimensions:** PAMU tracks five dimensions:
  - tone style and emotional tone, each stored as a category plus its probability;
  - response length, information density (OpenIE triples per word) and formality, each a normalized scalar.
- **Update rule:** The fused preference estimate is λ·SW + (1−λ)·EMA. A memory update fires only when the difference |SW − EMA| exceeds δ.
- **Hyperparameter stability:** The paper reports stable performance for λ ∈ [0.4, 0.7] and EMA decay β ∈ [0.8, 0.95]. Ablations were run on temporal reasoning with LLaMA 7B, scored by the average of F1 and BLEU-1.
- **Case study:** In a simulated dialogue where the user's preference shifts, both GPT-4 and ten human annotators judged the responses. Alignment scores (1–5, GPT/human) rose from 2.1/2.2 without PAMU to 4.8/4.5 with it. Without PAMU, the model adapted with a two-turn delay; with PAMU, it adapted immediately.
- **Limitations stated by the authors:**
  - errors in the external classifiers carry over into the preference profile;
  - prompt-based control can be brittle;
  - converting scores into discrete labels loses detail;
  - the preference set is narrow and leaves out, for example, reasoning style and persona.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Electronic Science and Technology of China](https://md.research.elamur.ai/free/en/universities/university-of-electronic-science-and-technology-of-china/) — University, Chengdu, China · 31 works · 2,012 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works

## Cite

Cite as: Haoran Sun, Zekun Zhang and Shaoning Zeng. 2026. Preference-Aware Memory Update for Long-Term LLM Agents. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{sun2026preference,
  title = {{Preference-Aware Memory Update for Long-Term LLM Agents}},
  author = {Haoran Sun, Zekun Zhang and Shaoning Zeng},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.38},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.38}
}
```

- [← previous PII-Bench: Evaluating Query-Aware Privacy Protection Systems](https://md.research.elamur.ai/free/en/papers/shen-2026-pii-bench-evaluating-query-aware/)
- [next → ProFit: Leveraging High-Value Signals in SFT via Probability-Guided Token Selection](https://md.research.elamur.ai/free/en/papers/liu-2026-profit-leveraging-high-value-signals/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/4/)

## References

25 references, 10 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. DeepSeek-AI. 2025. [Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2025-deepseek-r1-incentivizing-reasoning-capability/). Preprint, arXiv:2501.12948.
2. Jiawei Gu, Xuhui Jiang, Zhichao Shi, Hexiang Tan, Xuehao Zhai, Chengjin Xu, Wei Li, Yinghan Shen, Shengjie Ma, Honghao Liu, and 1 others. 2024. A survey on llm-as-a-judge. arXiv preprint arXiv:2411.15594. [find](https://scholar.google.com/scholar?q=Jiawei+Gu%2C+Xuhui+Jiang%2C+Zhichao+Shi%2C+Hexiang+Tan%2C+Xuehao+Zhai%2C+Chengjin+Xu%2C+Wei+Li%2C+Yinghan+Shen%2C+Shengjie+Ma%2C+Honghao+Liu%2C+and+1+others%2E+2024%2E+A+survey+on+llm%2Das%2Da%2Djudge%2E+arXiv+preprint+arXiv%3A2411%2E15)
3. Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V Chawla, Olaf Wiest, and Xiangliang Zhang. 2024. [Large language model based multi-agents: A survey of progress and challenges](https://md.research.elamur.ai/free/en/papers/guo-2024-large-language-model-based/). arXiv preprint arXiv:2402.01680.
4. Xu Han, Tianyu Gao, Yuan Yao, Demin Ye, Zhiyuan Liu, and Maosong Sun. 2019. Opennre: An open and extensible toolkit for neural relation extraction. arXiv preprint arXiv:1909.13078. [find](https://scholar.google.com/scholar?q=Xu+Han%2C+Tianyu+Gao%2C+Yuan+Yao%2C+Demin+Ye%2C+Zhiyuan+Liu%2C+and+Maosong+Sun%2E+2019%2E+Opennre%3A+An+open+and+extensible+toolkit+for+neural+relation+extraction%2E+arXiv+preprint+arXiv%3A1909%2E13078%2E)
5. Xu Huang, Weiwen Liu, Xiaolong Chen, Xingmei Wang, Hao Wang, Defu Lian, Yasheng Wang, Ruiming Tang, and Enhong Chen. 2024a. Understanding the planning of llm agents: A survey. arXiv preprint arXiv:2402.02716. [find](https://scholar.google.com/scholar?q=Xu+Huang%2C+Weiwen+Liu%2C+Xiaolong+Chen%2C+Xingmei+Wang%2C+Hao+Wang%2C+Defu+Lian%2C+Yasheng+Wang%2C+Ruiming+Tang%2C+and+Enhong+Chen%2E+2024a%2E+Understanding+the+planning+of+llm+agents%3A+A+survey%2E+arXiv+preprint+arXiv%3A240)
6. Xu Huang, Weiwen Liu, Xiaolong Chen, Xingmei Wang, Hao Wang, Defu Lian, Yasheng Wang, Ruiming Tang, and Enhong Chen. 2024b. Understanding the planning of llm agents: A survey. arXiv preprint arXiv:2402.02716. [find](https://scholar.google.com/scholar?q=Xu+Huang%2C+Weiwen+Liu%2C+Xiaolong+Chen%2C+Xingmei+Wang%2C+Hao+Wang%2C+Defu+Lian%2C+Yasheng+Wang%2C+Ruiming+Tang%2C+and+Enhong+Chen%2E+2024b%2E+Understanding+the+planning+of+llm+agents%3A+A+survey%2E+arXiv+preprint+arXiv%3A240)
7. Haolin Jin, Linghan Huang, Haipeng Cai, Jun Yan, Bo Li, and Huaming Chen. 2024. From llms to llm-based agents for software engineering: A survey of current, challenges and future. arXiv preprint arXiv:2408.02479. — [arXiv:2408.02479](https://arxiv.org/abs/2408.02479) [find](https://scholar.google.com/scholar?q=Haolin+Jin%2C+Linghan+Huang%2C+Haipeng+Cai%2C+Jun+Yan%2C+Bo+Li%2C+and+Huaming+Chen%2E+2024%2E+From+llms+to+llm%2Dbased+agents+for+software+engineering%3A+A+survey+of+current%2C+challenges+and+future%2E+arXiv+preprint+arXiv)
8. Kuang-Huei Lee, Xinyun Chen, Hiroki Furuta, John Canny, and Ian Fischer. 2024. [A human-inspired reading agent with gist memory of very long contexts](https://md.research.elamur.ai/free/en/papers/lee-2024-human-inspired-reading-agent-gist/). Preprint, arXiv:2402.09727.
9. Yuanchun Li, Hao Wen, Weijun Wang, Xiangyu Li, Yizhen Yuan, Guohong Liu, Jiacheng Liu, Wenxing Xu, Xiang Wang, Yi Sun, and 1 others. 2024. Personal llm agents: Insights and survey about the capability, efficiency and security. arXiv preprint arXiv:2401.05459. [find](https://scholar.google.com/scholar?q=Yuanchun+Li%2C+Hao+Wen%2C+Weijun+Wang%2C+Xiangyu+Li%2C+Yizhen+Yuan%2C+Guohong+Liu%2C+Jiacheng+Liu%2C+Wenxing+Xu%2C+Xiang+Wang%2C+Yi+Sun%2C+and+1+others%2E+2024%2E+Personal+llm+agents%3A+Insights+and+survey+about+the+capability)
10. Adyasha Maharana, Dong-Ho Lee, Sergey Tulyakov, Mohit Bansal, Francesco Barbieri, and Yuwei Fang. 2024. Evaluating very long-term conversational memory of llm agents. arXiv preprint arXiv:2402.17753. [find](https://scholar.google.com/scholar?q=Adyasha+Maharana%2C+Dong%2DHo+Lee%2C+Sergey+Tulyakov%2C+Mohit+Bansal%2C+Francesco+Barbieri%2C+and+Yuwei+Fang%2E+2024%2E+Evaluating+very+long%2Dterm+conversational+memory+of+llm+agents%2E+arXiv+preprint+arXiv%3A2402%2E17753%2E)
11. Charles Packer, Vivian Fang, Shishir_G Patil, Kevin Lin, Sarah Wooders, and Joseph_E Gonzalez. 2023. Memgpt: Towards llms as operating systems. [find](https://scholar.google.com/scholar?q=Charles+Packer%2C+Vivian+Fang%2C+Shishir%5FG+Patil%2C+Kevin+Lin%2C+Sarah+Wooders%2C+and+Joseph%5FE+Gonzalez%2E+2023%2E+Memgpt%3A+Towards+llms+as+operating+systems%2E)
12. Rana Salama, Jason Cai, Michelle Yuan, Anna Currey, Monica Sunkara, Yi Zhang, and Yassine Benajiba. 2025. [Meminsight: Autonomous memory augmentation for llm agents](https://md.research.elamur.ai/free/en/papers/salama-2025-meminsight-autonomous-memory-augmentation-llm/). arXiv preprint arXiv:2503.21760.
13. Haoran Sun, Haoyu Bian, Shaoning Zeng, Yunbo Rao, Xu Xu, Lin Mei, and Jianping Gou. 2025. Datasetagent: A novel multi-agent system for auto-constructing datasets from real-world images. Preprint, arXiv:2507.08648. — [arXiv:2507.08648](https://arxiv.org/abs/2507.08648) [find](https://scholar.google.com/scholar?q=Haoran+Sun%2C+Haoyu+Bian%2C+Shaoning+Zeng%2C+Yunbo+Rao%2C+Xu+Xu%2C+Lin+Mei%2C+and+Jianping+Gou%2E+2025%2E+Datasetagent%3A+A+novel+multi%2Dagent+system+for+auto%2Dconstructing+datasets+from+real%2Dworld+images%2E+Preprint%2C+arXi)
14. Haoran Sun and Shaoning Zeng. 2025. Introspection of thought helps ai agents. Preprint, arXiv:2507.08664. — [arXiv:2507.08664](https://arxiv.org/abs/2507.08664) [find](https://scholar.google.com/scholar?q=Haoran+Sun+and+Shaoning+Zeng%2E+2025%2E+Introspection+of+thought+helps+ai+agents%2E+Preprint%2C+arXiv%3A2507%2E08664%2E+%E2%80%94+%5BarXiv%3A2507%2E08664%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2507%2E08664%29)
15. Haoran Sun, Shaoning Zeng, and Bob Zhang. 2026. [H-MEM: Hierarchical memory for high-efficiency long-term reasoning in LLM agents](https://md.research.elamur.ai/free/en/papers/sun-2026-h-mem-hierarchical-memory-high/). In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 341–350, Rabat, Morocco. Ass…
16. Hao Tian, Can Gao, Xinyan Xiao, Hao Liu, Bolei He, Hua Wu, Haifeng Wang, and Feng Wu. 2020. [Skep: Sentiment knowledge enhanced pre-training for sentiment analysis](https://md.research.elamur.ai/free/en/papers/tian-2020-skep-sentiment-knowledge-enhanced-pre/). Preprint, arXiv:2005.05635.
17. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. 2023. [Llama: Open and efficient foundation language models](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/). Preprint…
18. Bing Wang, Xinnian Liang, Jian Yang, Hui Huang, Shuangzhi Wu, Peihao Wu, Lu Lu, Zejun Ma, and Zhoujun Li. 2023. Enhancing large language model with self-controlled memory framework. arXiv preprint arXiv:2304.13343. — [arXiv:2304.13343](https://arxiv.org/abs/2304.13343) [find](https://scholar.google.com/scholar?q=Bing+Wang%2C+Xinnian+Liang%2C+Jian+Yang%2C+Hui+Huang%2C+Shuangzhi+Wu%2C+Peihao+Wu%2C+Lu+Lu%2C+Zejun+Ma%2C+and+Zhoujun+Li%2E+2023%2E+Enhancing+large+language+model+with+self%2Dcontrolled+memory+framework%2E+arXiv+preprint+arX)
19. Junchao Wu, Shu Yang, Runzhe Zhan, Yulin Yuan, Lidia Sam Chao, and Derek Fai Wong. 2025. [A survey on llm-generated text detection: Necessity, methods, and future directions](https://md.research.elamur.ai/free/en/papers/wu-2025-survey-llm-generated-text-detection/). Computational Linguistics, pages 1–66.
20. Wujiang Xu, Zujie Liang, Kai Mei, Hang Gao, Juntao Tan, and Yongfeng Zhang. 2025. [A-mem: Agentic memory for llm agents](https://md.research.elamur.ai/free/en/papers/xu-2025-mem-agentic-memory-llm-agents/). arXiv preprint arXiv:2502.12110.
21. An Yang, Baosong Yang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Zhou, Chengpeng Li, Chengyuan Li, Dayiheng Liu, Fei Huang, Guanting Dong, Haoran Wei, Huan Lin, Jialong Tang, Jialin Wang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Ma, and 40 others. 2024. Qwen2 technical report. arXiv preprint arXi… [find](https://scholar.google.com/scholar?q=An+Yang%2C+Baosong+Yang%2C+Binyuan+Hui%2C+Bo+Zheng%2C+Bowen+Yu%2C+Chang+Zhou%2C+Chengpeng+Li%2C+Chengyuan+Li%2C+Dayiheng+Liu%2C+Fei+Huang%2C+Guanting+Dong%2C+Haoran+Wei%2C+Huan+Lin%2C+Jialong+Tang%2C+Jialin+Wang%2C+Jian+Yang%2C+Jian)
22. Yifan Yao, Jinhao Duan, Kaidi Xu, Yuanfang Cai, Zhibo Sun, and Yue Zhang. 2024. [A survey on large language model (llm) security and privacy: The good, the bad, and the ugly](https://md.research.elamur.ai/free/en/papers/yao-2023-survey-large-language-model-llm/). High-Confidence Computing, page 100211.
23. Zeyu Zhang, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Quanyu Dai, Jieming Zhu, Zhenhua Dong, and Ji-Rong Wen. 2024a. A survey on the memory mechanism of large language model based agents. arXiv preprint arXiv:2404.13501. [find](https://scholar.google.com/scholar?q=Zeyu+Zhang%2C+Xiaohe+Bo%2C+Chen+Ma%2C+Rui+Li%2C+Xu+Chen%2C+Quanyu+Dai%2C+Jieming+Zhu%2C+Zhenhua+Dong%2C+and+Ji%2DRong+Wen%2E+2024a%2E+A+survey+on+the+memory+mechanism+of+large+language+model+based+agents%2E+arXiv+preprint+ar)
24. Zeyu Zhang, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Quanyu Dai, Jieming Zhu, Zhenhua Dong, and Ji-Rong Wen. 2024b. A survey on the memory mechanism of large language model based agents. arXiv preprint arXiv:2404.13501. [find](https://scholar.google.com/scholar?q=Zeyu+Zhang%2C+Xiaohe+Bo%2C+Chen+Ma%2C+Rui+Li%2C+Xu+Chen%2C+Quanyu+Dai%2C+Jieming+Zhu%2C+Zhenhua+Dong%2C+and+Ji%2DRong+Wen%2E+2024b%2E+A+survey+on+the+memory+mechanism+of+large+language+model+based+agents%2E+arXiv+preprint+ar)
25. Wanjun Zhong, Lianghong Guo, Qiqi Gao, He Ye, and Yanlin Wang. 2024. Memorybank: Enhancing large language models with long-term memory. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pages 19724–19731. [find](https://scholar.google.com/scholar?q=Wanjun+Zhong%2C+Lianghong+Guo%2C+Qiqi+Gao%2C+He+Ye%2C+and+Yanlin+Wang%2E+2024%2E+Memorybank%3A+Enhancing+large+language+models+with+long%2Dterm+memory%2E+In+Proceedings+of+the+AAAI+Conference+on+Artificial+Intelligence)

*Updated 1 November 2026*