---
title: "Demystify the Role of Memory in Machine Learning Engineering"
description: "The authors propose Dynamic Coding Memory, a task-aware store that records past errors, the package responsible and the… 41 references."
authors: ["Xinyu Zhao", "Junpeng Wang", "Yuzhong Chen", "Menghai Pan", "Chin-Chia Michael Yeh", "Jiarui Sun", "Yan Zheng", "Mahashweta Das", "Tianlong Chen"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: ACL 2026"
source: "https://aclanthology.org/2026.findings-acl.525/"
doi: "10.18653/v1/2026.findings-acl.525"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhao-2026-demystify-role-memory-machine-learning/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhao-2026-demystify-role-memory-machine-learning/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/29/) / Demystify the Role of Memory in Machine Learning Engineering Agents

# Demystify the Role of Memory in Machine Learning Engineering Agents

**Authors:** [Xinyu Zhao](https://md.research.elamur.ai/free/en/authors/xinyu-zhao/), Junpeng Wang, Yuzhong Chen, [Menghai Pan](https://md.research.elamur.ai/free/en/authors/menghai-pan/), [Chin-Chia Michael Yeh](https://md.research.elamur.ai/free/en/authors/chin-chia-michael-yeh/), Jiarui Sun, [Yan Zheng](https://md.research.elamur.ai/free/en/authors/yan-zheng/), [Mahashweta Das](https://md.research.elamur.ai/free/en/authors/mahashweta-das/) and [Tianlong Chen](https://md.research.elamur.ai/free/en/authors/tianlong-chen/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: ACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-acl.525/) · [PDF](https://aclanthology.org/2026.findings-acl.525.pdf) · [DOI 10.18653/v1/2026.findings-acl.525](https://doi.org/10.18653/v1/2026.findings-acl.525) · [OpenAlex](https://openalex.org/W7166821551)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
LLM agents that automate machine learning engineering (MLE) often fall into the same errors repeatedly, both inside one search tree and across separate runs of a task. This paper asks how memory changes such agents and whether the effect depends on how the agent is built. The authors propose Dynamic Coding Memory, a task-aware store that records past errors, the package responsible and the fix that worked, and retrieves entries by task and embedding. They add it to two agent styles, the tree-search agent AIDE and the linear, step-by-step agent OpenHands, and test both on MLE-Bench. The outcome depends on architecture. For the sequential agent, memory steadily improves reliability and refinement. For the tree-search agent, it cuts bugs but pushes exploration toward safe, local edits, and this can lower final solution quality. The study frames memory as a lever between dependable execution and creative search. It points toward adaptive designs, such as weakening memory during early exploration.

## Key points
- For AIDE, memory lowers the bug rate by 22.7% but also measurably reduces search diversity.
- Effects differ by data modality (change in mean score):
  - AIDE gains on tabular tasks (+16.25) and drops on image (−23.13), audio (−5.00) and text (−5.21).
  - OpenHands gains on text (+11.11) and tabular (+8.33).
- Success case, leaf-classification: stored fixes for lightgbm/xgboost API mismatches were retrieved for 74% of buggy nodes. The bug rate fell from 91.7% to 21.2%.
- Failure case, dog-breed-identification: 40.7% of 1,348 memory entries were timeouts. These steered the agent toward lightweight tabular models, and the best score fell from 0.622 to 0.294.
- Retrieval is limited to the same task. Within-task similarity is 2–4.9× higher than cross-task similarity, so cross-task transfer remains open.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of North Carolina at Chapel Hill](https://md.research.elamur.ai/free/en/universities/university-of-north-carolina-at-chapel-hill/) — University, Chapel Hill, United States · 74 works · 23,278 citations
- [Visa](https://md.research.elamur.ai/free/en/companies/visa/) — Company, Foster City, United States · 3 works · 106 citations
- [Visa (United Kingdom)](https://md.research.elamur.ai/free/en/companies/visa-united-kingdom/) — Company, London, United Kingdom · 2 works · 65 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

## Cite

Cite as: Xinyu Zhao, Junpeng Wang, Yuzhong Chen, Menghai Pan, Chin-Chia Michael Yeh, Jiarui Sun, Yan Zheng, Mahashweta Das and Tianlong Chen. 2026. Demystify the Role of Memory in Machine Learning Engineering Agents. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhao2026demystify,
  title = {{Demystify the Role of Memory in Machine Learning Engineering Agents}},
  author = {Xinyu Zhao, Junpeng Wang, Yuzhong Chen, Menghai Pan, Chin-Chia Michael Yeh, Jiarui Sun, Yan Zheng, Mahashweta Das and Tianlong Chen},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.525},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.525}
}
```

- [← previous Democratizing the medieval English legal tradition](https://md.research.elamur.ai/free/en/papers/zhang-2026-democratizing-medieval-english-legal-tradition/)
- [next → Demystifying Funding: Reconstructing a Unified Dataset of the UK Funding Lifecycle](https://md.research.elamur.ai/free/en/papers/thorne-2026-demystifying-funding-reconstructing-unified-dataset/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/29/)

## References

41 references, 17 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Tamer Abuelsaad, Deepak Akkil, Prasenjit Dey, Ashish Jagmohan, Aditya Vempaty, and Ravi Kokku. 2024. Agent-e: From autonomous web navigation to foundational design principles in agentic systems. arXiv preprint arXiv:2407.13032. — [arXiv:2407.13032](https://arxiv.org/abs/2407.13032) [find](https://scholar.google.com/scholar?q=Tamer+Abuelsaad%2C+Deepak+Akkil%2C+Prasenjit+Dey%2C+Ashish+Jagmohan%2C+Aditya+Vempaty%2C+and+Ravi+Kokku%2E+2024%2E+Agent%2De%3A+From+autonomous+web+navigation+to+foundational+design+principles+in+agentic+systems%2E+arXiv)
2. Anthropic. 2025. Claude code. [find](https://scholar.google.com/scholar?q=Anthropic%2E+2025%2E+Claude+code%2E)
3. Jun Shern Chan, Neil Chowdhury, Oliver Jaffe, James Aung, Dane Sherburn, Evan Mays, Giulio Starace, Kevin Liu, Leon Maksin, Tejal Patwardhan, Aleksander Madry, and Lilian Weng. 2025. [Mle-bench: Evaluating machine learning agents on machine learning engineering](https://md.research.elamur.ai/free/en/papers/chan-2024-mle-bench-evaluating-machine/). In The Thirteenth International Confer…
4. Guangyao Chen, Siwei Dong, Yu Shu, Ge Zhang, Jaward Sesay, Börje F Karlsson, Jie Fu, and Yemin Shi. 2023. [AutoAgents: A framework for automatic agent generation](https://md.research.elamur.ai/free/en/papers/chen-2023-autoagents-framework-automatic-agent-generation/). arXiv preprint arXiv:2309.17288.
5. Prateek Chhikara, Dev Khant, Saket Aryan, Taranjeet Singh, and Deshraj Yadav. 2025. [Mem0: Building production-ready AI agents with scalable long-term memory](https://md.research.elamur.ai/free/en/papers/chhikara-2025-mem0-building-production-ready-ai/). arXiv preprint arXiv:2504.19413.
6. Haoyang Fang, Boran Han, Nick Erickson, Xiyuan Zhang, Su Zhou, Anirudh Dagar, Jiani Zhang, Ali Caner Turkmen, Cuixiong Hu, Huzefa Rangwala, and 1 others. 2025. MLZero: A multi-agent system for end-to-end machine learning automation. arXiv preprint arXiv:2505.13941. — [arXiv:2505.13941](https://arxiv.org/abs/2505.13941) [find](https://scholar.google.com/scholar?q=Haoyang+Fang%2C+Boran+Han%2C+Nick+Erickson%2C+Xiyuan+Zhang%2C+Su+Zhou%2C+Anirudh+Dagar%2C+Jiani+Zhang%2C+Ali+Caner+Turkmen%2C+Cuixiong+Hu%2C+Huzefa+Rangwala%2C+and+1+others%2E+2025%2E+MLZero%3A+A+multi%2Dagent+system+for+end%2Dto%2D)
7. Mourad Gridach, Jay Nanavati, Khaldoun Zine El Abidine, Lenon Mendes, and Christina Mack. 2025. Agentic AI for scientific discovery: A survey of progress, challenges, and future directions. arXiv preprint arXiv:2503.08979. — [arXiv:2503.08979](https://arxiv.org/abs/2503.08979) [find](https://scholar.google.com/scholar?q=Mourad+Gridach%2C+Jay+Nanavati%2C+Khaldoun+Zine+El+Abidine%2C+Lenon+Mendes%2C+and+Christina+Mack%2E+2025%2E+Agentic+AI+for+scientific+discovery%3A+A+survey+of+progress%2C+challenges%2C+and+future+directions%2E+arXiv+prep)
8. Siyuan Guo, Cheng Deng, Ying Wen, Hechang Chen, Yi Chang, and Jun Wang. 2024a. DS-Agent: Automated data science by empowering large language models with case-based reasoning. arXiv preprint arXiv:2402.17453. [find](https://scholar.google.com/scholar?q=Siyuan+Guo%2C+Cheng+Deng%2C+Ying+Wen%2C+Hechang+Chen%2C+Yi+Chang%2C+and+Jun+Wang%2E+2024a%2E+DS%2DAgent%3A+Automated+data+science+by+empowering+large+language+models+with+case%2Dbased+reasoning%2E+arXiv+preprint+arXiv%3A2402)
9. Xudong Guo, Kaixuan Huang, Jiale Liu, Wenhui Fan, Natalia Vélez, Qingyun Wu, Huazheng Wang, Thomas L Griffiths, and Mengdi Wang. 2024b. Embodied LLM agents learn to cooperate in organized teams. arXiv preprint arXiv:2403.12482. — [arXiv:2403.12482](https://arxiv.org/abs/2403.12482) [find](https://scholar.google.com/scholar?q=Xudong+Guo%2C+Kaixuan+Huang%2C+Jiale+Liu%2C+Wenhui+Fan%2C+Natalia+V%C3%A9lez%2C+Qingyun+Wu%2C+Huazheng+Wang%2C+Thomas+L+Griffiths%2C+and+Mengdi+Wang%2E+2024b%2E+Embodied+LLM+agents+learn+to+cooperate+in+organized+teams%2E+arXiv)
10. Sirui Hong, Yizhang Lin, Bang Liu, Bangbang Liu, Binhao Wu, Danyang Li, Jiaqi Chen, Jiayi Zhang, Jinlin Wang, Li Zhang, Lingyao Zhang, Min Yang, Mingchen Zhuge, Taicheng Guo, Tuo Zhou, Wei Tao, Wenyi Wang, Xiangru Tang, Xiangtao Lu, and 6 others. 2024a. [Data interpreter: An LLM agent for data scienc…](https://md.research.elamur.ai/free/en/papers/hong-2025-data-interpreter-llm-agent-data/)
11. Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Ceyao Zhang, Jinlin Wang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, and 1 others. 2024b. [Metagpt: Meta programming for a multi-agent collaborative framework](https://md.research.elamur.ai/free/en/papers/hong-2023-metagpt-meta-programming-multi/). International Conference on Learning Representations, ICLR.
12. Qian Huang, Jian Vora, Percy Liang, and Jure Leskovec. 2024. [Mlagentbench: Evaluating language agents on machine learning experimentation](https://md.research.elamur.ai/free/en/papers/huang-2023-mlagentbench-evaluating-language-agents/). In Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net.
13. Md Ashraful Islam, Mohammed Eunus Ali, and Md Rizwan Parvez. 2024. [MapCoder: Multi-agent code generation for competitive problem solving](https://md.research.elamur.ai/free/en/papers/islam-2024-mapcoder-multi-agent-code/). arXiv preprint arXiv:2405.11403.
14. Zhengyao Jiang, Dominik Schmidt, Dhruv Srikanth, Dixing Xu, Ian Kaplan, Deniss Jacenko, and Yuxiang Wu. 2025. AIDE: ai-driven exploration in the space of code. CoRR, abs/2502.13138. [find](https://scholar.google.com/scholar?q=Zhengyao+Jiang%2C+Dominik+Schmidt%2C+Dhruv+Srikanth%2C+Dixing+Xu%2C+Ian+Kaplan%2C+Deniss+Jacenko%2C+and+Yuxiang+Wu%2E+2025%2E+AIDE%3A+ai%2Ddriven+exploration+in+the+space+of+code%2E+CoRR%2C+abs%2F2502%2E13138%2E)
15. Liqiang Jing, Zhehui Huang, Xiaoyang Wang, Wenlin Yao, Wenhao Yu, Kaixin Ma, Hongming Zhang, Xinya Du, and Dong Yu. 2024. Dsbench: How far are data science agents to becoming data science experts? CoRR, abs/2409.07703. [find](https://scholar.google.com/scholar?q=Liqiang+Jing%2C+Zhehui+Huang%2C+Xiaoyang+Wang%2C+Wenlin+Yao%2C+Wenhao+Yu%2C+Kaixin+Ma%2C+Hongming+Zhang%2C+Xinya+Du%2C+and+Dong+Yu%2E+2024%2E+Dsbench%3A+How+far+are+data+science+agents+to+becoming+data+science+experts%3F+CoR)
16. Manling Li, Shiyu Zhao, Qineng Wang, Kangrui Wang, Yu Zhou, Sanjana Srivastava, Cem Gokmen, Tony Lee, Erran Li Li, Ruohan Zhang, and 1 others. 2024. Embodied agent interface: Benchmarking LLMs for embodied decision making. Advances in Neural Information Processing Systems, 37:100428–100534. [find](https://scholar.google.com/scholar?q=Manling+Li%2C+Shiyu+Zhao%2C+Qineng+Wang%2C+Kangrui+Wang%2C+Yu+Zhou%2C+Sanjana+Srivastava%2C+Cem+Gokmen%2C+Tony+Lee%2C+Erran+Li+Li%2C+Ruohan+Zhang%2C+and+1+others%2E+2024%2E+Embodied+agent+interface%3A+Benchmarking+LLMs+for+emb)
17. Yuan Li, Yixuan Zhang, and Lichao Sun. 2023. MetaAgents: Simulating interactions of human behaviors for LLM-based task-oriented coordination via collaborative generative agents. arXiv preprint arXiv:2310.06500. [find](https://scholar.google.com/scholar?q=Yuan+Li%2C+Yixuan+Zhang%2C+and+Lichao+Sun%2E+2023%2E+MetaAgents%3A+Simulating+interactions+of+human+behaviors+for+LLM%2Dbased+task%2Doriented+coordination+via+collaborative+generative+agents%2E+arXiv+preprint+arXiv%3A2)
18. Junwei Liu, Kaixin Wang, Yixuan Chen, Xin Peng, Zhenpeng Chen, Lingming Zhang, and Yiling Lou. 2024. Large language model-based agents for software engineering: A survey. arXiv preprint arXiv:2409.02977. — [arXiv:2409.02977](https://arxiv.org/abs/2409.02977) [find](https://scholar.google.com/scholar?q=Junwei+Liu%2C+Kaixin+Wang%2C+Yixuan+Chen%2C+Xin+Peng%2C+Zhenpeng+Chen%2C+Lingming+Zhang%2C+and+Yiling+Lou%2E+2024%2E+Large+language+model%2Dbased+agents+for+software+engineering%3A+A+survey%2E+arXiv+preprint+arXiv%3A2409%2E029)
19. Zexi Liu, Yuzhu Cai, Xinyu Zhu, Yujie Zheng, Runkun Chen, Ying Wen, Yanfeng Wang, Siheng Chen, and 1 others. 2025. ML-Master: Towards AI-for-AI via integration of exploration and reasoning. arXiv preprint arXiv:2506.16499. — [arXiv:2506.16499](https://arxiv.org/abs/2506.16499) [find](https://scholar.google.com/scholar?q=Zexi+Liu%2C+Yuzhu+Cai%2C+Xinyu+Zhu%2C+Yujie+Zheng%2C+Runkun+Chen%2C+Ying+Wen%2C+Yanfeng+Wang%2C+Siheng+Chen%2C+and+1+others%2E+2025%2E+ML%2DMaster%3A+Towards+AI%2Dfor%2DAI+via+integration+of+exploration+and+reasoning%2E+arXiv+prep)
20. Junru Lu, Siyu An, Mingbao Lin, Gabriele Pergola, Yulan He, Di Yin, Xing Sun, and Yunsheng Wu. 2023. MemoChat: Tuning LLMs to use memos for consistent long-range open-domain conversation. arXiv preprint arXiv:2308.08239. — [arXiv:2308.08239](https://arxiv.org/abs/2308.08239) [find](https://scholar.google.com/scholar?q=Junru+Lu%2C+Siyu+An%2C+Mingbao+Lin%2C+Gabriele+Pergola%2C+Yulan+He%2C+Di+Yin%2C+Xing+Sun%2C+and+Yunsheng+Wu%2E+2023%2E+MemoChat%3A+Tuning+LLMs+to+use+memos+for+consistent+long%2Drange+open%2Ddomain+conversation%2E+arXiv+prepri)
21. Zhengxi Lu, Yuxiang Chai, Yaxuan Guo, Xi Yin, Liang Liu, Hao Wang, Han Xiao, Shuai Ren, Guanjing Xiong, and Hongsheng Li. 2025. UI-R1: Enhancing efficient action prediction of GUI agents by reinforcement learning. arXiv preprint arXiv:2503.21620. — [arXiv:2503.21620](https://arxiv.org/abs/2503.21620) [find](https://scholar.google.com/scholar?q=Zhengxi+Lu%2C+Yuxiang+Chai%2C+Yaxuan+Guo%2C+Xi+Yin%2C+Liang+Liu%2C+Hao+Wang%2C+Han+Xiao%2C+Shuai+Ren%2C+Guanjing+Xiong%2C+and+Hongsheng+Li%2E+2025%2E+UI%2DR1%3A+Enhancing+efficient+action+prediction+of+GUI+agents+by+reinforcem)
22. Jaehyun Nam, Jinsung Yoon, Jiefeng Chen, Jinwoo Shin, Sercan Ö Arık, and Tomas Pfister. 2025. MLE-STAR: Machine learning engineering agent via search and targeted refinement. arXiv preprint arXiv:2506.15692. — [arXiv:2506.15692](https://arxiv.org/abs/2506.15692) [find](https://scholar.google.com/scholar?q=Jaehyun+Nam%2C+Jinsung+Yoon%2C+Jiefeng+Chen%2C+Jinwoo+Shin%2C+Sercan+%C3%96+Ar%C4%B1k%2C+and+Tomas+Pfister%2E+2025%2E+MLE%2DSTAR%3A+Machine+learning+engineering+agent+via+search+and+targeted+refinement%2E+arXiv+preprint+arXiv%3A2506)
23. Alexander Novikov, Ngân Vũ, Marvin Eisenberger, Emilien Dupont, Po-Sen Huang, Adam Zsolt Wagner, Sergey Shirobokov, Borislav Kozlovskii, Francisco JR Ruiz, Abbas Mehrabian, and 1 others. 2025. [Alphaevolve: A coding agent for scientific and algorithmic discovery](https://md.research.elamur.ai/free/en/papers/novikov-2025-alphaevolve-coding-agent-scientific-algorithmic/). arXiv preprint arXiv:2506.13131.
24. OpenAI. 2024. Memory and new controls for ChatGPT. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2024%2E+Memory+and+new+controls+for+ChatGPT%2E)
25. OpenAI. 2025. Introducing OpenAI o3 and o4-mini. [find](https://scholar.google.com/scholar?q=OpenAI%2E+2025%2E+Introducing+OpenAI+o3+and+o4%2Dmini%2E)
26. Charles Packer, Vivian Fang, Shishir_G Patil, Kevin Lin, Sarah Wooders, and Joseph_E Gonzalez. 2023. MemGPT: Towards LLMs as operating systems. [find](https://scholar.google.com/scholar?q=Charles+Packer%2C+Vivian+Fang%2C+Shishir%5FG+Patil%2C+Kevin+Lin%2C+Sarah+Wooders%2C+and+Joseph%5FE+Gonzalez%2E+2023%2E+MemGPT%3A+Towards+LLMs+as+operating+systems%2E)
27. Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. 2023. [Reflexion: Language agents with verbal reinforcement learning](https://md.research.elamur.ai/free/en/papers/shinn-2023-reflexion-language-agents-verbal-reinforcement/). Advances in Neural Information Processing Systems, 36:8634–8652.
28. Maojun Sun, Ruijian Han, Binyan Jiang, Houduo Qi, Defeng Sun, Yancheng Yuan, and Jian Huang. 2024. A survey on large language model–based agents for statistics and data science. arXiv preprint arXiv:2412.14222. — [arXiv:2412.14222](https://arxiv.org/abs/2412.14222) [find](https://scholar.google.com/scholar?q=Maojun+Sun%2C+Ruijian+Han%2C+Binyan+Jiang%2C+Houduo+Qi%2C+Defeng+Sun%2C+Yancheng+Yuan%2C+and+Jian+Huang%2E+2024%2E+A+survey+on+large+language+model%E2%80%93based+agents+for+statistics+and+data+science%2E+arXiv+preprint+arXiv%3A2)
29. Edan Toledo, Karen Hambardzumyan, Martin Josifoski, Rishi Hazra, Nicolas Baldwin, Alexis Audran-Reiss, Michael Kuchnik, Despoina Magka, Minqi Jiang, Alisia Maria Lupidi, and 1 others. 2025. AI research agents for machine learning: Search, exploration, and generalization in MLE-bench. arXiv preprint… — [arXiv:2507.02554](https://arxiv.org/abs/2507.02554) [find](https://scholar.google.com/scholar?q=Edan+Toledo%2C+Karen+Hambardzumyan%2C+Martin+Josifoski%2C+Rishi+Hazra%2C+Nicolas+Baldwin%2C+Alexis+Audran%2DReiss%2C+Michael+Kuchnik%2C+Despoina+Magka%2C+Minqi+Jiang%2C+Alisia+Maria+Lupidi%2C+and+1+others%2E+2025%2E+AI+researc)
30. Xingyao Wang, Boxuan Li, Yufan Song, Frank F Xu, Xiangru Tang, Mingchen Zhuge, Jiayi Pan, Yueqi Song, Bowen Li, Jaskirat Singh, and 1 others. 2024. [OpenHands: An open platform for AI software developers as generalist agents](https://md.research.elamur.ai/free/en/papers/wang-2024-openhands-open-platform-ai/). arXiv preprint arXiv:2407.16741.
31. Yaxiong Wu, Sheng Liang, Chen Zhang, Yichao Wang, Yongyue Zhang, Huifeng Guo, Ruiming Tang, and Yong Liu. 2025. From human memory to AI memory: A survey on memory mechanisms in the era of LLMs. arXiv preprint arXiv:2504.15965. — [arXiv:2504.15965](https://arxiv.org/abs/2504.15965) [find](https://scholar.google.com/scholar?q=Yaxiong+Wu%2C+Sheng+Liang%2C+Chen+Zhang%2C+Yichao+Wang%2C+Yongyue+Zhang%2C+Huifeng+Guo%2C+Ruiming+Tang%2C+and+Yong+Liu%2E+2025%2E+From+human+memory+to+AI+memory%3A+A+survey+on+memory+mechanisms+in+the+era+of+LLMs%2E+arXiv+)
32. Zidi Xiong, Yuping Lin, Wenya Xie, Pengfei He, Jiliang Tang, Himabindu Lakkaraju, and Zhen Xiang. 2025. [How memory management impacts LLM agents: An empirical study of experience-following behavior](https://md.research.elamur.ai/free/en/papers/xiong-2026-how-memory-management-impacts-llm/). arXiv preprint arXiv:2505.16067.
33. Wujiang Xu, Kai Mei, Hang Gao, Juntao Tan, Zujie Liang, and Yongfeng Zhang. 2025. [A-Mem: Agentic memory for LLM agents](https://md.research.elamur.ai/free/en/papers/xu-2025-mem-agentic-memory-llm-agents/). arXiv preprint arXiv:2502.12110.
34. Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Tom Griffiths, Yuan Cao, and Karthik Narasimhan. 2023. Tree of thoughts: Deliberate problem solving with large language models. Advances in neural information processing systems, 36:11809–11822. [find](https://scholar.google.com/scholar?q=Shunyu+Yao%2C+Dian+Yu%2C+Jeffrey+Zhao%2C+Izhak+Shafran%2C+Tom+Griffiths%2C+Yuan+Cao%2C+and+Karthik+Narasimhan%2E+2023%2E+Tree+of+thoughts%3A+Deliberate+problem+solving+with+large+language+models%2E+Advances+in+neural+inf)
35. Dan Zhang, Sining Zhoubian, Min Cai, Fengzu Li, Lekang Yang, Wei Wang, Tianjiao Dong, Ziniu Hu, Jie Tang, and Yisong Yue. 2025a. [DataSciBench: An LLM agent benchmark for data science](https://md.research.elamur.ai/free/en/papers/zhang-2026-datascibench-llm-agent-benchmark-data/). arXiv preprint arXiv:2502.13897.
36. Kechi Zhang, Jia Li, Ge Li, Xianjie Shi, and Zhi Jin. 2024a. [CodeAgent: Enhancing code generation with tool-integrated agent systems for real-world repo-level coding challenges](https://md.research.elamur.ai/free/en/papers/zhang-2024-codeagent-enhancing-code-generation-tool/). arXiv preprint arXiv:2401.07339.
37. Yunxiang Zhang, Edan Toledo, Martin Josifoski, Karen Hambardzumyan, Alisia Maria Lupidi, Alexis Audran-Reiss, Michael Kuchnik, Despoina Magka, Minqi Jiang, Nicolas Baldwin, and 1 others. 2026. [Learning to ideate for machine learning engineering agents](https://md.research.elamur.ai/free/en/papers/zhang-2026-learning-ideate-machine-learning-engineering/). arXiv preprint arXiv:2601.17596.
38. Zeyu Zhang, Quanyu Dai, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Jieming Zhu, Zhenhua Dong, and Ji-Rong Wen. 2024b. A survey on the memory mechanism of large language model based agents. ACM Transactions on Information Systems. [find](https://scholar.google.com/scholar?q=Zeyu+Zhang%2C+Quanyu+Dai%2C+Xiaohe+Bo%2C+Chen+Ma%2C+Rui+Li%2C+Xu+Chen%2C+Jieming+Zhu%2C+Zhenhua+Dong%2C+and+Ji%2DRong+Wen%2E+2024b%2E+A+survey+on+the+memory+mechanism+of+large+language+model+based+agents%2E+ACM+Transactions+)
39. Zeyu Zhang, Quanyu Dai, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Jieming Zhu, Zhenhua Dong, and Ji-Rong Wen. 2025b. A survey on the memory mechanism of large language model-based agents. ACM Transactions on Information Systems, 43(6):1–47. [find](https://scholar.google.com/scholar?q=Zeyu+Zhang%2C+Quanyu+Dai%2C+Xiaohe+Bo%2C+Chen+Ma%2C+Rui+Li%2C+Xu+Chen%2C+Jieming+Zhu%2C+Zhenhua+Dong%2C+and+Ji%2DRong+Wen%2E+2025b%2E+A+survey+on+the+memory+mechanism+of+large+language+model%2Dbased+agents%2E+ACM+Transactions+)
40. Yuxiang Zheng, Dayuan Fu, Xiangkun Hu, Xiaojie Cai, Lyumanshan Ye, Pengrui Lu, and Pengfei Liu. 2025. [DeepResearcher: Scaling deep research via reinforcement learning in real-world environments](https://md.research.elamur.ai/free/en/papers/zheng-2025-deepresearcher-scaling-deep-research-reinforcement/). arXiv preprint arXiv:2504.03160.
41. Shuyan Zhou, Frank F Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, and 1 others. 2023. [WebArena: A realistic web environment for building autonomous agents](https://md.research.elamur.ai/free/en/papers/zhou-2023-webarena-realistic-web-environment-building/). arXiv preprint arXiv:2307.13854.

*Updated 2 November 2026*