---
title: "MAPRO — paper by Zhang et al. (2026) — summary and ideas"
description: "Automating prompt design for such systems is hard for two reasons. 56 references, cited by 1 paper here."
authors: ["Zheyuan Zhang", "Lin Ge", "Hongjiang Li", "Weicheng Zhu", "Chuxu Zhang", "Yanfang Ye"]
year: 2026
venue: "Findings of the Association for Computational Linguistics: EACL 2026"
source: "https://aclanthology.org/2026.findings-eacl.233/"
doi: "10.18653/v1/2026.findings-eacl.233"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zhang-2026-mapro-recasting-multi-agent-prompt/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zhang-2026-mapro-recasting-multi-agent-prompt/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/) / MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference

# MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference

**Authors:** [Zheyuan Zhang](https://md.research.elamur.ai/free/en/authors/zheyuan-zhang/), Lin Ge, Hongjiang Li, Weicheng Zhu, [Chuxu Zhang](https://md.research.elamur.ai/free/en/authors/chuxu-zhang/) and [Yanfang Ye](https://md.research.elamur.ai/free/en/authors/yanfang-ye/) · **Year:** 2026 · **Venue:** [Findings of the Association for Computational Linguistics: EACL 2026](https://md.research.elamur.ai/free/en/venues/findings/) ([Findings of the Association for Computational Linguistics 2026](https://md.research.elamur.ai/free/en/venues/findings/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.findings-eacl.233/) · [PDF](https://aclanthology.org/2026.findings-eacl.233.pdf) · [DOI 10.18653/v1/2026.findings-eacl.233](https://doi.org/10.18653/v1/2026.findings-eacl.233) · [OpenAlex](https://openalex.org/W7140094036)

**Citations:** 2 citations (OpenAlex, 2026-10-14) · [1](https://md.research.elamur.ai/free/en/papers/zhang-2026-mapro-recasting-multi-agent-prompt/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
LLM-based multi-agent systems are fragile. Each agent reacts strongly to its prompt, and mistakes spread along the chain of hand-offs. Automating prompt design for such systems is hard for two reasons. The joint space of prompt candidates grows exponentially, and it is unclear which agent caused a failure. MAPRO represents the workflow as a directed acyclic graph. LLM-based reward models score each agent's prompt (node) and each pair of connected prompts (edge). System quality is the product of all these scores, so choosing the best prompt set becomes a Maximum a Posteriori (MAP) problem under a uniform prior. A language-guided variant of max-product belief propagation approximates the solution in polynomial time. A topology-aware step then revises each agent's own prompt pool, combining global execution feedback with blame passed back from downstream agents, and repeats until stopping criteria are met. MAPRO outperforms hand-built multi-agent systems and automated single- and multi-agent optimizers on math reasoning, question answering and code generation. Its optimization curves are also steadier. It gives a principled, plug-and-play way to tune deployed systems whose topology must stay fixed.

## Key points
- MAPRO has four stages: (1) initializing prompt candidates and reward models, (2) MAP selection via language-based max-product belief propagation, (3) preference-based policy updates using multi-level feedback, and (4) termination.
- Failures are split into two types, agent incompetence and defective interaction. The Joint Quality Score multiplies node and edge scores in [0, 1], reflecting that one weak link breaks the whole workflow. Brute force would require checking K^N combinations.
- Cost is measured in agent-level LLM calls. Per iteration, MAPRO uses N update calls, N node scores, E×K batched edge scores and only one full system run. TPE-style baselines instead need extra S×N calls, with S = 20 in the experiments.
- In the reward-model ablation, the demonstration-guided reward matters most, consistent with TPO. Its benefit is smaller on simpler tasks such as math. Low-temperature scoring gave nearly identical selections across runs.
- Limitations: the agent topology is fixed and only prompts are optimized. Possible future directions are joint prompt and topology search, and fine-tuned reward models, for example via Max a Posteriori Policy Optimization.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Amazon](https://md.research.elamur.ai/free/en/companies/amazon/) — Company, Seattle, United States · 128 works · 41,697 citations
- [University of Notre Dame](https://md.research.elamur.ai/free/en/universities/university-of-notre-dame/) — University, Notre Dame, United States · 59 works · 37,127 citations
- [University of Connecticut](https://md.research.elamur.ai/free/en/universities/university-of-connecticut/) — University, Storrs, United States · 13 works · 357 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works

## Cite

Cite as: Zheyuan Zhang, Lin Ge, Hongjiang Li, Weicheng Zhu, Chuxu Zhang and Yanfang Ye. 2026. MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference. Findings of the Association for Computational Linguistics: EACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zhang2026mapro,
  title = {{MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference}},
  author = {Zheyuan Zhang, Lin Ge, Hongjiang Li, Weicheng Zhu, Chuxu Zhang and Yanfang Ye},
  booktitle = {Findings of the Association for Computational Linguistics: EACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-eacl.233},
  url = {https://doi.org/10.18653/v1/2026.findings-eacl.233}
}
```

- [← previous LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimization](https://md.research.elamur.ai/free/en/papers/tang-2026-lpo-accurate-gui-agent-interaction/)
- [next → MathAgent: Adversarial Evolution of Constraint Graphs for Mathematical Reasoning Data Synthesis](https://md.research.elamur.ai/free/en/papers/yu-2026-mathagent-adversarial-evolution-constraint-graphs/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/5/)

## References

56 references, 26 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Abbas Abdolmaleki, Jost Tobias Springenberg, Yuval Tassa, Remi Munos, Nicolas Heess, and Martin Riedmiller. 2018. Maximum a posteriori policy optimisation. In ICLR. [find](https://scholar.google.com/scholar?q=Abbas+Abdolmaleki%2C+Jost+Tobias+Springenberg%2C+Yuval+Tassa%2C+Remi+Munos%2C+Nicolas+Heess%2C+and+Martin+Riedmiller%2E+2018%2E+Maximum+a+posteriori+policy+optimisation%2E+In+ICLR%2E)
2. Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013. [Semantic parsing on freebase from question-answer pairs](https://md.research.elamur.ai/free/en/papers/berant-2013-semantic-parsing-freebase-question-answer/). In EMNLP.
3. Chi-Min Chan, Weize Chen, Yusheng Su, Jianxuan Yu, Wei Xue, Shanghang Zhang, Jie Fu, and Zhiyuan Liu. 2024. [Chateval: Towards better llm-based evaluators through multi-agent debate](https://md.research.elamur.ai/free/en/papers/chan-2023-chateval-better-llm-based/). In ICLR.
4. Jingchang Chen, Hongxuan Tang, Zheng Chu, Qianglong Chen, Zekun Wang, Ming Liu, and Bing Qin. 2024a. Divide-and-conquer meets consensus: Unleashing the power of functions in code generation. In NeurIPS. [find](https://scholar.google.com/scholar?q=Jingchang+Chen%2C+Hongxuan+Tang%2C+Zheng+Chu%2C+Qianglong+Chen%2C+Zekun+Wang%2C+Ming+Liu%2C+and+Bing+Qin%2E+2024a%2E+Divide%2Dand%2Dconquer+meets+consensus%3A+Unleashing+the+power+of+functions+in+code+generation%2E+In+NeurIP)
5. Yongchao Chen, Jacob Arkin, Yilun Hao, Yang Zhang, Nicholas Roy, and Chuchu Fan. 2024b. Prompt optimization in multi-step tasks (promst): Integrating human feedback and heuristic-based sampling. In EMNLP. [find](https://scholar.google.com/scholar?q=Yongchao+Chen%2C+Jacob+Arkin%2C+Yilun+Hao%2C+Yang+Zhang%2C+Nicholas+Roy%2C+and+Chuchu+Fan%2E+2024b%2E+Prompt+optimization+in+multi%2Dstep+tasks+%28promst%29%3A+Integrating+human+feedback+and+heuristic%2Dbased+sampling%2E+In+EM)
6. Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al. 2021. [Training verifiers to solve math word problems](https://md.research.elamur.ai/free/en/papers/cobbe-2021-training-verifiers-solve-math-word/). arXiv preprint arXiv:2110.14168.
7. Wendi Cui, Jiaxin Zhang, Zhuohang Li, Hao Sun, Damien Lopez, Kamalika Das, Bradley A Malin, and Sricharan Kumar. 2025. Automatic prompt optimization via heuristic search: A survey. arXiv. [find](https://scholar.google.com/scholar?q=Wendi+Cui%2C+Jiaxin+Zhang%2C+Zhuohang+Li%2C+Hao+Sun%2C+Damien+Lopez%2C+Kamalika+Das%2C+Bradley+A+Malin%2C+and+Sricharan+Kumar%2E+2025%2E+Automatic+prompt+optimization+via+heuristic+search%3A+A+survey%2E+arXiv%2E)
8. Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021. [Measuring mathematical problem solving with the math dataset](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-mathematical-problem-solving-math/). In NeuralIPS.
9. Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, et al. 2024a. [Metagpt: Meta programming for a multi-agent collaborative framework](https://md.research.elamur.ai/free/en/papers/hong-2023-metagpt-meta-programming-multi/). In ICLR.
10. Sirui Hong, Mingchen Zhuge, Jonathan Chen, Xiawu Zheng, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, et al. 2024b. [Metagpt: Meta programming for a multi-agent collaborative framework](https://md.research.elamur.ai/free/en/papers/hong-2023-metagpt-meta-programming-multi/). In ICLR.
11. Shengran Hu, Cong Lu, and Jeff Clune. 2025. [Automated design of agentic systems](https://md.research.elamur.ai/free/en/papers/hu-2024-automated-design-agentic-systems/). In ICLR.
12. Haitao Jiang, Lin Ge, Yuhe Gao, Jianian Wang, and Rui Song. 2024. Llm4causal: Democratized causal tools for everyone via large language model. In CoLM. [find](https://scholar.google.com/scholar?q=Haitao+Jiang%2C+Lin+Ge%2C+Yuhe+Gao%2C+Jianian+Wang%2C+and+Rui+Song%2E+2024%2E+Llm4causal%3A+Democratized+causal+tools+for+everyone+via+large+language+model%2E+In+CoLM%2E)
13. Nicola Dainese, Matteo Merler, Minttu Alakuijala, and Pekka Marttinen. 2024. Generating code world models with large language models guided by monte carlo tree search. In NeurIPS. [find](https://scholar.google.com/scholar?q=Nicola+Dainese%2C+Matteo+Merler%2C+Minttu+Alakuijala%2C+and+Pekka+Marttinen%2E+2024%2E+Generating+code+world+models+with+large+language+models+guided+by+monte+carlo+tree+search%2E+In+NeurIPS%2E)
14. Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R Narasimhan. 2024. [Swe-bench: Can language models resolve real-world github issues?](https://md.research.elamur.ai/free/en/papers/jimenez-2024-swe-bench-can-language-models/) In ICLR.
15. Yihong Dong, Jiazheng Ding, Xue Jiang, Ge Li, Zhuo Li, and Zhi Jin. 2025. Codescore: Evaluating code generation by learning code execution. ACM Transactions on Software Engineering and Methodology. [find](https://scholar.google.com/scholar?q=Yihong+Dong%2C+Jiazheng+Ding%2C+Xue+Jiang%2C+Ge+Li%2C+Zhuo+Li%2C+and+Zhi+Jin%2E+2025%2E+Codescore%3A+Evaluating+code+generation+by+learning+code+execution%2E+ACM+Transactions+on+Software+Engineering+and+Methodology%2E)
16. Omar Khattab, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang, Keshav Santhanam, Saiful Haq, Ashutosh Sharma, Thomas T Joshi, Hanna Moazam, Heather Miller, et al. 2024. Dspy: Compiling declarative language model calls into state-of-the-art pipelines. In ICLR. [find](https://scholar.google.com/scholar?q=Omar+Khattab%2C+Arnav+Singhvi%2C+Paridhi+Maheshwari%2C+Zhiyuan+Zhang%2C+Keshav+Santhanam%2C+Saiful+Haq%2C+Ashutosh+Sharma%2C+Thomas+T+Joshi%2C+Hanna+Moazam%2C+Heather+Miller%2C+et+al%2E+2024%2E+Dspy%3A+Compiling+declarative+la)
17. Xidong Feng, Bo Liu, Yan Song, Haotian Fu, Ziyu Wan, Girish A Koushik, Zhiyuan Hu, Mengyue Yang, Ying Wen, and Jun Wang. 2024. Natural language reinforcement learning. arXiv preprint arXiv:2411.14251. — [arXiv:2411.14251](https://arxiv.org/abs/2411.14251) [find](https://scholar.google.com/scholar?q=Xidong+Feng%2C+Bo+Liu%2C+Yan+Song%2C+Haotian+Fu%2C+Ziyu+Wan%2C+Girish+A+Koushik%2C+Zhiyuan+Hu%2C+Mengyue+Yang%2C+Ying+Wen%2C+and+Jun+Wang%2E+2024%2E+Natural+language+reinforcement+learning%2E+arXiv+preprint+arXiv%3A2411%2E14251%2E)
18. Chrisantha Fernando, Dylan Banarse, Henryk Michalewski, Simon Osindero, and Tim Rocktäschel. 2024. [Promptbreeder: self-referential self-improvement via prompt evolution](https://md.research.elamur.ai/free/en/papers/fernando-2023-promptbreeder-self-referential-self-improvement/). In ICML.
19. Lin Ge, Hengrui Cai, Runzhe Wan, Yang Xu, and Rui Song. 2025. A review of causal decision making. arXiv preprint arXiv:2502.16156. — [arXiv:2502.16156](https://arxiv.org/abs/2502.16156) [find](https://scholar.google.com/scholar?q=Lin+Ge%2C+Hengrui+Cai%2C+Runzhe+Wan%2C+Yang+Xu%2C+and+Rui+Song%2E+2025%2E+A+review+of+causal+decision+making%2E+arXiv+preprint+arXiv%3A2502%2E16156%2E+%E2%80%94+%5BarXiv%3A2502%2E16156%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2502%2E16156%29)
20. Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, and Yujiu Yang. 2024a. Connecting large language models with evolutionary algorithms yields powerful prompt optimizers. In ICLR. [find](https://scholar.google.com/scholar?q=Qingyan+Guo%2C+Rui+Wang%2C+Junliang+Guo%2C+Bei+Li%2C+Kaitao+Song%2C+Xu+Tan%2C+Guoqing+Liu%2C+Jiang+Bian%2C+and+Yujiu+Yang%2E+2024a%2E+Connecting+large+language+models+with+evolutionary+algorithms+yields+powerful+prompt+o)
21. Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. 2022. [Large language models are zero-shot reasoners](https://md.research.elamur.ai/free/en/papers/kojima-2022-large-language-models-zero-shot/). NeurIPS.
22. Chao Lei, Yanchuan Chang, Nir Lipovetzky, and Krista A Ehinger. 2025. Planning-driven programming: A large language model programming workflow. ACL. [find](https://scholar.google.com/scholar?q=Chao+Lei%2C+Yanchuan+Chang%2C+Nir+Lipovetzky%2C+and+Krista+A+Ehinger%2E+2025%2E+Planning%2Ddriven+programming%3A+A+large+language+model+programming+workflow%2E+ACL%2E)
23. Manling Li, Shiyu Zhao, Qineng Wang, Kangrui Wang, Yu Zhou, Sanjana Srivastava, Cem Gokmen, Tony Lee, Li Erran Li, Ruohan Zhang, et al. 2024. Embodied agent interface: benchmarking llms for embodied decision making. In NeuralIPS. [find](https://scholar.google.com/scholar?q=Manling+Li%2C+Shiyu+Zhao%2C+Qineng+Wang%2C+Kangrui+Wang%2C+Yu+Zhou%2C+Sanjana+Srivastava%2C+Cem+Gokmen%2C+Tony+Lee%2C+Li+Erran+Li%2C+Ruohan+Zhang%2C+et+al%2E+2024%2E+Embodied+agent+interface%3A+benchmarking+llms+for+embodied+d)
24. Yafu Li, Xuyang Hu, Xiaoye Qu, Linjie Li, and Yu Cheng. 2025. Test-time preference optimization: On-the-fly alignment via iterative textual feedback. In ICML. [find](https://scholar.google.com/scholar?q=Yafu+Li%2C+Xuyang+Hu%2C+Xiaoye+Qu%2C+Linjie+Li%2C+and+Yu+Cheng%2E+2025%2E+Test%2Dtime+preference+optimization%3A+On%2Dthe%2Dfly+alignment+via+iterative+textual+feedback%2E+In+ICML%2E)
25. Qingyan Guo, Rui Wang, Junliang Guo, Bei Li, Kaitao Song, Xu Tan, Guoqing Liu, Jiang Bian, and Yujiu Yang. 2025. [Evoprompt: Connecting llms with evolutionary algorithms yields powerful prompt optimizers](https://md.research.elamur.ai/free/en/papers/guo-2023-evoprompt-connecting-llms-evolutionary-algorithms/). arXiv.
26. Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, et al. 2022. [Competition-level code generation with alphacode](https://md.research.elamur.ai/free/en/papers/li-2022-competition-level-code-generation-alphacode/). Science.
27. Siyuan Guo, Cheng Deng, Ying Wen, Hechang Chen, Yi Chang, and Jun Wang. 2024b. Ds-agent: automated data science by empowering large language models with case-based reasoning. In ICML. [find](https://scholar.google.com/scholar?q=Siyuan+Guo%2C+Cheng+Deng%2C+Ying+Wen%2C+Hechang+Chen%2C+Yi+Chang%2C+and+Jun+Wang%2E+2024b%2E+Ds%2Dagent%3A+automated+data+science+by+empowering+large+language+models+with+case%2Dbased+reasoning%2E+In+ICML%2E)
28. Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, and Lingming Zhang. 2023. [Is your code generated by chatgpt really correct? rigorous evaluation of large language models for code generation](https://md.research.elamur.ai/free/en/papers/liu-2023-your-code-generated-chatgpt-really/). NeuralIPS.
29. Xiangyan Liu, Bo Lan, Zhiyuan Hu, Yang Liu, Zhicheng Zhang, Fei Wang, Michael Shieh, and Wenmeng Zhou. 2025a. Codexgraph: Bridging large language models and code repositories via code graph databases. NAACL. [find](https://scholar.google.com/scholar?q=Xiangyan+Liu%2C+Bo+Lan%2C+Zhiyuan+Hu%2C+Yang+Liu%2C+Zhicheng+Zhang%2C+Fei+Wang%2C+Michael+Shieh%2C+and+Wenmeng+Zhou%2E+2025a%2E+Codexgraph%3A+Bridging+large+language+models+and+code+repositories+via+code+graph+databases%2E)
30. Yexiang Liu, Jie Cao, Zekun Li, Ran He, and Tieniu Tan. 2025b. Breaking mental set to improve reasoning through diverse multi-agent debate. In ICLR. [find](https://scholar.google.com/scholar?q=Yexiang+Liu%2C+Jie+Cao%2C+Zekun+Li%2C+Ran+He%2C+and+Tieniu+Tan%2E+2025b%2E+Breaking+mental+set+to+improve+reasoning+through+diverse+multi%2Dagent+debate%2E+In+ICLR%2E)
31. Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, et al. 2023. Self-refine: Iterative refinement with self-feedback. NeurIPS. [find](https://scholar.google.com/scholar?q=Aman+Madaan%2C+Niket+Tandon%2C+Prakhar+Gupta%2C+Skyler+Hallinan%2C+Luyu+Gao%2C+Sarah+Wiegreffe%2C+Uri+Alon%2C+Nouha+Dziri%2C+Shrimai+Prabhumoye%2C+Yiming+Yang%2C+et+al%2E+2023%2E+Self%2Drefine%3A+Iterative+refinement+with+self%2Df)
32. Krista Opsahl-Ong, Michael Ryan, Josh Purtell, David Broman, Christopher Potts, Matei Zaharia, and Omar Khattab. 2024. [Optimizing instructions and demonstrations for multi-stage language model programs](https://md.research.elamur.ai/free/en/papers/ong-2024-optimizing-instructions-demonstrations-multi-stage/). In EMNLP.
33. Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. [Training language models to follow instructions with human feedback](https://md.research.elamur.ai/free/en/papers/ouyang-2022-training-language-models-follow-instructions/). NeuralIPS.
34. Siru Ouyang, Wenhao Yu, Kaixin Ma, Zilin Xiao, Zhihan Zhang, Mengzhao Jia, Jiawei Han, Hongming Zhang, and Dong Yu. 2025. Repograph: Enhancing ai software engineering with repository-level code graph. ICLR. [find](https://scholar.google.com/scholar?q=Siru+Ouyang%2C+Wenhao+Yu%2C+Kaixin+Ma%2C+Zilin+Xiao%2C+Zhihan+Zhang%2C+Mengzhao+Jia%2C+Jiawei+Han%2C+Hongming+Zhang%2C+and+Dong+Yu%2E+2025%2E+Repograph%3A+Enhancing+ai+software+engineering+with+repository%2Dlevel+code+graph%2E)
35. Chen Qian, Wei Liu, Hongzhang Liu, Nuo Chen, Yufan Dang, Jiahao Li, Cheng Yang, Weize Chen, Yusheng Su, Xin Cong, et al. 2024. [Chatdev: Communicative agents for software development](https://md.research.elamur.ai/free/en/papers/qian-2023-chatdev-communicative-agents-software/). In ACL.
36. Chen Qian, Zihao Xie, YiFei Wang, Wei Liu, Kunlun Zhu, Hanchen Xia, Yufan Dang, Zhuoyun Du, Weize Chen, Cheng Yang, et al. 2025. [Scaling large language model-based multi-agent collaboration](https://md.research.elamur.ai/free/en/papers/qian-2024-scaling-large-language-model/). In ICLR.
37. Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. 2023. [Reflexion: Language agents with verbal reinforcement learning](https://md.research.elamur.ai/free/en/papers/shinn-2023-reflexion-language-agents-verbal-reinforcement/). NeurIPS.
38. Aditi Singh, Abul Ehtesham, Saket Kumar, and Tala Talaei Khoei. 2025. Agentic retrieval-augmented generation: A survey on agentic rag. arXiv. [find](https://scholar.google.com/scholar?q=Aditi+Singh%2C+Abul+Ehtesham%2C+Saket+Kumar%2C+and+Tala+Talaei+Khoei%2E+2025%2E+Agentic+retrieval%2Daugmented+generation%3A+A+survey+on+agentic+rag%2E+arXiv%2E)
39. Feifan Song, Yuxuan Fan, Xin Zhang, Peiyi Wang, and Houfeng Wang. 2025. Instantly learning preference alignment via in-context dpo. In NAACL. [find](https://scholar.google.com/scholar?q=Feifan+Song%2C+Yuxuan+Fan%2C+Xin+Zhang%2C+Peiyi+Wang%2C+and+Houfeng+Wang%2E+2025%2E+Instantly+learning+preference+alignment+via+in%2Dcontext+dpo%2E+In+NAACL%2E)
40. Adam Trischler, Tong Wang, Xingdi Yuan, Justin Harris, Alessandro Sordoni, Philip Bachman, and Kaheer Suleman. 2016. [Newsqa: A machine comprehension dataset](https://md.research.elamur.ai/free/en/papers/trischler-2017-newsqa-machine-comprehension-dataset/). arXiv.
41. Junlin Wang, WANG Jue, Ben Athiwaratkun, Ce Zhang, and James Zou. 2025. [Mixture-of-agents enhances large language model capabilities](https://md.research.elamur.ai/free/en/papers/wang-2024-mixture-agents-enhances-large/). In ICLR.
42. Ruochen Wang, Sohyun An, Minhao Cheng, Tianyi Zhou, Sung Ju Hwang, and Cho-Jui Hsieh. 2024a. One prompt is not enough: automated construction of a mixture-of-expert prompts. In ICML. [find](https://scholar.google.com/scholar?q=Ruochen+Wang%2C+Sohyun+An%2C+Minhao+Cheng%2C+Tianyi+Zhou%2C+Sung+Ju+Hwang%2C+and+Cho%2DJui+Hsieh%2E+2024a%2E+One+prompt+is+not+enough%3A+automated+construction+of+a+mixture%2Dof%2Dexpert+prompts%2E+In+ICML%2E)
43. Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, and Heng Ji. 2024b. [Executable code actions elicit better llm agents](https://md.research.elamur.ai/free/en/papers/wang-2024-executable-code-actions-elicit-better/). In ICML.
44. Xinyuan Wang, Chenxi Li, Zhen Wang, Fan Bai, Haotian Luo, Jiayou Zhang, Nebojsa Jojic, Eric Xing, and Zhiting Hu. 2024c. [Promptagent: Strategic planning with language models enables expert-level prompt optimization](https://md.research.elamur.ai/free/en/papers/wang-2023-promptagent-strategic-planning-language-models/). In ICLR.
45. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. [Chain-of-thought prompting elicits reasoning in large language models](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/). NeuralIPS.
46. Zhaoxuan Wu, Xiaoqiang Lin, Zhongxiang Dai, Wenyang Hu, Yao Shu, See-Kiong Ng, Patrick Jaillet, and Bryan Kian Hsiang Low. 2024. Prompt optimization with ease? efficient ordering-aware automated selection of exemplars. In NeurIPS. [find](https://scholar.google.com/scholar?q=Zhaoxuan+Wu%2C+Xiaoqiang+Lin%2C+Zhongxiang+Dai%2C+Wenyang+Hu%2C+Yao+Shu%2C+See%2DKiong+Ng%2C+Patrick+Jaillet%2C+and+Bryan+Kian+Hsiang+Low%2E+2024%2E+Prompt+optimization+with+ease%3F+efficient+ordering%2Daware+automated+selec)
47. Jinyu Xiang, Jiayi Zhang, Zhaoyang Yu, Fengwei Teng, Jinhao Tu, Xinbing Liang, Sirui Hong, Chenglin Wu, and Yuyu Luo. 2025. Self-supervised prompt optimization. arXiv. [find](https://scholar.google.com/scholar?q=Jinyu+Xiang%2C+Jiayi+Zhang%2C+Zhaoyang+Yu%2C+Fengwei+Teng%2C+Jinhao+Tu%2C+Xinbing+Liang%2C+Sirui+Hong%2C+Chenglin+Wu%2C+and+Yuyu+Luo%2E+2025%2E+Self%2Dsupervised+prompt+optimization%2E+arXiv%2E)
48. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2023. [React: Synergizing reasoning and acting in language models](https://md.research.elamur.ai/free/en/papers/yao-2022-react-synergizing-reasoning-acting-language/). In ICLR.
49. Yanfang Ye, Zheyuan Zhang, Tianyi Ma, Zehong Wang, Yiyang Li, Shifu Hou, Weixiang Sun, Kaiwen Shi, Yijun Ma, Wei Song, et al. 2025. Llms4all: A review of large language models across academic disciplines. arXiv preprint arXiv:2509.19580. — [arXiv:2509.19580](https://arxiv.org/abs/2509.19580) [find](https://scholar.google.com/scholar?q=Yanfang+Ye%2C+Zheyuan+Zhang%2C+Tianyi+Ma%2C+Zehong+Wang%2C+Yiyang+Li%2C+Shifu+Hou%2C+Weixiang+Sun%2C+Kaiwen+Shi%2C+Yijun+Ma%2C+Wei+Song%2C+et+al%2E+2025%2E+Llms4all%3A+A+review+of+large+language+models+across+academic+discipli)
50. Zhengqing Yuan, Yixin Liu, Yihan Cao, Weixiang Sun, Haolong Jia, Ruoxi Chen, Zhaoxu Li, Bin Lin, Li Yuan, Lifang He, et al. 2024. Mora: Enabling generalist video generation via a multi-agent framework. arXiv preprint arXiv:2403.13248. — [arXiv:2403.13248](https://arxiv.org/abs/2403.13248) [find](https://scholar.google.com/scholar?q=Zhengqing+Yuan%2C+Yixin+Liu%2C+Yihan+Cao%2C+Weixiang+Sun%2C+Haolong+Jia%2C+Ruoxi+Chen%2C+Zhaoxu+Li%2C+Bin+Lin%2C+Li+Yuan%2C+Lifang+He%2C+et+al%2E+2024%2E+Mora%3A+Enabling+generalist+video+generation+via+a+multi%2Dagent+framework)
51. Guibin Zhang, Yanwei Yue, Xiangguo Sun, Guancheng Wan, Miao Yu, Junfeng Fang, Kun Wang, Tianlong Chen, and Dawei Cheng. 2025a. G-designer: Architecting multi-agent communication topologies via graph neural networks. ICML. [find](https://scholar.google.com/scholar?q=Guibin+Zhang%2C+Yanwei+Yue%2C+Xiangguo+Sun%2C+Guancheng+Wan%2C+Miao+Yu%2C+Junfeng+Fang%2C+Kun+Wang%2C+Tianlong+Chen%2C+and+Dawei+Cheng%2E+2025a%2E+G%2Ddesigner%3A+Architecting+multi%2Dagent+communication+topologies+via+graph+n)
52. Zheyuan Zhang, Kaiwen Shi, Zhengqing Yuan, Zehong Wang, Tianyi Ma, Keerthiram Murugesan, Vincent Galassi, Chuxu Zhang, and Yanfang Ye. 2025b. [Agentrouter: A knowledge-graph-guided llm router for collaborative multi-agent question answering](https://md.research.elamur.ai/free/en/papers/zhang-2026-agentrouter-knowledge-graph-guided-llm/). arXiv preprint arXiv:2510.05445.
53. Kunhao Zheng, Juliette Decugis, Jonas Gehring, Taco Cohen, Gabriel Synnaeve, et al. 2025. What makes large language models reason in (multi-turn) code generation? In The Thirteenth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Kunhao+Zheng%2C+Juliette+Decugis%2C+Jonas+Gehring%2C+Taco+Cohen%2C+Gabriel+Synnaeve%2C+et+al%2E+2025%2E+What+makes+large+language+models+reason+in+%28multi%2Dturn%29+code+generation%3F+In+The+Thirteenth+International+Confe)
54. Han Zhou, Xingchen Wan, Lev Proleev, Diana Mincu, Jilin Chen, Katherine A Heller, and Subhrajit Roy. 2024. Batch calibration: Rethinking calibration for in-context learning and prompt engineering. In ICLR. [find](https://scholar.google.com/scholar?q=Han+Zhou%2C+Xingchen+Wan%2C+Lev+Proleev%2C+Diana+Mincu%2C+Jilin+Chen%2C+Katherine+A+Heller%2C+and+Subhrajit+Roy%2E+2024%2E+Batch+calibration%3A+Rethinking+calibration+for+in%2Dcontext+learning+and+prompt+engineering%2E+In+)
55. Han Zhou, Xingchen Wan, Ruoxi Sun, Hamid Palangi, Shariq Iqbal, Ivan Vulić, Anna Korhonen, and Sercan Ö Arık. 2025. Multi-agent design: Optimizing agents with better prompts and topologies. arXiv. [find](https://scholar.google.com/scholar?q=Han+Zhou%2C+Xingchen+Wan%2C+Ruoxi+Sun%2C+Hamid+Palangi%2C+Shariq+Iqbal%2C+Ivan+Vulic%CC%81%2C+Anna+Korhonen%2C+and+Sercan+%C3%96+Ar%C4%B1k%2E+2025%2E+Multi%2Dagent+design%3A+Optimizing+agents+with+better+prompts+and+topologies%2E+arXiv%2E)
56. Mingchen Zhuge, Wenyi Wang, Louis Kirsch, Francesco Faccio, Dmitrii Khizbullin, and Jürgen Schmidhuber. 2024. Gptswarm: [language agents as optimizable graphs](https://md.research.elamur.ai/free/en/papers/zhuge-2024-language-agents-optimizable-graphs/). In ICML.

*Updated 2 November 2026*