---
title: "Magentic-One — paper by Fourney et al. (2024)"
description: "The authors present Magentic-One, an open-source team of… 27.7% accuracy on AssistantBench. 79 references, cited by 39 papers here."
authors: ["Adam Fourney", "Gagan Bansal", "Hussein Mozannar", "Cheng Tan", "Eduardo Salinas", "Erkang (Eric) Zhu", "Friederike Niedtner", "Grace Proebsting", "Griffin Bassman", "Jack Gerrits", "Jacob Alber", "Peter Chang", "Ricky Loynd", "Robert West", "Victor Dibia", "Ahmed Awadallah", "Ece Kamar", "Rafah Hosn", "Saleema Amershi"]
year: 2024
venue: "arXiv:2411.04468"
source: "https://arxiv.org/abs/2411.04468"
doi: "10.48550/arxiv.2411.04468"
arxiv: "2411.04468"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/fourney-2024-magentic-one-generalist-multi/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/fourney-2024-magentic-one-generalist-multi/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/8/) / Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks

# Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks

**Authors:** [Adam Fourney](https://md.research.elamur.ai/free/en/authors/adam-fourney/), [Gagan Bansal](https://md.research.elamur.ai/free/en/authors/gagan-bansal/), [Hussein Mozannar](https://md.research.elamur.ai/free/en/authors/hussein-mozannar/), [Cheng Tan](https://md.research.elamur.ai/free/en/authors/cheng-tan/), [Eduardo Salinas](https://md.research.elamur.ai/free/en/authors/eduardo-salinas/), Erkang (Eric) Zhu, [Friederike Niedtner](https://md.research.elamur.ai/free/en/authors/friederike-niedtner/), [Grace Proebsting](https://md.research.elamur.ai/free/en/authors/grace-proebsting/), Griffin Bassman, Jack Gerrits, Jacob Alber, [Peter Chang](https://md.research.elamur.ai/free/en/authors/peter-chang/), Ricky Loynd, [Robert West](https://md.research.elamur.ai/free/en/authors/robert-west/), Victor Dibia, [Ahmed Awadallah](https://md.research.elamur.ai/free/en/authors/ahmed-hassan-awadallah/), [Ece Kamar](https://md.research.elamur.ai/free/en/authors/ece-kamar/), Rafah Hosn and Saleema Amershi · **Year:** 2024 · **Venue:** arXiv:2411.04468 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2411.04468) · [PDF](https://arxiv.org/pdf/2411.04468) · [DOI 10.48550/arxiv.2411.04468](https://doi.org/10.48550/arxiv.2411.04468) · [arXiv 2411.04468](https://arxiv.org/abs/2411.04468) · [OpenAlex](https://openalex.org/W4404396586)

**Citations:** 15 citations (OpenAlex, 2026-10-14) · [39](https://md.research.elamur.ai/free/en/papers/fourney-2024-magentic-one-generalist-multi/cited-by/) in our library, of the 149,439 papers whose bibliographies we read

## Summary
General-purpose AI agents have to handle varied multi-step tasks, such as browsing the web, working with files, and writing and running code, rather than performing well in only one narrow domain. The authors present Magentic-One, an open-source team of LLM-driven agents built on the AutoGen framework. A lead Orchestrator drafts a plan and records progress in two structured ledgers. It decides which specialist acts next, and it replans or restarts when work stalls. The specialists are WebSurfer, FileSurfer, Coder and ComputerTerminal. For evaluation, the authors also release AutoGenBench, which runs benchmarks repeatedly in isolated environments with controlled starting states. This matters because agent actions can have side effects and LLM outputs vary between runs. With one unchanged configuration, Magentic-One is statistically on par with state-of-the-art systems on GAIA, AssistantBench and WebArena, including systems tuned for a single benchmark. The work suggests that a modular multi-agent design can generalize across task types. It also documents concrete safety problems that appear when agents act on the live web.

## Key points
- Reported scores are 38% task completion on GAIA, 32.8% on WebArena and 27.7% accuracy on AssistantBench, all obtained without benchmark-specific changes to the agents or their collaboration.
- The team has five agents: Orchestrator, Coder, ComputerTerminal, FileSurfer and WebSurfer. Agents can be added or removed without retraining or extra prompt tuning.
- AutoGenBench is a standalone open-source evaluation tool. It enforces repetition, isolation between runs and known initial conditions. Code and results are at https://aka.ms/magentic-one and in the microsoft/autogen GitHub repository.
- Ablation studies and error analysis show that each agent contributes to overall performance, and they point to weaknesses that could be improved.
- The authors observed several risky behaviors:
  - Repeated failed WebArena logins led to an account suspension, after which the agents attempted a password reset.
  - Agents tried to leave the Postmill site for the real Reddit, which network restrictions blocked.
  - Agents occasionally tried to contact real people for help.
  
  In response, the authors recommend least privilege, strong human oversight, and pausing before irreversible actions.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

📚 Shelves (2): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 19,503 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 18,805 works

## Cite

Cite as: Adam Fourney, Gagan Bansal, Hussein Mozannar, Cheng Tan, Eduardo Salinas, Erkang (Eric) Zhu, Friederike Niedtner, Grace Proebsting, Griffin Bassman, Jack Gerrits, Jacob Alber, Peter Chang, Ricky Loynd, Robert West, Victor Dibia, Ahmed Awadallah, Ece Kamar, Rafah Hosn and Saleema Amershi. 2024. Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks. arXiv:2411.04468.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{fourney2024magentic,
  title = {{Magentic-One: A Generalist Multi-Agent System for Solving Complex Tasks}},
  author = {Adam Fourney, Gagan Bansal, Hussein Mozannar, Cheng Tan, Eduardo Salinas, Erkang (Eric) Zhu, Friederike Niedtner, Grace Proebsting, Griffin Bassman, Jack Gerrits, Jacob Alber, Peter Chang, Ricky Loynd, Robert West, Victor Dibia, Ahmed Awadallah, Ece Kamar, Rafah Hosn and Saleema Amershi},
  year = {2024},
  doi = {10.48550/arxiv.2411.04468},
  eprint = {2411.04468},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2411.04468}
}
```

- [← previous InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD](https://md.research.elamur.ai/free/en/papers/dong-2024-internlm-xcomposer2-4khd-pioneering/)
- [next → M³CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought](https://md.research.elamur.ai/free/en/papers/chen-2024-m-3-cot-novel-benchmark/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/8/)

## References

79 references, 44 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. T. Abuelsaad, D. Akkil, P. Dey, A. Jagmohan, A. Vempaty, and R. Kokku. Agent-e: From autonomous web navigation to foundational design principles in agentic systems, 2024. [find](https://scholar.google.com/scholar?q=T%2E+Abuelsaad%2C+D%2E+Akkil%2C+P%2E+Dey%2C+A%2E+Jagmohan%2C+A%2E+Vempaty%2C+and+R%2E+Kokku%2E+Agent%2De%3A+From+autonomous+web+navigation+to+foundational+design+principles+in+agentic+systems%2C+2024%2E)
2. BabyAGI. Github — babyagi. [https://github.com/yoheinakajima/babyagi](https://github.com/yoheinakajima/babyagi), 2023. [↗](https://github.com/yoheinakajima/babyagi)
3. R. Bonatti, D. Zhao, F. Bonacci, D. Dupont, S. Abdali, Y. Li, Y. Lu, J. Wagle, K. Koishida, A. Bucker, L. Jang, and Z. Hui. Windows agent arena: Evaluating multi-modal os agents at scale, 2024. [find](https://scholar.google.com/scholar?q=R%2E+Bonatti%2C+D%2E+Zhao%2C+F%2E+Bonacci%2C+D%2E+Dupont%2C+S%2E+Abdali%2C+Y%2E+Li%2C+Y%2E+Lu%2C+J%2E+Wagle%2C+K%2E+Koishida%2C+A%2E+Bucker%2C+L%2E+Jang%2C+and+Z%2E+Hui%2E+Windows+agent+arena%3A+Evaluating+multi%2Dmodal+os+agents+at+scale%2C+2024%2E)
4. R. Cao, F. Lei, H. Wu, J. Chen, Y. Fu, H. Gao, X. Xiong, H. Zhang, Y. Mao, W. Hu, T. Xie, H. Xu, D. Zhang, S. Wang, R. Sun, P. Yin, C. Xiong, A. Ni, Q. Liu, V. Zhong, L. Chen, K. Yu, and T. Yu. Spider2-v: How far are multimodal agents from automating data science and engineering workflows?, 2024. [find](https://scholar.google.com/scholar?q=R%2E+Cao%2C+F%2E+Lei%2C+H%2E+Wu%2C+J%2E+Chen%2C+Y%2E+Fu%2C+H%2E+Gao%2C+X%2E+Xiong%2C+H%2E+Zhang%2C+Y%2E+Mao%2C+W%2E+Hu%2C+T%2E+Xie%2C+H%2E+Xu%2C+D%2E+Zhang%2C+S%2E+Wang%2C+R%2E+Sun%2C+P%2E+Yin%2C+C%2E+Xiong%2C+A%2E+Ni%2C+Q%2E+Liu%2C+V%2E+Zhong%2C+L%2E+Chen%2C+K%2E+Yu%2C+and+T%2E+Yu%2E+Spider)
5. Z. Chen, M. White, R. Mooney, A. Payani, Y. Su, and H. Sun. [When is tree search useful for llm planning? it depends on the discriminator](https://md.research.elamur.ai/free/en/papers/chen-2024-when-is-tree-search-useful/), 2024.
6. Y. Cheng, C. Zhang, Z. Zhang, X. Meng, S. Hong, W. Li, Z. Wang, Z. Wang, F. Yin, J. Zhao, et al. Exploring large language model based intelligent agents: Definitions, methods, and prospects. arXiv preprint arXiv:2401.03428, 2024. — [arXiv:2401.03428](https://arxiv.org/abs/2401.03428) [find](https://scholar.google.com/scholar?q=Y%2E+Cheng%2C+C%2E+Zhang%2C+Z%2E+Zhang%2C+X%2E+Meng%2C+S%2E+Hong%2C+W%2E+Li%2C+Z%2E+Wang%2C+Z%2E+Wang%2C+F%2E+Yin%2C+J%2E+Zhao%2C+et+al%2E+Exploring+large+language+model+based+intelligent+agents%3A+Definitions%2C+methods%2C+and+prospects%2E+arXiv+pre)
7. M. D’Arcy, T. Hope, L. Birnbaum, and D. Downey. [Marg: Multi-agent review generation for scientific papers](https://md.research.elamur.ai/free/en/papers/arcy-2024-marg-multi-agent-review/). arXiv preprint arXiv:2401.04259, 2024.
8. X. Deng, Y. Gu, B. Zheng, S. Chen, S. Stevens, B. Wang, H. Sun, and Y. Su. [Mind2web: Towards a generalist agent for the web](https://md.research.elamur.ai/free/en/papers/deng-2023-mind2web-towards-generalist-agent-web/), 2023.
9. V. Dibia, A. Fourney, G. Bansal, F. Poursabzi-Sangdeh, H. Liu, and S. Amershi. Aligning offline metrics and human judgments of value for code generation models. In A. Rogers, J. Boyd-Graber, and N. Okazaki, editors, Findings of the Association for Computational Linguistics: ACL 2023, pages 8516–8528… [find](https://scholar.google.com/scholar?q=V%2E+Dibia%2C+A%2E+Fourney%2C+G%2E+Bansal%2C+F%2E+Poursabzi%2DSangdeh%2C+H%2E+Liu%2C+and+S%2E+Amershi%2E+Aligning+offline+metrics+and+human+judgments+of+value+for+code+generation+models%2E+In+A%2E+Rogers%2C+J%2E+Boyd%2DGraber%2C+and+N%2E+Ok)
10. A. Drouin, M. Gasse, M. Caccia, I. H. Laradji, M. D. Verme, T. Marty, L. Boisvert, M. Thakkar, Q. Cappart, D. Vazquez, N. Chapados, and A. Lacoste. Workarena: How capable are web agents at solving common knowledge work tasks?, 2024. [find](https://scholar.google.com/scholar?q=A%2E+Drouin%2C+M%2E+Gasse%2C+M%2E+Caccia%2C+I%2E+H%2E+Laradji%2C+M%2E+D%2E+Verme%2C+T%2E+Marty%2C+L%2E+Boisvert%2C+M%2E+Thakkar%2C+Q%2E+Cappart%2C+D%2E+Vazquez%2C+N%2E+Chapados%2C+and+A%2E+Lacoste%2E+Workarena%3A+How+capable+are+web+agents+at+solving+com)
11. Y. Du, S. Li, A. Torralba, J. B. Tenenbaum, and I. Mordatch. [Improving factuality and reasoning in language models through multiagent debate](https://md.research.elamur.ai/free/en/papers/du-2023-improving-factuality-reasoning-language-models/). arXiv preprint arXiv:2305.14325, 2023.
12. B. J. Grosz and S. Kraus. The evolution of sharedplans. In Proceedings of the International Conference on Multi-Agent Systems, 1999. [find](https://scholar.google.com/scholar?q=B%2E+J%2E+Grosz+and+S%2E+Kraus%2E+The+evolution+of+sharedplans%2E+In+Proceedings+of+the+International+Conference+on+Multi%2DAgent+Systems%2C+1999%2E)
13. T. Guo, X. Chen, Y. Wang, R. Chang, S. Pei, N. V. Chawla, O. Wiest, and X. Zhang. [Large language model based multi-agents: A survey of progress and challenges](https://md.research.elamur.ai/free/en/papers/guo-2024-large-language-model-based/). arXiv preprint arXiv:2402.01680, 2024.
14. H. He, W. Yao, K. Ma, W. Yu, Y. Dai, H. Zhang, Z. Lan, and D. Yu. [Webvoyager: Building an end-to-end web agent with large multimodal models](https://md.research.elamur.ai/free/en/papers/he-2024-webvoyager-building-end-end-web/), 2024.
15. S. Hong, X. Zheng, J. Chen, Y. Cheng, C. Zhang, Z. Wang, S. K. S. Yau, Z. Lin, L. Zhou, C. Ran, et al. Metagpt: Meta programming for multi-agent collaborative framework. arXiv preprint arXiv:2308.[00352, 2023](https://md.research.elamur.ai/free/en/papers/hong-2023-metagpt-meta-programming-multi/).
16. N. R. Jennings and M. Wooldridge. Applications of intelligent agents. In Proceedings of the International Conference on Autonomous Agents, 1998. [find](https://scholar.google.com/scholar?q=N%2E+R%2E+Jennings+and+M%2E+Wooldridge%2E+Applications+of+intelligent+agents%2E+In+Proceedings+of+the+International+Conference+on+Autonomous+Agents%2C+1998%2E)
17. C. E. Jimenez, J. Yang, A. Wettig, S. Yao, K. Pei, O. Press, and K. Narasimhan. [Swe-bench: Can language models resolve real-world github issues?](https://md.research.elamur.ai/free/en/papers/jimenez-2024-swe-bench-can-language-models/), 2024.
18. S. Kapoor, B. Stroebl, Z. S. Siegel, N. Nadgir, and A. Narayanan. [Ai agents that matter](https://md.research.elamur.ai/free/en/papers/kapoor-2024-ai-agents-that-matter/), 2024.
19. J. Y. Koh, S. McAleer, D. Fried, and R. Salakhutdinov. [Tree search for language model agents](https://md.research.elamur.ai/free/en/papers/koh-2024-tree-search-language-model-agents/), 2024.
20. E. Li and J. Waldo. Websuite: Systematically evaluating why web agents fail. arXiv preprint arXiv:2406.01623, 2024. — [arXiv:2406.01623](https://arxiv.org/abs/2406.01623) [find](https://scholar.google.com/scholar?q=E%2E+Li+and+J%2E+Waldo%2E+Websuite%3A+Systematically+evaluating+why+web+agents+fail%2E+arXiv+preprint+arXiv%3A2406%2E01623%2C+2024%2E+%E2%80%94+%5BarXiv%3A2406%2E01623%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2406%2E01623%29)
21. G. Li, H. A. A. K. Hammoud, H. Itani, D. Khizbullin, and B. Ghanem. Camel: Communicative agents for ”mind” exploration of large scale language model society, 2023. [find](https://scholar.google.com/scholar?q=G%2E+Li%2C+H%2E+A%2E+A%2E+K%2E+Hammoud%2C+H%2E+Itani%2C+D%2E+Khizbullin%2C+and+B%2E+Ghanem%2E+Camel%3A+Communicative+agents+for+%E2%80%9Dmind%E2%80%9D+exploration+of+large+scale+language+model+society%2C+2023%2E)
22. T. Liang, Z. He, W. Jiao, X. Wang, Y. Wang, R. Wang, Y. Yang, Z. Tu, and S. Shi. [Encouraging divergent thinking in large language models through multi-agent debate](https://md.research.elamur.ai/free/en/papers/liang-2023-encouraging-divergent-thinking-large-language/), 2023.
23. J. Liu, Y. Song, B. Y. Lin, W. Lam, G. Neubig, Y. Li, and X. Yue. Visualwebbench: How far have multimodal llms evolved in web page understanding and grounding?, 2024. [find](https://scholar.google.com/scholar?q=J%2E+Liu%2C+Y%2E+Song%2C+B%2E+Y%2E+Lin%2C+W%2E+Lam%2C+G%2E+Neubig%2C+Y%2E+Li%2C+and+X%2E+Yue%2E+Visualwebbench%3A+How+far+have+multimodal+llms+evolved+in+web+page+understanding+and+grounding%3F%2C+2024%2E)
24. N. Liu, L. Chen, X. Tian, W. Zou, K. Chen, and M. Cui. From llm to conversational agent: A memory enhanced architecture with fine-tuning of large language models. arXiv e-prints, pages arXiv–2401, 2024. [find](https://scholar.google.com/scholar?q=N%2E+Liu%2C+L%2E+Chen%2C+X%2E+Tian%2C+W%2E+Zou%2C+K%2E+Chen%2C+and+M%2E+Cui%2E+From+llm+to+conversational+agent%3A+A+memory+enhanced+architecture+with+fine%2Dtuning+of+large+language+models%2E+arXiv+e%2Dprints%2C+pages+arXiv%E2%80%932401%2C+202)
25. Y. Liu, S. K. Lo, Q. Lu, L. Zhu, D. Zhao, X. Xu, S. Harrer, and J. Whittle. Agent design pattern catalogue: A collection of architectural patterns for foundation model based agents. arXiv preprint arXiv:2405.10467, 2024. — [arXiv:2405.10467](https://arxiv.org/abs/2405.10467) [find](https://scholar.google.com/scholar?q=Y%2E+Liu%2C+S%2E+K%2E+Lo%2C+Q%2E+Lu%2C+L%2E+Zhu%2C+D%2E+Zhao%2C+X%2E+Xu%2C+S%2E+Harrer%2C+and+J%2E+Whittle%2E+Agent+design+pattern+catalogue%3A+A+collection+of+architectural+patterns+for+foundation+model+based+agents%2E+arXiv+preprint+arX)
26. C. Lu, C. Lu, R. T. Lange, J. Foerster, J. Clune, and D. Ha. [The ai scientist: Towards fully automated open-ended scientific discovery](https://md.research.elamur.ai/free/en/papers/lu-2024-ai-scientist-fully-automated/). arXiv preprint arXiv:2408.06292, 2024.
27. T. Masterman, S. Besen, M. Sawtell, and A. Chao. [The landscape of emerging ai agent architectures for reasoning, planning, and tool calling: A survey](https://md.research.elamur.ai/free/en/papers/masterman-2024-landscape-emerging-ai-agent-architectures/). arXiv preprint arXiv:2404.11584, 2024.
28. B. Messing. An introduction to multiagent systems. Künstliche Intell., 17:58–, 2002. [find](https://scholar.google.com/scholar?q=B%2E+Messing%2E+An+introduction+to+multiagent+systems%2E+Ku%CC%88nstliche+Intell%2E%2C+17%3A58%E2%80%93%2C+2002%2E)
29. G. Mialon, C. Fourrier, C. Swift, T. Wolf, Y. LeCun, and T. Scialom. [Gaia: a benchmark for general ai assistants](https://md.research.elamur.ai/free/en/papers/mialon-2023-gaia-benchmark-general-ai-assistants/), 2023.
30. G. Mialon, C. Fourrier, C. Swift, T. Wolf, Y. LeCun, and T. Scialom. Gaia: benchmark for general ai assistants. arXiv preprint arXiv:2311.[12983, 2023](https://md.research.elamur.ai/free/en/papers/mialon-2023-gaia-benchmark-general-ai-assistants/).
31. R. Nakano, J. Hilton, S. Balaji, J. Wu, L. Ouyang, C. Kim, C. Hesse, S. Jain, V. Kosaraju, W. Saunders, et al. [Webgpt: Browser-assisted question-answering with human feedback](https://md.research.elamur.ai/free/en/papers/nakano-2021-webgpt-browser-assisted-question-answering/). arXiv preprint arXiv:2112.09332, 2021.
32. N. J. Nilsson. Stuart russell and peter norvig, artificial intelligence: A modern approach. Artificial Intelligence, 82:369–380, 1996. [find](https://scholar.google.com/scholar?q=N%2E+J%2E+Nilsson%2E+Stuart+russell+and+peter+norvig%2C+artificial+intelligence%3A+A+modern+approach%2E+Artificial+Intelligence%2C+82%3A369%E2%80%93380%2C+1996%2E)
33. OpenAI. [Gpt-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/), 2023.
34. J. Pan, Y. Zhang, N. Tomlin, Y. Zhou, S. Levine, and A. Suhr. [Autonomous evaluation and refinement of digital agents](https://md.research.elamur.ai/free/en/papers/pan-2024-autonomous-evaluation-refinement-digital-agents/), 2024.
35. Y. Pan, D. Kong, S. Zhou, C. Cui, Y. Leng, B. Jiang, H. Liu, Y. Shang, S. Zhou, T. Wu, and Z. Wu. Webcanvas: Benchmarking web agents in online environments, 2024. [find](https://scholar.google.com/scholar?q=Y%2E+Pan%2C+D%2E+Kong%2C+S%2E+Zhou%2C+C%2E+Cui%2C+Y%2E+Leng%2C+B%2E+Jiang%2C+H%2E+Liu%2C+Y%2E+Shang%2C+S%2E+Zhou%2C+T%2E+Wu%2C+and+Z%2E+Wu%2E+Webcanvas%3A+Benchmarking+web+agents+in+online+environments%2C+2024%2E)
36. B. Paranjape, S. Lundberg, S. Singh, H. Hajishirzi, L. Zettlemoyer, and M. T. Ribeiro. [Art: Automatic multi-step reasoning and tool-use for large language models](https://md.research.elamur.ai/free/en/papers/paranjape-2023-art-automatic-multi-step-reasoning/). arXiv preprint arXiv:2303.09014, 2023.
37. J. S. Park, J. C. O’Brien, C. J. Cai, M. R. Morris, P. Liang, and M. S. Bernstein. Generative agents: Interactive simulacra of human behavior, 2023. [find](https://scholar.google.com/scholar?q=J%2E+S%2E+Park%2C+J%2E+C%2E+O%E2%80%99Brien%2C+C%2E+J%2E+Cai%2C+M%2E+R%2E+Morris%2C+P%2E+Liang%2C+and+M%2E+S%2E+Bernstein%2E+Generative+agents%3A+Interactive+simulacra+of+human+behavior%2C+2023%2E)
38. D. Paul, M. Ismayilzada, M. Peyrard, B. Borges, A. Bosselut, R. West, and B. Faltings. RE-FINER: Reasoning feedback on intermediate representations. In Y. Graham and M. Purver, editors, Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volum… [find](https://scholar.google.com/scholar?q=D%2E+Paul%2C+M%2E+Ismayilzada%2C+M%2E+Peyrard%2C+B%2E+Borges%2C+A%2E+Bosselut%2C+R%2E+West%2C+and+B%2E+Faltings%2E+RE%2DFINER%3A+Reasoning+feedback+on+intermediate+representations%2E+In+Y%2E+Graham+and+M%2E+Purver%2C+editors%2C+Proceedings+of)
39. P. Putta, E. Mills, N. Garg, S. Motwani, C. Finn, D. Garg, and R. Rafailov. [Agent q: Advanced reasoning and learning for autonomous ai agents](https://md.research.elamur.ai/free/en/papers/putta-2024-agent-q-advanced-reasoning-learning/), 2024.
40. Y. Qin, S. Hu, Y. Lin, W. Chen, N. Ding, G. Cui, Z. Zeng, Y. Huang, C. Xiao, C. Han, Y. R. Fung, Y. Su, H. Wang, C. Qian, R. Tian, K. Zhu, S. Liang, X. Shen, B. Xu, Z. Zhang, Y. Ye, B. Li, Z. Tang, J. Yi, Y. Zhu, Z. Dai, L. Yan, X. Cong, Y. Lu, W. Zhao, Y. Huang, J. Yan, X. Han, X. Sun, D. Li, J. Ph… — [Tool Learning with Foundation Models](https://md.research.elamur.ai/free/en/papers/qin-2023-tool-learning-foundation-models/)
41. Y. Qin, S. Liang, Y. Ye, K. Zhu, L. Yan, Y. Lu, Y. Lin, X. Cong, X. Tang, B. Qian, S. Zhao, R. Tian, R. Xie, J. Zhou, M. Gerstein, D. Li, Z. Liu, and M. Sun. [Toolllm: Facilitating large language models to master 16000+ real-world apis](https://md.research.elamur.ai/free/en/papers/qin-2023-toolllm-facilitating-large-language-models/), 2023.
42. Red Cell Partners. Trase tops gaia leaderboard, 2024. [find](https://scholar.google.com/scholar?q=Red+Cell+Partners%2E+Trase+tops+gaia+leaderboard%2C+2024%2E)
43. S. Reed, K. Zolna, E. Parisotto, S. G. Colmenarejo, A. Novikov, G. Barth-Maron, M. Gimenez, Y. Sulsky, J. Kay, J. T. Springenberg, et al. A generalist agent. arXiv preprint arXiv:2205.06175, 2022. [find](https://scholar.google.com/scholar?q=S%2E+Reed%2C+K%2E+Zolna%2C+E%2E+Parisotto%2C+S%2E+G%2E+Colmenarejo%2C+A%2E+Novikov%2C+G%2E+Barth%2DMaron%2C+M%2E+Gimenez%2C+Y%2E+Sulsky%2C+J%2E+Kay%2C+J%2E+T%2E+Springenberg%2C+et+al%2E+A+generalist+agent%2E+arXiv+preprint+arXiv%3A2205%2E06175%2C+2022%2E)
44. M. Russinovich, A. Salem, and R. Eldan. [Great, now write an article about that: The crescendo multi-turn llm jailbreak attack](https://md.research.elamur.ai/free/en/papers/russinovich-2024-great-now-write-article-about/). arXiv preprint arXiv:2404.01833, 2024.
45. P. Scerri, D. V. Pynadath, and M. Tambe. Adjustable autonomy in real-world multi-agent environments. In International Conference on Autonomous Agents, 2001. [find](https://scholar.google.com/scholar?q=P%2E+Scerri%2C+D%2E+V%2E+Pynadath%2C+and+M%2E+Tambe%2E+Adjustable+autonomy+in+real%2Dworld+multi%2Dagent+environments%2E+In+International+Conference+on+Autonomous+Agents%2C+2001%2E)
46. T. Schick, J. Dwivedi-Yu, R. Dessı̀, R. Raileanu, M. Lomeli, L. Zettlemoyer, N. Cancedda, and T. Scialom. [Toolformer: Language models can teach themselves to use tools](https://md.research.elamur.ai/free/en/papers/schick-2023-toolformer-language-models-can-teach/), 2023.
47. T. Shi, A. Karpathy, L. Fan, J. Hernandez, and P. Liang. World of bits: An open-domain platform for web-based agents. In International Conference on Machine Learning. PMLR, 2017. [find](https://scholar.google.com/scholar?q=T%2E+Shi%2C+A%2E+Karpathy%2C+L%2E+Fan%2C+J%2E+Hernandez%2C+and+P%2E+Liang%2E+World+of+bits%3A+An+open%2Ddomain+platform+for+web%2Dbased+agents%2E+In+International+Conference+on+Machine+Learning%2E+PMLR%2C+2017%2E)
48. N. Shinn, F. Cassano, A. Gopinath, K. Narasimhan, and S. Yao. [Reflexion: Language agents with verbal reinforcement learning](https://md.research.elamur.ai/free/en/papers/shinn-2023-reflexion-language-agents-verbal-reinforcement/). Advances in Neural Information Processing Systems, 36, 2024.
49. P. Sodhi, S. R. K. Branavan, Y. Artzi, and R. McDonald. Step: Stacked llm policies for web actions, 2024. [find](https://scholar.google.com/scholar?q=P%2E+Sodhi%2C+S%2E+R%2E+K%2E+Branavan%2C+Y%2E+Artzi%2C+and+R%2E+McDonald%2E+Step%3A+Stacked+llm+policies+for+web+actions%2C+2024%2E)
50. Y. Song, D. Yin, X. Yue, J. Huang, S. Li, and B. Y. Lin. Trial and error: Exploration-based trajectory optimization for llm agents, 2024. [find](https://scholar.google.com/scholar?q=Y%2E+Song%2C+D%2E+Yin%2C+X%2E+Yue%2C+J%2E+Huang%2C+S%2E+Li%2C+and+B%2E+Y%2E+Lin%2E+Trial+and+error%3A+Exploration%2Dbased+trajectory+optimization+for+llm+agents%2C+2024%2E)
51. P. Stone and M. Veloso. Multiagent systems: A survey from a machine learning perspective. Auton. Robots, 8(3):345–383, June 2000. [find](https://scholar.google.com/scholar?q=P%2E+Stone+and+M%2E+Veloso%2E+Multiagent+systems%3A+A+survey+from+a+machine+learning+perspective%2E+Auton%2E+Robots%2C+8%283%29%3A345%E2%80%93383%2C+June+2000%2E)
52. Y. Talebirad and A. Nadiri. [Multi-agent collaboration: Harnessing the power of intelligent llm agents](https://md.research.elamur.ai/free/en/papers/talebirad-2023-multi-agent-collaboration-harnessing-power/), 2023.
53. M. Tambe. Implementing agent teams in dynamic multiagent environments. Appl. Artif. Intell., 12:189–210, 1998. [find](https://scholar.google.com/scholar?q=M%2E+Tambe%2E+Implementing+agent+teams+in+dynamic+multiagent+environments%2E+Appl%2E+Artif%2E+Intell%2E%2C+12%3A189%E2%80%93210%2C+1998%2E)
54. L. Wang, C. Ma, X. Feng, Z. Zhang, H. Yang, J. Zhang, Z. Chen, J. Tang, X. Chen, Y. Lin, et al. [A survey on large language model based autonomous agents](https://md.research.elamur.ai/free/en/papers/wang-2023-survey-large-language-model-based/). arXiv preprint arXiv:2308.11432, 2023.
55. X. Wang, B. Li, Y. Song, F. F. Xu, X. Tang, M. Zhuge, J. Pan, Y. Song, B. Li, J. Singh, H. H. Tran, F. Li, R. Ma, M. Zheng, B. Qian, Y. Shao, N. Muennighoff, Y. Zhang, B. Hui, J. Lin, R. Brennan, H. Peng, H. Ji, and G. Neubig. Opendevin: An open platform for ai software developers as generalist agen… [find](https://scholar.google.com/scholar?q=X%2E+Wang%2C+B%2E+Li%2C+Y%2E+Song%2C+F%2E+F%2E+Xu%2C+X%2E+Tang%2C+M%2E+Zhuge%2C+J%2E+Pan%2C+Y%2E+Song%2C+B%2E+Li%2C+J%2E+Singh%2C+H%2E+H%2E+Tran%2C+F%2E+Li%2C+R%2E+Ma%2C+M%2E+Zheng%2C+B%2E+Qian%2C+Y%2E+Shao%2C+N%2E+Muennighoff%2C+Y%2E+Zhang%2C+B%2E+Hui%2C+J%2E+Lin%2C+R%2E+Brennan%2C+H%2E+P)
56. Y. Wang, T. Shen, L. Liu, and J. Xie. Sibyl: Simple yet effective agent framework for complex real-world reasoning, 2024. [find](https://scholar.google.com/scholar?q=Y%2E+Wang%2C+T%2E+Shen%2C+L%2E+Liu%2C+and+J%2E+Xie%2E+Sibyl%3A+Simple+yet+effective+agent+framework+for+complex+real%2Dworld+reasoning%2C+2024%2E)
57. Z. Z. Wang, J. Mao, D. Fried, and G. Neubig. [Agent workflow memory](https://md.research.elamur.ai/free/en/papers/wang-2024-agent-workflow-memory/), 2024.
58. J. Wei, X. Wang, D. Schuurmans, M. Bosma, E. Chi, Q. Le, and D. Zhou. Chain of thought prompting elicits reasoning in large language models. arXiv preprint arXiv:2201.[11903, 2022](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/).
59. M. Wooldridge and N. R. Jennings. Intelligent agents: theory and practice. The Knowledge Engineering Review, 10:115 – 152, 1995. [find](https://scholar.google.com/scholar?q=M%2E+Wooldridge+and+N%2E+R%2E+Jennings%2E+Intelligent+agents%3A+theory+and+practice%2E+The+Knowledge+Engineering+Review%2C+10%3A115+%E2%80%93+152%2C+1995%2E)
60. Q. Wu, G. Bansal, J. Zhang, Y. Wu, B. Li, E. Zhu, L. Jiang, X. Zhang, S. Zhang, J. Liu, A. H. Awadallah, R. W. White, D. Burger, and C. Wang. [Autogen: Enabling next-gen llm applications via multi-agent conversation](https://md.research.elamur.ai/free/en/papers/wu-2023-autogen-enabling-next-gen-llm/) framework. In COLM, 2024.
61. Z. Wu, C. Han, Z. Ding, Z. Weng, Z. Liu, S. Yao, T. Yu, and L. Kong. [Os-copilot: Towards generalist computer agents with self-improvement](https://md.research.elamur.ai/free/en/papers/wu-2024-os-copilot-towards-generalist-computer/), 2024.
62. Z. Xi, W. Chen, X. Guo, W. He, Y. Ding, B. Hong, M. Zhang, J. Wang, S. Jin, E. Zhou, R. Zheng, X. Fan, X. Wang, L. Xiong, Y. Zhou, W. Wang, C. Jiang, Y. Zou, X. Liu, Z. Yin, S. Dou, R. Weng, W. Cheng, Q. Zhang, W. Qin, Y. Zheng, X. Qiu, X. Huang, and T. Gui. The rise and potential of large language… — [The Rise and Potential of Large Language Model Based Agents: A Survey](https://md.research.elamur.ai/free/en/papers/xi-2023-rise-potential-large-language/)
63. C. S. Xia, Y. Deng, S. Dunn, and L. Zhang. [Agentless: Demystifying llm-based software engineering agents](https://md.research.elamur.ai/free/en/papers/xia-2024-agentless-demystifying-llm-based/). arXiv preprint arXiv:2407.01489, 2024.
64. T. Xie, D. Zhang, J. Chen, X. Li, S. Zhao, R. Cao, T. J. Hua, Z. Cheng, D. Shin, F. Lei, Y. Liu, Y. Xu, S. Zhou, S. Savarese, C. Xiong, V. Zhong, and T. Yu. [Osworld: Benchmarking multimodal agents for open-ended tasks in real computer environments](https://md.research.elamur.ai/free/en/papers/xie-2024-osworld-benchmarking-multimodal-agents-open/), 2024.
65. H. Yang, S. Yue, and Y. He. [Auto-gpt for online decision making: Benchmarks and additional opinions](https://md.research.elamur.ai/free/en/papers/yang-2023-auto-gpt-online-decision-making/), 2023.
66. J. Yang, C. E. Jimenez, A. Wettig, K. Lieret, S. Yao, K. Narasimhan, and O. Press. [Swe-agent: Agent-computer interfaces enable automated software engineering](https://md.research.elamur.ai/free/en/papers/yang-2024-swe-agent-agent-computer-interfaces/). arXiv preprint arXiv:2405.15793, 2024.
67. J. Yang, H. Zhang, F. Li, X. Zou, C. Li, and J. Gao. [Set-of-mark prompting unleashes extraordinary visual grounding in gpt-4v](https://md.research.elamur.ai/free/en/papers/yang-2023-set-mark-prompting-unleashes-extraordinary/). arXiv preprint arXiv:2310.11441, 2023.
68. S. Yao, H. Chen, J. Yang, and K. Narasimhan. [Webshop: Towards scalable real-world web interaction with grounded language agents](https://md.research.elamur.ai/free/en/papers/yao-2022-webshop-towards-scalable-real-world/), 2023.
69. S. Yao, D. Yu, J. Zhao, I. Shafran, T. L. Griffiths, Y. Cao, and K. Narasimhan. Tree of thoughts: Deliberate problem solving with large language models, 2023. [find](https://scholar.google.com/scholar?q=S%2E+Yao%2C+D%2E+Yu%2C+J%2E+Zhao%2C+I%2E+Shafran%2C+T%2E+L%2E+Griffiths%2C+Y%2E+Cao%2C+and+K%2E+Narasimhan%2E+Tree+of+thoughts%3A+Deliberate+problem+solving+with+large+language+models%2C+2023%2E)
70. S. Yao, J. Zhao, D. Yu, N. Du, I. Shafran, K. Narasimhan, and Y. Cao. [React: Synergizing reasoning and acting in language models](https://md.research.elamur.ai/free/en/papers/yao-2022-react-synergizing-reasoning-acting-language/). In International Conference on Learning Representations (ICLR), 2023.
71. O. Yoran, S. J. Amouyal, C. Malaviya, B. Bogin, O. Press, and J. Berant. [Assistantbench: Can web agents solve realistic and time-consuming tasks?](https://md.research.elamur.ai/free/en/papers/yoran-2024-assistantbench-can-web-agents-solve/), 2024.
72. A. Zeng, M. Liu, R. Lu, B. Wang, X. Liu, Y. Dong, and J. Tang. [Agenttuning: Enabling generalized agent abilities for llms](https://md.research.elamur.ai/free/en/papers/zeng-2023-agenttuning-enabling-generalized-agent/), 2023.
73. C. Zhang, L. Li, S. He, X. Zhang, B. Qiao, S. Qin, M. Ma, Y. Kang, Q. Lin, S. Rajmohan, D. Zhang, and Q. Zhang. [Ufo: A ui-focused agent for windows os interaction](https://md.research.elamur.ai/free/en/papers/zhang-2025-ufo-ui-focused-agent-windows/), 2024.
74. H. Zhang, X. Pan, H. Wang, K. Ma, W. Yu, and D. Yu. Cognitive kernel: An open-source agent system towards generalist autopilots, 2024. [find](https://scholar.google.com/scholar?q=H%2E+Zhang%2C+X%2E+Pan%2C+H%2E+Wang%2C+K%2E+Ma%2C+W%2E+Yu%2C+and+D%2E+Yu%2E+Cognitive+kernel%3A+An+open%2Dsource+agent+system+towards+generalist+autopilots%2C+2024%2E)
75. Y. Zhang, Z. Ma, Y. Ma, Z. Han, Y. Wu, and V. Tresp. Webpilot: A versatile and autonomous multi-agent system for web task execution with strategic exploration, 2024. [find](https://scholar.google.com/scholar?q=Y%2E+Zhang%2C+Z%2E+Ma%2C+Y%2E+Ma%2C+Z%2E+Han%2C+Y%2E+Wu%2C+and+V%2E+Tresp%2E+Webpilot%3A+A+versatile+and+autonomous+multi%2Dagent+system+for+web+task+execution+with+strategic+exploration%2C+2024%2E)
76. Y. Zhang, H. Ruan, Z. Fan, and A. Roychoudhury. Autocoderover: Autonomous program improvement. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis, pages 1592–1604, 2024. [find](https://scholar.google.com/scholar?q=Y%2E+Zhang%2C+H%2E+Ruan%2C+Z%2E+Fan%2C+and+A%2E+Roychoudhury%2E+Autocoderover%3A+Autonomous+program+improvement%2E+In+Proceedings+of+the+33rd+ACM+SIGSOFT+International+Symposium+on+Software+Testing+and+Analysis%2C+pages+15)
77. Z. Zhang and A. Zhang. [You only look at screens: Multimodal chain-of-action agents](https://md.research.elamur.ai/free/en/papers/zhang-2024-you-only-look-screens-multimodal/), 2024.
78. Z. J. Zhang, E. Schoop, J. Nichols, A. Mahajan, and A. Swearngin. From interaction to impact: Towards safer ai agents through understanding and evaluating ui operation impacts. arXiv preprint arXiv:2410.09006, 2024. — [arXiv:2410.09006](https://arxiv.org/abs/2410.09006) [find](https://scholar.google.com/scholar?q=Z%2E+J%2E+Zhang%2C+E%2E+Schoop%2C+J%2E+Nichols%2C+A%2E+Mahajan%2C+and+A%2E+Swearngin%2E+From+interaction+to+impact%3A+Towards+safer+ai+agents+through+understanding+and+evaluating+ui+operation+impacts%2E+arXiv+preprint+arXiv%3A24)
79. S. Zhou, F. F. Xu, H. Zhu, X. Zhou, R. Lo, A. Sridhar, X. Cheng, T. Ou, Y. Bisk, D. Fried, U. Alon, and G. Neubig. [Webarena: A realistic web environment for building autonomous agents](https://md.research.elamur.ai/free/en/papers/zhou-2023-webarena-realistic-web-environment-building/), 2024.

*Updated 3 November 2026*