---
title: "KernelBench: Can LLMs Write Efficient GPU — Ouyang 2025"
description: "Hand-writing fast GPU kernels takes deep expertise and a lot of time."
authors: ["Anne Ouyang", "Simon Guo", "Simran Arora", "Alex L. Zhang", "William Hu", "Christopher Re", "Azalia Mirhoseini"]
year: 2025
venue: "arXiv:2502.10517"
source: "https://arxiv.org/abs/2502.10517"
doi: "10.48550/arxiv.2502.10517"
arxiv: "2502.10517"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/ouyang-2025-kernelbench-llms-write-efficient-gpu/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/ouyang-2025-kernelbench-llms-write-efficient-gpu/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/2/) / KernelBench: Can LLMs Write Efficient GPU Kernels?

# KernelBench: Can LLMs Write Efficient GPU Kernels?

**Authors:** Anne Ouyang, Simon Guo, [Simran Arora](https://md.research.elamur.ai/free/en/authors/simran-arora/), Alex L. Zhang, William Hu, [Christopher Re](https://md.research.elamur.ai/free/en/authors/christopher-re/), [Azalia Mirhoseini](https://md.research.elamur.ai/free/en/authors/azalia-mirhoseini/) · **Year:** 2025 · **Venue:** arXiv:2502.10517 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2502.10517) · [PDF](https://arxiv.org/pdf/2502.10517) · [DOI 10.48550/arxiv.2502.10517](https://doi.org/10.48550/arxiv.2502.10517) · [arXiv 2502.10517](https://arxiv.org/abs/2502.10517) · [OpenAlex](https://openalex.org/W4407683692)

**Citations:** 2 citations (openalex-snapshot · 2026-10-14) · 168 in our library, of the 140673 papers whose bibliographies we read

## Summary
Hand-writing fast GPU kernels takes deep expertise and a lot of time. New ML architectures and new accelerators often wait years for well-tuned implementations; FlashAttention is a well-known example. The authors ask whether language models can take over this work.

They present KernelBench, an open-source evaluation framework with 250 PyTorch workloads. For each task, the model receives a reference `Model` class and must produce a `ModelNew` replacement. The model chooses which operations to rewrite and how, using any language or library. Outputs are checked automatically for correctness and wall-clock speed. Results are scored with fast_p, the fraction of outputs that are correct and also beat the baseline by more than a chosen speedup factor p.

Tested out of the box, even the strongest reasoning models match PyTorch Eager on fewer than one task in five. The main failures are compilation and correctness errors. Iterative refinement using execution and profiler feedback raises scores considerably. The benchmark gets harder as p increases, and gains on it carry over directly to faster real-world kernels.

## Key points
- The 250 tasks are split into three levels:
  - Level 1: 100 single operators, such as convolutions, matmuls, norms and losses.
  - Level 2: 100 fusable sequences of 3–6 operators.
  - Level 3: 50 complete architectures, such as AlexNet and MiniGPT, drawn from pytorch, huggingface/transformers and pytorch-image-models.
- OpenAI-o1 and DeepSeek-R1 perform best without help, but still reach PyTorch Eager speed on under 20% of tasks.
- Feeding execution and profiling results back to the model raised fast_1 by level: 12%→43%, 36%→72% and 12%→18%.
- The authors attribute weak correctness partly to scarce CUDA training data, which makes up only 0.073% of The Stack v1.2. R1 tried tensor-core wmma instructions in about half of the Level 1 matmul tasks, but most of these attempts failed to compile.
- Notable generated kernels include:
  - a dense-times-diagonal matrix product that scales rows instead of loading zeros (13× speedup);
  - a fused GELU kernel (2.9×);
  - a cosine similarity kernel using shared memory (2.8×).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [AI & machine learning](https://md.research.elamur.ai/free/en/shelves/ai/) · [Computing & GPUs](https://md.research.elamur.ai/free/en/shelves/computing/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{ouyang2025kernelbench,
  title = {{KernelBench: Can LLMs Write Efficient GPU Kernels?}},
  author = {Ouyang, Anne and Guo, Simon and Arora, Simran and Zhang, Alex L. and Hu, William and Re, Christopher and Mirhoseini, Azalia},
  year = {2025},
  doi = {10.48550/arxiv.2502.10517},
  eprint = {2502.10517},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2502.10517}
}
```

- [← previous Jenin at AraGenEval Shared Task: Parameter-Efficient Fine-Tuning and Layer-Wise Analysis of Arabic LLMs for Authorship Style Transfer and Classification](https://md.research.elamur.ai/free/en/papers/malhis-2025-jenin-arageneval-shared-task-parameter/)
- [next → Kimi k1.5: Scaling Reinforcement Learning with LLMs](https://md.research.elamur.ai/free/en/papers/kimi-2025-team-kimi-k1-5-scaling-reinforcement/)
- [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/2/)

## References

46 references, 7 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Apple. Apple ml compute framework (mlx), 2020. URL [https://developer.apple.com/metal/](https://developer.apple.com/metal/). [↗](https://developer.apple.com/metal/)
2. Simran Arora, Sabri Eyuboglu, Michael Zhang, Aman Timalsina, Silas Alberti, Dylan Zinsley, James Zou, Atri Rudra, and Christopher Ré. Simple linear attention language models balance the recall-throughput tradeoff. International Conference on Machine Learning, 2024. [find](https://scholar.google.com/scholar?q=Simran+Arora%2C+Sabri+Eyuboglu%2C+Michael+Zhang%2C+Aman+Timalsina%2C+Silas+Alberti%2C+Dylan+Zinsley%2C+James+Zou%2C+Atri+Rudra%2C+and+Christopher+Re%CC%81%2E+Simple+linear+attention+language+models+balance+the+recall%2Dthroug)
3. Bradley Brown, Jordan Juravsky, Ryan Ehrlich, Ronald Clark, Quoc V. Le, Christopher Ré, and Azalia Mirhoseini. Large language monkeys: Scaling inference compute with repeated sampling, 2024. URL https://arxiv.org/abs/2407.21787. [↗](https://arxiv.org/abs/2407.21787) [our card](https://md.research.elamur.ai/free/en/papers/brown-2024-large-language-monkeys-scaling-inference/)
4. Cerebras. Cerebras wafer-scale engine wse architecture. Online. [https://cerebras.ai/product-chip/](https://cerebras.ai/product-chip/). [↗](https://cerebras.ai/product-chip/)
5. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhai… [find](https://scholar.google.com/scholar?q=Mark+Chen%2C+Jerry+Tworek%2C+Heewoo+Jun%2C+Qiming+Yuan%2C+Henrique+Ponde+de+Oliveira+Pinto%2C+Jared+Kaplan%2C+Harri+Edwards%2C+Yuri+Burda%2C+Nicholas+Joseph%2C+Greg+Brockman%2C+Alex+Ray%2C+Raul+Puri%2C+Gretchen+Krueger%2C+Mich) [our card](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/)
6. Tri Dao. FlashAttention-2: Faster attention with better parallelism and work partitioning. International Conference on Learning Representations, 2024. [find](https://scholar.google.com/scholar?q=Tri+Dao%2E+FlashAttention%2D2%3A+Faster+attention+with+better+parallelism+and+work+partitioning%2E+International+Conference+on+Learning+Representations%2C+2024%2E)
7. Tri Dao and Albert Gu. Transformers are ssms: Generalized models and efficient algorithms through structured state space duality. International Conference on Machine Learning (ICML), 2024. [find](https://scholar.google.com/scholar?q=Tri+Dao+and+Albert+Gu%2E+Transformers+are+ssms%3A+Generalized+models+and+efficient+algorithms+through+structured+state+space+duality%2E+International+Conference+on+Machine+Learning+%28ICML%29%2C+2024%2E)
8. Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, and Christopher Ré. FlashAttention: Fast and memory-efficient exact attention with IO-awareness. In Advances in Neural Information Processing Systems, 2022. [find](https://scholar.google.com/scholar?q=Tri+Dao%2C+Daniel+Y%2E+Fu%2C+Stefano+Ermon%2C+Atri+Rudra%2C+and+Christopher+Re%CC%81%2E+FlashAttention%3A+Fast+and+memory%2Defficient+exact+attention+with+IO%2Dawareness%2E+In+Advances+in+Neural+Information+Processing+Systems)
9. DeepSeek-AI. DeepSeek-V3. Deepseek-v3 technical report, 2025. URL [https://github.com/deepseek-ai/](https://github.com/deepseek-ai/) [↗](https://github.com/deepseek-ai/)
10. Graphcore. Graphcore IPU architecture. Online. [https://www.graphcore.ai/products/ipu](https://www.graphcore.ai/products/ipu). [↗](https://www.graphcore.ai/products/ipu)
11. Groq. Groq architecture. Online. [https://groq.com/](https://groq.com/). [↗](https://groq.com/)
12. Dejan Grubisic, Chris Cummins, Volker Seeker, and Hugh Leather. Priority sampling of large language models for compilers, 2024. URL https://arxiv.org/abs/2402.18734. — [arXiv:2402.18734](https://arxiv.org/abs/2402.18734) [↗](https://arxiv.org/abs/2402.18734)
13. Dan Hendrycks and Kevin Gimpel. Gaussian error linear units (gelus), 2023. URL [https://arxiv.org/](https://arxiv.org/) abs/1606.08415. [↗](https://arxiv.org/)
14. Norman P. Jouppi, George Kurian, Sheng Li, Peter Ma, Rahul Nagarajan, Lifeng Nai, Nishant Patil, Suvinay Subramanian, Andy Swing, Brian Towles, Cliff Young, Xiang Zhou, Zongwei Zhou, and David Patterson. Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for… [find](https://scholar.google.com/scholar?q=Norman+P%2E+Jouppi%2C+George+Kurian%2C+Sheng+Li%2C+Peter+Ma%2C+Rahul+Nagarajan%2C+Lifeng+Nai%2C+Nishant+Patil%2C+Suvinay+Subramanian%2C+Andy+Swing%2C+Brian+Towles%2C+Cliff+Young%2C+Xiang+Zhou%2C+Zongwei+Zhou%2C+and+David+Patters)
15. Peter Kim. Flashattention minimal. flash-attention-minimal. Online, 2024. [https://github.com/tspeterkim/](https://github.com/tspeterkim/) [↗](https://github.com/tspeterkim/)
16. Denis Kocetkov, Raymond Li, Loubna Ben Allal, Jia Li, Chenghao Mou, Carlos Muñoz Ferrandis, Yacine Jernite, Margaret Mitchell, Sean Hughes, Thomas Wolf, Dzmitry Bahdanau, Leandro von Werra, and Harm de Vries. The stack: 3 tb of permissively licensed source code, 2022. URL https://arxiv.org/abs/221… [↗](https://arxiv.org/abs/221…)
17. Yuhang Lai, Chengxi Li, Yiming Wang, Tianyi Zhang, Ruiqi Zhong, Luke Zettlemoyer, Scott Wen tau Yih, Daniel Fried, Sida Wang, and Tao Yu. Ds-1000: A natural and reliable benchmark for data science code generation, 2022. URL https://arxiv.org/abs/2211.11501. [↗](https://arxiv.org/abs/2211.11501)
18. Raymond Li, Loubna Ben Allal, Yangtian Zi, Niklas Muennighoff, Denis Kocetkov, Chenghao Mou, Marc Marone, Christopher Akiki, Jia Li, Jenny Chim, Qian Liu, Evgenii Zheltonozhskii, Terry Yue Zhuo, Thomas Wang, Olivier Dehaene, Mishig Davaadorj, Joel Lamy-Poirier, João Monteiro, Oleh Shliazhko, Nicola… [find](https://scholar.google.com/scholar?q=Raymond+Li%2C+Loubna+Ben+Allal%2C+Yangtian+Zi%2C+Niklas+Muennighoff%2C+Denis+Kocetkov%2C+Chenghao+Mou%2C+Marc+Marone%2C+Christopher+Akiki%2C+Jia+Li%2C+Jenny+Chim%2C+Qian+Liu%2C+Evgenii+Zheltonozhskii%2C+Terry+Yue+Zhuo%2C+Thoma)
19. Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, Thomas Hubert, Peter Choy, Cyprien de Masson d’Autume, Igor Babuschkin, Xinyun Chen, Po-Sen Huang, Johannes Welbl, Sven Gowal, Alexey Cherepanov, James… [find](https://scholar.google.com/scholar?q=Yujia+Li%2C+David+Choi%2C+Junyoung+Chung%2C+Nate+Kushman%2C+Julian+Schrittwieser%2C+Re%CC%81mi+Leblond%2C+Tom+Eccles%2C+James+Keeling%2C+Felix+Gimeno%2C+Agustin+Dal+Lago%2C+Thomas+Hubert%2C+Peter+Choy%2C+Cyprien+de+Masson+d%E2%80%99Autum) [our card](https://md.research.elamur.ai/free/en/papers/li-2022-competition-level-code-generation-alphacode/)
20. Christian J. Mills. Cuda mode notes - lecture 004. Online, 2024. [https://christianjmills.com/](https://christianjmills.com/) posts/cuda-mode-notes/lecture-004/. [↗](https://christianjmills.com/)
21. Daniel Nichols, Pranav Polasam, Harshitha Menon, Aniruddha Marathe, Todd Gamblin, and Abhinav Bhatele. Performance-aligned llms for generating fast code, 2024. URL https://arxiv.org/abs/2404. 18864. [↗](https://arxiv.org/abs/2404)
22. NVIDIA. cudnn: Gpu-accelerated library for deep neural networks, 2014. URL [https://developer.nvidia.com/cudnn](https://developer.nvidia.com/cudnn). [↗](https://developer.nvidia.com/cudnn)
23. NVIDIA. Cuda templates for linear algebra subroutines, 2017. URL [https://github.com/NVIDIA/](https://github.com/NVIDIA/) cutlass. [↗](https://github.com/NVIDIA/)
24. NVIDIA. Nvidia Tesla V100 GPU architecture, 2017. [find](https://scholar.google.com/scholar?q=NVIDIA%2E+Nvidia+Tesla+V100+GPU+architecture%2C+2017%2E)
25. NVIDIA. Nvidia A100 tensor core GPU architecture, 2020. [find](https://scholar.google.com/scholar?q=NVIDIA%2E+Nvidia+A100+tensor+core+GPU+architecture%2C+2020%2E)
26. NVIDIA. Nvidia H100 tensor core GPU architecture, 2022. [find](https://scholar.google.com/scholar?q=NVIDIA%2E+Nvidia+H100+tensor+core+GPU+architecture%2C+2022%2E)
27. NVIDIA. cuBLAS, 2023. URL [https://docs.nvidia.com/cuda/cublas/](https://docs.nvidia.com/cuda/cublas/). [↗](https://docs.nvidia.com/cuda/cublas/)
28. Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Köpf, Edward Yang, Zach DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Sou… [find](https://scholar.google.com/scholar?q=Adam+Paszke%2C+Sam+Gross%2C+Francisco+Massa%2C+Adam+Lerer%2C+James+Bradbury%2C+Gregory+Chanan%2C+Trevor+Killeen%2C+Zeming+Lin%2C+Natalia+Gimelshein%2C+Luca+Antiga%2C+Alban+Desmaison%2C+Andreas+Ko%CC%88pf%2C+Edward+Yang%2C+Zach+DeVi) [our card](https://md.research.elamur.ai/free/en/papers/paszke-2019-pytorch-imperative-style-high-performance/)
29. Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Huanqi Cao, Xin Cheng, Michael Chung, Matteo Grella, Kranthi Kiran GV, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, and Jiaming et al. Kong. Rwkv: Reinventing rnns for the transformer era. Findings of the Association… [find](https://scholar.google.com/scholar?q=Bo+Peng%2C+Eric+Alcaide%2C+Quentin+Anthony%2C+Alon+Albalak%2C+Samuel+Arcadinho%2C+Huanqi+Cao%2C+Xin+Cheng%2C+Michael+Chung%2C+Matteo+Grella%2C+Kranthi+Kiran+GV%2C+Xuzheng+He%2C+Haowen+Hou%2C+Przemyslaw+Kazienko%2C+Jan+Kocon%2C+a)
30. Jay Shah, Ganesh Bikshandi, Ying Zhang, Vijay Thakkar, Pradeep Ramani, and Tri Dao. Flashattention-3: Fast and accurate attention with asynchrony and low-precision, 2024. URL [https://arxiv.org/](https://arxiv.org/) abs/2407.08608. [↗](https://arxiv.org/)
31. Quan Shi, Michael Tang, Karthik Narasimhan, and Shunyu Yao. Can language models solve olympiad programming?, 2024. URL https://arxiv.org/abs/2404.10952. [↗](https://arxiv.org/abs/2404.10952)
32. Benjamin Spector, Simran Arora, Aaryan Singhal, Daniel Fu, and Christopher Ré. Thunderkittens: Simple, fast, and adorable ai kernels. International Conference on Learning Representations (ICLR), 2024. [find](https://scholar.google.com/scholar?q=Benjamin+Spector%2C+Simran+Arora%2C+Aaryan+Singhal%2C+Daniel+Fu%2C+and+Christopher+Re%CC%81%2E+Thunderkittens%3A+Simple%2C+fast%2C+and+adorable+ai+kernels%2E+International+Conference+on+Learning+Representations+%28ICLR%29%2C+2024)
33. Yi Tay, Mostafa Dehghani, Dara Bahri, and Donald Metzler. Efficient transformers: A survey. ACM Computing Surveys, 55(6):1–28, 2022. [find](https://scholar.google.com/scholar?q=Yi+Tay%2C+Mostafa+Dehghani%2C+Dara+Bahri%2C+and+Donald+Metzler%2E+Efficient+transformers%3A+A+survey%2E+ACM+Computing+Surveys%2C+55%286%29%3A1%E2%80%9328%2C+2022%2E) [our card](https://md.research.elamur.ai/free/en/papers/tay-2020-efficient-transformers-survey/)
34. Team PyTorch, Horace He, Driss Guessous, Yanbo Liang, and Joy Dong. FlexAttention: The flexibility of PyTorch with the performance of FlashAttention, 2024. URL [https://pytorch.org/blog/](https://pytorch.org/blog/) flexattention/. [↗](https://pytorch.org/blog/)
35. Ali TehraniJamsaz, Arijit Bhattacharjee, Le Chen, Nesreen K. Ahmed, Amir Yazdanbakhsh, and Ali Jannesari. Coderosetta: Pushing the boundaries of unsupervised code translation for parallel programming. In The Thirty-eighth Annual Conference on Neural Information Processing Systems, 2024. URL https://… [find](https://scholar.google.com/scholar?q=Ali+TehraniJamsaz%2C+Arijit+Bhattacharjee%2C+Le+Chen%2C+Nesreen+K%2E+Ahmed%2C+Amir+Yazdanbakhsh%2C+and+Ali+Jannesari%2E+Coderosetta%3A+Pushing+the+boundaries+of+unsupervised+code+translation+for+parallel+programming%2E)
36. Philippe Tillet, H. T. Kung, and David Cox. Triton: an intermediate language and compiler for tiled neural network computations. In Proceedings of the 3rd ACM SIGPLAN International Workshop on Machine Learning and Programming Languages, 2019. [find](https://scholar.google.com/scholar?q=Philippe+Tillet%2C+H%2E+T%2E+Kung%2C+and+David+Cox%2E+Triton%3A+an+intermediate+language+and+compiler+for+tiled+neural+network+computations%2E+In+Proceedings+of+the+3rd+ACM+SIGPLAN+International+Workshop+on+Machine) [our card](https://md.research.elamur.ai/free/en/papers/tillet-2019-triton-intermediate-language-compiler-tiled/)
37. Alan M. Turing. On computable numbers, with an application to the Entscheidungsproblem. Proceedings of the London Mathematical Society, 2(42):230–265, 1936. URL [http://www.cs.helsinki.fi/u/](http://www.cs.helsinki.fi/u/) gionis/cc05/OnComputableNumbers.pdf. [↗](http://www.cs.helsinki.fi/u/)
38. Pedro Valero-Lara, Alexis Huante, Mustafa Al Lail, William F. Godoy, Keita Teranishi, Prasanna Balaprakash, and Jeffrey S. Vetter. Comparing llama-2 and gpt-3 llms for hpc kernels generation, 2023. URL https://arxiv.org/abs/2309.07103. [↗](https://arxiv.org/abs/2309.07103)
39. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. 31st Conference on Neural Information Processing Systems (NIPS 2017), 2017. [find](https://scholar.google.com/scholar?q=Ashish+Vaswani%2C+Noam+Shazeer%2C+Niki+Parmar%2C+Jakob+Uszkoreit%2C+Llion+Jones%2C+Aidan+N+Gomez%2C+Lukasz+Kaiser%2C+and+Illia+Polosukhin%2E+Attention+is+all+you+need%2E+31st+Conference+on+Neural+Information+Processing)
40. Siddhant Waghjale, Vishruth Veerendranath, Zhiruo Wang, and Daniel Fried. ECCO: Can we improve model-generated code efficiency without sacrificing functional correctness? In Yaser Al-Onaizan, Mohit Bansal, and Yun-Nung Chen (eds.), Proceedings of the 2024 Conference on Empirical Methods in Natural L… [find](https://scholar.google.com/scholar?q=Siddhant+Waghjale%2C+Vishruth+Veerendranath%2C+Zhiruo+Wang%2C+and+Daniel+Fried%2E+ECCO%3A+Can+we+improve+model%2Dgenerated+code+efficiency+without+sacrificing+functional+correctness%3F+In+Yaser+Al%2DOnaizan%2C+Mohit+Ba)
41. Yuanbo Wen, Qi Guo, Qiang Fu, Xiaqing Li, Jianxing Xu, Yanlin Tang, Yongwei Zhao, Xing Hu, Zidong Du, Ling Li, Chao Wang, Xuehai Zhou, and Yunji Chen. BabelTower: Learning to auto-parallelized program translation. In Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvari, Gang Niu, and Siva… [find](https://scholar.google.com/scholar?q=Yuanbo+Wen%2C+Qi+Guo%2C+Qiang+Fu%2C+Xiaqing+Li%2C+Jianxing+Xu%2C+Yanlin+Tang%2C+Yongwei+Zhao%2C+Xing+Hu%2C+Zidong+Du%2C+Ling+Li%2C+Chao+Wang%2C+Xuehai+Zhou%2C+and+Yunji+Chen%2E+BabelTower%3A+Learning+to+auto%2Dparallelized+program)
42. Hjalmar Wijk, Tao Lin, Joel Becker, Sami Jawhar, Neev Parikh, Thomas Broadley, Lawrence Chan, Michael Chen, Josh Clymer, Jai Dhyani, Elena Ericheva, Katharyn Garcia, Brian Goodrich, Nikola Jurkovic, Megan Kinniment, Aron Lajko, Seraphina Nix, Lucas Sato, William Saunders, Maksym Taran, Ben West, and… [find](https://scholar.google.com/scholar?q=Hjalmar+Wijk%2C+Tao+Lin%2C+Joel+Becker%2C+Sami+Jawhar%2C+Neev+Parikh%2C+Thomas+Broadley%2C+Lawrence+Chan%2C+Michael+Chen%2C+Josh+Clymer%2C+Jai+Dhyani%2C+Elena+Ericheva%2C+Katharyn+Garcia%2C+Brian+Goodrich%2C+Nikola+Jurkovic%2C+M)
43. John Yang, Carlos E. Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press. Swe-agent: Agent-computer interfaces enable automated software engineering. arXiv:2405.15793, 2024. [find](https://scholar.google.com/scholar?q=John+Yang%2C+Carlos+E%2E+Jimenez%2C+Alexander+Wettig%2C+Kilian+Lieret%2C+Shunyu+Yao%2C+Karthik+Narasimhan%2C+and+Ofir+Press%2E+Swe%2Dagent%3A+Agent%2Dcomputer+interfaces+enable+automated+software+engineering%2E+arXiv%3A2405%2E15) [our card](https://md.research.elamur.ai/free/en/papers/yang-2024-swe-agent-agent-computer-interfaces/)
44. John Yang, Carlos E. Jimenez, Alex L. Zhang, Kilian Lieret, Joyce Yang, Xindi Wu, Ori Press, Niklas Muennighoff, Gabriel Synnaeve, Karthik R. Narasimhan, Diyi Yang, Sida I. Wang, and Ofir Press. Swe-bench multimodal: Do ai systems generalize to visual software domains?, 2024. URL [https://arxiv.org/a…](https://arxiv.org/a…) — [arXiv:2410.03859](https://arxiv.org/abs/2410.03859) [↗](https://arxiv.org/a…)
45. Songlin Yang and Yu Zhang. Fla: A triton-based library for hardware-efficient implementations of linear attention mechanism, January 2024. URL [https://github.com/sustcsonglin/](https://github.com/sustcsonglin/) flash-linear-attention. [↗](https://github.com/sustcsonglin/)
46. Pengcheng Yin, Wen-Ding Li, Kefan Xiao, Abhishek Rao, Yeming Wen, Kensen Shi, Joshua Howland, Paige Bailey, Michele Catasta, Henryk Michalewski, Alex Polozov, and Charles Sutton. Natural language to code generation in interactive data science notebooks, 2022. URL https://arxiv.org/abs/2212. 09248. [↗](https://arxiv.org/abs/2212)