---
title: "From Code to Correctness — paper by Shi et al. (2024)"
description: "The authors propose MGDebugger, which needs no extra training and works in a zero-shot setting. 77 references, cited by 11 papers here."
authors: ["Yuling Shi", "Songsong Wang", "Chengcheng Wan", "Min Wang", "Xiaodong Gu"]
year: 2024
venue: "arXiv:2410.01215"
source: "https://arxiv.org/abs/2410.01215"
doi: "10.48550/arxiv.2410.01215"
arxiv: "2410.01215"
licence: "CC BY 4.0 (arXiv)"
licence_url: "http://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/shi-2024-code-correctness-closing-last-mile/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/shi-2024-code-correctness-closing-last-mile/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/9/) / From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging

# From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging

**Authors:** [Yuling Shi](https://md.research.elamur.ai/free/en/authors/yuling-shi/), Songsong Wang, Chengcheng Wan, [Min Wang](https://md.research.elamur.ai/free/en/authors/min-wang/) and [Xiaodong Gu](https://md.research.elamur.ai/free/en/authors/xiaodong-gu/) · **Year:** 2024 · **Venue:** arXiv:2410.01215 · **Licence:** [CC BY 4.0 (arXiv)](http://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/2410.01215) · [PDF](https://arxiv.org/pdf/2410.01215) · [DOI 10.48550/arxiv.2410.01215](https://doi.org/10.48550/arxiv.2410.01215) · [arXiv 2410.01215](https://arxiv.org/abs/2410.01215) · [OpenAlex](https://openalex.org/W4403322015)

**Citations:** 4 citations (OpenAlex, 2026-10-14) · 11 in our library, of the 149,439 papers whose bibliographies we read

## Summary
LLMs often write code that is almost right but fails tests because of small mistakes. Existing LLM-based repair loops usually look at the whole program at once, which makes bugs hard to locate. The authors propose MGDebugger, which needs no extra training and works in a zero-shot setting. First, an LLM restructures the faulty code into a tree of small helper functions. Next, unit tests for each helper are derived from the main function's public tests. Instead of a real debugger, an LLM simulates execution step by step and records key variable values to find where behaviour goes wrong. Repairs start at the leaves of the tree and propagate upward to the callers. Across open-source and commercial models, the method beats prior debuggers such as Self-Debugging, Reflexion and LDB on HumanEval and HumanEvalFix. It also transfers to human-written Java bugs in Defects4J. The work suggests that granular, structure-aware debugging is a practical way to make LLM code generation more reliable.

## Key points
- The pipeline has four stages: LLM-driven hierarchical decomposition, test generation for each subfunction, debugging with an LLM-simulated Python executor, and bottom-up propagation of fixes.
- With DeepSeek-Coder-V2-Lite, CodeQwen1.5 and Codestral, HumanEval accuracy rose from 75.6% to 94.5% (up to +18.9% over seed generations), and HumanEvalFix reached a 97.6% repair success rate.
- GPT-4o and Claude 3.5 Sonnet each gained 6.1% on HumanEval, reaching 96.3% and 95.7%.
- In the ablation, removing the hierarchical strategy lowered the HumanEval repair success rate from 76.3% to 52.6%, making it the most important component.
- On Defects4J, MGDebugger fixed 129 bugs in v1.2 and 64 in v2.0, beating state-of-the-art APR tools by 13.2% and 8.5%; code is available at github.com/YerbaPage/MGDebugger (ICSE '26).

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [University of Pennsylvania](https://md.research.elamur.ai/free/en/universities/university-of-pennsylvania/) — University, Philadelphia, United States · 221 works · 63,234 citations
- [Shanghai Jiao Tong University](https://md.research.elamur.ai/free/en/universities/shanghai-jiao-tong-university/) — University, Shanghai, China · 149 works · 16,161 citations
- [East China Normal University](https://md.research.elamur.ai/free/en/universities/east-china-normal-university/) — University, Shanghai, China · 50 works · 2,174 citations
- [University of California, Davis](https://md.research.elamur.ai/free/en/universities/university-of-california-davis/) — University, Davis, United States · 28 works · 41,916 citations

📚 Shelves (4): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🗄️ Information Systems](https://md.research.elamur.ai/free/en/shelves/computer-science/information-systems/) · 1,437 works · [💻 Software](https://md.research.elamur.ai/free/en/shelves/computer-science/software/) · 92 works · [🖥️ Computer Science Applications](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-science-applications/) · 102 works

🧭 Topics (1): [💻 Code & programming languages](https://md.research.elamur.ai/free/en/topics/code-and-programming/) · 129 works

## Cite

Cite as: Yuling Shi, Songsong Wang, Chengcheng Wan, Min Wang and Xiaodong Gu. 2024. From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging. arXiv:2410.01215.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{shi2024code,
  title = {{From Code to Correctness: Closing the Last Mile of Code Generation with Hierarchical Debugging}},
  author = {Yuling Shi, Songsong Wang, Chengcheng Wan, Min Wang and Xiaodong Gu},
  year = {2024},
  doi = {10.48550/arxiv.2410.01215},
  eprint = {2410.01215},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.2410.01215}
}
```

- [← previous EXCGEC: A Benchmark for Edit-Wise Explainable Chinese Grammatical Error Correction](https://md.research.elamur.ai/free/en/papers/ye-2024-excgec-benchmark-edit-wise-explainable/)
- [next → Preference Optimization for Reasoning with Pseudo Feedback](https://md.research.elamur.ai/free/en/papers/jiao-2024-preference-optimization-reasoning-pseudo-feedback/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/9/)

## References

77 references, 16 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. DeepSeek AI. 2024. [DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence](https://md.research.elamur.ai/free/en/papers/deepseek-ai-2024-deepseek-coder-v2-breaking-barrier/). arXiv:2406.11931
2. Anthropic. 2024. Introducing Claude 3.5 Sonnet. [https://www.anthropic.com/news/claude-3-5-sonnet](https://www.anthropic.com/news/claude-3-5-sonnet). [↗](https://www.anthropic.com/news/claude-3-5-sonnet)
3. Jacob Austin, Augustus Odena, Maxwell Nye, Maarten Bosma, Henryk Michalewski, David Dohan, Ellen Jiang, Carrie Cai, Michael Terry, Quoc Le, and Charles Sutton. 2021. [Program Synthesis with Large Language Models](https://md.research.elamur.ai/free/en/papers/austin-2021-program-synthesis-large-language-models/). arXiv:2108.07732 [cs] doi:10.48550/arXiv.2108.07732
4. Islem Bouzenia, Premkumar Devanbu, and Michael Pradel. 2024. RepairAgent: An Autonomous, LLM-Based Agent for Program Repair. arXiv:2403.17134 [cs] doi:10.48550/arXiv.2403.17134 — [doi:10.48550/arxiv.2403.17134](https://doi.org/10.48550/arxiv.2403.17134) [find](https://scholar.google.com/scholar?q=Islem+Bouzenia%2C+Premkumar+Devanbu%2C+and+Michael+Pradel%2E+2024%2E+RepairAgent%3A+An+Autonomous%2C+LLM%2DBased+Agent+for+Program+Repair%2E+arXiv%3A2403%2E17134+%5Bcs%5D+doi%3A10%2E48550%2FarXiv%2E2403%2E17134+%E2%80%94+%5Bdoi%3A10%2E48550%2Farxiv%2E2)
5. Collin Burns, Pavel Izmailov, Jan Hendrik Kirchner, Bowen Baker, Leo Gao, Leopold Aschenbrenner, Yining Chen, Adrien Ecoffet, Manas Joglekar, Jan Leike, Ilya Sutskever, and Jeff Wu. 2023. [Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision](https://md.research.elamur.ai/free/en/papers/burns-2023-weak-strong-generalization-eliciting-strong/). arXiv:2312.09390 doi:10.4855…
6. Bei Chen, Fengji Zhang, Anh Nguyen, Daoguang Zan, Zeqi Lin, Jian-Guang Lou, and Weizhu Chen. 2022. CodeT: Code Generation with Generated Tests. In The Twelfth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Bei+Chen%2C+Fengji+Zhang%2C+Anh+Nguyen%2C+Daoguang+Zan%2C+Zeqi+Lin%2C+Jian%2DGuang+Lou%2C+and+Weizhu+Chen%2E+2022%2E+CodeT%3A+Code+Generation+with+Generated+Tests%2E+In+The+Twelfth+International+Conference+on+Learning+Repr)
7. Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhai… — [Evaluating Large Language Models Trained on Code](https://md.research.elamur.ai/free/en/papers/chen-2021-evaluating-large-language-models-trained/)
8. Xinyun Chen, Renat Aksitov, Uri Alon, Jie Ren, Kefan Xiao, Pengcheng Yin, Sushant Prakash, Charles Sutton, Xuezhi Wang, and Denny Zhou. 2023. [Universal Self-Consistency for Large Language Model Generation](https://md.research.elamur.ai/free/en/papers/chen-2023-universal-self-consistency-large-language/). arXiv:2311.17311
9. Xinyun Chen, Maxwell Lin, Nathanael Schärli, and Denny Zhou. 2023. Teaching Large Language Models to Self-Debug. In The Twelfth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Xinyun+Chen%2C+Maxwell+Lin%2C+Nathanael+Sch%C3%A4rli%2C+and+Denny+Zhou%2E+2023%2E+Teaching+Large+Language+Models+to+Self%2DDebug%2E+In+The+Twelfth+International+Conference+on+Learning+Representations%2E)
10. Yangruibo Ding, Marcus J. Min, Gail Kaiser, and Baishakhi Ray. 2024. CYCLE: Learning to Self-Refine the Code Generation. Proc. ACM Program. Lang. 8, OOPSLA1 (April 2024), 108:392–108:418. doi:10.1145/3649825 — [doi:10.1145/3649825](https://doi.org/10.1145/3649825) [find](https://scholar.google.com/scholar?q=Yangruibo+Ding%2C+Marcus+J%2E+Min%2C+Gail+Kaiser%2C+and+Baishakhi+Ray%2E+2024%2E+CYCLE%3A+Learning+to+Self%2DRefine+the+Code+Generation%2E+Proc%2E+ACM+Program%2E+Lang%2E+8%2C+OOPSLA1+%28April+2024%29%2C+108%3A392%E2%80%93108%3A418%2E+doi%3A10%2E1145%2F)
11. Yihong Dong, Xue Jiang, Zhi Jin, and Ge Li. 2024. Self-Collaboration Code Generation via ChatGPT. ACM Trans. Softw. Eng. Methodol. (June 2024). doi:10. 1145/3672459 [find](https://scholar.google.com/scholar?q=Yihong+Dong%2C+Xue+Jiang%2C+Zhi+Jin%2C+and+Ge+Li%2E+2024%2E+Self%2DCollaboration+Code+Generation+via+ChatGPT%2E+ACM+Trans%2E+Softw%2E+Eng%2E+Methodol%2E+%28June+2024%29%2E+doi%3A10%2E+1145%2F3672459)
12. Shihan Dou, Haoxiang Jia, Shenxi Wu, Huiyuan Zheng, Weikang Zhou, Muling Wu, Mingxu Chai, Jessica Fan, Caishuang Huang, Yunbo Tao, Yan Liu, Enyu Zhou, Ming Zhang, Yuhao Zhou, Yueming Wu, Rui Zheng, Ming Wen, Rongxiang Weng, Jingang Wang, Xunliang Cai, Tao Gui, Xipeng Qiu, Qi Zhang, and Xuanjing Huan… — [arXiv:2407.06153](https://arxiv.org/abs/2407.06153) [find](https://scholar.google.com/scholar?q=Shihan+Dou%2C+Haoxiang+Jia%2C+Shenxi+Wu%2C+Huiyuan+Zheng%2C+Weikang+Zhou%2C+Muling+Wu%2C+Mingxu+Chai%2C+Jessica+Fan%2C+Caishuang+Huang%2C+Yunbo+Tao%2C+Yan+Liu%2C+Enyu+Zhou%2C+Ming+Zhang%2C+Yuhao+Zhou%2C+Yueming+Wu%2C+Rui+Zheng%2C+Mi)
13. Kavi Gupta, Peter Ebert Christensen, Xinyun Chen, and Dawn Song. 2020. Synthesize, Execute and Debug: Learning to Repair for Neural Program Synthesis. In Advances in Neural Information Processing Systems, Vol. 33. Curran Associates, Inc., 17685–17695. [find](https://scholar.google.com/scholar?q=Kavi+Gupta%2C+Peter+Ebert+Christensen%2C+Xinyun+Chen%2C+and+Dawn+Song%2E+2020%2E+Synthesize%2C+Execute+and+Debug%3A+Learning+to+Repair+for+Neural+Program+Synthesis%2E+In+Advances+in+Neural+Information+Processing+Syst)
14. Dan Hendrycks, Steven Basart, Saurav Kadavath, Mantas Mazeika, Akul Arora, Ethan Guo, Collin Burns, Samir Puranik, Horace He, Dawn Song, and Jacob Steinhardt. 2021. [Measuring Coding Challenge Competence With APPS](https://md.research.elamur.ai/free/en/papers/hendrycks-2021-measuring-coding-challenge-competence-apps/). In Thirty-Fifth Conference on Neural Information Processing Systems Datasets and Bench…
15. Soneya Binta Hossain, Nan Jiang, Qiang Zhou, Xiaopeng Li, Wen-Hao Chiang, Yingjun Lyu, Hoan Nguyen, and Omer Tripp. 2024. A Deep Dive into Large Language Models for Automated Bug Localization and Repair. Proc. ACM Softw. Eng. 1, FSE (July 2024), 66:1471–66:1493. doi:10.1145/3660773 — [doi:10.1145/3660773](https://doi.org/10.1145/3660773) [find](https://scholar.google.com/scholar?q=Soneya+Binta+Hossain%2C+Nan+Jiang%2C+Qiang+Zhou%2C+Xiaopeng+Li%2C+Wen%2DHao+Chiang%2C+Yingjun+Lyu%2C+Hoan+Nguyen%2C+and+Omer+Tripp%2E+2024%2E+A+Deep+Dive+into+Large+Language+Models+for+Automated+Bug+Localization+and+Repa)
16. Xueyu Hu, Kun Kuang, Jiankai Sun, Hongxia Yang, and Fei Wu. 2024. Leveraging Print Debugging to Improve Code Generation in Large Language Models. arXiv:2401.05319 — [arXiv:2401.05319](https://arxiv.org/abs/2401.05319) [find](https://scholar.google.com/scholar?q=Xueyu+Hu%2C+Kun+Kuang%2C+Jiankai+Sun%2C+Hongxia+Yang%2C+and+Fei+Wu%2E+2024%2E+Leveraging+Print+Debugging+to+Improve+Code+Generation+in+Large+Language+Models%2E+arXiv%3A2401%2E05319+%E2%80%94+%5BarXiv%3A2401%2E05319%5D%28https%3A%2F%2Farxiv%2Eor)
17. Dong Huang, Qingwen Bu, Jie M. Zhang, Michael Luck, and Heming Cui. 2023. AgentCoder: Multi-Agent-based Code Generation with Iterative Testing and Optimisation. arXiv:2312.13010 doi:10.48550/arXiv.2312.13010 [find](https://scholar.google.com/scholar?q=Dong+Huang%2C+Qingwen+Bu%2C+Jie+M%2E+Zhang%2C+Michael+Luck%2C+and+Heming+Cui%2E+2023%2E+AgentCoder%3A+Multi%2DAgent%2Dbased+Code+Generation+with+Iterative+Testing+and+Optimisation%2E+arXiv%3A2312%2E13010+doi%3A10%2E48550%2FarXiv%2E231)
18. Kai Huang, Xiangxin Meng, Jian Zhang, Yang Liu, Wenjie Wang, Shuhao Li, and Yuqing Zhang. 2023. An Empirical Study on Fine-Tuning Large Language Models of Code for Automated Program Repair. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE). IEEE, Luxembourg, Luxe… — [doi:10.1109/ase56229.2023.00181](https://doi.org/10.1109/ase56229.2023.00181) [find](https://scholar.google.com/scholar?q=Kai+Huang%2C+Xiangxin+Meng%2C+Jian+Zhang%2C+Yang+Liu%2C+Wenjie+Wang%2C+Shuhao+Li%2C+and+Yuqing+Zhang%2E+2023%2E+An+Empirical+Study+on+Fine%2DTuning+Large+Language+Models+of+Code+for+Automated+Program+Repair%2E+In+2023+38)
19. Ayaz Isazadeh, Habib Izadkhah, and Islam Elgedawy. 2017. Source Code Modularization. Springer International Publishing, Cham. doi:10.1007/978-3-319-63346-6 — [doi:10.1007/978-3-319-63346-6](https://doi.org/10.1007/978-3-319-63346-6) [find](https://scholar.google.com/scholar?q=Ayaz+Isazadeh%2C+Habib+Izadkhah%2C+and+Islam+Elgedawy%2E+2017%2E+Source+Code+Modularization%2E+Springer+International+Publishing%2C+Cham%2E+doi%3A10%2E1007%2F978%2D3%2D319%2D63346%2D6+%E2%80%94+%5Bdoi%3A10%2E1007%2F978%2D3%2D319%2D63346%2D6%5D%28https%3A%2F%2Fdo)
20. Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar-Lezama, Koushik Sen, and Ion Stoica. 2025. Live-CodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code. In The Thirteenth International Conference on Learning Representati… [find](https://scholar.google.com/scholar?q=Naman+Jain%2C+King+Han%2C+Alex+Gu%2C+Wen%2DDing+Li%2C+Fanjia+Yan%2C+Tianjun+Zhang%2C+Sida+Wang%2C+Armando+Solar%2DLezama%2C+Koushik+Sen%2C+and+Ion+Stoica%2E+2025%2E+Live%2DCodeBench%3A+Holistic+and+Contamination+Free+Evaluation+of)
21. Naman Jain, Tianjun Zhang, Wei-Lin Chiang, Joseph E. Gonzalez, Koushik Sen, and Ion Stoica. 2023. LLM-Assisted Code Cleaning For Training Accurate Code Generators. arXiv:2311.14904 doi:10.48550/arXiv.2311.14904 [find](https://scholar.google.com/scholar?q=Naman+Jain%2C+Tianjun+Zhang%2C+Wei%2DLin+Chiang%2C+Joseph+E%2E+Gonzalez%2C+Koushik+Sen%2C+and+Ion+Stoica%2E+2023%2E+LLM%2DAssisted+Code+Cleaning+For+Training+Accurate+Code+Generators%2E+arXiv%3A2311%2E14904+doi%3A10%2E48550%2FarXiv%2E)
22. Nan Jiang, Xiaopeng Li, Shiqi Wang, Qiang Zhou, Soneya Binta Hossain, Baishakhi Ray, Varun Kumar, Xiaofei Ma, and Anoop Deoras. 2024. Training LLMs to Better Self-Debug and Explain Code. In NeurIPS2024. [find](https://scholar.google.com/scholar?q=Nan+Jiang%2C+Xiaopeng+Li%2C+Shiqi+Wang%2C+Qiang+Zhou%2C+Soneya+Binta+Hossain%2C+Baishakhi+Ray%2C+Varun+Kumar%2C+Xiaofei+Ma%2C+and+Anoop+Deoras%2E+2024%2E+Training+LLMs+to+Better+Self%2DDebug+and+Explain+Code%2E+In+NeurIPS202)
23. Nan Jiang, Thibaud Lutellier, Yiling Lou, Lin Tan, Dan Goldwasser, and Xiangyu Zhang. 2023. KNOD: Domain Knowledge Distilled Tree Decoder for Automated Program Repair. In Proceedings of the 45th International Conference on Software Engineering (ICSE ’23). IEEE Press, Melbourne, Victoria, Australia,… — [doi:10.1109/icse48619.2023.00111](https://doi.org/10.1109/icse48619.2023.00111) [find](https://scholar.google.com/scholar?q=Nan+Jiang%2C+Thibaud+Lutellier%2C+Yiling+Lou%2C+Lin+Tan%2C+Dan+Goldwasser%2C+and+Xiangyu+Zhang%2E+2023%2E+KNOD%3A+Domain+Knowledge+Distilled+Tree+Decoder+for+Automated+Program+Repair%2E+In+Proceedings+of+the+45th+Inter)
24. Shuyang Jiang, Yuhao Wang, and Yu Wang. 2023. SelfEvolve: A Code Evolution Framework via Large Language Models. arXiv:2306.02907 [cs] doi:10.48550/arXiv. 2306.02907 — [doi:10.48550/arxiv](https://doi.org/10.48550/arxiv) [find](https://scholar.google.com/scholar?q=Shuyang+Jiang%2C+Yuhao+Wang%2C+and+Yu+Wang%2E+2023%2E+SelfEvolve%3A+A+Code+Evolution+Framework+via+Large+Language+Models%2E+arXiv%3A2306%2E02907+%5Bcs%5D+doi%3A10%2E48550%2FarXiv%2E+2306%2E02907+%E2%80%94+%5Bdoi%3A10%2E48550%2Farxiv%5D%28https%3A%2F%2Fdoi%2E)
25. René Just, Darioush Jalali, and Michael D. Ernst. 2014. Defects4J: A Database of Existing Faults to Enable Controlled Testing Studies for Java Programs. In Proceedings of the 2014 International Symposium on Software Testing and Analysis (ISSTA 2014). Association for Computing Machinery, New York, NY… [find](https://scholar.google.com/scholar?q=Ren%C3%A9+Just%2C+Darioush+Jalali%2C+and+Michael+D%2E+Ernst%2E+2014%2E+Defects4J%3A+A+Database+of+Existing+Faults+to+Enable+Controlled+Testing+Studies+for+Java+Programs%2E+In+Proceedings+of+the+2014+International+Sympos)
26. YoungJae Kim, Yechan Park, Seungheon Han, and Jooyong Yi. 2024. Enhancing the Efficiency of Automated Program Repair via Greybox Analysis. In Proceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering (ASE ’24). Association for Computing Machinery, New York, NY, USA,… — [doi:10.1145/3691620.3695602](https://doi.org/10.1145/3691620.3695602) [find](https://scholar.google.com/scholar?q=YoungJae+Kim%2C+Yechan+Park%2C+Seungheon+Han%2C+and+Jooyong+Yi%2E+2024%2E+Enhancing+the+Efficiency+of+Automated+Program+Repair+via+Greybox+Analysis%2E+In+Proceedings+of+the+39th+IEEE%2FACM+International+Conference+)
27. Jiaolong Kong, Xiaofei Xie, Mingfei Cheng, Shangqing Liu, Xiaoning Du, and Qi Guo. 2025. ContrastRepair: Enhancing Conversation-Based Automated Program Repair via Contrastive Test Case Pairs. ACM Trans. Softw. Eng. Methodol. (March 2025). doi:10.1145/3719345 — [doi:10.1145/3719345](https://doi.org/10.1145/3719345) [find](https://scholar.google.com/scholar?q=Jiaolong+Kong%2C+Xiaofei+Xie%2C+Mingfei+Cheng%2C+Shangqing+Liu%2C+Xiaoning+Du%2C+and+Qi+Guo%2E+2025%2E+ContrastRepair%3A+Enhancing+Conversation%2DBased+Automated+Program+Repair+via+Contrastive+Test+Case+Pairs%2E+ACM+Tran)
28. Aviral Kumar, Vincent Zhuang, Rishabh Agarwal, Yi Su, John D. Co-Reyes, Avi Singh, Kate Baumli, Shariq Iqbal, Colton Bishop, Rebecca Roelofs, Lei M. Zhang, Kay McKinney, Disha Shrivastava, Cosmin Paduraru, George Tucker, Doina Precup, Feryal Behbahani, and Aleksandra Faust. 2024. [Training Language M…](https://md.research.elamur.ai/free/en/papers/kumar-2024-training-language-models-self-correct/)
29. Emanuele La Malfa, Christoph Weinhuber, Orazio Torre, Fangru Lin, Samuele Marro, Anthony Cohn, Nigel Shadbolt, and Michael Wooldridge. 2024. Code simulation challenges for large language models. arXiv preprint arXiv:2401.09074 (2024). — [arXiv:2401.09074](https://arxiv.org/abs/2401.09074) [find](https://scholar.google.com/scholar?q=Emanuele+La+Malfa%2C+Christoph+Weinhuber%2C+Orazio+Torre%2C+Fangru+Lin%2C+Samuele+Marro%2C+Anthony+Cohn%2C+Nigel+Shadbolt%2C+and+Michael+Wooldridge%2E+2024%2E+Code+simulation+challenges+for+large+language+models%2E+arXiv)
30. Xuan-Bach D. Le, Duc-Hiep Chu, David Lo, Claire Le Goues, and Willem Visser. 2017. S3: Syntax- and Semantic-Guided Repair Synthesis via Programming by Examples. In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering (ESEC/FSE 2017). Association for Computing Machinery,… — [doi:10.1145/3106237.3106309](https://doi.org/10.1145/3106237.3106309) [find](https://scholar.google.com/scholar?q=Xuan%2DBach+D%2E+Le%2C+Duc%2DHiep+Chu%2C+David+Lo%2C+Claire+Le+Goues%2C+and+Willem+Visser%2E+2017%2E+S3%3A+Syntax%2D+and+Semantic%2DGuided+Repair+Synthesis+via+Programming+by+Examples%2E+In+Proceedings+of+the+2017+11th+Joint+M)
31. Claire Le Goues, ThanhVu Nguyen, Stephanie Forrest, and Westley Weimer. 2012. GenProg: A Generic Method for Automatic Software Repair. IEEE Trans. Softw. Eng. 38, 1 (Jan. 2012), 54–72. doi:10.1109/TSE.2011.104 [find](https://scholar.google.com/scholar?q=Claire+Le+Goues%2C+ThanhVu+Nguyen%2C+Stephanie+Forrest%2C+and+Westley+Weimer%2E+2012%2E+GenProg%3A+A+Generic+Method+for+Automatic+Software+Repair%2E+IEEE+Trans%2E+Softw%2E+Eng%2E+38%2C+1+%28Jan%2E+2012%29%2C+54%E2%80%9372%2E+doi%3A10%2E1109%2FTSE)
32. Cheryl Lee, Chunqiu Steven Xia, Jen-tse Huang, Zhouruixin Zhu, Lingming Zhang, and Michael R. Lyu. 2024. A Unified Debugging Approach via LLM-Based Multi-Agent Synergy. arXiv:2404.17153 — [arXiv:2404.17153](https://arxiv.org/abs/2404.17153) [find](https://scholar.google.com/scholar?q=Cheryl+Lee%2C+Chunqiu+Steven+Xia%2C+Jen%2Dtse+Huang%2C+Zhouruixin+Zhu%2C+Lingming+Zhang%2C+and+Michael+R%2E+Lyu%2E+2024%2E+A+Unified+Debugging+Approach+via+LLM%2DBased+Multi%2DAgent+Synergy%2E+arXiv%3A2404%2E17153+%E2%80%94+%5BarXiv%3A2404%2E)
33. Chengshu Li, Jacky Liang, Andy Zeng, Xinyun Chen, Karol Hausman, Dorsa Sadigh, Sergey Levine, Li Fei-Fei, Fei Xia, and Brian Ichter. 2023. Chain of Code: Reasoning with a Language Model-Augmented Code Emulator. arXiv:2312.04474 — [arXiv:2312.04474](https://arxiv.org/abs/2312.04474) [find](https://scholar.google.com/scholar?q=Chengshu+Li%2C+Jacky+Liang%2C+Andy+Zeng%2C+Xinyun+Chen%2C+Karol+Hausman%2C+Dorsa+Sadigh%2C+Sergey+Levine%2C+Li+Fei%2DFei%2C+Fei+Xia%2C+and+Brian+Ichter%2E+2023%2E+Chain+of+Code%3A+Reasoning+with+a+Language+Model%2DAugmented+Code)
34. Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, Thomas Hubert, Peter Choy, Cyprien de Masson d’Autume, Igor Babuschkin, Xinyun Chen, Po-Sen Huang, Johannes Welbl, Sven Gowal, Alexey Cherepanov, James M… — [Competition-Level Code Generation with AlphaCode](https://md.research.elamur.ai/free/en/papers/li-2022-competition-level-code-generation-alphacode/)
35. Yi Li, Shaohua Wang, and Tien N. Nguyen. 2020. DLFix: Context-Based Code Transformation Learning for Automated Program Repair. In Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering (ICSE ’20). Association for Computing Machinery, New York, NY, USA, 602–614. doi:10.1145… — [doi:10.1145/3377811.3380345](https://doi.org/10.1145/3377811.3380345) [find](https://scholar.google.com/scholar?q=Yi+Li%2C+Shaohua+Wang%2C+and+Tien+N%2E+Nguyen%2E+2020%2E+DLFix%3A+Context%2DBased+Code+Transformation+Learning+for+Automated+Program+Repair%2E+In+Proceedings+of+the+ACM%2FIEEE+42nd+International+Conference+on+Software+)
36. Bo Lin, Shangwen Wang, Ming Wen, Liqian Chen, and Xiaoguang Mao. 2024. One Size Does Not Fit All: Multi-granularity Patch Generation for Better Automated Program Repair. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2024). Association for Comp… — [doi:10.1145/3650212.3680381](https://doi.org/10.1145/3650212.3680381) [find](https://scholar.google.com/scholar?q=Bo+Lin%2C+Shangwen+Wang%2C+Ming+Wen%2C+Liqian+Chen%2C+and+Xiaoguang+Mao%2E+2024%2E+One+Size+Does+Not+Fit+All%3A+Multi%2Dgranularity+Patch+Generation+for+Better+Automated+Program+Repair%2E+In+Proceedings+of+the+33rd+ACM)
37. Jiawei Liu, Chunqiu Steven Xia, Yuyao Wang, and Lingming Zhang. 2023. [Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation](https://md.research.elamur.ai/free/en/papers/liu-2023-your-code-generated-chatgpt-really/). arXiv:2305.01210 [cs] doi:10.48550/arXiv. 2305.01210
38. Jiate Liu, Yiqin Zhu, Kaiwen Xiao, Qiang Fu, Xiao Han, Yang Wei, and Deheng Ye. 2023. RLTF: Reinforcement Learning from Unit Test Feedback. Transactions on Machine Learning Research (July 2023). [find](https://scholar.google.com/scholar?q=Jiate+Liu%2C+Yiqin+Zhu%2C+Kaiwen+Xiao%2C+Qiang+Fu%2C+Xiao+Han%2C+Yang+Wei%2C+and+Deheng+Ye%2E+2023%2E+RLTF%3A+Reinforcement+Learning+from+Unit+Test+Feedback%2E+Transactions+on+Machine+Learning+Research+%28July+2023%29%2E)
39. Kui Liu, Anil Koyuncu, Dongsun Kim, and Tegawende F. Bissyandè. 2019. AVATAR: Fixing Semantic Bugs with Fix Patterns of Static Analysis Violations. In 2019 IEEE 26th International Conference on Software Analysis, Evolution and Reengineering (SANER). IEEE Computer Society, 1–12. doi:10.1109/SANER.201… — [doi:10.1109/saner.2019.8667970](https://doi.org/10.1109/saner.2019.8667970) [find](https://scholar.google.com/scholar?q=Kui+Liu%2C+Anil+Koyuncu%2C+Dongsun+Kim%2C+and+Tegawende+F%2E+Bissyand%C3%A8%2E+2019%2E+AVATAR%3A+Fixing+Semantic+Bugs+with+Fix+Patterns+of+Static+Analysis+Violations%2E+In+2019+IEEE+26th+International+Conference+on+Softwa)
40. Thibaud Lutellier, Hung Viet Pham, Lawrence Pang, Yitong Li, Moshi Wei, and Lin Tan. 2020. CoCoNuT: Combining Context-Aware Neural Translation Models Using Ensemble for Program Repair. In Proceedings of the 29th ACM SIGSOFT International Symposium on Software Testing and Analysis (IS-STA 2020). Asso… — [doi:10.1145/3395363.3397369](https://doi.org/10.1145/3395363.3397369) [find](https://scholar.google.com/scholar?q=Thibaud+Lutellier%2C+Hung+Viet+Pham%2C+Lawrence+Pang%2C+Yitong+Li%2C+Moshi+Wei%2C+and+Lin+Tan%2E+2020%2E+CoCoNuT%3A+Combining+Context%2DAware+Neural+Translation+Models+Using+Ensemble+for+Program+Repair%2E+In+Proceedings+)
41. Sergey Mechtaev, Jooyong Yi, and Abhik Roychoudhury. 2016. Angelix: Scalable Multiline Program Patch Synthesis via Symbolic Analysis. In Proceedings of the 38th International Conference on Software Engineering (ICSE ’16). Association for Computing Machinery, New York, NY, USA, 691–701. doi:10.1145/2… — [doi:10.1145/2884781](https://doi.org/10.1145/2884781) [find](https://scholar.google.com/scholar?q=Sergey+Mechtaev%2C+Jooyong+Yi%2C+and+Abhik+Roychoudhury%2E+2016%2E+Angelix%3A+Scalable+Multiline+Program+Patch+Synthesis+via+Symbolic+Analysis%2E+In+Proceedings+of+the+38th+International+Conference+on+Software+En)
42. Mistral AI team. 2024. Codestral: Hello, World! [https://mistral.ai/news/codestral/](https://mistral.ai/news/codestral/). [↗](https://mistral.ai/news/codestral/)
43. Seungjun Moon, Hyungjoo Chae, Yongho Song, Taeyoon Kwon, Dongjin Kang, Kai Tzu-iunn Ong, Seung-won Hwang, and Jinyoung Yeo. 2024. Coffee: Boost Your Code LLMs by Fixing Bugs with Feedback. arXiv:2311.07215 [cs] — [arXiv:2311.07215](https://arxiv.org/abs/2311.07215) [find](https://scholar.google.com/scholar?q=Seungjun+Moon%2C+Hyungjoo+Chae%2C+Yongho+Song%2C+Taeyoon+Kwon%2C+Dongjin+Kang%2C+Kai+Tzu%2Diunn+Ong%2C+Seung%2Dwon+Hwang%2C+and+Jinyoung+Yeo%2E+2024%2E+Coffee%3A+Boost+Your+Code+LLMs+by+Fixing+Bugs+with+Feedback%2E+arXiv%3A2311%2E)
44. Niklas Muennighoff, Qian Liu, Armel Randy Zebaze, Qinkai Zheng, Binyuan Hui, Terry Yue Zhuo, Swayam Singh, Xiangru Tang, Leandro Von Werra, and Shayne Longpre. 2023. OctoPack: Instruction Tuning Code Large Language Models. In The Twelfth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Niklas+Muennighoff%2C+Qian+Liu%2C+Armel+Randy+Zebaze%2C+Qinkai+Zheng%2C+Binyuan+Hui%2C+Terry+Yue+Zhuo%2C+Swayam+Singh%2C+Xiangru+Tang%2C+Leandro+Von+Werra%2C+and+Shayne+Longpre%2E+2023%2E+OctoPack%3A+Instruction+Tuning+Code+)
45. Ansong Ni, Miltiadis Allamanis, Arman Cohan, Yinlin Deng, Kensen Shi, Charles Sutton, and Pengcheng Yin. 2024. NExT: Teaching Large Language Models to Reason about Code Execution. arXiv:2404.14662 [find](https://scholar.google.com/scholar?q=Ansong+Ni%2C+Miltiadis+Allamanis%2C+Arman+Cohan%2C+Yinlin+Deng%2C+Kensen+Shi%2C+Charles+Sutton%2C+and+Pengcheng+Yin%2E+2024%2E+NExT%3A+Teaching+Large+Language+Models+to+Reason+about+Code+Execution%2E+arXiv%3A2404%2E14662)
46. Ansong Ni, Srini Iyer, Dragomir Radev, Ves Stoyanov, Wen-tau Yih, Sida I. Wang, and Xi Victoria Lin. 2023. [LEVER: Learning to Verify Language-to-Code Generation with Execution](https://md.research.elamur.ai/free/en/papers/ni-2023-lever-learning-verify-language-code/). arXiv:2302.08468 doi:10.48550/arXiv.2302.08468
47. Theo X. Olausson, Jeevana Priya Inala, Chenglong Wang, Jianfeng Gao, and Armando Solar-Lezama. 2023. Is Self-Repair a Silver Bullet for Code Generation?. In The Twelfth International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Theo+X%2E+Olausson%2C+Jeevana+Priya+Inala%2C+Chenglong+Wang%2C+Jianfeng+Gao%2C+and+Armando+Solar%2DLezama%2E+2023%2E+Is+Self%2DRepair+a+Silver+Bullet+for+Code+Generation%3F%2E+In+The+Twelfth+International+Conference+on+Lea)
48. OpenAI. 2023. [GPT-4 Technical Report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). arXiv:2303.08774 [cs] doi:10.48550/arXiv. 2303.08774
49. Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn. 2023. [Direct Preference Optimization: Your Language Model Is Secretly a Reward Model](https://md.research.elamur.ai/free/en/papers/rafailov-2023-direct-preference-optimization-language-model/). In Thirty-Seventh Conference on Neural Information Processing Systems.
50. Max Schäfer, Sarah Nadi, Aryaz Eghbali, and Frank Tip. 2024. An Empirical Evaluation of Using Large Language Models for Automated Unit Test Generation. IEEE Transactions on Software Engineering 50, 1 (Jan. 2024), 85–105. doi:10.1109/ TSE.2023.3334955 [find](https://scholar.google.com/scholar?q=Max+Sch%C3%A4fer%2C+Sarah+Nadi%2C+Aryaz+Eghbali%2C+and+Frank+Tip%2E+2024%2E+An+Empirical+Evaluation+of+Using+Large+Language+Models+for+Automated+Unit+Test+Generation%2E+IEEE+Transactions+on+Software+Engineering+50%2C+1+)
51. Yuchen Shao, Yuheng Huang, Jiawei Shen, Lei Ma, Ting Su, and Chengcheng Wan. 2025. Are LLMs Correctly Integrated into Software Systems?. In 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE). IEEE, 1178–1190. [find](https://scholar.google.com/scholar?q=Yuchen+Shao%2C+Yuheng+Huang%2C+Jiawei+Shen%2C+Lei+Ma%2C+Ting+Su%2C+and+Chengcheng+Wan%2E+2025%2E+Are+LLMs+Correctly+Integrated+into+Software+Systems%3F%2E+In+2025+IEEE%2FACM+47th+International+Conference+on+Software+Engi)
52. Yuling Shi, Hongyu Zhang, Chengcheng Wan, and Xiaodong Gu. 2024. Between Lines of Code: Unraveling the Distinct Patterns of Machine and Human Programmers. In 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE). IEEE Computer Society (2024), 51–62. [find](https://scholar.google.com/scholar?q=Yuling+Shi%2C+Hongyu+Zhang%2C+Chengcheng+Wan%2C+and+Xiaodong+Gu%2E+2024%2E+Between+Lines+of+Code%3A+Unraveling+the+Distinct+Patterns+of+Machine+and+Human+Programmers%2E+In+2025+IEEE%2FACM+47th+International+Conferenc)
53. Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik R. Narasimhan, and Shunyu Yao. 2023. [Reflexion: Language Agents with Verbal Reinforcement Learning](https://md.research.elamur.ai/free/en/papers/shinn-2023-reflexion-language-agents-verbal-reinforcement/). In Thirty-Seventh Conference on Neural Information Processing Systems.
54. Qwen Team. 2023. [Qwen Technical Report](https://md.research.elamur.ai/free/en/papers/bai-2023-qwen-technical-report/). arXiv:2309.16609 [cs] doi:10.48550/ arXiv.2309.16609
55. Runchu Tian, Yining Ye, Yujia Qin, Xin Cong, Yankai Lin, Yinxu Pan, Yesai Wu, Zhiyuan Liu, and Maosong Sun. 2024. DebugBench: Evaluating Debugging Capability of Large Language Models. arXiv:2401.04621 doi:10.48550/arXiv.2401. 04621 [find](https://scholar.google.com/scholar?q=Runchu+Tian%2C+Yining+Ye%2C+Yujia+Qin%2C+Xin+Cong%2C+Yankai+Lin%2C+Yinxu+Pan%2C+Yesai+Wu%2C+Zhiyuan+Liu%2C+and+Maosong+Sun%2E+2024%2E+DebugBench%3A+Evaluating+Debugging+Capability+of+Large+Language+Models%2E+arXiv%3A2401%2E04621)
56. Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, and Guillaume Lample. 2023. [LLaMA: Open and Efficient Foundation Language Models](https://md.research.elamur.ai/free/en/papers/touvron-2023-llama-open-efficient-foundation-language/). arXiv:23…
57. Changjie Wang, Mariano Scazzariello, Anoud Alshnakat, Roberto Guanciale, Dejan Kostić, and Marco Chiesa. 2025. Dissect-and-Restore: AI-based Code Verification with Transient Refactoring. arXiv preprint arXiv:2510.25406 (2025). — [arXiv:2510.25406](https://arxiv.org/abs/2510.25406) [find](https://scholar.google.com/scholar?q=Changjie+Wang%2C+Mariano+Scazzariello%2C+Anoud+Alshnakat%2C+Roberto+Guanciale%2C+Dejan+Kosti%C4%87%2C+and+Marco+Chiesa%2E+2025%2E+Dissect%2Dand%2DRestore%3A+AI%2Dbased+Code+Verification+with+Transient+Refactoring%2E+arXiv+preprin)
58. Song Wang, Nishtha Shrestha, Abarna Kucheri Subburaman, Junjie Wang, Moshi Wei, and Nachiappan Nagappan. 2021. Automatic Unit Test Generation for Machine Learning Libraries: How Far Are We?. In 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). 1548–1560. doi:10.1109/ICSE439… — [doi:10.1109/icse43902](https://doi.org/10.1109/icse43902) [find](https://scholar.google.com/scholar?q=Song+Wang%2C+Nishtha+Shrestha%2C+Abarna+Kucheri+Subburaman%2C+Junjie+Wang%2C+Moshi+Wei%2C+and+Nachiappan+Nagappan%2E+2021%2E+Automatic+Unit+Test+Generation+for+Machine+Learning+Libraries%3A+How+Far+Are+We%3F%2E+In+2021+I)
59. Jiaxin Wen, Ruiqi Zhong, Pei Ke, Zhihong Shao, Hongning Wang, and Minlie Huang. 2024. Learning Task Decomposition to Assist Humans in Competitive Programming. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Lun-Wei Ku, Andre Martins… [find](https://scholar.google.com/scholar?q=Jiaxin+Wen%2C+Ruiqi+Zhong%2C+Pei+Ke%2C+Zhihong+Shao%2C+Hongning+Wang%2C+and+Minlie+Huang%2E+2024%2E+Learning+Task+Decomposition+to+Assist+Humans+in+Competitive+Programming%2E+In+Proceedings+of+the+62nd+Annual+Meeting)
60. S. N. Woodfield, H. E. Dunsmore, and V. Y. Shen. 1981. The Effect of Modularization and Comments on Program Comprehension. In Proceedings of the 5th International Conference on Software Engineering (ICSE ’81). IEEE Press, San Diego, California, USA, 215–223. [find](https://scholar.google.com/scholar?q=S%2E+N%2E+Woodfield%2C+H%2E+E%2E+Dunsmore%2C+and+V%2E+Y%2E+Shen%2E+1981%2E+The+Effect+of+Modularization+and+Comments+on+Program+Comprehension%2E+In+Proceedings+of+the+5th+International+Conference+on+Software+Engineering+%28I)
61. Chunqiu Steven Xia, Yuxiang Wei, and Lingming Zhang. 2023. Automated Program Repair in the Era of Large Pre-trained Language Models. In 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE). 1482– 1494. doi:10.1109/ICSE48619.2023.00129 — [doi:10.1109/icse48619.2023.00129](https://doi.org/10.1109/icse48619.2023.00129) [find](https://scholar.google.com/scholar?q=Chunqiu+Steven+Xia%2C+Yuxiang+Wei%2C+and+Lingming+Zhang%2E+2023%2E+Automated+Program+Repair+in+the+Era+of+Large+Pre%2Dtrained+Language+Models%2E+In+2023+IEEE%2FACM+45th+International+Conference+on+Software+Engineer)
62. Chunqiu Steven Xia and Lingming Zhang. 2024. Automated Program Repair via Conversation: Fixing 162 out of 337 Bugs for $0.42 Each Using ChatGPT. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis. ACM, Vienna Austria, 819–831. doi:10.1145/3650212.3680323 — [doi:10.1145/3650212.3680323](https://doi.org/10.1145/3650212.3680323) [find](https://scholar.google.com/scholar?q=Chunqiu+Steven+Xia+and+Lingming+Zhang%2E+2024%2E+Automated+Program+Repair+via+Conversation%3A+Fixing+162+out+of+337+Bugs+for+%240%2E42+Each+Using+ChatGPT%2E+In+Proceedings+of+the+33rd+ACM+SIGSOFT+International+Sy)
63. Qi Xin, Haojun Wu, Jinran Tang, Xinyu Liu, Steven P. Reiss, and Jifeng Xuan. 2024. Detecting, Creating, Repairing, and Understanding Indivisible Multi-Hunk Bugs. Reproduction Package for Article Detecting, Creating, Repairing, and Understanding Indivisible Multi-Hunk Bugs 1, FSE (July 2024), 121:274… [find](https://scholar.google.com/scholar?q=Qi+Xin%2C+Haojun+Wu%2C+Jinran+Tang%2C+Xinyu+Liu%2C+Steven+P%2E+Reiss%2C+and+Jifeng+Xuan%2E+2024%2E+Detecting%2C+Creating%2C+Repairing%2C+and+Understanding+Indivisible+Multi%2DHunk+Bugs%2E+Reproduction+Package+for+Article+Detec)
64. Michihiro Yasunaga and Percy Liang. 2021. Break-It-Fix-It: Unsupervised Learning for Program Repair. In Proceedings of the 38th International Conference on Machine Learning. PMLR, 11941–11952. [find](https://scholar.google.com/scholar?q=Michihiro+Yasunaga+and+Percy+Liang%2E+2021%2E+Break%2DIt%2DFix%2DIt%3A+Unsupervised+Learning+for+Program+Repair%2E+In+Proceedings+of+the+38th+International+Conference+on+Machine+Learning%2E+PMLR%2C+11941%E2%80%9311952%2E)
65. Xin Yin, Chao Ni, Shaohua Wang, Zhenhao Li, Limin Zeng, and Xiaohu Yang. 2024. ThinkRepair: Self-Directed Automated Program Repair. In Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2024). Association for Computing Machinery, New York, NY, USA, 12… — [doi:10.1145/3650212.3680359](https://doi.org/10.1145/3650212.3680359) [find](https://scholar.google.com/scholar?q=Xin+Yin%2C+Chao+Ni%2C+Shaohua+Wang%2C+Zhenhao+Li%2C+Limin+Zeng%2C+and+Xiaohu+Yang%2E+2024%2E+ThinkRepair%3A+Self%2DDirected+Automated+Program+Repair%2E+In+Proceedings+of+the+33rd+ACM+SIGSOFT+International+Symposium+on+So)
66. Eric Zelikman, Qian Huang, Gabriel Poesia, Noah Goodman, and Nick Haber. 2023. Parsel: Algorithmic Reasoning with Language Models by Composing Decompositions. In Thirty-Seventh Conference on Neural Information Processing Systems. [find](https://scholar.google.com/scholar?q=Eric+Zelikman%2C+Qian+Huang%2C+Gabriel+Poesia%2C+Noah+Goodman%2C+and+Nick+Haber%2E+2023%2E+Parsel%3A+Algorithmic+Reasoning+with+Language+Models+by+Composing+Decompositions%2E+In+Thirty%2DSeventh+Conference+on+Neural+In)
67. Andreas Zeller. 2009. Why Programs Fail: A Guide to Systematic Debugging. Morgan Kaufmann. [find](https://scholar.google.com/scholar?q=Andreas+Zeller%2E+2009%2E+Why+Programs+Fail%3A+A+Guide+to+Systematic+Debugging%2E+Morgan+Kaufmann%2E)
68. Kechi Zhang, Jia Li, Ge Li, Xianjie Shi, and Zhi Jin. 2024. [CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challenges](https://md.research.elamur.ai/free/en/papers/zhang-2024-codeagent-enhancing-code-generation-tool/). arXiv:2401.07339
69. Kechi Zhang, Zhuo Li, Jia Li, Ge Li, and Zhi Jin. 2023. Self-Edit: Fault-Aware Code Editor for Code Generation. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Toronto, Canada, 769–787. doi… [find](https://scholar.google.com/scholar?q=Kechi+Zhang%2C+Zhuo+Li%2C+Jia+Li%2C+Ge+Li%2C+and+Zhi+Jin%2E+2023%2E+Self%2DEdit%3A+Fault%2DAware+Code+Editor+for+Code+Generation%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Association+for+Computational+Linguisti)
70. Quanjun Zhang, Chunrong Fang, Tongke Zhang, Bowen Yu, Weisong Sun, and Zhenyu Chen. 2024. Gamma: Revisiting Template-based Automated Program Repair via Mask Prediction. In Proceedings of the 38th IEEE/ACM International Conference on Automated Software Engineering (ASE ’23). IEEE Press, Echternach, L… — [doi:10.1109/ase56229.2023.00063](https://doi.org/10.1109/ase56229.2023.00063) [find](https://scholar.google.com/scholar?q=Quanjun+Zhang%2C+Chunrong+Fang%2C+Tongke+Zhang%2C+Bowen+Yu%2C+Weisong+Sun%2C+and+Zhenyu+Chen%2E+2024%2E+Gamma%3A+Revisiting+Template%2Dbased+Automated+Program+Repair+via+Mask+Prediction%2E+In+Proceedings+of+the+38th+IEEE)
71. Shun Zhang, Zhenfang Chen, Yikang Shen, Mingyu Ding, Joshua B. Tenenbaum, and Chuang Gan. 2022. Planning with Large Language Models for Code Generation. In The Eleventh International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Shun+Zhang%2C+Zhenfang+Chen%2C+Yikang+Shen%2C+Mingyu+Ding%2C+Joshua+B%2E+Tenenbaum%2C+and+Chuang+Gan%2E+2022%2E+Planning+with+Large+Language+Models+for+Code+Generation%2E+In+The+Eleventh+International+Conference+on+Lea)
72. Yuwei Zhang, Zhi Jin, Ying Xing, Ge Li, Fang Liu, Jiaxin Zhu, Wensheng Dou, and Jun Wei. 2025. PATCH: Empowering Large Language Model with Programmer-Intent Guidance and Collaborative-Behavior Simulation for Automatic Bug Fixing. ACM Trans. Softw. Eng. Methodol. (Feb. 2025). doi:10.1145/3718739 — [doi:10.1145/3718739](https://doi.org/10.1145/3718739) [find](https://scholar.google.com/scholar?q=Yuwei+Zhang%2C+Zhi+Jin%2C+Ying+Xing%2C+Ge+Li%2C+Fang+Liu%2C+Jiaxin+Zhu%2C+Wensheng+Dou%2C+and+Jun+Wei%2E+2025%2E+PATCH%3A+Empowering+Large+Language+Model+with+Programmer%2DIntent+Guidance+and+Collaborative%2DBehavior+Simulat)
73. Tianyu Zheng, Ge Zhang, Tianhao Shen, Xueling Liu, Bill Yuchen Lin, Jie Fu, Wenhu Chen, and Xiang Yue. 2024. OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement. arXiv:2402.14658 doi:10.48550/arXiv. 2402.14658 [find](https://scholar.google.com/scholar?q=Tianyu+Zheng%2C+Ge+Zhang%2C+Tianhao+Shen%2C+Xueling+Liu%2C+Bill+Yuchen+Lin%2C+Jie+Fu%2C+Wenhu+Chen%2C+and+Xiang+Yue%2E+2024%2E+OpenCodeInterpreter%3A+Integrating+Code+Generation+with+Execution+and+Refinement%2E+arXiv%3A2402%2E)
74. Wenqing Zheng, S. P. Sharan, Ajay Kumar Jaiswal, Kevin Wang, Yihan Xi, Dejia Xu, and Zhangyang Wang. 2023. Outline, Then Details: Syntactically Guided Coarse-To-Fine Code Generation. In Proceedings of the 40th International Conference on Machine Learning. PMLR, 42403–42419. [find](https://scholar.google.com/scholar?q=Wenqing+Zheng%2C+S%2E+P%2E+Sharan%2C+Ajay+Kumar+Jaiswal%2C+Kevin+Wang%2C+Yihan+Xi%2C+Dejia+Xu%2C+and+Zhangyang+Wang%2E+2023%2E+Outline%2C+Then+Details%3A+Syntactically+Guided+Coarse%2DTo%2DFine+Code+Generation%2E+In+Proceedings+of)
75. Li Zhong, Zilong Wang, and Jingbo Shang. 2024. Debug like a Human: A Large Language Model Debugger via Verifying Runtime Execution Step by Step. In Findings of the Association for Computational Linguistics ACL 2024, Lun-Wei Ku, Andre Martins, and Vivek Srikumar (Eds.). Association for Computational… [find](https://scholar.google.com/scholar?q=Li+Zhong%2C+Zilong+Wang%2C+and+Jingbo+Shang%2E+2024%2E+Debug+like+a+Human%3A+A+Large+Language+Model+Debugger+via+Verifying+Runtime+Execution+Step+by+Step%2E+In+Findings+of+the+Association+for+Computational+Lingui)
76. Qihao Zhu, Zeyu Sun, Wenjie Zhang, Yingfei Xiong, and Lu Zhang. 2023. Tare: Type-Aware Neural Program Repair. In 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE). 1443–1455. doi:10.1109/ICSE48619.2023. 00126 — [doi:10.1109/icse48619.2023](https://doi.org/10.1109/icse48619.2023) [find](https://scholar.google.com/scholar?q=Qihao+Zhu%2C+Zeyu+Sun%2C+Wenjie+Zhang%2C+Yingfei+Xiong%2C+and+Lu+Zhang%2E+2023%2E+Tare%3A+Type%2DAware+Neural+Program+Repair%2E+In+2023+IEEE%2FACM+45th+International+Conference+on+Software+Engineering+%28ICSE%29%2E+1443%E2%80%931455%2E+)
77. Daniel M. Ziegler, Nisan Stiennon, Jeffrey Wu, Tom B. Brown, Alec Radford, Dario Amodei, Paul Christiano, and Geoffrey Irving. 2020. Fine-Tuning Language Models from Human Preferences. arXiv:1909.08593 [find](https://scholar.google.com/scholar?q=Daniel+M%2E+Ziegler%2C+Nisan+Stiennon%2C+Jeffrey+Wu%2C+Tom+B%2E+Brown%2C+Alec+Radford%2C+Dario+Amodei%2C+Paul+Christiano%2C+and+Geoffrey+Irving%2E+2020%2E+Fine%2DTuning+Language+Models+from+Human+Preferences%2E+arXiv%3A1909%2E0859)

*Updated 31 October 2026*