---
title: "Dashboard2Code — paper by Niu et al. (2026)"
description: "This paper introduces Dashboard2Code, a task in which a model must explore a live dashboard on its own by clicking… 29 references."
authors: ["Tianhao Niu", "Ziyu Han", "Qiguang Chen", "Shiqi Zhou", "Baocai Shan", "Hengjie Fang", "Qingfu Zhu", "Wanxiang Che"]
year: 2026
venue: "Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/2026.acl-long.1750/"
doi: "10.18653/v1/2026.acl-long.1750"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/niu-2026-dashboard2code-evaluating-multimodal-models-reconstructing/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/niu-2026-dashboard2code-evaluating-multimodal-models-reconstructing/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/26/) / Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards

# Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards

**Authors:** Tianhao Niu, Ziyu Han, [Qiguang Chen](https://md.research.elamur.ai/free/en/authors/qiguang-chen/), Shiqi Zhou, [Baocai Shan](https://md.research.elamur.ai/free/en/authors/baocai-shan/), Hengjie Fang, [Qingfu Zhu](https://md.research.elamur.ai/free/en/authors/qingfu-zhu/) and [Wanxiang Che](https://md.research.elamur.ai/free/en/authors/wanxiang-che/) · **Year:** 2026 · **Venue:** [Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/acl/) ([ACL 2026](https://md.research.elamur.ai/free/en/venues/acl/2026/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.acl-long.1750/) · [PDF](https://aclanthology.org/2026.acl-long.1750.pdf) · [DOI 10.18653/v1/2026.acl-long.1750](https://doi.org/10.18653/v1/2026.acl-long.1750) · [OpenAlex](https://openalex.org/W7166868539)

**Citations:** 0 citations (OpenAlex, 2026-10-14)

## Summary
Most multimodal work on visualization-to-code targets static charts. Real data exploration, however, often happens in interactive dashboards. This paper introduces Dashboard2Code, a task in which a model must explore a live dashboard on its own by clicking, hovering, filtering or dragging. It collects screenshots and, optionally, DOM feedback, then writes code that reproduces both the look and the callback behaviour of the original. Unlike Interaction2Code or IWR-Bench, no human-annotated interaction trace is provided. To support the task, the authors build DashboardMimic, a Plotly+Dash benchmark that mixes curated real dashboards with LLM-generated ones. All examples are organized by a taxonomy of interaction logic and checked manually. Scoring is automatic and combines semantic analysis of the code with interaction-driven runtime tests. Its scores agree well with human ratings. Across open- and closed-source models, even the best system degrades sharply on the most complex dashboards, and open models trail closed ones considerably. The work therefore offers a testbed for agents that must explore an interface and then implement what they observed.

## Key points
- DashboardMimic contains 180 manually verified dashboard–code pairs. Of these, 58 are real examples from the Dash example index and 122 are synthetic. The synthetic ones were selected from roughly 500 drafts produced by Gemini, GPT and Claude generators.
- The benchmark spans 20 visualization types and 8 callback-logic patterns grouped into three complexity levels. The taxonomy was derived from 108 real dashboards, including 50 from DashGallery.
- The automated evaluation reaches a Pearson correlation of 0.78 with human judgments.
- Gemini 3 Pro performs best with 79.4 overall but drops to 64.2 on Complexity L3.
- Additional analyses report three findings:
  - Anonymizing visible layout text noticeably hurts callback reproduction.
  - Assigning exploration and coding to separate agents gives modest gains, for example Claude-4.5-Sonnet rising from 44.3 to 49.2.
  - Errors on L1/L2 are mostly transformation hallucinations, whereas L3 failures mainly involve misread inter-component dependencies.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

## Institutions

- [Harbin Institute of Technology](https://md.research.elamur.ai/free/en/universities/harbin-institute-of-technology/) — University, Harbin, China · 158 works · 28,841 citations

📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 16,667 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 16,194 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 16,039 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 15,891 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 2,869 works

🧭 Topics (1): [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 657 works

## Cite

Cite as: Tianhao Niu, Ziyu Han, Qiguang Chen, Shiqi Zhou, Baocai Shan, Hengjie Fang, Qingfu Zhu and Wanxiang Che. 2026. Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{niu2026dashboard2code,
  title = {{Dashboard2Code: Evaluating Multimodal Models on Reconstructing Interactive Dashboards}},
  author = {Tianhao Niu, Ziyu Han, Qiguang Chen, Shiqi Zhou, Baocai Shan, Hengjie Fang, Qingfu Zhu and Wanxiang Che},
  booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2026},
  doi = {10.18653/v1/2026.acl-long.1750},
  url = {https://doi.org/10.18653/v1/2026.acl-long.1750}
}
```

- [← previous DART: Mitigating Harm Drift in Difference-Aware LLMs via Distill-Audit-Repair Training](https://md.research.elamur.ai/free/en/papers/pan-2026-dart-mitigating-harm-drift-difference/)
- [next → Data Augmentation Based on Selective Masking of Language Models for One Health Context](https://md.research.elamur.ai/free/en/papers/mahdoubi-2026-data-augmentation-based-selective-masking/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/26/)

## References

29 references, 7 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Shuai Bai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Lianghao Deng, Wei Ding, Chang Gao, Chunjiang Ge, Wenbin Ge, Zhifang Guo, Qidong Huang, Jie Huang, Fei Huang, Binyuan Hui, Shutong Jiang, Zhaohai Li, Mingsheng Li, and 45 others. 2025. [Qwen3-vl technical report](https://md.research.elamur.ai/free/en/papers/bai-2025-qwen3-vl-technical-report/). Preprint, ar…
2. Yang Chen, Minghao Liu, Yufan Shen, Yunwen Li, Tianyuan Huang, Xinyu Fang, Tianyu Zheng, Wenxuan Huang, Cheng Yang, Daocheng Fu, Jianbiao Mei, Rong Wu, Yunfei Zhao, Licheng Wen, Xuemeng Yang, Song Mao, Qunshu Lin, Zhi Yu, Yongliang Shen, and 2 others. 2025. Iwr-bench: Can lvlms reconstruct interacti… — [arXiv:2509.24709](https://arxiv.org/abs/2509.24709) [find](https://scholar.google.com/scholar?q=Yang+Chen%2C+Minghao+Liu%2C+Yufan+Shen%2C+Yunwen+Li%2C+Tianyuan+Huang%2C+Xinyu+Fang%2C+Tianyu+Zheng%2C+Wenxuan+Huang%2C+Cheng+Yang%2C+Daocheng+Fu%2C+Jianbiao+Mei%2C+Rong+Wu%2C+Yunfei+Zhao%2C+Licheng+Wen%2C+Xuemeng+Yang%2C+Song+Mao)
3. Raymond Choi, Frank Burns, and Chase Lawrence. 2025. End-to-end chart summarization via visual chain-of-thought in vision-language models. Preprint, arXiv:2502.17589. — [arXiv:2502.17589](https://arxiv.org/abs/2502.17589) [find](https://scholar.google.com/scholar?q=Raymond+Choi%2C+Frank+Burns%2C+and+Chase+Lawrence%2E+2025%2E+End%2Dto%2Dend+chart+summarization+via+visual+chain%2Dof%2Dthought+in+vision%2Dlanguage+models%2E+Preprint%2C+arXiv%3A2502%2E17589%2E+%E2%80%94+%5BarXiv%3A2502%2E17589%5D%28https%3A%2F%2Farxi)
4. Aaryaman Kartha, Ahmed Masry, Mohammed Saidul Islam, Thinh Lang, Shadikur Rahman, Ridwan Mahbub, Mizanur Rahman, Mahir Ahmed, Md Rizwan Parvez, Enamul Hoque, and Shafiq Joty. 2025. Dashboardqa: Benchmarking multimodal agents for question answering on interactive dashboards. Preprint, arXiv:2508.1739… [find](https://scholar.google.com/scholar?q=Aaryaman+Kartha%2C+Ahmed+Masry%2C+Mohammed+Saidul+Islam%2C+Thinh+Lang%2C+Shadikur+Rahman%2C+Ridwan+Mahbub%2C+Mizanur+Rahman%2C+Mahir+Ahmed%2C+Md+Rizwan+Parvez%2C+Enamul+Hoque%2C+and+Shafiq+Joty%2E+2025%2E+Dashboardqa%3A+Benchm)
5. Kenton Lee, Mandar Joshi, Iulia Turc, Hexiang Hu, Fangyu Liu, Julian Eisenschlos, Urvashi Khandelwal, Peter Shaw, Ming-Wei Chang, and Kristina Toutanova. 2023. Pix2struct: Screenshot parsing as pretraining for visual language understanding. Preprint, arXiv:2210.03347. [find](https://scholar.google.com/scholar?q=Kenton+Lee%2C+Mandar+Joshi%2C+Iulia+Turc%2C+Hexiang+Hu%2C+Fangyu+Liu%2C+Julian+Eisenschlos%2C+Urvashi+Khandelwal%2C+Peter+Shaw%2C+Ming%2DWei+Chang%2C+and+Kristina+Toutanova%2E+2023%2E+Pix2struct%3A+Screenshot+parsing+as+pretra)
6. Ahmed Masry, Mohammed Saidul Islam, Mahir Ahmed, Aayush Bajaj, Firoz Kabir, Aaryaman Kartha, Md Tahmid Rahman Laskar, Mizanur Rahman, Shadikur Rahman, Mehrad Shahmohammadi, Megh Thakkar, Md Rizwan Parvez, Enamul Hoque, and Shafiq Joty. 2025. Chartqapro: A more diverse and challenging benchmark for c… [find](https://scholar.google.com/scholar?q=Ahmed+Masry%2C+Mohammed+Saidul+Islam%2C+Mahir+Ahmed%2C+Aayush+Bajaj%2C+Firoz+Kabir%2C+Aaryaman+Kartha%2C+Md+Tahmid+Rahman+Laskar%2C+Mizanur+Rahman%2C+Shadikur+Rahman%2C+Mehrad+Shahmohammadi%2C+Megh+Thakkar%2C+Md+Rizwan+Par)
7. Ahmed Masry, Do Xuan Long, Jia Qing Tan, Shafiq Joty, and Enamul Hoque. 2022. [Chartqa: A benchmark for question answering about charts with visual and logical reasoning](https://md.research.elamur.ai/free/en/papers/masry-2022-chartqa-benchmark-question-answering-about/). Preprint, arXiv:2203.10244.
8. Yuansheng Ni, Ping Nie, Kai Zou, Xiang Yue, and Wenhu Chen. 2025. VisCoder: Fine-tuning LLMs for executable python visualization code generation. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 2956–2983, Suzhou, China. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yuansheng+Ni%2C+Ping+Nie%2C+Kai+Zou%2C+Xiang+Yue%2C+and+Wenhu+Chen%2E+2025%2E+VisCoder%3A+Fine%2Dtuning+LLMs+for+executable+python+visualization+code+generation%2E+In+Findings+of+the+Association+for+Computational+Lingu)
9. Tianhao Niu, Yiming Cui, Baoxin Wang, Xiao Xu, Xin Yao, Qingfu Zhu, Dayong Wu, Shijin Wang, and Wanxiang Che. 2025. Chart2Code53: A large-scale diverse and complex dataset for enhancing chart-to-code generation. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processin… [find](https://scholar.google.com/scholar?q=Tianhao+Niu%2C+Yiming+Cui%2C+Baoxin+Wang%2C+Xiao+Xu%2C+Xin+Yao%2C+Qingfu+Zhu%2C+Dayong+Wu%2C+Shijin+Wang%2C+and+Wanxiang+Che%2E+2025%2E+Chart2Code53%3A+A+large%2Dscale+diverse+and+complex+dataset+for+enhancing+chart%2Dto%2Dcode+)
10. OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, and 262 others.… — [GPT-4 Technical Report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/)
11. Wei Pang, Kevin Qinghong Lin, Xiangru Jian, Xi He, and Philip Torr. 2025. Paper2poster: Towards multimodal poster automation from scientific papers. Preprint, arXiv:2505.21497. — [arXiv:2505.21497](https://arxiv.org/abs/2505.21497) [find](https://scholar.google.com/scholar?q=Wei+Pang%2C+Kevin+Qinghong+Lin%2C+Xiangru+Jian%2C+Xi+He%2C+and+Philip+Torr%2E+2025%2E+Paper2poster%3A+Towards+multimodal+poster+automation+from+scientific+papers%2E+Preprint%2C+arXiv%3A2505%2E21497%2E+%E2%80%94+%5BarXiv%3A2505%2E21497%5D%28ht)
12. Mizanur Rahman, Md Tahmid Rahman Laskar, Shafiq Joty, and Enamul Hoque. 2025. Text2Vis: A challenging and diverse benchmark for generating multimodal visualizations from text. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 31849–31874, Suzhou, China.… [find](https://scholar.google.com/scholar?q=Mizanur+Rahman%2C+Md+Tahmid+Rahman+Laskar%2C+Shafiq+Joty%2C+and+Enamul+Hoque%2E+2025%2E+Text2Vis%3A+A+challenging+and+diverse+benchmark+for+generating+multimodal+visualizations+from+text%2E+In+Proceedings+of+the+20)
13. Chenglei Si, Yanzhe Zhang, Ryan Li, Zhengyuan Yang, Ruibo Liu, and Diyi Yang. 2025. [Design2Code: Benchmarking multimodal code generation for automated front-end engineering](https://md.research.elamur.ai/free/en/papers/si-2025-design2code-benchmarking-multimodal-code-generation/). In Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics:…
14. Jiahao Tang, Henry Hengyuan Zhao, Lijian Wu, Yifei Tao, Dongxing Mao, Yang Wan, Jingru Tan, Min Zeng, Min Li, and Alex Jinpeng Wang. 2025a. [From charts to code: A hierarchical benchmark for multimodal models](https://md.research.elamur.ai/free/en/papers/tang-2026-charts-code-hierarchical-benchmark-multimodal/). Preprint, arXiv:2510.17932.
15. Wenxin Tang, Jingyu Xiao, Wenxuan Jiang, Xi Xiao, Yuhang Wang, Xuxin Tang, Qing Li, Yuehe Ma, Junliang Liu, Shisong Tang, and Michael R. Lyu. 2025b. [find](https://scholar.google.com/scholar?q=Wenxin+Tang%2C+Jingyu+Xiao%2C+Wenxuan+Jiang%2C+Xi+Xiao%2C+Yuhang+Wang%2C+Xuxin+Tang%2C+Qing+Li%2C+Yuehe+Ma%2C+Junliang+Liu%2C+Shisong+Tang%2C+and+Michael+R%2E+Lyu%2E+2025b%2E)
16. SlideCoder: Layout-aware RAG-enhanced hierarchical slide generation from design. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 9015–9039, Suzhou, China. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=SlideCoder%3A+Layout%2Daware+RAG%2Denhanced+hierarchical+slide+generation+from+design%2E+In+Proceedings+of+the+2025+Conference+on+Empirical+Methods+in+Natural+Language+Processing%2C+pages+9015%E2%80%939039%2C+Suzhou%2C+Chi)
17. Mingde Xu, Zhen Yang, Wenyi Hong, Lihang Pan, Xinyue Fan, Yan Wang, Xiaotao Gu, Bin Xu, and Jie Tang. 2025a. Webvia: A web-based vision-language agentic framework for interactive and verifiable ui-to-code generation. Preprint, arXiv:2511.06251. — [arXiv:2511.06251](https://arxiv.org/abs/2511.06251) [find](https://scholar.google.com/scholar?q=Mingde+Xu%2C+Zhen+Yang%2C+Wenyi+Hong%2C+Lihang+Pan%2C+Xinyue+Fan%2C+Yan+Wang%2C+Xiaotao+Gu%2C+Bin+Xu%2C+and+Jie+Tang%2E+2025a%2E+Webvia%3A+A+web%2Dbased+vision%2Dlanguage+agentic+framework+for+interactive+and+verifiable+ui%2Dto%2D)
18. Gemma Team, Aishwarya Kamath, Johan Ferret, Shreya Pathak, Nino Vieillard, Ramona Merhej, Sarah Perrin, Tatiana Matejovicova, Alexandre Ramé, Morgane Rivière, Louis Rouillard, Thomas Mesnard, Geoffrey Cideron, Jean bastien Grill, Sabela Ramos, Edouard Yvinec, Michelle Casbon, Etienne Pot, Ivo Penche… [find](https://scholar.google.com/scholar?q=Gemma+Team%2C+Aishwarya+Kamath%2C+Johan+Ferret%2C+Shreya+Pathak%2C+Nino+Vieillard%2C+Ramona+Merhej%2C+Sarah+Perrin%2C+Tatiana+Matejovicova%2C+Alexandre+Ram%C3%A9%2C+Morgane+Rivi%C3%A8re%2C+Louis+Rouillard%2C+Thomas+Mesnard%2C+Geoffrey)
19. Zhengzhuo Xu, Bowen Qu, Yiyan Qi, Sinan Du, Chengjin Xu, Chun Yuan, and Jian Guo. 2025b. Chartmoe: Mixture of diversely aligned expert connector for chart understanding. Preprint, arXiv:2409.03277. — [arXiv:2409.03277](https://arxiv.org/abs/2409.03277) [find](https://scholar.google.com/scholar?q=Zhengzhuo+Xu%2C+Bowen+Qu%2C+Yiyan+Qi%2C+Sinan+Du%2C+Chengjin+Xu%2C+Chun+Yuan%2C+and+Jian+Guo%2E+2025b%2E+Chartmoe%3A+Mixture+of+diversely+aligned+expert+connector+for+chart+understanding%2E+Preprint%2C+arXiv%3A2409%2E03277%2E+%E2%80%94+)
20. Weiyun Wang, Zhangwei Gao, Lixin Gu, Hengjun Pu, Long Cui, Xingguang Wei, Zhaoyang Liu, Linglin Jing, Shenglong Ye, Jie Shao, Zhaokai Wang, Zhe Chen, Hongjie Zhang, Ganlin Yang, Haomin Wang, Qi Wei, Jinhui Yin, Wenhao Li, Erfei Cui, and 56 others. 2025a. [Internvl3.5: Advancing open-source multimodal…](https://md.research.elamur.ai/free/en/papers/wang-2025-internvl3-5-advancing-open/)
21. Xuehui Wang, Zhenyu Wu, JingJing Xie, Zichen Ding, Bowen Yang, Zehao Li, Zhaoyang Liu, Qingyun Li, Xuan Dong, Zhe Chen, Weiyun Wang, Xiangyu Zhao, Jixuan Chen, Haodong Duan, Tianbao Xie, Chenyu Yang, Shiqian Su, Yue Yu, Yuan Huang, and 9 others. 2025b. Mmbench-gui: Hierarchical multi-platform evalua… — [arXiv:2507.19478](https://arxiv.org/abs/2507.19478) [find](https://scholar.google.com/scholar?q=Xuehui+Wang%2C+Zhenyu+Wu%2C+JingJing+Xie%2C+Zichen+Ding%2C+Bowen+Yang%2C+Zehao+Li%2C+Zhaoyang+Liu%2C+Qingyun+Li%2C+Xuan+Dong%2C+Zhe+Chen%2C+Weiyun+Wang%2C+Xiangyu+Zhao%2C+Jixuan+Chen%2C+Haodong+Duan%2C+Tianbao+Xie%2C+Chenyu+Yang%2C+)
22. Zirui Wang, Mengzhou Xia, Luxi He, Howard Chen, Yitao Liu, Richard Zhu, Kaiqu Liang, Xindi Wu, Haotian Liu, Sadhika Malladi, Alexis Chevalier, Sanjeev Arora, and Danqi Chen. 2024. Charxiv: Charting gaps in realistic chart understanding in multimodal llms. Preprint, arXiv:2406.18521. [find](https://scholar.google.com/scholar?q=Zirui+Wang%2C+Mengzhou+Xia%2C+Luxi+He%2C+Howard+Chen%2C+Yitao+Liu%2C+Richard+Zhu%2C+Kaiqu+Liang%2C+Xindi+Wu%2C+Haotian+Liu%2C+Sadhika+Malladi%2C+Alexis+Chevalier%2C+Sanjeev+Arora%2C+and+Danqi+Chen%2E+2024%2E+Charxiv%3A+Charting+ga)
23. Chengyue Wu, Zhixuan Liang, Yixiao Ge, Qiushan Guo, Zeyu Lu, Jiahao Wang, Ying Shan, and Ping Luo. 2025. Plot2Code: A comprehensive benchmark for evaluating multi-modal large language models in code generation from scientific plots. In Findings of the Association for Computational Linguistics: NAACL… [find](https://scholar.google.com/scholar?q=Chengyue+Wu%2C+Zhixuan+Liang%2C+Yixiao+Ge%2C+Qiushan+Guo%2C+Zeyu+Lu%2C+Jiahao+Wang%2C+Ying+Shan%2C+and+Ping+Luo%2E+2025%2E+Plot2Code%3A+A+comprehensive+benchmark+for+evaluating+multi%2Dmodal+large+language+models+in+code+g)
24. Jingyu Xiao, Yuxuan Wan, Yintong Huo, Zixin Wang, Xinyi Xu, Wenxuan Wang, Zhiyao Xu, Yuhang Wang, and Michael R. Lyu. 2025. Interaction2code: Benchmarking mllm-based interactive webpage code generation from interactive prototyping. Preprint, arXiv:2411.03292. — [arXiv:2411.03292](https://arxiv.org/abs/2411.03292) [find](https://scholar.google.com/scholar?q=Jingyu+Xiao%2C+Yuxuan+Wan%2C+Yintong+Huo%2C+Zixin+Wang%2C+Xinyi+Xu%2C+Wenxuan+Wang%2C+Zhiyao+Xu%2C+Yuhang+Wang%2C+and+Michael+R%2E+Lyu%2E+2025%2E+Interaction2code%3A+Benchmarking+mllm%2Dbased+interactive+webpage+code+generatio)
25. Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh Jing Hua, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, Yitao Liu, Yiheng Xu, Shuyan Zhou, Silvio Savarese, Caiming Xiong, Victor Zhong, and Tao Yu. 2024. [OSWorld: Benchmarking multimodal agents for open-ended tasks in…](https://md.research.elamur.ai/free/en/papers/xie-2024-osworld-benchmarking-multimodal-agents-open/)
26. Cheng Yang, Chufan Shi, Yaxin Liu, Bo Shui, Junjie Wang, Mohan Jing, Linran XU, Xinyu Zhu, Siheng Li, Yuxiang Zhang, Gongye Liu, Xiaomei Nie, Deng Cai, and Yujiu Yang. 2025. Chartmimic: Evaluating LMM’s cross-modal reasoning capability via chart-to-code generation. In The Thirteenth International Co… [find](https://scholar.google.com/scholar?q=Cheng+Yang%2C+Chufan+Shi%2C+Yaxin+Liu%2C+Bo+Shui%2C+Junjie+Wang%2C+Mohan+Jing%2C+Linran+XU%2C+Xinyu+Zhu%2C+Siheng+Li%2C+Yuxiang+Zhang%2C+Gongye+Liu%2C+Xiaomei+Nie%2C+Deng+Cai%2C+and+Yujiu+Yang%2E+2025%2E+Chartmimic%3A+Evaluating+LMM)
27. Zhengyuan Yang, Linjie Li, Jianfeng Wang, Kevin Lin, Ehsan Azarnasab, Faisal Ahmed, Zicheng Liu, Ce Liu, Michael Zeng, and Lijuan Wang. 2023. Mm-react: Prompting chatgpt for multimodal reasoning and action. Preprint, arXiv:2303.11381. [find](https://scholar.google.com/scholar?q=Zhengyuan+Yang%2C+Linjie+Li%2C+Jianfeng+Wang%2C+Kevin+Lin%2C+Ehsan+Azarnasab%2C+Faisal+Ahmed%2C+Zicheng+Liu%2C+Ce+Liu%2C+Michael+Zeng%2C+and+Lijuan+Wang%2E+2023%2E+Mm%2Dreact%3A+Prompting+chatgpt+for+multimodal+reasoning+and+a)
28. Sukmin Yun, Haokun Lin, Rusiru Thushara, Mohammad Qazim Bhat, Yongxin Wang, Zutao Jiang, Mingkai Deng, Jinhong Wang, Tianhua Tao, Junbo Li, Haonan Li, Preslav Nakov, Timothy Baldwin, Zhengzhong Liu, Eric P. Xing, Xiaodan Liang, and Zhiqiang Shen. 2024. Web2code: A large-scale webpage-to-code dataset… — [arXiv:2406.20098](https://arxiv.org/abs/2406.20098) [find](https://scholar.google.com/scholar?q=Sukmin+Yun%2C+Haokun+Lin%2C+Rusiru+Thushara%2C+Mohammad+Qazim+Bhat%2C+Yongxin+Wang%2C+Zutao+Jiang%2C+Mingkai+Deng%2C+Jinhong+Wang%2C+Tianhua+Tao%2C+Junbo+Li%2C+Haonan+Li%2C+Preslav+Nakov%2C+Timothy+Baldwin%2C+Zhengzhong+Liu%2C+E)
29. Xuanle Zhao, Xianzhen Luo, Qi Shi, Chi Chen, Shuo Wang, Zhiyuan Liu, and Maosong Sun. 2025. Chart-Coder: Advancing multimodal large language model for chart-to-code generation. In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7… [find](https://scholar.google.com/scholar?q=Xuanle+Zhao%2C+Xianzhen+Luo%2C+Qi+Shi%2C+Chi+Chen%2C+Shuo+Wang%2C+Zhiyuan+Liu%2C+and+Maosong+Sun%2E+2025%2E+Chart%2DCoder%3A+Advancing+multimodal+large+language+model+for+chart%2Dto%2Dcode+generation%2E+In+Proceedings+of+the+6)

*Updated 1 November 2026*