--- title: "WorldCuisines — paper by Winata et al. (2025)" description: "WorldCuisines tests this using food as a cultural proxy. 7 references, cited by 36 papers here." authors: ["Genta Indra Winata", "Frederikus Hudi", "Patrick Amadeus Irawan", "David Anugraha", "Rifki Afina Putri", "Wang Yutong", "Adam Nohejl", "Ubaidillah Ariq Prathama", "Nedjma Ousidhoum", "Afifa Amriani", "Anar Rzayev", "Anirban Das", "Ashmari Pramodya", "Aulia Adila", "Bryan Wilie", "Candy Olivia Mawalim", "Cheng Ching Lam", "Daud Abolade", "Emmanuele Chersoni", "Enrico Santus", "Fariz Ikhwantri", "Garry Kuwanto", "Hanyang Zhao", "Haryo Akbarianto Wibowo", "Holy Lovenia", "Jan Christian Blaise Cruz", "Jan Wira Gotama Putra", "Junho Myung", "Lucky Susanto", "Maria Angelica Riera Machin", "Marina Zhukova", "Michael Anugraha", "Muhammad Farid Adilazuarda", "Natasha Christabelle Santosa", "Peerat Limkonchotiwat", "Raj Dabre", "Rio Alexander Audino", "Samuel Cahyawijaya", "Shi-Xiong Zhang", "Stephanie Yulia Salim", "Yi Zhou", "Yinxuan Gui", "David Ifeoluwa Adelani", "En-Shiun Annie Lee", "Shogo Okada", "Ayu Purwarianti", "Alham Fikri Aji", "Taro Watanabe", "Derry Tanti Wijaya", "Alice Oh", "Chong-Wah Ngo"] year: 2025 venue: "Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)" source: "https://aclanthology.org/2025.naacl-long.167/" doi: "10.18653/v1/2025.naacl-long.167" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/winata-2025-worldcuisines-massive-scale-benchmark-multilingual/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/winata-2025-worldcuisines-massive-scale-benchmark-multilingual/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/) / WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines # WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines **Authors:** [Genta Indra Winata](https://md.research.elamur.ai/free/en/authors/genta-indra-winata/), [Frederikus Hudi](https://md.research.elamur.ai/free/en/authors/frederikus-hudi/), Patrick Amadeus Irawan, [David Anugraha](https://md.research.elamur.ai/free/en/authors/david-anugraha/), [Rifki Afina Putri](https://md.research.elamur.ai/free/en/authors/rifki-afina-putri/), Wang Yutong, [Adam Nohejl](https://md.research.elamur.ai/free/en/authors/adam-nohejl/), Ubaidillah Ariq Prathama, [Nedjma Ousidhoum](https://md.research.elamur.ai/free/en/authors/nedjma-ousidhoum/), Afifa Amriani, Anar Rzayev, Anirban Das, Ashmari Pramodya, Aulia Adila, [Bryan Wilie](https://md.research.elamur.ai/free/en/authors/bryan-wilie/), Candy Olivia Mawalim, Cheng Ching Lam, Daud Abolade, [Emmanuele Chersoni](https://md.research.elamur.ai/free/en/authors/emmanuele-chersoni/), [Enrico Santus](https://md.research.elamur.ai/free/en/authors/enrico-santus/), Fariz Ikhwantri, Garry Kuwanto, Hanyang Zhao, Haryo Akbarianto Wibowo, [Holy Lovenia](https://md.research.elamur.ai/free/en/authors/holy-lovenia/), [Jan Christian Blaise Cruz](https://md.research.elamur.ai/free/en/authors/jan-christian-blaise-cruz/), Jan Wira Gotama Putra, [Junho Myung](https://md.research.elamur.ai/free/en/authors/junho-myung/), Lucky Susanto, Maria Angelica Riera Machin, Marina Zhukova, Michael Anugraha, Muhammad Farid Adilazuarda, Natasha Christabelle Santosa, [Peerat Limkonchotiwat](https://md.research.elamur.ai/free/en/authors/peerat-limkonchotiwat/), [Raj Dabre](https://md.research.elamur.ai/free/en/authors/raj-dabre/), Rio Alexander Audino, [Samuel Cahyawijaya](https://md.research.elamur.ai/free/en/authors/samuel-cahyawijaya/), [Shi-Xiong Zhang](https://md.research.elamur.ai/free/en/authors/shi-xiong-zhang/), Stephanie Yulia Salim, [Yi Zhou](https://md.research.elamur.ai/free/en/authors/yi-zhou/), Yinxuan Gui, [David Ifeoluwa Adelani](https://md.research.elamur.ai/free/en/authors/david-ifeoluwa-adelani/), [En-Shiun Annie Lee](https://md.research.elamur.ai/free/en/authors/en-shiun-annie-lee/), Shogo Okada, Ayu Purwarianti, [Alham Fikri Aji](https://md.research.elamur.ai/free/en/authors/alham-fikri-aji/), [Taro Watanabe](https://md.research.elamur.ai/free/en/authors/taro-watanabe/), [Derry Tanti Wijaya](https://md.research.elamur.ai/free/en/authors/derry-tanti-wijaya/), [Alice Oh](https://md.research.elamur.ai/free/en/authors/alice-oh/) and Chong-Wah Ngo · **Year:** 2025 · **Venue:** [Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)](https://md.research.elamur.ai/free/en/venues/naacl/) ([NAACL 2025](https://md.research.elamur.ai/free/en/venues/naacl/2025/)) · **Publisher:** [Association for Computational Linguistics](https://md.research.elamur.ai/free/en/publishers/association-for-computational-linguistics/) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2025.naacl-long.167/) · [PDF](https://aclanthology.org/2025.naacl-long.167.pdf) · [DOI 10.18653/v1/2025.naacl-long.167](https://doi.org/10.18653/v1/2025.naacl-long.167) · [OpenAlex](https://openalex.org/W4411120481) **Citations:** 10 citations (OpenAlex, 2026-10-14) · [36](https://md.research.elamur.ai/free/en/papers/winata-2025-worldcuisines-massive-scale-benchmark-multilingual/cited-by/) in our library, of the 149,439 papers whose bibliographies we read ## Summary Vision Language Models (VLMs) often lack culture-specific knowledge, especially outside English and for underrepresented regions. WorldCuisines tests this using food as a cultural proxy. The authors built WC-KB, a knowledge base of culturally distinctive dishes drawn from Wikipedia, with openly licensed images from Wikimedia Commons and annotated metadata. From it they generated WC-VQA, a parallel visual question answering dataset whose question templates were translated by native speakers, including dialects and formal and casual registers. The benchmark has two tasks: naming a dish from its image, and identifying where it originates or is commonly eaten. The dish-naming task has three variants: no context, correct context, and misleading (adversarial) context. Answers are either multiple-choice or open-ended. Models do better when given the right location context but are easily misled by adversarial hints. They also struggle with specific regional cuisines and low-resource languages. The released data, code and leaderboard support culturally aware multilingual VLM evaluation. ## Key points - WC-VQA has over 1 million text-image pairs (about 1.15M in total) across 30 languages and dialects from 9 language families. The authors describe it as the largest multicultural VQA benchmark so far. - There are two evaluation splits (12k and 60k instances) and a training split of roughly 1M instances. Everything is released under CC BY-SA 4.0 on Hugging Face and GitHub. - WC-KB covers 2,414 dishes with 6,045 images from 189 countries, concentrated mostly in Asia, Europe and North America. It also includes 90 multilingual prompt templates and 401 parallel location and cuisine entries. - Among open-source models, Llama 3.2 Instruct performed best overall. NVLM-D trailed its base model, Qwen2 VL Instruct, possibly because NVLM is tuned heavily toward English. Larger models generally scored higher. - Known limitations: - Dishes come only from English Wikipedia. - Evaluation relies on accuracy and BERTScore, and the authors say metrics suited to multicultural VQA are still an open problem. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* ## Institutions - [Columbia University](https://md.research.elamur.ai/free/en/universities/columbia-university/) — University, New York, United States · 254 works · 56,747 citations - [Monash University](https://md.research.elamur.ai/free/en/universities/monash-university/) — University, Melbourne, Australia · 64 works · 54,972 citations - [Hong Kong Polytechnic University](https://md.research.elamur.ai/free/en/universities/hong-kong-polytechnic-university/) — University, Hong Kong, China · 106 works · 5,190 citations - [Canadian Institute for Advanced Research](https://md.research.elamur.ai/free/en/labs/canadian-institute-for-advanced-research/) — Research institute, Toronto, Canada · 35 works · 19,316 citations - [Korea Advanced Institute of Science and Technology](https://md.research.elamur.ai/free/en/universities/korea-advanced-institute-of-science-and-technology/) — University, Daejeon, South Korea · 56 works · 3,269 citations - [Tokyo Institute of Technology](https://md.research.elamur.ai/free/en/universities/tokyo-institute-of-technology/) — University, Tokyo, Japan · 23 works · 2,137 citations - [Cardiff University](https://md.research.elamur.ai/free/en/universities/cardiff-university/) — University, Cardiff, United Kingdom · 23 works · 2,549 citations - [Boston University](https://md.research.elamur.ai/free/en/universities/boston-university/) — University, Boston, United States · 30 works · 4,343 citations - [Japan Advanced Institute of Science and Technology](https://md.research.elamur.ai/free/en/universities/japan-advanced-institute-of-science-and-technology/) — University, Nomi Shi, Japan · 7 works · 980 citations - [Ontario Tech University](https://md.research.elamur.ai/free/en/universities/ontario-tech-university/) — University, Oshawa, Canada · 8 works · 1,554 citations - [AI Singapore](https://md.research.elamur.ai/free/en/government/ai-singapore/) — Government body, Singapore, Singapore · 5 works · 383 citations - [University of Lagos](https://md.research.elamur.ai/free/en/universities/university-of-lagos/) — University, Lagos, Nigeria · 3 works · 846 citations 📚 Shelves (5): [🖥️ Computer Science](https://md.research.elamur.ai/free/en/shelves/computer-science/) · 18,614 works · [🤖 Artificial Intelligence](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · 17,965 works · [🎭 Arts and Humanities](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · 17,450 works · [🗣️ Language and Linguistics](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · 17,296 works · [👁️ Computer Vision and Pattern Recognition](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/) · 3,486 works 🧭 Topics (4): [📏 Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · 1,341 works · [🌍 Multilingual & cross-lingual NLP](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · 882 works · [🖼️ Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/) · 811 works · [❓ Question answering](https://md.research.elamur.ai/free/en/topics/question-answering/) · 487 works ## Cite Cite as: Genta Indra Winata, Frederikus Hudi, Patrick Amadeus Irawan, David Anugraha, Rifki Afina Putri, Wang Yutong, Adam Nohejl, Ubaidillah Ariq Prathama, Nedjma Ousidhoum, Afifa Amriani, Anar Rzayev, Anirban Das, Ashmari Pramodya, Aulia Adila, Bryan Wilie, Candy Olivia Mawalim, Cheng Ching Lam, Daud Abolade, Emmanuele Chersoni, Enrico Santus, Fariz Ikhwantri, Garry Kuwanto, Hanyang Zhao, Haryo Akbarianto Wibowo, Holy Lovenia, Jan Christian Blaise Cruz, Jan Wira Gotama Putra, Junho Myung, Lucky Susanto, Maria Angelica Riera Machin, Marina Zhukova, Michael Anugraha, Muhammad Farid Adilazuarda, Natasha Christabelle Santosa, Peerat Limkonchotiwat, Raj Dabre, Rio Alexander Audino, Samuel Cahyawijaya, Shi-Xiong Zhang, Stephanie Yulia Salim, Yi Zhou, Yinxuan Gui, David Ifeoluwa Adelani, En-Shiun Annie Lee, Shogo Okada, Ayu Purwarianti, Alham Fikri Aji, Taro Watanabe, Derry Tanti Wijaya, Alice Oh and Chong-Wah Ngo. 2025. WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines. Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{winata2025worldcuisines, title = {{WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines}}, author = {Genta Indra Winata, Frederikus Hudi, Patrick Amadeus Irawan, David Anugraha, Rifki Afina Putri, Wang Yutong, Adam Nohejl, Ubaidillah Ariq Prathama, Nedjma Ousidhoum, Afifa Amriani, Anar Rzayev, Anirban Das, Ashmari Pramodya, Aulia Adila, Bryan Wilie, Candy Olivia Mawalim, Cheng Ching Lam, Daud Abolade, Emmanuele Chersoni, Enrico Santus, Fariz Ikhwantri, Garry Kuwanto, Hanyang Zhao, Haryo Akbarianto Wibowo, Holy Lovenia, Jan Christian Blaise Cruz, Jan Wira Gotama Putra, Junho Myung, Lucky Susanto, Maria Angelica Riera Machin, Marina Zhukova, Michael Anugraha, Muhammad Farid Adilazuarda, Natasha Christabelle Santosa, Peerat Limkonchotiwat, Raj Dabre, Rio Alexander Audino, Samuel Cahyawijaya, Shi-Xiong Zhang, Stephanie Yulia Salim, Yi Zhou, Yinxuan Gui, David Ifeoluwa Adelani, En-Shiun Annie Lee, Shogo Okada, Ayu Purwarianti, Alham Fikri Aji, Taro Watanabe, Derry Tanti Wijaya, Alice Oh and Chong-Wah Ngo}, booktitle = {Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)}, year = {2025}, doi = {10.18653/v1/2025.naacl-long.167}, url = {https://doi.org/10.18653/v1/2025.naacl-long.167} } ``` - [← previous NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Models](https://md.research.elamur.ai/free/en/papers/rao-2025-normad-framework-measuring-cultural-adaptability/) - [next → Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic Tools](https://md.research.elamur.ai/free/en/papers/wu-2025-agentic-reasoning-streamlined-framework-enhancing/) - [↑ back to papers of 2025](https://md.research.elamur.ai/free/en/papers/2025/page/3/) ## References 7 references, 4 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Marah Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, et al. 2024. [Phi-3 technical report: A highly capable language model locally on your phone](https://md.research.elamur.ai/free/en/papers/abdin-2024-phi-3-technical-report-highly/). arXiv preprint arXiv:2404.14219. 2. Marié Abe. 2013. Tokyo, japan. In The Ethnomusicolo-gists’ Cookbook, pages 40–45. Routledge. [find](https://scholar.google.com/scholar?q=Mari%C3%A9+Abe%2E+2013%2E+Tokyo%2C+japan%2E+In+The+Ethnomusicolo%2Dgists%E2%80%99+Cookbook%2C+pages+40%E2%80%9345%2E+Routledge%2E) 3. Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2023. [Gpt-4 technical report](https://md.research.elamur.ai/free/en/papers/openai-2023-gpt-4-technical-report/). arXiv preprint arXiv:2303.08774. 4. Muhammad Farid Adilazuarda, Sagnik Mukherjee, Pradhyumna Lavania, Siddhant Singh, Ashutosh Dwivedi, Alham Fikri Aji, Jacki O’Neill, Ashutosh Modi, and Monojit Choudhury. 2024. [Towards measuring and modeling" culture" in llms: A survey](https://md.research.elamur.ai/free/en/papers/adilazuarda-2024-measuring-modeling-culture-llms-survey/). arXiv preprint arXiv:2403.15412. 5. Pulkit Agarwal, Settaluri Sravanthi, and Pushpak Bhattacharyya. 2024. Indifoodvqa: Advancing visual question answering and reasoning with a knowledge-infused synthetic data generation pipeline. In Findings of the Association for Computational Linguistics: EACL 2024, pages 1158–1176. [find](https://scholar.google.com/scholar?q=Pulkit+Agarwal%2C+Settaluri+Sravanthi%2C+and+Pushpak+Bhattacharyya%2E+2024%2E+Indifoodvqa%3A+Advancing+visual+question+answering+and+reasoning+with+a+knowledge%2Dinfused+synthetic+data+generation+pipeline%2E+In+Fin) 6. Pravesh Agrawal, Szymon Antoniak, Emma Bou Hanna, Devendra Chaplot, Jessica Chudnovsky, Saurabh Garg, Theophile Gervet, Soham Ghosh, Amélie Héliou, Paul Jacob, et al. 2024. [Pixtral 12b](https://md.research.elamur.ai/free/en/papers/agrawal-2024-pixtral-12b/). arXiv preprint arXiv:2410.07073. 7. Gina M Almerico. 2014. Food and identity: Food studies, cultural, and personal identity. Journal of International Business and Cultural Studies, 8:1. \#\# Ethical Considerations [find](https://scholar.google.com/scholar?q=Gina+M+Almerico%2E+2014%2E+Food+and+identity%3A+Food+studies%2C+cultural%2C+and+personal+identity%2E+Journal+of+International+Business+and+Cultural+Studies%2C+8%3A1%2E+%5C%23%5C%23+Ethical+Considerations) *Updated 2 November 2026*