---
title: "Samuel Cahyawijaya — author profile and papers in our library"
description: "Samuel Cahyawijaya, Pelita Harapan University: 5 papers on Elamur Research (2020–2024), h-index 25 — affiliations, topics, co-authors and…"
canonical: "https://research.elamur.ai/free/en/authors/samuel-cahyawijaya/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/authors/samuel-cahyawijaya/)

[home](https://md.research.elamur.ai/free/en/) / [authors](https://md.research.elamur.ai/free/en/authors/) / Samuel Cahyawijaya

# Samuel Cahyawijaya

Samuel Cahyawijaya works in natural language processing, with a focus on how language technology is measured and how well it serves languages beyond English. The two papers here, from 2020 and 2023, both build evaluation resources. One gathers scattered datasets into a standard benchmark for a language with little prior infrastructure. The other designs reproducible tests for a conversational large language model. The work touches [Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/), [Multilingual & cross-lingual NLP](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/), [Reasoning](https://md.research.elamur.ai/free/en/topics/reasoning/) and [Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/).

The earlier paper, [IndoNLU](https://md.research.elamur.ai/free/en/papers/wilie-2020-indonlu-benchmark-resources-evaluating-indonesian/) (2020), responded to Indonesian datasets that were fragmented and hard to reproduce. It collected twelve existing datasets of formal and informal text, gave them fixed splits, and grouped them into four task families. It also introduced Indo4B, a cleaned pre-training corpus. The more recent and more widely cited paper, [A Multitask, Multilingual, Multimodal Evaluation of ChatGPT](https://md.research.elamur.ai/free/en/papers/bang-2023-multitask-multilingual-multimodal-evaluation-chatgpt/) (2023), turned to large language models. It tested a December 2022 version of ChatGPT in a zero-shot setting on 23 public datasets spanning eight task types, including translation, summarization, question answering and misinformation detection. It also examined multilingual coverage, reasoning, hallucination, and visual ability elicited through code generation.

Cahyawijaya is currently affiliated with the [Hong Kong University of Science and Technology](https://md.research.elamur.ai/free/en/universities/hong-kong-university-of-science-and-technology/), where most of the bylines fall from 2020 onward, and also with [AI Singapore](https://md.research.elamur.ai/free/en/government/ai-singapore/). Earlier papers list the [Bandung Institute of Technology](https://md.research.elamur.ai/free/en/universities/bandung-institute-of-technology/), and 2025 bylines include [Cohere](https://md.research.elamur.ai/free/en/companies/cohere/). Co-authors on the papers here include [Bryan Wilie](https://md.research.elamur.ai/free/en/authors/bryan-wilie/), who appears on both, along with [Pascale Fung](https://md.research.elamur.ai/free/en/authors/pascale-fung/), [Yejin Bang](https://md.research.elamur.ai/free/en/authors/yejin-bang/) and [Genta Indra Winata](https://md.research.elamur.ai/free/en/authors/genta-indra-winata/).

Samuel Cahyawijaya has 5 papers in our library, in 2020–2024, most of them on [Multilingual & cross-lingual NLP](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/), [Language models & pretraining](https://md.research.elamur.ai/free/en/topics/language-models/), [Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/); often with [Genta Indra Winata](https://md.research.elamur.ai/free/en/authors/genta-indra-winata/), [Pascale Fung](https://md.research.elamur.ai/free/en/authors/pascale-fung/), [Alham Fikri Aji](https://md.research.elamur.ai/free/en/authors/alham-fikri-aji/).

5 papers in our library · 2020–2024

[OpenAlex](https://openalex.org/A5084836777) · [**h-index 25**](https://openalex.org/authors/A5084836777) · [118 works](https://openalex.org/works?filter=author.id:A5084836777) · [3,804 citations](https://openalex.org/works?filter=author.id:A5084836777&sort=cited_by_count:desc) OpenAlex, 2026-10-14

[📄 5 works in our library](https://md.research.elamur.ai/free/en/authors/samuel-cahyawijaya/#papers) · [🔗 Cited 1,142 times in our library](https://md.research.elamur.ai/free/en/authors/samuel-cahyawijaya/cited-by/) · [9 more in our library without a page yet](#also) · [⭐ Paper Stars ranking: #1680](https://md.research.elamur.ai/free/en/paper-stars/page/17/#star-1680)

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: [Google Scholar](https://scholar.google.com/citations?view_op=search_authors&mauthors=Samuel+Cahyawijaya) · [Semantic Scholar](https://www.semanticscholar.org/search?q=Samuel+Cahyawijaya) · [dblp](https://dblp.org/search?q=Samuel+Cahyawijaya) · [ACL Anthology](https://aclanthology.org/search/?q=Samuel+Cahyawijaya)

## Affiliations

[🎓**Hong Kong University of Science and Technology** Hong Kong · China 2020–2025 · 98 papers*current*](https://md.research.elamur.ai/free/en/universities/hong-kong-university-of-science-and-technology/) · [🏛️**AI Singapore** Singapore · Singapore 2024–2025 · 2 papers*current*](https://md.research.elamur.ai/free/en/government/ai-singapore/) · [🎓**Pelita Harapan University** Tangerang · Indonesia 2025 · 1 paper*current*](https://ror.org/02qhjtc16) · [🏢**Cohere** San Francisco · United States 2025–2026 · 14 papers](https://md.research.elamur.ai/free/en/companies/cohere/) · [🎓**Bandung Institute of Technology** Bandung · Indonesia 2014–2018 · 3 papers](https://md.research.elamur.ai/free/en/universities/bandung-institute-of-technology/) · [🎓**Korea Advanced Institute of Science and Technology** Daejeon · South Korea 2022–2023 · 2 papers](https://md.research.elamur.ai/free/en/universities/korea-advanced-institute-of-science-and-technology/) · [🎓**Kumamoto University** Kumamoto · Japan 2022–2023 · 2 papers](https://ror.org/02cgss904) · [🎓**University of Tasmania** Hobart · Australia 2023 · 2 papers](https://ror.org/01nfmeh72)

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 2 more institutions on single bylines are not listed.

## Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 5 The field of science this work belongs to (OpenAlex fields).[Arts and Humanities · 5 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/) · [Computer Science · 5 works](https://md.research.elamur.ai/free/en/shelves/computer-science/) · [Artificial Intelligence · 5 works](https://md.research.elamur.ai/free/en/shelves/computer-science/artificial-intelligence/) · [Language and Linguistics · 5 works](https://md.research.elamur.ai/free/en/shelves/arts-and-humanities/language-and-linguistics/) · [Computer Vision and Pattern Recognition · 1 work](https://md.research.elamur.ai/free/en/shelves/computer-science/computer-vision-and-pattern-recognition/)

🧭 Topics 8 Research subjects and languages the work is about.[Evaluation & benchmarks · 2 works](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) · [Multilingual & cross-lingual NLP · 3 works](https://md.research.elamur.ai/free/en/topics/multilingual-nlp/) · [Language models & pretraining · 2 works](https://md.research.elamur.ai/free/en/topics/language-models/) · [Reasoning · 1 work](https://md.research.elamur.ai/free/en/topics/reasoning/) · [Vision & language · 1 work](https://md.research.elamur.ai/free/en/topics/multimodal/) · [Sentiment & emotion · 1 work](https://md.research.elamur.ai/free/en/topics/sentiment-emotion/) · [Grammatical error correction & learner language · 1 work](https://md.research.elamur.ai/free/en/topics/grammatical-error-correction/) · [Low-resource languages · 1 work](https://md.research.elamur.ai/free/en/topics/low-resource-languages/)

## Works by year

### 2020s

[**2024** 1 paper Samuel Cahyawijaya's papers of 2024](https://md.research.elamur.ai/free/en/papers/cahyawijaya-2024-llms-are-few-shot-context/) · [**2023** 3 papers Samuel Cahyawijaya's papers of 2023](https://md.research.elamur.ai/free/en/authors/samuel-cahyawijaya/year/2023/) · [**2020** 1 paper Samuel Cahyawijaya's papers of 2020](https://md.research.elamur.ai/free/en/papers/wilie-2020-indonlu-benchmark-resources-evaluating-indonesian/)

## Papers

The most cited first (OpenAlex and our library).

1. **[A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity](https://md.research.elamur.ai/free/en/papers/bang-2023-multitask-multilingual-multimodal-evaluation-chatgpt/)** *(2023 · 876 citations)* When ChatGPT appeared, its abilities were known mostly from anecdotes, and OpenAI had released no benchmark numbers.
2. **[IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding](https://md.research.elamur.ai/free/en/papers/wilie-2020-indonlu-benchmark-resources-evaluating-indonesian/)** *(2020 · 265 citations)* Indonesian has a very large online user base, but NLP work on it has advanced slowly. Datasets are scattered and poorly documented, and many studies omit code or test splits, so results cannot be reproduced. The authors respond with IndoNLU, the first Indonesian NLU benchmark. It gathers twelve existing datasets…
3. **[NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages](https://md.research.elamur.ai/free/en/papers/winata-2023-nusax-multilingual-parallel-sentiment-dataset/)** *(2023 · 130 citations)* Most of Indonesia's 700+ languages have almost no public NLP datasets or benchmarks, even when they have millions of speakers.
4. **[LLMs Are Few-Shot In-Context Low-Resource Language Learners](https://md.research.elamur.ai/free/en/papers/cahyawijaya-2024-llms-are-few-shot-context/)** *(2024 · 92 citations)* Large language models handle low-resource languages poorly, and adapting them through fine-tuning or adapters is expensive and can cause catastrophic forgetting.
5. **[Multilingual Large Language Models Are Not (Yet) Code-Switchers](https://md.research.elamur.ai/free/en/papers/zhang-2023-multilingual-large-language-models-are/)** *(2023 · 85 citations)* Code-switching (CSW), where speakers alternate between languages within a single utterance, is common in multilingual communities.

## All works

14 works of theirs in our library, the most cited first; 5 with a page here, the others link their original until we summarise them.

1. [**A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity arXiv:2302.04023**Yejin Bang, Samuel Cahyawijaya, Nayeon Lee, et al.*2023 · 876 citations*](https://md.research.elamur.ai/free/en/papers/bang-2023-multitask-multilingual-multimodal-evaluation-chatgpt/)
2. **[IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding](https://md.research.elamur.ai/free/en/papers/wilie-2020-indonlu-benchmark-resources-evaluating-indonesian/) [Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)](https://md.research.elamur.ai/free/en/venues/aacl/)**Bryan Wilie, Karissa Vincentio, Genta Indra Winata, et al.*2020 · 265 citations*
3. **[NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages](https://md.research.elamur.ai/free/en/papers/winata-2023-nusax-multilingual-parallel-sentiment-dataset/) [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/)**Genta Indra Winata, Alham Fikri Aji, Samuel Cahyawijaya, et al.*2023 · 130 citations*
4. **[LLMs Are Few-Shot In-Context Low-Resource Language Learners](https://md.research.elamur.ai/free/en/papers/cahyawijaya-2024-llms-are-few-shot-context/) [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/)**Samuel Cahyawijaya, Holy Lovenia, Pascale Fung*2024 · 92 citations*
5. **[CVQA: Culturally-diverse Multilingual Visual Question Answering Benchmark ↗](https://arxiv.org/abs/2406.05967) arXiv:2406.05967 · no summary yet**David Romero et al.*2024 · 87 citations*
6. **[Multilingual Large Language Models Are Not (Yet) Code-Switchers](https://md.research.elamur.ai/free/en/papers/zhang-2023-multilingual-large-language-models-are/) [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/)**Ruochen Zhang, Samuel Cahyawijaya, Jan Christian Blaise Cruz, et al.*2023 · 85 citations*
7. **[SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages ↗](https://aclanthology.org/2024.emnlp-main.296/) Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · no summary yet**Holy Lovenia et al.*2024 · 54 citations*
8. **[LLM Internal States Reveal Hallucination Risk Faced With a Query ↗](https://arxiv.org/abs/2407.03282) arXiv:2407.03282 · no summary yet**Ziwei Ji et al.*2024 · 51 citations*
9. **[Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages ↗](https://arxiv.org/abs/2303.13592) arXiv:2303.13592 · no summary yet**Zheng-Xin Yong et al.*2023 · 48 citations*
10. **[WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines ↗](https://aclanthology.org/2025.naacl-long.167/) Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers) · no summary yet**Genta Indra Winata et al.*2025 · 45 citations*
11. **[InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction Tuning ↗](https://arxiv.org/abs/2305.13627) arXiv:2305.13627 · no summary yet**Samuel Cahyawijaya et al.*2023 · 22 citations*
12. **[High-Dimensional Interlingual Representations of Large Language Models ↗](https://aclanthology.org/2025.sigtyp-1.14/) Proceedings of the 7th Workshop on Research in Computational Linguistic Typology and Multilingual NLP · no summary yet**Bryan Wilie et al.*2025 · 4 citations*
13. **[Lost in Simulation: LLM-Simulated Users are Unreliable Proxies for Human Users in Agentic Evaluations ↗](https://aclanthology.org/2026.acl-long.2192/) Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yet**Preethi Seshadri et al.*2026 · 2 citations*
14. **[ITLC at SemEval-2026 Task 11: Normalization and Deterministic Parsing for Formal Reasoning in LLMs ↗](https://aclanthology.org/2026.semeval-1.221/) Proceedings of the 20th International Workshop on Semantic Evaluation (2026) · no summary yet**Wicaksono Leksono Muhamad et al.*2026 · 1 citation*

## Co-authors here

12 of 16 co-authors with a page, the most papers together first.

- [Genta Indra Winata](https://md.research.elamur.ai/free/en/authors/genta-indra-winata/) ×3
- [Pascale Fung](https://md.research.elamur.ai/free/en/authors/pascale-fung/) ×3
- [Alham Fikri Aji](https://md.research.elamur.ai/free/en/authors/alham-fikri-aji/) ×2
- [Bryan Wilie](https://md.research.elamur.ai/free/en/authors/bryan-wilie/) ×2
- [Holy Lovenia](https://md.research.elamur.ai/free/en/authors/holy-lovenia/) ×2
- [Rahmad Mahendra](https://md.research.elamur.ai/free/en/authors/rahmad-mahendra/) ×2
- [Dan Su](https://md.research.elamur.ai/free/en/authors/dan-su/)
- [Fajri Koto](https://md.research.elamur.ai/free/en/authors/fajri-koto/)
- [Jey Han Lau](https://md.research.elamur.ai/free/en/authors/jey-han-lau/)
- [Nayeon Lee](https://md.research.elamur.ai/free/en/authors/nayeon-lee/)
- [Tiezheng Yu](https://md.research.elamur.ai/free/en/authors/tiezheng-yu/)
- [Timothy Baldwin](https://md.research.elamur.ai/free/en/authors/timothy-baldwin/)

## Venues

Where their works here were published, the most works first, with the editions of those that have a page.

- [Conference on Empirical Methods in Natural Language Processing (EMNLP)](https://md.research.elamur.ai/free/en/venues/emnlp/) ×2: [EMNLP 2023](https://md.research.elamur.ai/free/en/venues/emnlp/2023/)
- [Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL)](https://md.research.elamur.ai/free/en/venues/aacl/): [AACL 2020](https://md.research.elamur.ai/free/en/venues/aacl/2020/)
- [Conference of the European Chapter of the Association for Computational Linguistics (EACL)](https://md.research.elamur.ai/free/en/venues/eacl/): [EACL 2023](https://md.research.elamur.ai/free/en/venues/eacl/2023/)
- [Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)](https://md.research.elamur.ai/free/en/venues/naacl/): [NAACL 2024](https://md.research.elamur.ai/free/en/venues/naacl/2024/)
- [Northern European Journal of Language Technology](https://md.research.elamur.ai/free/en/venues/northern-european-journal-of-language-technology/)
- Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers)
- Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
- Proceedings of the 7th Workshop on Research in Computational Linguistic Typology and Multilingual NLP

## Cited by

Papers of our library cite their works 1,142 times (of the 141,840 papers whose bibliographies we read); [125 citing papers with a page here →](https://md.research.elamur.ai/free/en/authors/samuel-cahyawijaya/cited-by/).

Updated 24 October 2026