--- title: "Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation — Pal 2023" description: "This report covers the WMT 2023 shared task on machine translation for low-resource languages of Northeast India. 6 references, cited by 30 papers here." authors: ["Santanu Pal", "Partha Pakray", "Sahinur Rahman Laskar", "Lenin Laitonjam", "Vanlalmuansangi Khenglawt", "Sunita Warjri", "Pankaj Kundan Dadure", "Sandeep Kumar Dash"] year: 2023 venue: "Proceedings of the Eighth Conference on Machine Translation" source: "https://aclanthology.org/2023.wmt-1.56/" doi: "10.18653/v1/2023.wmt-1.56" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/pal-2023-findings-wmt-2023-shared-task/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/pal-2023-findings-wmt-2023-shared-task/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2023](https://md.research.elamur.ai/free/en/papers/2023/page/6/) / Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation # Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation **Authors:** [Santanu Pal](https://md.research.elamur.ai/free/en/authors/santanu-pal/), [Partha Pakray](https://md.research.elamur.ai/free/en/authors/partha-pakray/), Sahinur Rahman Laskar, [Lenin Laitonjam](https://md.research.elamur.ai/free/en/authors/lenin-laitonjam/), Vanlalmuansangi Khenglawt, Sunita Warjri, Pankaj Kundan Dadure and [Sandeep Kumar Dash](https://md.research.elamur.ai/free/en/authors/sandeep-kumar-dash/) · **Year:** 2023 · **Venue:** Proceedings of the Eighth Conference on Machine Translation · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2023.wmt-1.56/) · [PDF](https://aclanthology.org/2023.wmt-1.56.pdf) · [DOI 10.18653/v1/2023.wmt-1.56](https://doi.org/10.18653/v1/2023.wmt-1.56) · [OpenAlex](https://openalex.org/W4389524233) **Citations:** 11 citations (OpenAlex, 2026-10-14) · [30](https://md.research.elamur.ai/free/en/papers/pal-2023-findings-wmt-2023-shared-task/cited-by/) in our library, of the 140,884 papers whose bibliographies we read ## Summary This report covers the WMT 2023 shared task on machine translation for low-resource languages of Northeast India. These languages have little digital text, and that shortage makes MT hard to build. Teams built systems translating between English and Assamese, Mizo, Khasi and Manipuri, in both directions. The organizers released IndicNE-Corp1.0, which combines parallel and monolingual corpora from their earlier projects. Sources include the Bible, the Xobdo and Glosbe dictionaries, PMIndia, news sites and blogs. Each team could enter one PRIMARY system per direction, trained without extra parallel data, plus up to two CONTRASTIVE runs. Outputs were scored with BLEU, TER, RIBES, COMET and ChrF, and experts also rated samples by hand. The best systems mostly fine-tuned pretrained multilingual models, such as IndicBART and IndicTrans2, or used denoising and data augmentation. Translating into English worked better than translating out of it, because the Indic languages are morphologically rich. The task matters because it provides a shared benchmark for languages from four language families that MT research has largely ignored. ## Key points - **Parallel data in IndicNE-Corp1.0 (train/validation/test):** - en–as: 50,000 / 2,000 / 2,000 - en–lus: 50,000 / 1,500 / 2,000 - en–kha: 24,000 / 1,000 / 1,000 - en–mni: 21,687 / 1,000 / 1,000 (Manipuri in Bengali script) - **Monolingual data:** about 2.62M Assamese sentences, 1.91M Mizo, 2.14M Manipuri and only 182,737 Khasi. - **Participation:** 31 teams registered, but only 9 submitted system description papers. Results from teams without a paper were left out of the report. - **Top BLEU by pair:** - IACS-LRILT (IndicBART): both en–as directions and mni→en - NICT-AI4B (IndicTrans2): both en–lus directions - IOL Research (T5/BART denoising plus augmentation): both en–kha directions - CUNI: en→mni - **Human evaluation:** experts rated 20 sentences per primary submission on a 0–5 scale for adequacy, fluency and an overall score. Fluency consistently scored higher than adequacy. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/) · [Machine translation](https://md.research.elamur.ai/free/en/shelves/machine-translation/) Topics: [🔁 Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/) · [🌱 Low-resource languages](https://md.research.elamur.ai/free/en/topics/low-resource-languages/) · [📏 Evaluation & benchmarks](https://md.research.elamur.ai/free/en/topics/evaluation-benchmarks/) ## Institutions - [National Institute Of Technology Silchar](https://md.research.elamur.ai/free/en/universities/national-institute-of-technology-silchar/) — University, Silchar, India · 2 works · 62 citations - [University of Petroleum and Energy Studies](https://md.research.elamur.ai/free/en/universities/university-of-petroleum-and-energy-studies/) — University, Dehradun, India · 2 works · 41 citations Also on the byline: [Mizoram University](https://ror.org/04b1m3e94) · [MIT World Peace University](https://ror.org/004ymxd45). ## Cite Cite as: Santanu Pal, Partha Pakray, Sahinur Rahman Laskar, Lenin Laitonjam, Vanlalmuansangi Khenglawt, Sunita Warjri, Pankaj Kundan Dadure and Sandeep Kumar Dash. 2023. Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation. Proceedings of the Eighth Conference on Machine Translation. The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{pal2023findings, title = {{Findings of the WMT 2023 Shared Task on Low-Resource Indic Language Translation}}, author = {Santanu Pal, Partha Pakray, Sahinur Rahman Laskar, Lenin Laitonjam, Vanlalmuansangi Khenglawt, Sunita Warjri, Pankaj Kundan Dadure and Sandeep Kumar Dash}, booktitle = {Proceedings of the Eighth Conference on Machine Translation}, year = {2023}, doi = {10.18653/v1/2023.wmt-1.56}, url = {https://doi.org/10.18653/v1/2023.wmt-1.56} } ``` - [← previous EPIC: Multi-Perspective Annotation of a Corpus of Irony](https://md.research.elamur.ai/free/en/papers/frenda-2023-epic-multi-perspective-annotation-corpus/) - [next → Automatic Evaluation and Analysis of Idioms in Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/baziotis-2023-automatic-evaluation-analysis-idioms-neural/) - [↑ back to papers of 2023](https://md.research.elamur.ai/free/en/papers/2023/page/6/) ## References 6 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Goutam Agrawal, Rituraj Das, Anupam Biswas, and Dalton Meitei Thounaojam. 2023. Neural machine translation for english - manipuri and english - assamese. [find](https://scholar.google.com/scholar?q=Goutam+Agrawal%2C+Rituraj+Das%2C+Anupam+Biswas%2C+and+Dalton+Meitei+Thounaojam%2E+2023%2E+Neural+machine+translation+for+english+%2D+manipuri+and+english+%2D+assamese%2E) 2. Mazida Ahmed, Kuwali Talukdar, Parvez Boruah, Shikhar Kumar Sarma, and Kishore Kashyap. 2023. Guit-nlp’s submission to shared task: Low resource indic language translation. [find](https://scholar.google.com/scholar?q=Mazida+Ahmed%2C+Kuwali+Talukdar%2C+Parvez+Boruah%2C+Shikhar+Kumar+Sarma%2C+and+Kishore+Kashyap%2E+2023%2E+Guit%2Dnlp%E2%80%99s+submission+to+shared+task%3A+Low+resource+indic+language+translation%2E) 3. Rupjyoti Baruah, Rajesh Kumar Mundotiya, and Anil Kumar Singh. 2021. Low resource neural machine translation: Assamese to/from other indo-aryan (indic) languages. ACM Trans. Asian Low-Resour. Lang. Inf. Process., 21(1). [find](https://scholar.google.com/scholar?q=Rupjyoti+Baruah%2C+Rajesh+Kumar+Mundotiya%2C+and+Anil+Kumar+Singh%2E+2021%2E+Low+resource+neural+machine+translation%3A+Assamese+to%2Ffrom+other+indo%2Daryan+%28indic%29+languages%2E+ACM+Trans%2E+Asian+Low%2DResour%2E+Lang%2E+In) 4. Raj Dabre, Jay Gala, and Pranjal Chitale. 2023. Nict-ai4b’s submission to the indic mt shared task in wmt 2023. [find](https://scholar.google.com/scholar?q=Raj+Dabre%2C+Jay+Gala%2C+and+Pranjal+Chitale%2E+2023%2E+Nict%2Dai4b%E2%80%99s+submission+to+the+indic+mt+shared+task+in+wmt+2023%2E) 5. Raj Dabre, Himani Shrotriya, Anoop Kunchukuttan, Ratish Puduppully, Mitesh Khapra, and Pratyush Kumar. 2022. IndicBART: A pre-trained model for indic natural language generation. In Findings of the Association for Computational Linguistics: ACL 2022, pages 1849–1863, Dublin, Ireland. Association for… [find](https://scholar.google.com/scholar?q=Raj+Dabre%2C+Himani+Shrotriya%2C+Anoop+Kunchukuttan%2C+Ratish+Puduppully%2C+Mitesh+Khapra%2C+and+Pratyush+Kumar%2E+2022%2E+IndicBART%3A+A+pre%2Dtrained+model+for+indic+natural+language+generation%2E+In+Findings+of+the+As) 6. Team Name IACS-LRILT CFILT-IITB NICT-AI4B IOL Research CUNI Organizer MUNI-NLP ATULYA-NITS GUIT-NLP Translation Type English-To-Assamese (Primary) English-To-Assamese (Contrastive-1) English-To-Assamese (Contrastive-2) Assamese-To-English (Primary) Assamese-To-English (Contrastive-1) Assamese-To-Eng… [find](https://scholar.google.com/scholar?q=Team+Name+IACS%2DLRILT+CFILT%2DIITB+NICT%2DAI4B+IOL+Research+CUNI+Organizer+MUNI%2DNLP+ATULYA%2DNITS+GUIT%2DNLP+Translation+Type+English%2DTo%2DAssamese+%28Primary%29+English%2DTo%2DAssamese+%28Contrastive%2D1%29+English%2DTo%2DAssame)