---
title: "The CUHKSZ System for the IWSLT 2026 Low-Resource — SUN 2026"
description: "Fine-tuning a single multilingual speech translation model on several low-resource languages at once often causes negative transfer: gradients from…"
authors: ["ruiyan SUN", "Qingming Li", "Satoshi Nakamura"]
year: 2026
venue: "Proceedings of the 23rd International Conference on Spoken Language Translation (IWSLT 2026)"
source: "https://aclanthology.org/2026.iwslt-1.33/"
doi: "10.18653/v1/2026.iwslt-1.33"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/sun-2026-cuhksz-system-iwslt-2026-low/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/sun-2026-cuhksz-system-iwslt-2026-low/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2026](https://md.research.elamur.ai/free/papers/2026/page/5/) / The CUHKSZ System for the IWSLT 2026 Low-Resource Speech-to-Text Task

# The CUHKSZ System for the IWSLT 2026 Low-Resource Speech-to-Text Task

**Authors:** ruiyan SUN, Qingming Li, [Satoshi Nakamura](https://md.research.elamur.ai/free/authors/satoshi-nakamura/) · **Year:** 2026 · **Venue:** Proceedings of the 23rd International Conference on Spoken Language Translation (IWSLT 2026) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.iwslt-1.33/) · [PDF](https://aclanthology.org/2026.iwslt-1.33.pdf) · [DOI 10.18653/v1/2026.iwslt-1.33](https://doi.org/10.18653/v1/2026.iwslt-1.33) · [OpenAlex](https://openalex.org/W7166859338)

**Citations:** 0 citations (openalex-snapshot · 2026-10-14) · 1 in our library, of the 140673 papers whose bibliographies we read

## Summary
Fine-tuning a single multilingual speech translation model on several low-resource languages at once often causes negative transfer: gradients from different languages push shared weights in opposite directions. For the IWSLT 2026 low-resource speech-to-text track, the CUHKSZ team (submitting as SLC) addresses this with Gradient-Driven Parameter Sharing (GDPS). Starting from SeamlessM4T-Medium, they measure per-language gradient statistics using three methods: pairwise cosine similarity with Ward clustering, a self-versus-cross conflict score, and joint SVD/CCA. These statistics determine how languages are grouped, how much capacity remains shared, and which layer to split. The analysis points to the FFN2 block of encoder Layer 11, which is rebuilt as one shared path plus group-specific private paths. Training adds curriculum distillation from SeamlessM4T-v2-Large, with pseudo-labels gradually mixed with reference data. At inference, outputs from multiple checkpoints are reranked using prior BLEU and self-consistency. Across eight languages, GDPS helps most where gradient conflict is strong (Bemba, Hausa), while the outlier Central Kurdish and Yoruba gain mainly from reranking. The work offers a data-driven alternative to hand-designed parameter sharing.

## Key points
- **Language setup:** The system covers 8 directions: six official IWSLT 2026 directions (bem, ckb, gle, hau, ibo, yor) plus aeb (IWSLT 2022) and est (LoResMT). All submissions use the unconstrained condition, with roughly 9k–20k lines of data per language.
- **Gradient analysis findings:**
  - Layer 11 FFN2 showed the highest cross-language subspace disagreement (0.174).
  - ckb is a clear outlier, with self-similarity of 0.509 versus about 0.21 for cross-language pairs.
  - The derived shared ratio was ρ=0.5, with K=3 groups for Medium and K=4 for LargeV2.
- **GDPS gains over unified fine-tuning (UFT-Med):** bem +2.07 BLEU, hau +1.50, ibo +0.38. GDPS-Med also had a slightly higher average COMET (0.573 vs. 0.568).
- **Distillation and reranking:**
  - The best curriculum stage mixes 50% pseudo-labeled and 50% reference data.
  - Prior-BLEU+Consensus reranking reached 14.85 average BLEU.
  - It lifted ckb from 8.38 to 20.26 and yor from 8.03 to 13.23.
- **Official blind test:** yor reached 11.7 spBLEU. The ckb result was withdrawn, which the authors attribute to a submission formatting error. Within-cluster gains were hard to predict, ranging from +1.50 to −0.40 BLEU in the Niger-Congo group.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/) · [Machine translation](https://md.research.elamur.ai/free/shelves/machine-translation/)

Topics: [Machine translation](https://md.research.elamur.ai/free/topics/machine-translation/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{sun2026cuhksz,
  title = {{The CUHKSZ System for the IWSLT 2026 Low-Resource Speech-to-Text Task}},
  author = {SUN, ruiyan and Li, Qingming and Nakamura, Satoshi},
  booktitle = {Proceedings of the 23rd International Conference on Spoken Language Translation (IWSLT 2026)},
  year = {2026},
  doi = {10.18653/v1/2026.iwslt-1.33},
  url = {https://doi.org/10.18653/v1/2026.iwslt-1.33}
}
```

- [← previous The acquisition of English irregular inflections by Yemeni L1 Arabic learners: A Universal Grammar approach](https://md.research.elamur.ai/free/papers/alsawsh-2026-acquisition-english-irregular-inflections-yemeni/)
- [next → The Evolution of Philosophy: A Metaphorical Cognition Perspective](https://md.research.elamur.ai/free/papers/mao-2026-evolution-philosophy-metaphorical-cognition-perspective/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/papers/2026/page/5/)

## References

23 references, 8 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. David Ifeoluwa Adelani, Victor Agostinelli, Antonios Anastasopoulos, Luisa Bentivogli, Ondřej Bojar, Sebastien Bratières, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, Lizhong Chen, Marcello Federico, Marco Gaido, Mahendra Gupta, HyoJung Han, Ali Hatami, David Javorský, Yejin Jeon, Marek Kaszteln… [find](https://scholar.google.com/scholar?q=David+Ifeoluwa+Adelani%2C+Victor+Agostinelli%2C+Antonios+Anastasopoulos%2C+Luisa+Bentivogli%2C+Ondr%CC%8Cej+Bojar%2C+Sebastien+Brati%C3%A8res%2C+Marine+Carpuat%2C+Roldano+Cattoni%2C+Mauro+Cettolo%2C+Lizhong+Chen%2C+Marcello+Federi)
2. Milind Agarwal, Sweta Agrawal, Antonios Anastasopoulos, Luisa Bentivogli, Ondřej Bojar, Claudia Borg, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, Mingda Chen, and 1 others. 2023. Findings of the IWSLT 2023 evaluation campaign. In Proceedings of the 20th International Conference on Spoken Langua… [find](https://scholar.google.com/scholar?q=Milind+Agarwal%2C+Sweta+Agrawal%2C+Antonios+Anastasopoulos%2C+Luisa+Bentivogli%2C+Ondr%CC%8Cej+Bojar%2C+Claudia+Borg%2C+Marine+Carpuat%2C+Roldano+Cattoni%2C+Mauro+Cettolo%2C+Mingda+Chen%2C+and+1+others%2E+2023%2E+Findings+of+the+) [our card](https://md.research.elamur.ai/free/papers/agarwal-2023-findings-iwslt-2023-evaluation-campaign/)
3. Antonios Anastasopoulos, Loïc Barrault, Luisa Bentivogli, Marcely Zanon Boito, Ondřej Bojar, Roldano Cattoni, Anna Currey, Georgiana Dinu, Kevin Duh, Maha Elbayad, and 1 others. 2022. Findings of the IWSLT 2022 evaluation campaign. In Proceedings of the 19th International Conference on Spoken Langu… [find](https://scholar.google.com/scholar?q=Antonios+Anastasopoulos%2C+Lo%C3%AFc+Barrault%2C+Luisa+Bentivogli%2C+Marcely+Zanon+Boito%2C+Ondr%CC%8Cej+Bojar%2C+Roldano+Cattoni%2C+Anna+Currey%2C+Georgiana+Dinu%2C+Kevin+Duh%2C+Maha+Elbayad%2C+and+1+others%2E+2022%2E+Findings+of+the) [our card](https://md.research.elamur.ai/free/papers/anastasopoulos-2022-findings-iwslt-2022-evaluation-campaign/)
4. Loïc Barrault, Yu-An Chung, Mariano Coria Meglioli, and 1 others. 2023a. Seamless: Multilingual expressive and streaming speech translation. arXiv preprint arXiv:2312.05187. [find](https://scholar.google.com/scholar?q=Lo%C3%AFc+Barrault%2C+Yu%2DAn+Chung%2C+Mariano+Coria+Meglioli%2C+and+1+others%2E+2023a%2E+Seamless%3A+Multilingual+expressive+and+streaming+speech+translation%2E+arXiv+preprint+arXiv%3A2312%2E05187%2E) [our card](https://md.research.elamur.ai/free/papers/communication-2023-seamless-multilingual-expressive-streaming-speech/)
5. Loïc Barrault, Yu-An Chung, Mariano Coria Meglioli, and 1 others. 2023b. Seamlessm4t: Massively multilingual & multimodal machine translation. arXiv preprint arXiv:2308.11596. [find](https://scholar.google.com/scholar?q=Lo%C3%AFc+Barrault%2C+Yu%2DAn+Chung%2C+Mariano+Coria+Meglioli%2C+and+1+others%2E+2023b%2E+Seamlessm4t%3A+Massively+multilingual+%26+multimodal+machine+translation%2E+arXiv+preprint+arXiv%3A2308%2E11596%2E) [our card](https://md.research.elamur.ai/free/papers/communication-2023-seamlessm4t-massively-multilingual-multimodal-machine/)
6. Konstantinos Bousmalis, George Trigeorgis, Nathan Silberman, Dilip Krishnan, and Dumitru Erhan. 2016. Domain separation networks. In Advances in neural information processing systems, pages 343–351. [find](https://scholar.google.com/scholar?q=Konstantinos+Bousmalis%2C+George+Trigeorgis%2C+Nathan+Silberman%2C+Dilip+Krishnan%2C+and+Dumitru+Erhan%2E+2016%2E+Domain+separation+networks%2E+In+Advances+in+neural+information+processing+systems%2C+pages+343%E2%80%93351%2E)
7. Xin Dong, Ruize Wu, Chao Xiong, Hai Li, Lei Cheng, Yong He, and 1 others. 2022. Gdod: Effective gradient descent using orthogonal decomposition for multi-task learning. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management, pages 386–395. [find](https://scholar.google.com/scholar?q=Xin+Dong%2C+Ruize+Wu%2C+Chao+Xiong%2C+Hai+Li%2C+Lei+Cheng%2C+Yong+He%2C+and+1+others%2E+2022%2E+Gdod%3A+Effective+gradient+descent+using+orthogonal+decomposition+for+multi%2Dtask+learning%2E+In+Proceedings+of+the+31st+ACM+)
8. Isaac Gerber. 2025. Attention is not all you need: The importance of feedforward networks in transformer models. arXiv preprint arXiv:2505.06633. — [arXiv:2505.06633](https://arxiv.org/abs/2505.06633) [find](https://scholar.google.com/scholar?q=Isaac+Gerber%2E+2025%2E+Attention+is+not+all+you+need%3A+The+importance+of+feedforward+networks+in+transformer+models%2E+arXiv+preprint+arXiv%3A2505%2E06633%2E+%E2%80%94+%5BarXiv%3A2505%2E06633%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2505%2E06633%29)
9. David R Hardoon, Sandor Szedmak, and John Shawe-Taylor. 2004. Canonical correlation analysis: An overview with application to learning methods. Neural computation, 16(12):2639–2664. [find](https://scholar.google.com/scholar?q=David+R+Hardoon%2C+Sandor+Szedmak%2C+and+John+Shawe%2DTaylor%2E+2004%2E+Canonical+correlation+analysis%3A+An+overview+with+application+to+learning+methods%2E+Neural+computation%2C+16%2812%29%3A2639%E2%80%932664%2E)
10. Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531. [find](https://scholar.google.com/scholar?q=Geoffrey+Hinton%2C+Oriol+Vinyals%2C+and+Jeff+Dean%2E+2015%2E+Distilling+the+knowledge+in+a+neural+network%2E+arXiv+preprint+arXiv%3A1503%2E02531%2E) [our card](https://md.research.elamur.ai/free/papers/hinton-2015-distilling-knowledge-neural-network/)
11. Nathaniel R. Robinson, Niyati Bafna, Xiluo He, Tom Lupicki, Lavanya Shankar, Cihan Xiao, Qi Sun, Kenton Murray, and David Yarowsky. 2025. [find](https://scholar.google.com/scholar?q=Nathaniel+R%2E+Robinson%2C+Niyati+Bafna%2C+Xiluo+He%2C+Tom+Lupicki%2C+Lavanya+Shankar%2C+Cihan+Xiao%2C+Qi+Sun%2C+Kenton+Murray%2C+and+David+Yarowsky%2E+2025%2E)
12. JHU IWSLT 2025 Low-resource System Description. In Proc. IWSLT. [find](https://scholar.google.com/scholar?q=JHU+IWSLT+2025+Low%2Dresource+System+Description%2E+In+Proc%2E+IWSLT%2E)
13. SEAMLESS Communication Team. 2025. Joint speech and text machine translation for up to 100 languages. Nature, 637:587–593. [find](https://scholar.google.com/scholar?q=SEAMLESS+Communication+Team%2E+2025%2E+Joint+speech+and+text+machine+translation+for+up+to+100+languages%2E+Nature%2C+637%3A587%E2%80%93593%2E)
14. Claytone Sikasote, Eunice Mukonde, Md Mahfuz Ibn Alam, and Antonios Anastasopoulos. 2023. BIGC: A Multimodal Multi-Purpose Dataset for Bemba. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2062–2078. [find](https://scholar.google.com/scholar?q=Claytone+Sikasote%2C+Eunice+Mukonde%2C+Md+Mahfuz+Ibn+Alam%2C+and+Antonios+Anastasopoulos%2E+2023%2E+BIGC%3A+A+Multimodal+Multi%2DPurpose+Dataset+for+Bemba%2E+In+Proceedings+of+the+61st+Annual+Meeting+of+the+Associati)
15. Tiia Sildam, Andra Velve, and Tanel Alumäe. 2024. Finetuning end-to-end models for Estonian conversational spoken language translation. In Proceedings of the Seventh Workshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT 2024), pages 166–174. [find](https://scholar.google.com/scholar?q=Tiia+Sildam%2C+Andra+Velve%2C+and+Tanel+Alum%C3%A4e%2E+2024%2E+Finetuning+end%2Dto%2Dend+models+for+Estonian+conversational+spoken+language+translation%2E+In+Proceedings+of+the+Seventh+Workshop+on+Technologies+for+Machi)
16. Ruiyan Sun and Satoshi Nakamura. 2026. Gradient-informed training for low-resource multilingual speech translation. arXiv preprint arXiv:2603.25836. — [arXiv:2603.25836](https://arxiv.org/abs/2603.25836) [find](https://scholar.google.com/scholar?q=Ruiyan+Sun+and+Satoshi+Nakamura%2E+2026%2E+Gradient%2Dinformed+training+for+low%2Dresource+multilingual+speech+translation%2E+arXiv+preprint+arXiv%3A2603%2E25836%2E+%E2%80%94+%5BarXiv%3A2603%2E25836%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2603%2E258)
17. Ziyu Yang, Guibin Chen, Yuxin Yang, Aoxiong Zeng, and Xiangquan Yang. 2026. Disentangling task conflicts in multi-task lora via orthogonal gradient projection. arXiv preprint arXiv:2601.09684. — [arXiv:2601.09684](https://arxiv.org/abs/2601.09684) [find](https://scholar.google.com/scholar?q=Ziyu+Yang%2C+Guibin+Chen%2C+Yuxin+Yang%2C+Aoxiong+Zeng%2C+and+Xiangquan+Yang%2E+2026%2E+Disentangling+task+conflicts+in+multi%2Dtask+lora+via+orthogonal+gradient+projection%2E+arXiv+preprint+arXiv%3A2601%2E09684%2E+%E2%80%94+%5BarXi)
18. Tianhe Yu, Saurabh Kumar, Abhishek Gupta, Sergey Levine, Karol Hausman, and Chelsea Finn. 2020. Gradient surgery for multi-task learning. In Advances in Neural Information Processing Systems, volume 33, pages 5824–5836. [find](https://scholar.google.com/scholar?q=Tianhe+Yu%2C+Saurabh+Kumar%2C+Abhishek+Gupta%2C+Sergey+Levine%2C+Karol+Hausman%2C+and+Chelsea+Finn%2E+2020%2E+Gradient+surgery+for+multi%2Dtask+learning%2E+In+Advances+in+Neural+Information+Processing+Systems%2C+volume+3) [our card](https://md.research.elamur.ai/free/papers/yu-2020-gradient-surgery-multi-task-learning/)
19. Shijie Zhu, Hui Zhao, Tianshu Wu, Pengjie Wang, Hongbo Deng, Jian Xu, and Bo Zheng. 2025. Gradient deconfliction via orthogonal projections onto subspaces for multi-task learning. In Proceedings of the 18th ACM International Conference on Web Search and Data Mining. [find](https://scholar.google.com/scholar?q=Shijie+Zhu%2C+Hui+Zhao%2C+Tianshu+Wu%2C+Pengjie+Wang%2C+Hongbo+Deng%2C+Jian+Xu%2C+and+Bo+Zheng%2E+2025%2E+Gradient+deconfliction+via+orthogonal+projections+onto+subspaces+for+multi%2Dtask+learning%2E+In+Proceedings+of+th)
20. Harold Hotelling. 1936. Relations between two sets of variates. Biometrika, 28(3/4):321–377. [find](https://scholar.google.com/scholar?q=Harold+Hotelling%2E+1936%2E+Relations+between+two+sets+of+variates%2E+Biometrika%2C+28%283%2F4%29%3A321%E2%80%93377%2E)
21. Chutong Meng and Antonios Anastasopoulos. 2025. GMU Systems for the IWSLT 2025 Low-Resource Speech Translation Shared Task. In Proc. IWSLT. [find](https://scholar.google.com/scholar?q=Chutong+Meng+and+Antonios+Anastasopoulos%2E+2025%2E+GMU+Systems+for+the+IWSLT+2025+Low%2DResource+Speech+Translation+Shared+Task%2E+In+Proc%2E+IWSLT%2E)
22. Maja Popović. 2015. chrf: character n-gram f-score for automatic mt evaluation. In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 392–395. [find](https://scholar.google.com/scholar?q=Maja+Popovic%CC%81%2E+2015%2E+chrf%3A+character+n%2Dgram+f%2Dscore+for+automatic+mt+evaluation%2E+In+Proceedings+of+the+Tenth+Workshop+on+Statistical+Machine+Translation%2C+pages+392%E2%80%93395%2E) [our card](https://md.research.elamur.ai/free/papers/popovic-2015-chrf-character-n-gram-f/)
23. Vineel Pratap, Andros Tjandra, Bowen Shi, Paden Tomasello, and 1 others. 2024. Scaling speech technology to 1,000+ languages. Journal of Machine Learning Research, 25:1–52. [find](https://scholar.google.com/scholar?q=Vineel+Pratap%2C+Andros+Tjandra%2C+Bowen+Shi%2C+Paden+Tomasello%2C+and+1+others%2E+2024%2E+Scaling+speech+technology+to+1%2C000%2B+languages%2E+Journal+of+Machine+Learning+Research%2C+25%3A1%E2%80%9352%2E) [our card](https://md.research.elamur.ai/free/papers/pratap-2023-scaling-speech-technology-1-000/)