--- title: "Selected-Layer Codec Compression for Compact — Palomino 2026" description: "The paper addresses how to shrink a large audio-language model for English-to-Chinese speech translation without losing much translation quality." authors: ["Alonso Palomino"] year: 2026 venue: "Proceedings of the 23rd International Conference on Spoken Language Translation (IWSLT 2026)" source: "https://aclanthology.org/2026.iwslt-1.4/" doi: "10.18653/v1/2026.iwslt-1.4" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/papers/palomino-2026-selected-layer-codec-compression-compact/" --- [Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/palomino-2026-selected-layer-codec-compression-compact/) [home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2026](https://md.research.elamur.ai/free/papers/2026/page/4/) / Selected-Layer Codec Compression for Compact Speech Translation Models: An IWSLT 2026 English-to-Chinese Submission # Selected-Layer Codec Compression for Compact Speech Translation Models: An IWSLT 2026 English-to-Chinese Submission **Authors:** Alonso Palomino · **Year:** 2026 · **Venue:** Proceedings of the 23rd International Conference on Spoken Language Translation (IWSLT 2026) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/2026.iwslt-1.4/) · [PDF](https://aclanthology.org/2026.iwslt-1.4.pdf) · [DOI 10.18653/v1/2026.iwslt-1.4](https://doi.org/10.18653/v1/2026.iwslt-1.4) · [OpenAlex](https://openalex.org/W7166827838) **Citations:** 0 citations (openalex-snapshot · 2026-10-14) · 1 in our library, of the 140673 papers whose bibliographies we read ## Summary The paper addresses how to shrink a large audio-language model for English-to-Chinese speech translation without losing much translation quality. It is a submission to the constrained IWSLT 2026 Model Compression Shared Task, where only ACL60/60 data may be used. Using Qwen2-Audio-7B-Instruct as a fixed backbone, the author tests a post-hoc, training-free codec. Weights are first quantized, which is the lossy step, and then packed with lossless Zstandard coding. The codec is applied only to the feed-forward projections (gate_proj, up_proj, down_proj), and all other parts of the model stay intact. It is compared with FP16, bitsandbytes int8, a codec applied to every linear layer, and a pruning-plus-codec variant. All systems are scored with COMET on a 416-utterance local split. Limiting compression to the MLP layers keeps quality almost at the FP16 level, while compressing all layers clearly hurts it. The work shows that choosing which layers to compress matters more than how aggressively the whole model is compressed. This gives a cheap alternative to compression pipelines that depend on retraining. ## Key points - The FP16 baseline scores 0.7792 COMET at 14.436 GB. The selected-layer q3 + Zstd variant scores 0.7767 at 10.312 GB and was the primary submission. The selected-layer q2 + Zstd variant scores 0.7764 at 8.422 GB, which is the best trade-off. - Applying the global codec to all linear layers gives the smallest model (3.628 GB, ratio about 3.98×), but COMET drops to 0.7411. Selected-layer pruning plus codec performs worst, at 0.5871 COMET and 8.020 GB. - The bitsandbytes Int8 baseline keeps quality well (0.7752 COMET at 9.026 GB). However, it is much slower, at about 2.54 s per item compared with 0.66 s for FP16. - Evaluation uses Unbabel/wmt22-comet-da (unbabel-comet 2.2.2) with a fixed prompt and max_new_tokens=64, run on one RTX A6000 GPU. - The official ACL60/60 blind-test COMET for the primary run was 0.339. This was measured under different conditions from the local experiments, so the two results are not directly comparable. Code is available at github.com/alonsopg/iwslt-2026-model-compression. *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/) · [Machine translation](https://md.research.elamur.ai/free/shelves/machine-translation/) Topics: [Machine translation](https://md.research.elamur.ai/free/topics/machine-translation/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @inproceedings{palomino2026selected, title = {{Selected-Layer Codec Compression for Compact Speech Translation Models: An IWSLT 2026 English-to-Chinese Submission}}, author = {Palomino, Alonso}, booktitle = {Proceedings of the 23rd International Conference on Spoken Language Translation (IWSLT 2026)}, year = {2026}, doi = {10.18653/v1/2026.iwslt-1.4}, url = {https://doi.org/10.18653/v1/2026.iwslt-1.4} } ``` - [← previous SearchLLM: Detecting LLM Paraphrased Text by Measuring the Similarity with Regeneration of the Candidate Source via Search Engine](https://md.research.elamur.ai/free/papers/son-2026-searchllm-detecting-llm-paraphrased-text/) - [next → Sema System for the DMR 2026 Shared Task: Multistage UMR Parsing with Qwen3-4B](https://md.research.elamur.ai/free/papers/vergnette-2026-sema-system-dmr-2026-shared/) - [↑ back to papers of 2026](https://md.research.elamur.ai/free/papers/2026/page/4/) ## References 1 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. David Ifeoluwa Adelani, Antonios Anastasopoulos, Victor Agostinelli, Luisa Bentivogli, Ondřej Bojar, Sebastien Bratières, Marine Carpuat, Roldano Cattoni, Mauro Cettolo, Lizhong Chen, Marcello Federico, Marco Gaido, Mahendra Gupta, HyoJung Han, Ali Hatami, David Javorský, Yejin Jeon, Marek Kaszteln… [find](https://scholar.google.com/scholar?q=David+Ifeoluwa+Adelani%2C+Antonios+Anastasopoulos%2C+Victor+Agostinelli%2C+Luisa+Bentivogli%2C+Ondr%CC%8Cej+Bojar%2C+Sebastien+Brati%C3%A8res%2C+Marine+Carpuat%2C+Roldano+Cattoni%2C+Mauro+Cettolo%2C+Lizhong+Chen%2C+Marcello+Federi)