---
title: "Chain-of-Dictionary Prompting Elicits Translation in Large Language Models — Lu 2024"
description: "The authors propose CoD (Chain-of-Dictionary Prompting) to address this. 33 references, cited by 60 papers here."
authors: ["Hongyuan Lu", "Haoran Yang", "Haoyang Huang", "Dongdong Zhang", "Wai Lam", "Furu Wei"]
year: 2024
venue: "Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing"
source: "https://aclanthology.org/2024.emnlp-main.55/"
doi: "10.18653/v1/2024.emnlp-main.55"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/lu-2024-chain-dictionary-prompting-elicits-translation/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/lu-2024-chain-dictionary-prompting-elicits-translation/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2024](https://md.research.elamur.ai/free/en/papers/2024/page/3/) / Chain-of-Dictionary Prompting Elicits Translation in Large Language Models

# Chain-of-Dictionary Prompting Elicits Translation in Large Language Models

**Authors:** [Hongyuan Lu](https://md.research.elamur.ai/free/en/authors/hongyuan-lu/), Haoran Yang, [Haoyang Huang](https://md.research.elamur.ai/free/en/authors/haoyang-huang/), [Dongdong Zhang](https://md.research.elamur.ai/free/en/authors/dongdong-zhang/), [Wai Lam](https://md.research.elamur.ai/free/en/authors/wai-lam/) and [Furu Wei](https://md.research.elamur.ai/free/en/authors/furu-wei/) · **Year:** 2024 · **Venue:** Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2024.emnlp-main.55/) · [PDF](https://aclanthology.org/2024.emnlp-main.55.pdf) · [DOI 10.18653/v1/2024.emnlp-main.55](https://doi.org/10.18653/v1/2024.emnlp-main.55) · [OpenAlex](https://openalex.org/W4404783577)

**Citations:** 21 citations (OpenAlex, 2026-10-14) · [60](https://md.research.elamur.ai/free/en/papers/lu-2024-chain-dictionary-prompting-elicits-translation/cited-by/) in our library, of the 140,884 papers whose bibliographies we read

## Summary
Large language models translate fairly well without dedicated training, but they still handle low-resource languages poorly, often because they mistranslate rare words. The authors propose CoD (Chain-of-Dictionary Prompting) to address this. For a subset of words in the source sentence, CoD adds lexical hints to an ordinary zero-shot translation prompt. Each hint links the word to its equivalents in the target language and in three high-resource auxiliary languages: French, German and Portuguese. The dictionaries are built automatically. ChatGPT pulls out keywords from the input, and NLLB translates them. The approach is tested on FLORES-200 across translation directions between English and roughly 200 languages, using GPT-3.5-TURBO, text-davinci-003 and BLOOM-7b, with NLLB 3.3B as a reference system. CoD improves ChatGPT on most languages and sometimes recovers translation in directions where the model had nearly failed. It also outperforms bilingual hints, unchained (decomposed) hints and few-shot demonstrations for low-resource languages. This matters because dictionaries are far easier to obtain than parallel examples for under-resourced languages, Ukrainian-adjacent ones included.

## Key points
- The largest reported gain is about 13x in chrF++, from 3.08 to 42.63 for English→Serbian (Cyrillic) on the full FLORES-200 devtest set.
- Each prompt chains 5 languages: source, target, and fra_Latn, deu_Latn and por_Latn as auxiliaries.
- With CoD, ChatGPT clearly surpasses the SOTA translator NLLB 3.3B.
- Several design choices hurt quality:
  - splitting the chain into separate bilingual pairs;
  - shuffling dictionary entries out of source-word order;
  - choosing auxiliary languages similar to the target, for example ones written in the same script.
- The cost is up to 1.8x inference time and up to 3x prompt length. Dropping stopwords from the dictionary reduces this cost. Code and resources are released at github.com/HongyuanLuke/Chain-of-Dictionary.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

Topics: [🌱 Low-resource languages](https://md.research.elamur.ai/free/en/topics/low-resource-languages/)

## Institutions

- [Microsoft](https://md.research.elamur.ai/free/en/companies/microsoft/) — Company, Redmond, United States · 193 works · 110,465 citations
- [Chinese University of Hong Kong](https://md.research.elamur.ai/free/en/universities/chinese-university-of-hong-kong/) — University, Hong Kong, Hong Kong · 42 works · 11,333 citations

## Cite

Cite as: Hongyuan Lu, Haoran Yang, Haoyang Huang, Dongdong Zhang, Wai Lam and Furu Wei. 2024. Chain-of-Dictionary Prompting Elicits Translation in Large Language Models. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing.

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{lu2024chain,
  title = {{Chain-of-Dictionary Prompting Elicits Translation in Large Language Models}},
  author = {Hongyuan Lu, Haoran Yang, Haoyang Huang, Dongdong Zhang, Wai Lam and Furu Wei},
  booktitle = {Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing},
  year = {2024},
  doi = {10.18653/v1/2024.emnlp-main.55},
  url = {https://doi.org/10.18653/v1/2024.emnlp-main.55}
}
```

- [← previous Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation](https://md.research.elamur.ai/free/en/papers/kocmi-2024-error-span-annotation-balanced-approach/)
- [next → LAraBench: Benchmarking Arabic AI with Large Language Models](https://md.research.elamur.ai/free/en/papers/abdelali-2024-larabench-benchmarking-arabic-ai-large/)
- [↑ back to papers of 2024](https://md.research.elamur.ai/free/en/papers/2024/page/3/)

## References

33 references, 17 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Sweta Agrawal, Chunting Zhou, Mike Lewis, Luke Zettlemoyer, and Marjan Ghazvininejad. 2022. In-context Examples Selection for Machine Translation. arXiv e-prints, page arXiv:2212.02437. [our card](https://md.research.elamur.ai/free/en/papers/agrawal-2023-context-examples-selection-machine-translation/)
2. Philip Arthur, Graham Neubig, and Satoshi Nakamura. 2016. Incorporating discrete translation lexicons into neural machine translation. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1557–1567, Austin, Texas. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/arthur-2016-incorporating-discrete-translation-lexicons-into/)
3. Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chri… [our card](https://md.research.elamur.ai/free/en/papers/brown-2020-language-models-few-shot-learners/)
4. Guanhua Chen, Yun Chen, Yong Wang, and Victor O. K. Li. 2021. Lexical-constraint-aware neural machine translation via data augmentation. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI’20. [find](https://scholar.google.com/scholar?q=Guanhua+Chen%2C+Yun+Chen%2C+Yong+Wang%2C+and+Victor+O%2E+K%2E+Li%2E+2021%2E+Lexical%2Dconstraint%2Daware+neural+machine+translation+via+data+augmentation%2E+In+Proceedings+of+the+Twenty%2DNinth+International+Joint+Conferen)
5. Georgiana Dinu, Prashant Mathur, Marcello Federico, and Yaser Al-Onaizan. 2019. Training neural machine translation to apply terminology constraints. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pages 3063– 3068, Florence, Italy. Association for Computa… [our card](https://md.research.elamur.ai/free/en/papers/dinu-2019-training-neural-machine-translation-apply/)
6. Chris Dyer, Victor Chahuneau, and Noah A. Smith. 2013. A simple, fast, and effective reparameterization of IBM model 2. In Proceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 644–648, Atlanta, Georgia.… [find](https://scholar.google.com/scholar?q=Chris+Dyer%2C+Victor+Chahuneau%2C+and+Noah+A%2E+Smith%2E+2013%2E+A+simple%2C+fast%2C+and+effective+reparameterization+of+IBM+model+2%2E+In+Proceedings+of+the+2013+Conference+of+the+North+American+Chapter+of+the+Assoc)
7. Xavier Garcia and Orhan Firat. 2022. Using natural language prompts for machine translation. arXiv e-prints, page arXiv:2202.11822. — [arXiv:2202.11822](https://arxiv.org/abs/2202.11822) [find](https://scholar.google.com/scholar?q=Xavier+Garcia+and+Orhan+Firat%2E+2022%2E+Using+natural+language+prompts+for+machine+translation%2E+arXiv+e%2Dprints%2C+page+arXiv%3A2202%2E11822%2E+%E2%80%94+%5BarXiv%3A2202%2E11822%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F2202%2E11822%29)
8. Marjan Ghazvininejad, Hila Gonen, and Luke Zettlemoyer. 2023. Dictionary-based Phrase-level Prompting of Large Language Models for Machine Translation. arXiv e-prints, page arXiv:2302.07856. [our card](https://md.research.elamur.ai/free/en/papers/ghazvininejad-2023-dictionary-based-phrase-level-prompting/)
9. Mika Hämäläinen and Khalid Alnajjar. 2020. A template based approach for training nmt for low-resource uralic languages - a pilot with finnish. In Proceedings of the 2019 2nd International Conference on Algorithms, Computing and Artificial Intelligence, ACAI ’19, page 520–525, New York, NY, USA. Ass… [find](https://scholar.google.com/scholar?q=Mika+H%C3%A4m%C3%A4l%C3%A4inen+and+Khalid+Alnajjar%2E+2020%2E+A+template+based+approach+for+training+nmt+for+low%2Dresource+uralic+languages+%2D+a+pilot+with+finnish%2E+In+Proceedings+of+the+2019+2nd+International+Conference+)
10. Chris Hokamp and Qun Liu. 2017. Lexically constrained decoding for sequence generation using grid beam search. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1535–1546, Vancouver, Canada. Association for Computational Linguis… [our card](https://md.research.elamur.ai/free/en/papers/hokamp-2017-lexically-constrained-decoding-sequence-generation/)
11. Wenxiang Jiao, Jen-tse Huang, Wenxuan Wang, Zhiwei He, Tian Liang, Xing Wang, Shuming Shi, and Zhaopeng Tu. 2023. ParroT: Translating during chat using large language models tuned with human translation and feedback. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 150… [find](https://scholar.google.com/scholar?q=Wenxiang+Jiao%2C+Jen%2Dtse+Huang%2C+Wenxuan+Wang%2C+Zhiwei+He%2C+Tian+Liang%2C+Xing+Wang%2C+Shuming+Shi%2C+and+Zhaopeng+Tu%2E+2023%2E+ParroT%3A+Translating+during+chat+using+large+language+models+tuned+with+human+translati)
12. Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilić, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, Jonathan Tow, Alexander M. Rush, Stella Biderman, Albert Webson, Pawan Sasanka Ammanamanchi, Thomas Wang, Benoît Sagot, Niklas Muennigho… [find](https://scholar.google.com/scholar?q=Teven+Le+Scao%2C+Angela+Fan%2C+Christopher+Akiki%2C+Ellie+Pavlick%2C+Suzana+Ilic%CC%81%2C+Daniel+Hesslow%2C+Roman+Castagn%C3%A9%2C+Alexandra+Sasha+Luccioni%2C+Fran%C3%A7ois+Yvon%2C+Matthias+Gall%C3%A9%2C+Jonathan+Tow%2C+Alexander+M%2E+Rush%2C+Ste)
13. Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, Ramakanth Pasunuru, Sam Shleifer, Punit Singh Koura, Vishrav Chaudhary, Brian O’Horo, Jeff Wang, Luke Zettlemoyer, Zornitsa Kozareva, Mona Diab, Veselin Stoyano… [our card](https://md.research.elamur.ai/free/en/papers/lin-2021-few-shot-learning-multilingual-language/)
14. Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, and Luke Zettlemoyer. 2020. Multilingual denoising pre-training for neural machine translation. Transactions of the Association for Computational Linguistics, 8:726–742. [find](https://scholar.google.com/scholar?q=Yinhan+Liu%2C+Jiatao+Gu%2C+Naman+Goyal%2C+Xian+Li%2C+Sergey+Edunov%2C+Marjan+Ghazvininejad%2C+Mike+Lewis%2C+and+Luke+Zettlemoyer%2E+2020%2E+Multilingual+denoising+pre%2Dtraining+for+neural+machine+translation%2E+Transactio)
15. Hongyuan Lu, Haoyang Huang, Shuming Ma, Dongdong Zhang, Wai Lam, Zhaochuan Gao, Anthony Aue, Arul Menezes, and Furu Wei. 2023. TRIP: Accelerating document-level multilingual pre-training via triangular document-level pre-training on parallel data triplets. In Findings of the Association for Computat… [find](https://scholar.google.com/scholar?q=Hongyuan+Lu%2C+Haoyang+Huang%2C+Shuming+Ma%2C+Dongdong+Zhang%2C+Wai+Lam%2C+Zhaochuan+Gao%2C+Anthony+Aue%2C+Arul+Menezes%2C+and+Furu+Wei%2E+2023%2E+TRIP%3A+Accelerating+document%2Dlevel+multilingual+pre%2Dtraining+via+triangula)
16. Hongyuan Lu, Haoyang Huang, Dongdong Zhang, Furu Wei, and Wai Lam. 2024. Revamping multilingual agreement bidirectionally via switched back-translation for multilingual neural machine translation. In Findings of the Association for Computational Linguistics: EACL 2024, pages 264–275, St. Julian’s, M… [find](https://scholar.google.com/scholar?q=Hongyuan+Lu%2C+Haoyang+Huang%2C+Dongdong+Zhang%2C+Furu+Wei%2C+and+Wai+Lam%2E+2024%2E+Revamping+multilingual+agreement+bidirectionally+via+switched+back%2Dtranslation+for+multilingual+neural+machine+translation%2E+In+)
17. NLLB-Team. 2022. No language left behind: Scaling human-centered machine translation. [find](https://scholar.google.com/scholar?q=NLLB%2DTeam%2E+2022%2E+No+language+left+behind%3A+Scaling+human%2Dcentered+machine+translation%2E)
18. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pages 311–318, Philadelphia, Pennsylvania, USA. Association for Computational… [our card](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
19. Keqin Peng, Liang Ding, Qihuang Zhong, Li Shen, Xuebo Liu, Min Zhang, Yuanxin Ouyang, and Dacheng Tao. 2023. Towards Making the Most of ChatGPT for Machine Translation. arXiv e-prints, page arXiv:2303.13780. [our card](https://md.research.elamur.ai/free/en/papers/peng-2023-making-most-chatgpt-machine-translation/)
20. Maja Popović. 2015. chrF: character n-gram F-score for automatic MT evaluation. In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 392–395, Lisbon, Portugal. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/popovic-2015-chrf-character-n-gram-f/)
21. Matt Post and David Vilar. 2018. Fast lexically constrained decoding with dynamic beam allocation for neural machine translation. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers),… [our card](https://md.research.elamur.ai/free/en/papers/post-2018-fast-lexically-constrained-decoding-dynamic/)
22. Ricardo Rei, Craig Stewart, Ana C Farinha, and Alon Lavie. 2020. COMET: A neural framework for MT evaluation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 2685–2702, Online. Association for Computational Linguistics. [our card](https://md.research.elamur.ai/free/en/papers/rei-2020-comet-neural-framework-mt-evaluation/)
23. Laria Reynolds and Kyle McDonell. 2021. Prompt programming for large language models: Beyond the few-shot paradigm. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, CHI EA ’21, New York, NY, USA. Association for Computing Machinery. [our card](https://md.research.elamur.ai/free/en/papers/reynolds-2021-prompt-programming-large-language-models/)
24. Freda Shi, Xinyun Chen, Kanishka Misra, Nathan Scales, David Dohan, Ed Chi, Nathanael Schärli, and Denny Zhou. 2023. Large Language Models Can Be Easily Distracted by Irrelevant Context. arXiv e-prints, page arXiv:2302.00093. [our card](https://md.research.elamur.ai/free/en/papers/shi-2023-large-language-models-easily-distracted/)
25. Kai Song, Yue Zhang, Heng Yu, Weihua Luo, Kun Wang, and Min Zhang. 2019. Code-switching for enhancing NMT with pre-specified translation. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long… [find](https://scholar.google.com/scholar?q=Kai+Song%2C+Yue+Zhang%2C+Heng+Yu%2C+Weihua+Luo%2C+Kun+Wang%2C+and+Min+Zhang%2E+2019%2E+Code%2Dswitching+for+enhancing+NMT+with+pre%2Dspecified+translation%2E+In+Proceedings+of+the+2019+Conference+of+the+North+American+Ch)
26. Tianyi Tang, Hongyuan Lu, Yuchen Jiang, Haoyang Huang, Dongdong Zhang, Xin Zhao, Tom Kocmi, and Furu Wei. 2024. Not all metrics are guilty: Improving NLG evaluation by diversifying references. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Li… [find](https://scholar.google.com/scholar?q=Tianyi+Tang%2C+Hongyuan+Lu%2C+Yuchen+Jiang%2C+Haoyang+Huang%2C+Dongdong+Zhang%2C+Xin+Zhao%2C+Tom+Kocmi%2C+and+Furu+Wei%2E+2024%2E+Not+all+metrics+are+guilty%3A+Improving+NLG+evaluation+by+diversifying+references%2E+In+Proc)
27. David Vilar, Markus Freitag, Colin Cherry, Jiaming Luo, Viresh Ratnakar, and George Foster. 2022. Prompting PaLM for Translation: Assessing Strategies and Performance. arXiv e-prints, page arXiv:2211.09102. [find](https://scholar.google.com/scholar?q=David+Vilar%2C+Markus+Freitag%2C+Colin+Cherry%2C+Jiaming+Luo%2C+Viresh+Ratnakar%2C+and+George+Foster%2E+2022%2E+Prompting+PaLM+for+Translation%3A+Assessing+Strategies+and+Performance%2E+arXiv+e%2Dprints%2C+page+arXiv%3A2211%2E)
28. Jiaan Wang, Yunlong Liang, Fandong Meng, Haoxiang Shi, Zhixu Li, Jinan Xu, Jianfeng Qu, and Jie Zhou. 2023. Is ChatGPT a Good NLG Evaluator? A Preliminary Study. arXiv e-prints, page arXiv:2303.04048. [our card](https://md.research.elamur.ai/free/en/papers/wang-2023-chatgpt-good-nlg-evaluator-preliminary/)
29. Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, brian ichter, Fei Xia, Ed H. Chi, Quoc V Le, and Denny Zhou. 2022. Chain of thought prompting elicits reasoning in large language models. In Advances in Neural Information Processing Systems. [our card](https://md.research.elamur.ai/free/en/papers/wei-2022-chain-thought-prompting-elicits-reasoning/)
30. Jiajun Zhang and Chengqing Zong. 2016. Bridging Neural Machine Translation and Bilingual Dictionaries. arXiv e-prints, page arXiv:1610.07272. — [arXiv:1610.07272](https://arxiv.org/abs/1610.07272) [find](https://scholar.google.com/scholar?q=Jiajun+Zhang+and+Chengqing+Zong%2E+2016%2E+Bridging+Neural+Machine+Translation+and+Bilingual+Dictionaries%2E+arXiv+e%2Dprints%2C+page+arXiv%3A1610%2E07272%2E+%E2%80%94+%5BarXiv%3A1610%2E07272%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1610%2E07272%29)
31. Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, and Luke Zettlemoyer. 2022. OPT: Open Pre-trai… [our card](https://md.research.elamur.ai/free/en/papers/zhang-2022-opt-open-pre-trained-transformer/)
32. Tianyi Zhang*, Varsha Kishore*, Felix Wu*, Kilian Q. Weinberger, and Yoav Artzi. 2020. Bertscore: Evaluating text generation with bert. In International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Tianyi+Zhang%2A%2C+Varsha+Kishore%2A%2C+Felix+Wu%2A%2C+Kilian+Q%2E+Weinberger%2C+and+Yoav+Artzi%2E+2020%2E+Bertscore%3A+Evaluating+text+generation+with+bert%2E+In+International+Conference+on+Learning+Representations%2E)
33. Xin Zheng, Zhirui Zhang, Shujian Huang, Boxing Chen, Jun Xie, Weihua Luo, and Jiajun Chen. 2021. Non-parametric unsupervised domain adaptation for neural machine translation. In Findings of the Association for Computational Linguistics: EMNLP 2021, pages 4234–4241, Punta Cana, Dominican Republic. As… [find](https://scholar.google.com/scholar?q=Xin+Zheng%2C+Zhirui+Zhang%2C+Shujian+Huang%2C+Boxing+Chen%2C+Jun+Xie%2C+Weihua+Luo%2C+and+Jiajun+Chen%2E+2021%2E+Non%2Dparametric+unsupervised+domain+adaptation+for+neural+machine+translation%2E+In+Findings+of+the+Associ)
