---
title: "Findings of the Second Shared Task on — Elliott 2017"
description: "Most image captioning research targets English. This WMT 2017 shared task tests how well systems can produce image descriptions in other languages. It…"
authors: ["Desmond Elliott", "Stella Frank", "Loïc Barrault", "Fethi Bougares", "Lucia Specia"]
year: 2017
venue: "Proceedings of the Second Conference on Machine Translation"
source: "https://aclanthology.org/W17-4718/"
doi: "10.18653/v1/w17-4718"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/elliott-2017-findings-second-shared-task-multimodal/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/elliott-2017-findings-second-shared-task-multimodal/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2017](https://md.research.elamur.ai/free/papers/2017/page/2/) / Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

# Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

**Authors:** [Desmond Elliott](https://md.research.elamur.ai/free/authors/desmond-elliott/), [Stella Frank](https://md.research.elamur.ai/free/authors/stella-frank/), [Loïc Barrault](https://md.research.elamur.ai/free/authors/loic-barrault/), [Fethi Bougares](https://md.research.elamur.ai/free/authors/fethi-bougares/), [Lucia Specia](https://md.research.elamur.ai/free/authors/lucia-specia/) · **Year:** 2017 · **Venue:** Proceedings of the Second Conference on Machine Translation · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/W17-4718/) · [PDF](https://aclanthology.org/W17-4718.pdf) · [DOI 10.18653/v1/w17-4718](https://doi.org/10.18653/v1/w17-4718) · [OpenAlex](https://openalex.org/W2758129972)

**Citations:** 25 citations (openalex-snapshot · 2026-10-14) · [108](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Most image captioning research targets English. This WMT 2017 shared task tests how well systems can produce image descriptions in other languages. It had two subtasks. In Task 1, systems translate an English caption into German or French with the image as extra context. In Task 2, systems must write a German description from the image alone, since no source caption is available at test time. The organisers added French crowdsourced translations to Multi30K, which makes the dataset aligned across three languages. They also built two new test sets: a fresh Multi30K 2017 split drawn from Flickr groups, and Ambiguous COCO, a small set of captions containing verbs whose sense the image may clarify. Nine teams sent 19 systems, and human judgements were collected for translation for the first time. Multimodal systems improved over 2016, but text-only models stayed close in performance. External data helped, especially for sentences with unknown words. Humans often favoured multimodal outputs that automatic metrics did not reward, so the organisers argue that future evaluation should rely on human judgement.

## Key points
- **French translations:** 12 crowdworkers produced the French translations of Multi30K, at an estimated cost of about €9,700. Their output differs from phrase-based MT suggestions at a TER of 0.41, so it was not simple post-editing.
- **Multi30K 2017 test:** 1,000 images for translation and 1,071 images (5,355 German descriptions) for description generation. Organisers also released ResNet-50 visual features ('res4 relu' and average-pooled).
- **Ambiguous COCO:** 461 captions covering 56 ambiguous verbs, derived from the VerSe dataset. Visual features gave mixed results on it, and the text-only NICT NMTrerank system placed in the top three for both target languages.
- **Out-of-vocabulary words:** 16% of 2017 test sentences contain an OOV word, compared with 1.7% in the earlier Flickr test. On these sentences, the unconstrained UvA-TiCC IMAGINATION system led all metrics.
- **Out-of-domain baseline:** A strong WMT'16 news-domain system (Sennrich et al.) landed mid-table (Meteor 49.9, BLEU 29.0). This shows that in-domain tuning still matters.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Machine translation](https://md.research.elamur.ai/free/shelves/machine-translation/) · [Natural language processing](https://md.research.elamur.ai/free/shelves/nlp/)

Topics: [Machine translation](https://md.research.elamur.ai/free/topics/machine-translation/)

## Cited by

Cited by

108 papers of our library cite it (of the 140673 whose bibliographies we read); 5 of them have a page here, 103 not yet.

- [Findings of the Third Shared Task on Multimodal Machine Translation](https://md.research.elamur.ai/free/papers/barrault-2018-findings-third-shared-task-multimodal/)
- [Findings of the 2017 Conference on Machine Translation (WMT17)](https://md.research.elamur.ai/free/papers/bojar-2017-findings-2017-conference-machine-translation/)
- [Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation](https://md.research.elamur.ai/free/papers/guo-2023-bridging-gap-between-synthetic-authentic/)
- [Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision](https://md.research.elamur.ai/free/papers/jia-2021-scaling-up-visual-vision-language/)
- [Extension Multi30K: Multimodal Dataset for Integrated Vision and Language Research in Ukrainian](https://md.research.elamur.ai/free/papers/saichyshyna-2023-extension-multi30k-multimodal-dataset-integrated/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{elliott2017findings,
  title = {{Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description}},
  author = {Elliott, Desmond and Frank, Stella and Barrault, Loïc and Bougares, Fethi and Specia, Lucia},
  booktitle = {Proceedings of the Second Conference on Machine Translation},
  year = {2017},
  doi = {10.18653/v1/w17-4718},
  url = {https://doi.org/10.18653/v1/w17-4718}
}
```

- [← previous Findings of the 2017 Conference on Machine Translation (WMT17)](https://md.research.elamur.ai/free/papers/bojar-2017-findings-2017-conference-machine-translation/)
- [next → Findings of the VarDial Evaluation Campaign 2017](https://md.research.elamur.ai/free/papers/zampieri-2017-findings-vardial-evaluation-campaign/)
- [↑ back to papers of 2017](https://md.research.elamur.ai/free/papers/2017/page/2/)

## References

52 references, 11 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proceedings of the International Conference on Learning Representations. [find](https://scholar.google.com/scholar?q=Dzmitry+Bahdanau%2C+Kyunghyun+Cho%2C+and+Yoshua+Bengio%2E+2015%2E+Neural+machine+translation+by+jointly+learning+to+align+and+translate%2E+In+Proceedings+of+the+International+Conference+on+Learning+Representati) [our card](https://md.research.elamur.ai/free/papers/bahdanau-2014-neural-machine-translation-jointly-learning/)
2. Raffaella Bernardi, Ruket Cakici, Desmond Elliott, Aykut Erdem, Erkut Erdem, Nazli Ikizler-Cinbis, Frank Keller, Adrian Muscat, and Barbara Plank. 2016. Automatic description generation from images: A survey of models, datasets, and evaluation measures. J. Artif. Intell. Res., 55:409–442. [find](https://scholar.google.com/scholar?q=Raffaella+Bernardi%2C+Ruket+Cakici%2C+Desmond+Elliott%2C+Aykut+Erdem%2C+Erkut+Erdem%2C+Nazli+Ikizler%2DCinbis%2C+Frank+Keller%2C+Adrian+Muscat%2C+and+Barbara+Plank%2E+2016%2E+Automatic+description+generation+from+images%3A+A)
3. Ozan Caglayan, Loı̈c Barrault, and Fethi Bougares. 2016. Multimodal attention for neural machine translation. CoRR, abs/1609.03976. — [arXiv:1609.03976](https://arxiv.org/abs/1609.03976) [find](https://scholar.google.com/scholar?q=Ozan+Caglayan%2C+Lo%C4%B1%CC%88c+Barrault%2C+and+Fethi+Bougares%2E+2016%2E+Multimodal+attention+for+neural+machine+translation%2E+CoRR%2C+abs%2F1609%2E03976%2E+%E2%80%94+%5BarXiv%3A1609%2E03976%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1609%2E03976%29)
4. Ozan Caglayan, Walid Aransa, Adrien Bardet, Mercedes Garcı́a-Martı́nez, Fethi Bougares, Loı̈c Barrault, Marc Masana, Luis Herranz, and Joost van de Weijer. 2017a. LIUM-CVC Submissions for WMT17 Multimodal Translation Task. In Proceedings of the Second Conference on Machine Translation, Volume 2: Sha… [find](https://scholar.google.com/scholar?q=Ozan+Caglayan%2C+Walid+Aransa%2C+Adrien+Bardet%2C+Mercedes+Garc%C4%B1%CC%81a%2DMart%C4%B1%CC%81nez%2C+Fethi+Bougares%2C+Lo%C4%B1%CC%88c+Barrault%2C+Marc+Masana%2C+Luis+Herranz%2C+and+Joost+van+de+Weijer%2E+2017a%2E+LIUM%2DCVC+Submissions+for+WMT17+Multim)
5. Ozan Caglayan, Mercedes Garcı́a-Martı́nez, Adrien Bardet, Walid. Aransa, Fethi. Bougares, and Loı̈c Barrault. 2017b. NMTPY: A Flexible Toolkit for Advanced Neural Machine Translation Systems. CoRR, 1706.00457. [find](https://scholar.google.com/scholar?q=Ozan+Caglayan%2C+Mercedes+Garc%C4%B1%CC%81a%2DMart%C4%B1%CC%81nez%2C+Adrien+Bardet%2C+Walid%2E+Aransa%2C+Fethi%2E+Bougares%2C+and+Lo%C4%B1%CC%88c+Barrault%2E+2017b%2E+NMTPY%3A+A+Flexible+Toolkit+for+Advanced+Neural+Machine+Translation+Systems%2E+CoRR%2C+17)
6. Iacer Calixto, Koel Dutta Chowdhury, and Qun Liu. 2017a. DCU System Report on the WMT 2017 Multi-modal Machine Translation Task. In Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, pages 440–444. [find](https://scholar.google.com/scholar?q=Iacer+Calixto%2C+Koel+Dutta+Chowdhury%2C+and+Qun+Liu%2E+2017a%2E+DCU+System+Report+on+the+WMT+2017+Multi%2Dmodal+Machine+Translation+Task%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Volume+)
7. Iacer Calixto, Qun Liu, and Nick Campbell. 2017b. Incorporating Global Visual Features into Attention-Based Neural Machine Translation. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. \#\# Acknowledgements Xinlei Chen, Hao Fang, Tsung-Yi Lin, Ramakrishna Veda… [find](https://scholar.google.com/scholar?q=Iacer+Calixto%2C+Qun+Liu%2C+and+Nick+Campbell%2E+2017b%2E+Incorporating+Global+Visual+Features+into+Attention%2DBased+Neural+Machine+Translation%2E+In+Proceedings+of+the+2017+Conference+on+Empirical+Methods+in+Na) [our card](https://md.research.elamur.ai/free/papers/chen-2015-microsoft-coco-captions-data-collection/)
8. This work was supported by the CHIST-ERA M2CR project (French National Research Agency Jonathan H Clark, Chris Dyer, Alon Lavie, and Noah A Smith. 2011. Better hypothesis testing for statistical machine translation: Controlling for optimizer instability. In 49th Annual Meeting of the Association for… [find](https://scholar.google.com/scholar?q=This+work+was+supported+by+the+CHIST%2DERA+M2CR+project+%28French+National+Research+Agency+Jonathan+H+Clark%2C+Chris+Dyer%2C+Alon+Lavie%2C+and+Noah+A+Smith%2E+2011%2E+Better+hypothesis+testing+for+statistical+machi)
9. Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In IEEE Conference on Computer Vision and Pattern Recognition, pages 770–778. [find](https://scholar.google.com/scholar?q=Kaiming+He%2C+Xiangyu+Zhang%2C+Shaoqing+Ren%2C+and+Jian+Sun%2E+2016%2E+Deep+residual+learning+for+image+recognition%2E+In+IEEE+Conference+on+Computer+Vision+and+Pattern+Recognition%2C+pages+770%E2%80%93778%2E)
10. Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. ImageNet: A Large-Scale Hierarchical Image Database. In IEEE Conference on Computer Vision and Pattern Recognition. [find](https://scholar.google.com/scholar?q=Jia+Deng%2C+Wei+Dong%2C+Richard+Socher%2C+Li%2DJia+Li%2C+Kai+Li%2C+and+Li+Fei%2DFei%2E+2009%2E+ImageNet%3A+A+Large%2DScale+Hierarchical+Image+Database%2E+In+IEEE+Conference+on+Computer+Vision+and+Pattern+Recognition%2E)
11. Jindřich Helcl and Jindřich Libovický. 2017. CUNI System for the WMT17 Multimodal Translation Task. In Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, pages 450–457. [find](https://scholar.google.com/scholar?q=Jindr%CC%8Cich+Helcl+and+Jindr%CC%8Cich+Libovicky%CC%81%2E+2017%2E+CUNI+System+for+the+WMT17+Multimodal+Translation+Task%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Volume+2%3A+Shared+Task+Papers%2C+pag)
12. Michael Denkowski and Alon Lavie. 2014. Meteor universal: Language specific translation evaluation for any target language. In EACL 2014 Workshop on Statistical Machine Translation. [find](https://scholar.google.com/scholar?q=Michael+Denkowski+and+Alon+Lavie%2E+2014%2E+Meteor+universal%3A+Language+specific+translation+evaluation+for+any+target+language%2E+In+EACL+2014+Workshop+on+Statistical+Machine+Translation%2E) [our card](https://md.research.elamur.ai/free/papers/denkowski-2014-meteor-universal-language-specific-translation/)
13. John Duselis, Michael Hutt, Jeremy Gwinnup, James Davis, and Joshua Sandvick. 2017. The AFRL-OSU WMT17 Multimodal Translation System: An Image Processing Approach. In Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, pages 445–449. [find](https://scholar.google.com/scholar?q=John+Duselis%2C+Michael+Hutt%2C+Jeremy+Gwinnup%2C+James+Davis%2C+and+Joshua+Sandvick%2E+2017%2E+The+AFRL%2DOSU+WMT17+Multimodal+Translation+System%3A+An+Image+Processing+Approach%2E+In+Proceedings+of+the+Second+Confere)
14. Desmond Elliott and Ákos Kádár. 2017. nation improves Multimodal Translation. abs/1705.04350. — [arXiv:1705.04350](https://arxiv.org/abs/1705.04350) [find](https://scholar.google.com/scholar?q=Desmond+Elliott+and+A%CC%81kos+Ka%CC%81da%CC%81r%2E+2017%2E+nation+improves+Multimodal+Translation%2E+abs%2F1705%2E04350%2E+%E2%80%94+%5BarXiv%3A1705%2E04350%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1705%2E04350%29)
15. Imagi-CoRR, Desmond Elliott and Frank Keller. 2014. Comparing automatic evaluation measures for image description. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: Short Papers, pages 452–457. [find](https://scholar.google.com/scholar?q=Imagi%2DCoRR%2C+Desmond+Elliott+and+Frank+Keller%2E+2014%2E+Comparing+automatic+evaluation+measures+for+image+description%2E+In+Proceedings+of+the+52nd+Annual+Meeting+of+the+Association+for+Computational+Lingui)
16. Desmond Elliott, Stella Frank, and Eva Hasler. 2015. Multi-language image description with neural sequence models. CoRR, abs/1510.04709. — [arXiv:1510.04709](https://arxiv.org/abs/1510.04709) [find](https://scholar.google.com/scholar?q=Desmond+Elliott%2C+Stella+Frank%2C+and+Eva+Hasler%2E+2015%2E+Multi%2Dlanguage+image+description+with+neural+sequence+models%2E+CoRR%2C+abs%2F1510%2E04709%2E+%E2%80%94+%5BarXiv%3A1510%2E04709%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1510%2E04709%29)
17. Desmond Elliott, Stella Frank, Khalil Simaan, and Lucia Specia. 2016. Multi30k: Multilingual english-german image descriptions. In 5th Workshop on Vision and Language, pages 70–74. [find](https://scholar.google.com/scholar?q=Desmond+Elliott%2C+Stella+Frank%2C+Khalil+Simaan%2C+and+Lucia+Specia%2E+2016%2E+Multi30k%3A+Multilingual+english%2Dgerman+image+descriptions%2E+In+5th+Workshop+on+Vision+and+Language%2C+pages+70%E2%80%9374%2E) [our card](https://md.research.elamur.ai/free/papers/elliott-2016-multi30k-multilingual-english-german-image/)
18. Gertrud Faaß and Kerstin Eckart. 2013. SdeWaC–a corpus of parsable sentences from the web. In Language processing and knowledge in the Web, pages 61–68. Springer. [find](https://scholar.google.com/scholar?q=Gertrud+Faa%C3%9F+and+Kerstin+Eckart%2E+2013%2E+SdeWaC%E2%80%93a+corpus+of+parsable+sentences+from+the+web%2E+In+Language+processing+and+knowledge+in+the+Web%2C+pages+61%E2%80%9368%2E+Springer%2E)
19. Christian Federmann. 2012. Appraise: An open-source toolkit for manual evaluation of machine translation output. The Prague Bulletin of Mathematical Linguistics, 98:25–35, September. [find](https://scholar.google.com/scholar?q=Christian+Federmann%2E+2012%2E+Appraise%3A+An+open%2Dsource+toolkit+for+manual+evaluation+of+machine+translation+output%2E+The+Prague+Bulletin+of+Mathematical+Linguistics%2C+98%3A25%E2%80%9335%2C+September%2E)
20. Spandana Gella, Mirella Lapata, and Frank Keller. 2016. Unsupervised visual sense disambiguation for verbs using multimodal embeddings. In 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 182–192, San Diego, California… [find](https://scholar.google.com/scholar?q=Spandana+Gella%2C+Mirella+Lapata%2C+and+Frank+Keller%2E+2016%2E+Unsupervised+visual+sense+disambiguation+for+verbs+using+multimodal+embeddings%2E+In+2016+Conference+of+the+North+American+Chapter+of+the+Associat)
21. Yvette Graham, Timothy Baldwin, Alistair Moffat, and Justin Zobel. 2015. Can machine translation systems be evaluated by the crowd alone. Natural Language Engineering, 23(1):3–30. [find](https://scholar.google.com/scholar?q=Yvette+Graham%2C+Timothy+Baldwin%2C+Alistair+Moffat%2C+and+Justin+Zobel%2E+2015%2E+Can+machine+translation+systems+be+evaluated+by+the+crowd+alone%2E+Natural+Language+Engineering%2C+23%281%29%3A3%E2%80%9330%2E)
22. Julian Hitschler, Shigehiko Schamoni, and Stefan Riezler. 2016. Multimodal Pivots for Image Caption Translation. In 54th Annual Meeting of the Association for Computational Linguistics, pages 2399– 2409. [find](https://scholar.google.com/scholar?q=Julian+Hitschler%2C+Shigehiko+Schamoni%2C+and+Stefan+Riezler%2E+2016%2E+Multimodal+Pivots+for+Image+Caption+Translation%2E+In+54th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages+2399%E2%80%93+24)
23. Alan Jaffe. 2017. Generating Image Descriptions using Multilingual Data. In Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, pages 458–464. [find](https://scholar.google.com/scholar?q=Alan+Jaffe%2E+2017%2E+Generating+Image+Descriptions+using+Multilingual+Data%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Volume+2%3A+Shared+Task+Papers%2C+pages+458%E2%80%93464%2E)
24. Douwe Kiela. 2016. MMFeat: A toolkit for extracting multi-modal features. In Proceedings of ACL-2016 System Demonstrations, pages 55–60. [find](https://scholar.google.com/scholar?q=Douwe+Kiela%2E+2016%2E+MMFeat%3A+A+toolkit+for+extracting+multi%2Dmodal+features%2E+In+Proceedings+of+ACL%2D2016+System+Demonstrations%2C+pages+55%E2%80%9360%2E)
25. Mert Kilickaya, Aykut Erdem, Nazli Ikizler-Cinbis, and Erkut Erdem. 2017. Re-evaluating automatic metrics for image captioning. In Proceedings of EACL 2017, pages 199–209. [find](https://scholar.google.com/scholar?q=Mert+Kilickaya%2C+Aykut+Erdem%2C+Nazli+Ikizler%2DCinbis%2C+and+Erkut+Erdem%2E+2017%2E+Re%2Devaluating+automatic+metrics+for+image+captioning%2E+In+Proceedings+of+EACL+2017%2C+pages+199%E2%80%93209%2E)
26. Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, et al. 2007. Moses: Open source toolkit for statistical machine translation. In 45th Annual meeting of Association for Computational Linguisti… [find](https://scholar.google.com/scholar?q=Philipp+Koehn%2C+Hieu+Hoang%2C+Alexandra+Birch%2C+Chris+Callison%2DBurch%2C+Marcello+Federico%2C+Nicola+Bertoldi%2C+Brooke+Cowan%2C+Wade+Shen%2C+Christine+Moran%2C+Richard+Zens%2C+et+al%2E+2007%2E+Moses%3A+Open+source+toolkit+fo)
27. D.T. Le, R. Bernardi, and J.R.R. Uijlings. 2014. TUHOI: Trento Universal Human Object Interaction Dataset. In Vision and Language Workshop at the 26th International Conference on Computational Linguistics. [find](https://scholar.google.com/scholar?q=D%2ET%2E+Le%2C+R%2E+Bernardi%2C+and+J%2ER%2ER%2E+Uijlings%2E+2014%2E+TUHOI%3A+Trento+Universal+Human+Object+Interaction+Dataset%2E+In+Vision+and+Language+Workshop+at+the+26th+International+Conference+on+Computational+Linguis)
28. Xirong Li, Weiyu Lan, Jianfeng Dong, and Hailong Liu. 2016. Adding chinese captions to images. In Proceedings of the 2016 ACM on International Conference on Multimedia Retrieval, pages 271–275. [find](https://scholar.google.com/scholar?q=Xirong+Li%2C+Weiyu+Lan%2C+Jianfeng+Dong%2C+and+Hailong+Liu%2E+2016%2E+Adding+chinese+captions+to+images%2E+In+Proceedings+of+the+2016+ACM+on+International+Conference+on+Multimedia+Retrieval%2C+pages+271%E2%80%93275%2E)
29. Jindřich Libovický and Jindřich Helcl. 2017. Attention strategies for multi-source sequence-to-sequence learning. CoRR, abs/1704.06567. [find](https://scholar.google.com/scholar?q=Jindr%CC%8Cich+Libovicky%CC%81+and+Jindr%CC%8Cich+Helcl%2E+2017%2E+Attention+strategies+for+multi%2Dsource+sequence%2Dto%2Dsequence+learning%2E+CoRR%2C+abs%2F1704%2E06567%2E)
30. Tsung-Yi Lin, Michael Maire, Serge J. Belongie, Lubomir D. Bourdev, Ross B. Girshick, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C. Lawrence Zitnick. 2014. Microsoft COCO: common objects in context. CoRR, abs/1405.0312. [find](https://scholar.google.com/scholar?q=Tsung%2DYi+Lin%2C+Michael+Maire%2C+Serge+J%2E+Belongie%2C+Lubomir+D%2E+Bourdev%2C+Ross+B%2E+Girshick%2C+James+Hays%2C+Pietro+Perona%2C+Deva+Ramanan%2C+Piotr+Dolla%CC%81r%2C+and+C%2E+Lawrence+Zitnick%2E+2014%2E+Microsoft+COCO%3A+common+obje) [our card](https://md.research.elamur.ai/free/papers/lin-2014-microsoft-coco-common-objects-context/)
31. Minh-Thang Luong, Hieu Pham, and Christopher D Manning. 2015. Effective approaches to attention-based neural machine translation. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pages 1412–1421. [find](https://scholar.google.com/scholar?q=Minh%2DThang+Luong%2C+Hieu+Pham%2C+and+Christopher+D+Manning%2E+2015%2E+Effective+approaches+to+attention%2Dbased+neural+machine+translation%2E+In+Proceedings+of+the+2015+Conference+on+Empirical+Methods+in+Natural+)
32. Software Demonstrations of the 15th Conference of the European Chapter of the Association for Computational Linguistics, pages 65–68. [find](https://scholar.google.com/scholar?q=Software+Demonstrations+of+the+15th+Conference+of+the+European+Chapter+of+the+Association+for+Computational+Linguistics%2C+pages+65%E2%80%9368%2E)
33. Mingbo Ma, Dapeng Li, Kai Zhao, and Liang Huang. 2017. OSU Multimodal Machine Translation System Report. In Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, pages 465–469. [find](https://scholar.google.com/scholar?q=Mingbo+Ma%2C+Dapeng+Li%2C+Kai+Zhao%2C+and+Liang+Huang%2E+2017%2E+OSU+Multimodal+Machine+Translation+System+Report%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Volume+2%3A+Shared+Task+Papers%2C+p)
34. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006. A study of translation edit rate with targeted human annotation. In Proceedings of Association for Machine Translation in the Americas. [find](https://scholar.google.com/scholar?q=Matthew+Snover%2C+Bonnie+Dorr%2C+Richard+Schwartz%2C+Linnea+Micciulla%2C+and+John+Makhoul%2E+2006%2E+A+study+of+translation+edit+rate+with+targeted+human+annotation%2E+In+Proceedings+of+Association+for+Machine+Tran) [our card](https://md.research.elamur.ai/free/papers/snover-2006-study-translation-edit-rate-targeted/)
35. Pranava Swaroop Madhyastha, Josiah Wang, and Lucia Specia. 2017. Sheffield MultiMT: Using Object Posterior Predictions for Multimodal Machine Translation. In Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, pages 470–476. [find](https://scholar.google.com/scholar?q=Pranava+Swaroop+Madhyastha%2C+Josiah+Wang%2C+and+Lucia+Specia%2E+2017%2E+Sheffield+MultiMT%3A+Using+Object+Posterior+Predictions+for+Multimodal+Machine+Translation%2E+In+Proceedings+of+the+Second+Conference+on+Ma)
36. Lucia Specia, Stella Frank, Khalil Sima’an, and Desmond Elliott. 2016. A shared task on multimodal machine translation and crosslingual image description. In First Conference on Machine Translation, pages 543–553. [find](https://scholar.google.com/scholar?q=Lucia+Specia%2C+Stella+Frank%2C+Khalil+Sima%E2%80%99an%2C+and+Desmond+Elliott%2E+2016%2E+A+shared+task+on+multimodal+machine+translation+and+crosslingual+image+description%2E+In+First+Conference+on+Machine+Translation%2C+p) [our card](https://md.research.elamur.ai/free/papers/specia-2016-shared-task-multimodal-machine-translation/)
37. Takashi Miyazaki and Nobuyuki Shimizu. 2016. Cross-lingual image caption generation. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, pages 1780–1790. [find](https://scholar.google.com/scholar?q=Takashi+Miyazaki+and+Nobuyuki+Shimizu%2E+2016%2E+Cross%2Dlingual+image+caption+generation%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages+1780%E2%80%931790%2E)
38. Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, and Zbigniew Wojna. 2015. Rethinking the inception architecture for computer vision. CoRR, abs/1512.00567. [find](https://scholar.google.com/scholar?q=Christian+Szegedy%2C+Vincent+Vanhoucke%2C+Sergey+Ioffe%2C+Jonathon+Shlens%2C+and+Zbigniew+Wojna%2E+2015%2E+Rethinking+the+inception+architecture+for+computer+vision%2E+CoRR%2C+abs%2F1512%2E00567%2E)
39. Franz Josef Och. 2003. Minimum error rate training in statistical machine translation. In 41st Annual Meeting on Association for Computational Linguistics, pages 160–167, Sapporo, Japan. [find](https://scholar.google.com/scholar?q=Franz+Josef+Och%2E+2003%2E+Minimum+error+rate+training+in+statistical+machine+translation%2E+In+41st+Annual+Meeting+on+Association+for+Computational+Linguistics%2C+pages+160%E2%80%93167%2C+Sapporo%2C+Japan%2E)
40. Jörg Tiedemann. 2012. Parallel data, tools and interfaces in opus. In Eight International Conference on Language Resources and Evaluation (LREC’12). [find](https://scholar.google.com/scholar?q=Jo%CC%88rg+Tiedemann%2E+2012%2E+Parallel+data%2C+tools+and+interfaces+in+opus%2E+In+Eight+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%E2%80%9912%29%2E)
41. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. Bleu: A method for automatic evaluation of machine translation. In 40th Annual Meeting on Association for Computational Linguistics, pages 311–318. [find](https://scholar.google.com/scholar?q=Kishore+Papineni%2C+Salim+Roukos%2C+Todd+Ward%2C+and+Wei%2DJing+Zhu%2E+2002%2E+Bleu%3A+A+method+for+automatic+evaluation+of+machine+translation%2E+In+40th+Annual+Meeting+on+Association+for+Computational+Linguistics%2C+) [our card](https://md.research.elamur.ai/free/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
42. Mesut Erhan Unal, Begum Citamak, Semih Yagcioglu, Aykut Erdem, Erkut Erdem, Nazli Iki-zler Cinbis, and Ruket Cakici. 2016. Tasviret: Görüntülerden otomatik türkçe açıklama oluşturma İçin bir denektaçı veri kümesi (TasvirEt: A benchmark dataset for automatic Turkish description generation… [find](https://scholar.google.com/scholar?q=Mesut+Erhan+Unal%2C+Begum+Citamak%2C+Semih+Yagcioglu%2C+Aykut+Erdem%2C+Erkut+Erdem%2C+Nazli+Iki%2Dzler+Cinbis%2C+and+Ruket+Cakici%2E+2016%2E+Tasviret%3A+Go%CC%88ru%CC%88ntu%CC%88lerden+otomatik+tu%CC%88rkc%CC%A7e+ac%CC%A7%C4%B1klama+olus%CC%A7turma+I%CC%87c%CC%A7in+bir+)
43. Janarthanan Rajendran, Mitesh M Khapra, Sarath Chandar, and Balaraman Ravindran. 2016. Bridge correlational neural networks for multilingual multimodal representation learning. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human… [find](https://scholar.google.com/scholar?q=Janarthanan+Rajendran%2C+Mitesh+M+Khapra%2C+Sarath+Chandar%2C+and+Balaraman+Ravindran%2E+2016%2E+Bridge+correlational+neural+networks+for+multilingual+multimodal+representation+learning%2E+In+Proceedings+of+the+2)
44. Emiel van Miltenburg, Desmond Elliott, and Piek Vossen. 2017. Cross-linguistic differences and similarities in image descriptions. In Proceedings of the 10th International Conference on Natural Language Generation. [find](https://scholar.google.com/scholar?q=Emiel+van+Miltenburg%2C+Desmond+Elliott%2C+and+Piek+Vossen%2E+2017%2E+Cross%2Dlinguistic+differences+and+similarities+in+image+descriptions%2E+In+Proceedings+of+the+10th+International+Conference+on+Natural+Langua)
45. Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. 2015. ImageNet Large Scale Visual Recognition Challenge. International Journal of Computer Vision (IJCV), 115(3):211–25… [find](https://scholar.google.com/scholar?q=Olga+Russakovsky%2C+Jia+Deng%2C+Hao+Su%2C+Jonathan+Krause%2C+Sanjeev+Satheesh%2C+Sean+Ma%2C+Zhiheng+Huang%2C+Andrej+Karpathy%2C+Aditya+Khosla%2C+Michael+Bernstein%2C+Alexander+C%2E+Berg%2C+and+Li+Fei%2DFei%2E+2015%2E+ImageNet+Larg) [our card](https://md.research.elamur.ai/free/papers/russakovsky-2014-imagenet-large-scale-visual-recognition/)
46. Yuya Yoshikawa, Yutaro Shigeto, and Akikazu Takeuchi. 2017. Stair captions: Constructing a large-scale japanese image caption dataset. CoRR, abs/1705.00823. [find](https://scholar.google.com/scholar?q=Yuya+Yoshikawa%2C+Yutaro+Shigeto%2C+and+Akikazu+Takeuchi%2E+2017%2E+Stair+captions%3A+Constructing+a+large%2Dscale+japanese+image+caption+dataset%2E+CoRR%2C+abs%2F1705%2E00823%2E)
47. Mike Schuster and Kaisuke Nakajima. 2012. Japanese and korean voice search. In 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 5149–5152. [find](https://scholar.google.com/scholar?q=Mike+Schuster+and+Kaisuke+Nakajima%2E+2012%2E+Japanese+and+korean+voice+search%2E+In+2012+IEEE+International+Conference+on+Acoustics%2C+Speech+and+Signal+Processing+%28ICASSP%29%2C+pages+5149%E2%80%935152%2E)
48. Peter Young, Alice Lai, Micah Hodosh, and Julia Hockenmaier. 2014. From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions. Transactions of the Association for Computational Linguistics, 2:67–78. [find](https://scholar.google.com/scholar?q=Peter+Young%2C+Alice+Lai%2C+Micah+Hodosh%2C+and+Julia+Hockenmaier%2E+2014%2E+From+image+descriptions+to+visual+denotations%3A+New+similarity+metrics+for+semantic+inference+over+event+descriptions%2E+Transactions+of)
49. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016a. Edinburgh neural machine translation systems for WMT 16. In Proceedings of the First Conference on Machine Translation. [find](https://scholar.google.com/scholar?q=Rico+Sennrich%2C+Barry+Haddow%2C+and+Alexandra+Birch%2E+2016a%2E+Edinburgh+neural+machine+translation+systems+for+WMT+16%2E+In+Proceedings+of+the+First+Conference+on+Machine+Translation%2E) [our card](https://md.research.elamur.ai/free/papers/sennrich-2016-edinburgh-neural-machine-translation-systems/)
50. Jingyi Zhang, Masao Utiyama, Eiichro Sumita, Graham Neubig, and Satoshi Nakamura. 2017. NICT-NAIST System for WMT17 Multimodal Translation Task. In Proceedings of the Second Conference on Machine Translation, Volume 2: Shared Task Papers, pages 477–482, Copenhagen, Denmark. [find](https://scholar.google.com/scholar?q=Jingyi+Zhang%2C+Masao+Utiyama%2C+Eiichro+Sumita%2C+Graham+Neubig%2C+and+Satoshi+Nakamura%2E+2017%2E+NICT%2DNAIST+System+for+WMT17+Multimodal+Translation+Task%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Tran)
51. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016b. Neural machine translation of rare words with subword units. In 54th Annual Meeting of the Association for Computational Linguistics, pages 1715–1725, Berlin, Germany. [find](https://scholar.google.com/scholar?q=Rico+Sennrich%2C+Barry+Haddow%2C+and+Alexandra+Birch%2E+2016b%2E+Neural+machine+translation+of+rare+words+with+subword+units%2E+In+54th+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+pages+171)
52. Rico Sennrich, Orhan Firat, Kyunghyun Cho, Alexandra Birch, Barry Haddow, Julian Hitschler, Marcin Junczys-Dowmunt, Samuel Läubli, Antonio Valerio Miceli Barone, Jozef Mokry, et al. 2017. Nematus: a toolkit for neural machine translation. In [find](https://scholar.google.com/scholar?q=Rico+Sennrich%2C+Orhan+Firat%2C+Kyunghyun+Cho%2C+Alexandra+Birch%2C+Barry+Haddow%2C+Julian+Hitschler%2C+Marcin+Junczys%2DDowmunt%2C+Samuel+La%CC%88ubli%2C+Antonio+Valerio+Miceli+Barone%2C+Jozef+Mokry%2C+et+al%2E+2017%2E+Nematus%3A+a+) [our card](https://md.research.elamur.ai/free/papers/sennrich-2017-nematus-toolkit-neural-machine-translation/)