---
title: "Findings of the 2017 Conference on Machine — Bojar 2017"
description: "WMT17 is an annual benchmarking campaign that tracks the state of machine translation and supplies common test sets, training corpora and human judgments."
authors: ["Ondřej Bojar", "Rajen Chatterjee", "Christian Federmann", "Yvette Graham", "Barry Haddow", "Shujian Huang", "Matthias Huck", "Philipp Koehn", "Qun Liu", "Varvara Logacheva", "Christof Monz", "Matteo Negri", "Matt Post", "Raphael Rubino", "Lucia Specia", "Marco Turchi"]
year: 2017
venue: "Proceedings of the Second Conference on Machine Translation"
source: "https://aclanthology.org/W17-4717/"
doi: "10.18653/v1/w17-4717"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/bojar-2017-findings-2017-conference-machine-translation/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/bojar-2017-findings-2017-conference-machine-translation/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2017](https://md.research.elamur.ai/free/en/papers/2017/page/2/) / Findings of the 2017 Conference on Machine Translation (WMT17)

# Findings of the 2017 Conference on Machine Translation (WMT17)

**Authors:** [Ondřej Bojar](https://md.research.elamur.ai/free/en/authors/ondrej-bojar/), [Rajen Chatterjee](https://md.research.elamur.ai/free/en/authors/rajen-chatterjee/), [Christian Federmann](https://md.research.elamur.ai/free/en/authors/christian-federmann/), [Yvette Graham](https://md.research.elamur.ai/free/en/authors/yvette-graham/), [Barry Haddow](https://md.research.elamur.ai/free/en/authors/barry-haddow/), [Shujian Huang](https://md.research.elamur.ai/free/en/authors/shujian-huang/), [Matthias Huck](https://md.research.elamur.ai/free/en/authors/matthias-huck/), [Philipp Koehn](https://md.research.elamur.ai/free/en/authors/philipp-koehn/), [Qun Liu](https://md.research.elamur.ai/free/en/authors/qun-liu/), [Varvara Logacheva](https://md.research.elamur.ai/free/en/authors/varvara-logacheva/), [Christof Monz](https://md.research.elamur.ai/free/en/authors/christof-monz/), [Matteo Negri](https://md.research.elamur.ai/free/en/authors/matteo-negri/) et al. (16 authors) · **Year:** 2017 · **Venue:** Proceedings of the Second Conference on Machine Translation · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/W17-4717/) · [PDF](https://aclanthology.org/W17-4717.pdf) · [DOI 10.18653/v1/w17-4717](https://doi.org/10.18653/v1/w17-4717) · [OpenAlex](https://openalex.org/W2760656271)

**Citations:** 395 citations (openalex-snapshot · 2026-10-14) · [290](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
WMT17 is an annual benchmarking campaign that tracks the state of machine translation and supplies common test sets, training corpora and human judgments. This overview covers three of its shared tasks. The news task covered 14 translation directions, each pairing English with one of seven languages: German, Czech, Russian, Chinese, Finnish, Turkish or Latvian. Latvian, a lower-resourced pair, and Chinese, run together with CWMT, were new this year. Professional translators built test sets of about 3,000 sentences per pair, half originally written on each side. Organizers also released parallel and monolingual training data, including the new EU Press Release corpus. In total, 31 institutions submitted 103 systems. These were ranked officially by human Direct Assessment of adequacy on a 100-point scale, gathered from researchers and Mechanical Turk workers. The quality estimation task asked for sentence-level effort scores and word- or phrase-level good/bad labels. The automatic post-editing (APE) task asked for corrections to the output of an unknown MT engine. In APE, neural approaches beat the baseline for every participant for the first time, yet still fall short of human post-edits. All data and judgments are public.

## Key points
- News task: 103 submissions from 31 institutions across 14 language directions. Test sets have roughly 3,000 sentences, except Latvian, which has 2,000 test plus 2,000 development sentences. Outputs can be compared interactively with MT-ComparEval at wmt.ufal.cz.
- Training resources included Europarl, Common Crawl, the Yandex 1M Russian–English corpus, the United Nations corpus, CzEng v1.6 and News Commentary v12. New this year were the EU Press Release corpus (German, Finnish, Latvian) and Chinese corpora such as casict2015, neu2017 and datum2017.
- Quality estimation and APE data came from two domains: English→German IT texts and German→English pharmaceutical texts. Quality estimation was split into sentence-level, word-level and phrase-level subtasks.
- In APE (third edition), the top English→German system gained up to −4.9 TER and +7.6 BLEU over the baseline. The German→English gains were small (−0.26 TER, +0.28 BLEU) but statistically significant.
- Human Direct Assessment in APE showed that all English→German systems beat the no-post-edit baseline. The German→English primary systems clustered with the baseline. TER and BLEU gave slightly different rankings, with DA agreeing somewhat more with BLEU.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/) · [Machine translation](https://md.research.elamur.ai/free/en/shelves/machine-translation/)

Topics: [Machine translation](https://md.research.elamur.ai/free/en/topics/machine-translation/)

## Cited by

Cited by

290 papers of our library cite it (of the 140673 whose bibliographies we read); 36 of them have a page here, 254 not yet.

- [Massively Multilingual Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/aharoni-2019-massively-multilingual-neural-machine-translation/)
- [Findings of the 2021 Conference on Machine Translation (WMT21)](https://md.research.elamur.ai/free/en/papers/akhbardeh-2021-findings-2021-conference-machine-translation/)
- [Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges](https://md.research.elamur.ai/free/en/papers/arivazhagan-2019-massively-multilingual-neural-machine-translation/)
- [Findings of the 2019 Conference on Machine Translation (WMT19)](https://md.research.elamur.ai/free/en/papers/barrault-2019-findings-2019-conference-machine-translation/)
- [Findings of the 2020 Conference on Machine Translation (WMT20)](https://md.research.elamur.ai/free/en/papers/barrault-2020-findings-2020-conference-machine-translation/)
- [Findings of the 2018 Conference on Machine Translation (WMT18)](https://md.research.elamur.ai/free/en/papers/bojar-2018-findings-2018-conference-machine-translation/)
- [An Open Dataset and Model for Language Identification](https://md.research.elamur.ai/free/en/papers/burchell-2023-open-dataset-model-language-identification/)
- [A Survey of Domain Adaptation for Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/chu-2018-survey-domain-adaptation-neural-machine/)
- [NTREX-128 – News Test References for MT Evaluation of 128 Languages](https://md.research.elamur.ai/free/en/papers/federmann-2022-ntrex-128-news-test-references/)
- [Taking MT Evaluation Metrics to Extremes: Beyond Correlation with Human Judgments](https://md.research.elamur.ai/free/en/papers/fomicheva-2019-taking-mt-evaluation-metrics-extremes/)
- [Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation](https://md.research.elamur.ai/free/en/papers/freitag-2021-experts-errors-context-large-scale/)
- [The FLORES Evaluation Datasets for Low-Resource Machine Translation: Nepali–English and Sinhala–English](https://md.research.elamur.ai/free/en/papers/guzman-2019-flores-evaluation-datasets-low-resource/)
- [Achieving Human Parity on Automatic Chinese to English News Translation](https://md.research.elamur.ai/free/en/papers/hassan-2018-achieving-human-parity-automatic-chinese/)
- [LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion](https://md.research.elamur.ai/free/en/papers/jiang-2023-llm-blender-ensembling-large-language/)
- [Marian: Fast Neural Machine Translation in C++](https://md.research.elamur.ai/free/en/papers/junczys-2018-dowmunt-marian-fast-neural-machine-translation/)
- [GlotLID: Language Identification for Low-Resource Languages](https://md.research.elamur.ai/free/en/papers/kargaran-2023-glotlid-language-identification-low-resource/)
- [On the Impact of Various Types of Noise on Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/khayrallah-2018-impact-various-types-noise-neural/)
- [Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation](https://md.research.elamur.ai/free/en/papers/kocmi-2024-error-span-annotation-balanced-approach/)
- [Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet](https://md.research.elamur.ai/free/en/papers/kocmi-2024-findings-wmt24-general-machine-translation/)
- [ParCorFull: a Parallel Corpus Annotated with Full Coreference](https://md.research.elamur.ai/free/en/papers/koltunski-2018-parcorfull-parallel-corpus-annotated-full/)
- [TellMeWhy: A Dataset for Answering Why-Questions in Narratives](https://md.research.elamur.ai/free/en/papers/lal-2021-tellmewhy-dataset-answering-why-questions/)
- [Has Machine Translation Achieved Human Parity? A Case for Document-level Evaluation](https://md.research.elamur.ai/free/en/papers/laubli-2018-has-machine-translation-achieved-human/)
- [XQ-MEval: A Dataset with Cross-lingual Parallel Quality for Benchmarking Translation Metrics](https://md.research.elamur.ai/free/en/papers/liu-2026-xq-meval-dataset-cross-lingual/)
- [The First Multilingual Surface Realisation Shared Task (SR'18): Overview and Evaluation Results](https://md.research.elamur.ai/free/en/papers/mille-2018-first-multilingual-surface-realisation-shared/)
- [Coreference meets Universal Dependencies – a pilot experiment on harmonizing coreference datasets for 11 languages](https://md.research.elamur.ai/free/en/papers/nedoluzhko-2021-coreference-meets-universal-dependencies/)
- [Fixing Translation Divergences in Parallel Corpora for Neural MT](https://md.research.elamur.ai/free/en/papers/pham-2018-fixing-translation-divergences-parallel-corpora/)
- [Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/post-2018-fast-lexically-constrained-decoding-dynamic/)
- [COMET: A Neural Framework for MT Evaluation](https://md.research.elamur.ai/free/en/papers/rei-2020-comet-neural-framework-mt-evaluation/)
- [AudioPaLM: A Large Language Model That Can Speak and Listen](https://md.research.elamur.ai/free/en/papers/rubenstein-2023-audiopalm-large-language-model-that/)
- [Findings of the WMT 2018 Shared Task on Quality Estimation](https://md.research.elamur.ai/free/en/papers/specia-2018-findings-wmt-2018-shared-task/)
- [Multilingual Translation from Denoising Pre-Training](https://md.research.elamur.ai/free/en/papers/tang-2021-multilingual-translation-denoising-pre-training/)
- [Automatic Machine Translation Evaluation in Many Languages via Zero-Shot Paraphrasing](https://md.research.elamur.ai/free/en/papers/thompson-2020-automatic-machine-translation-evaluation-many/)
- [Attaining the Unattainable? Reassessing Claims of Human Parity in Neural Machine Translation](https://md.research.elamur.ai/free/en/papers/toral-2018-attaining-unattainable-reassessing-claims-human/)
- [Probing Pretrained Language Models for Lexical Semantics](https://md.research.elamur.ai/free/en/papers/vulic-2020-probing-pretrained-language-models-lexical/)
- [Beyond BLEU: Training Neural Machine Translation with Semantic Similarity](https://md.research.elamur.ai/free/en/papers/wieting-2019-beyond-bleu-training-neural-machine/)
- [Handling Syntactic Divergence in Low-resource Machine Translation](https://md.research.elamur.ai/free/en/papers/zhou-2019-handling-syntactic-divergence-low-resource/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{bojar2017findings,
  title = {{Findings of the 2017 Conference on Machine Translation (WMT17)}},
  author = {Bojar, Ondřej and Chatterjee, Rajen and Federmann, Christian and Graham, Yvette and Haddow, Barry and Huang, Shujian and Huck, Matthias and Koehn, Philipp and Liu, Qun and Logacheva, Varvara and Monz, Christof and Negri, Matteo and Post, Matt and Rubino, Raphael and Specia, Lucia and Turchi, Marco},
  booktitle = {Proceedings of the Second Conference on Machine Translation},
  year = {2017},
  doi = {10.18653/v1/w17-4717},
  url = {https://doi.org/10.18653/v1/w17-4717}
}
```

- [← previous FiLM: Visual Reasoning with a General Conditioning Layer](https://md.research.elamur.ai/free/en/papers/perez-2017-film-visual-reasoning-general-conditioning/)
- [next → Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description](https://md.research.elamur.ai/free/en/papers/elliott-2017-findings-second-shared-task-multimodal/)
- [↑ back to papers of 2017](https://md.research.elamur.ai/free/en/papers/2017/page/2/)

## References

109 references, 27 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Hervé Abdi. 2007. The bonferroni and šidák corrections for multiple comparisons. Encyclopedia of measurement and statistics, 3:103–107. [find](https://scholar.google.com/scholar?q=Herve%CC%81+Abdi%2E+2007%2E+The+bonferroni+and+s%CC%8Cida%CC%81k+corrections+for+multiple+comparisons%2E+Encyclopedia+of+measurement+and+statistics%2C+3%3A103%E2%80%93107%2E)
2. Eleftherios Avramidis. 2017a. Comparative quality estimation for machine translation: Observations on machine learning and features. The Prague Bulletin of Mathematical Linguistics (PBML), 108:307–318. [find](https://scholar.google.com/scholar?q=Eleftherios+Avramidis%2E+2017a%2E+Comparative+quality+estimation+for+machine+translation%3A+Observations+on+machine+learning+and+features%2E+The+Prague+Bulletin+of+Mathematical+Linguistics+%28PBML%29%2C+108%3A307%E2%80%93318)
3. Eleftherios Avramidis. 2017b. Sentence-level quality estimation by predicting HTER as a multi-component metric. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Eleftherios+Avramidis%2E+2017b%2E+Sentence%2Dlevel+quality+estimation+by+predicting+HTER+as+a+multi%2Dcomponent+metric%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Ass)
4. Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473. [find](https://scholar.google.com/scholar?q=Dzmitry+Bahdanau%2C+Kyunghyun+Cho%2C+and+Yoshua+Bengio%2E+2014%2E+Neural+machine+translation+by+jointly+learning+to+align+and+translate%2E+arXiv+preprint+arXiv%3A1409%2E0473%2E) [our card](https://md.research.elamur.ai/free/en/papers/bahdanau-2014-neural-machine-translation-jointly-learning/)
5. Alexandre Berard, Laurent Besacier, and Olivier Pietquin. 2017. LIG-CRIStAL Submission for the WMT 2017 Automatic Post-Editing Task. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Alexandre+Berard%2C+Laurent+Besacier%2C+and+Olivier+Pietquin%2E+2017%2E+LIG%2DCRIStAL+Submission+for+the+WMT+2017+Automatic+Post%2DEditing+Task%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Cop)
6. Ergun Biçici. 2017. Predicting Translation Performance with Referential Translation Machines. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ergun+Bic%CC%A7ici%2E+2017%2E+Predicting+Translation+Performance+with+Referential+Translation+Machines%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Association+for+Comp)
7. Frédéric Blain, Varvara Logacheva, and Lucia Specia. 2016. Phrase level segmentation and labelling of machine translation errors. LREC16. [find](https://scholar.google.com/scholar?q=Fre%CC%81de%CC%81ric+Blain%2C+Varvara+Logacheva%2C+and+Lucia+Specia%2E+2016%2E+Phrase+level+segmentation+and+labelling+of+machine+translation+errors%2E+LREC16%2E)
8. Frédéric Blain, Carolina Scarton, and Lucia Specia. 2017. Bilexical Embeddings for Quality Estimation. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Fre%CC%81de%CC%81ric+Blain%2C+Carolina+Scarton%2C+and+Lucia+Specia%2E+2017%2E+Bilexical+Embeddings+for+Quality+Estimation%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Associatio)
9. Ondrej Bojar, Christian Buck, Christian Federmann, Barry Haddow, Philipp Koehn, Johannes Leveling, Christof Monz, Pavel Pecina, Matt Post, Herve Saint-Amand, Radu Soricut, Lucia Specia, and Aleš Tamchyna. 2014. Findings of the 2014 workshop on statistical machine translation. In Proceedings of the… [find](https://scholar.google.com/scholar?q=Ondrej+Bojar%2C+Christian+Buck%2C+Christian+Federmann%2C+Barry+Haddow%2C+Philipp+Koehn%2C+Johannes+Leveling%2C+Christof+Monz%2C+Pavel+Pecina%2C+Matt+Post%2C+Herve+Saint%2DAmand%2C+Radu+Soricut%2C+Lucia+Specia%2C+and+Ales%CC%8C+Tamc) [our card](https://md.research.elamur.ai/free/en/papers/bojar-2014-findings-2014-workshop-statistical-machine/)
10. Ondřej Bojar, Yvette Graham, and Amir Kamran. 2017a. Results of the WMT17 Metrics Shared Task. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ondr%CC%8Cej+Bojar%2C+Yvette+Graham%2C+and+Amir+Kamran%2E+2017a%2E+Results+of+the+WMT17+Metrics+Shared+Task%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Association+for+Com) [our card](https://md.research.elamur.ai/free/en/papers/bojar-2017-results-wmt17-metrics-shared-task/)
11. Ondřej Bojar, Jindřich Helcl, Tom Kocmi, Jindřich Libovický, and Tomáš Musil. 2017b. Results of the WMT17 Neural MT Training Task. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ondr%CC%8Cej+Bojar%2C+Jindr%CC%8Cich+Helcl%2C+Tom+Kocmi%2C+Jindr%CC%8Cich+Libovicky%CC%81%2C+and+Toma%CC%81s%CC%8C+Musil%2E+2017b%2E+Results+of+the+WMT17+Neural+MT+Training+Task%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C)
12. Ondřej Bojar, Christian Buck, Chris Callison-Burch, Christian Federmann, Barry Haddow, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, and Lucia Specia. 2013. Findings of the 2013 Workshop on Statistical Machine Translation. In Proceedings of the Eighth Workshop on Statistical Machine Transl… [find](https://scholar.google.com/scholar?q=Ondr%CC%8Cej+Bojar%2C+Christian+Buck%2C+Chris+Callison%2DBurch%2C+Christian+Federmann%2C+Barry+Haddow%2C+Philipp+Koehn%2C+Christof+Monz%2C+Matt+Post%2C+Radu+Soricut%2C+and+Lucia+Specia%2E+2013%2E+Findings+of+the+2013+Workshop+on+) [our card](https://md.research.elamur.ai/free/en/papers/bojar-2013-findings-2013-workshop-statistical-machine/)
13. Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Aurelie Neveol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi,… [find](https://scholar.google.com/scholar?q=Ondr%CC%8Cej+Bojar%2C+Rajen+Chatterjee%2C+Christian+Federmann%2C+Yvette+Graham%2C+Barry+Haddow%2C+Matthias+Huck%2C+Antonio+Jimeno+Yepes%2C+Philipp+Koehn%2C+Varvara+Logacheva%2C+Christof+Monz%2C+Matteo+Negri%2C+Aurelie+Neveol%2C+M) [our card](https://md.research.elamur.ai/free/en/papers/bojar-2016-findings-2016-conference-machine-translation/)
14. Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Barry Haddow, Matthias Huck, Chris Hokamp, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Carolina Scarton, Lucia Specia, and Marco Turchi. 2015. Findings of the 2015 Workshop on Statistical Machine Translation. In Proc… [find](https://scholar.google.com/scholar?q=Ondr%CC%8Cej+Bojar%2C+Rajen+Chatterjee%2C+Christian+Federmann%2C+Barry+Haddow%2C+Matthias+Huck%2C+Chris+Hokamp%2C+Philipp+Koehn%2C+Varvara+Logacheva%2C+Christof+Monz%2C+Matteo+Negri%2C+Matt+Post%2C+Carolina+Scarton%2C+Lucia+Speci) [our card](https://md.research.elamur.ai/free/en/papers/bojar-2015-findings-2015-workshop-statistical-machine/)
15. Ondřej Bojar, Ondřej Dušek, Tom Kocmi, Jindřich Libovický, Michal Novák, Martin Popel, Roman Sudarikov, and Dušan Variš. 2016b. CzEng 1.6: Enlarged Czech-English Parallel Corpus with Processing Tools Dockered. In Text, Speech and Dialogue: 19th International Conference, TSD 2016, Brno, Czech… [find](https://scholar.google.com/scholar?q=Ondr%CC%8Cej+Bojar%2C+Ondr%CC%8Cej+Dus%CC%8Cek%2C+Tom+Kocmi%2C+Jindr%CC%8Cich+Libovicky%CC%81%2C+Michal+Nova%CC%81k%2C+Martin+Popel%2C+Roman+Sudarikov%2C+and+Dus%CC%8Can+Varis%CC%8C%2E+2016b%2E+CzEng+1%2E6%3A+Enlarged+Czech%2DEnglish+Parallel+Corpus+with+Processin)
16. Franck Burlot, Pooyan Safari, Matthieu Labeau, Alexandre Allauzen, and François Yvon. 2017. LIMSI@WMT’17. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Franck+Burlot%2C+Pooyan+Safari%2C+Matthieu+Labeau%2C+Alexandre+Allauzen%2C+and+Franc%CC%A7ois+Yvon%2E+2017%2E+LIMSI%40WMT%E2%80%9917%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Associat)
17. Chris Callison-Burch, Cameron Shaw Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2007. (Meta-) evaluation of machine translation. In Proceedings of the Second Workshop on Statistical Machine Translation, pages 136–158, Prague, Czech Methods for MT Automatic Post-Editing. In Proceedings… [find](https://scholar.google.com/scholar?q=Chris+Callison%2DBurch%2C+Cameron+Shaw+Fordyce%2C+Philipp+Koehn%2C+Christof+Monz%2C+and+Josh+Schroeder%2E+2007%2E+%28Meta%2D%29+evaluation+of+machine+translation%2E+In+Proceedings+of+the+Second+Workshop+on+Statistical+Mach) [our card](https://md.research.elamur.ai/free/en/papers/burch-2007-meta-evaluation-machine-translation/)
18. Chris Callison-Burch, Cameron Shaw Fordyce, Philipp Koehn, Christof Monz, and Josh Schroeder. 2008. Further meta-evaluation of machine translation. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 70–106, Columbus, Ohio. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Chris+Callison%2DBurch%2C+Cameron+Shaw+Fordyce%2C+Philipp+Koehn%2C+Christof+Monz%2C+and+Josh+Schroeder%2E+2008%2E+Further+meta%2Devaluation+of+machine+translation%2E+In+Proceedings+of+the+Third+Workshop+on+Statistical+)
19. Chris Callison-Burch, Philipp Koehn, Christof Monz, Kay Peterson, Mark Przybocki, and Omar Zaidan. 2010. Findings of the 2010 joint workshop on statistical machine translation and metrics for machine translation. In Proceedings of the Joint Fifth Workshop on Statistical Machine Translation and Metri… [find](https://scholar.google.com/scholar?q=Chris+Callison%2DBurch%2C+Philipp+Koehn%2C+Christof+Monz%2C+Kay+Peterson%2C+Mark+Przybocki%2C+and+Omar+Zaidan%2E+2010%2E+Findings+of+the+2010+joint+workshop+on+statistical+machine+translation+and+metrics+for+machine+) [our card](https://md.research.elamur.ai/free/en/papers/burch-2010-findings-2010-joint-workshop-statistical/)
20. Chris Callison-Burch, Philipp Koehn, Christof Monz, Matt Post, Radu Soricut, and Lucia Specia. 2012. Findings of the 2012 workshop on statistical machine translation. In Proceedings of the Seventh Workshop on Statistical Machine Translation, pages 10–48, Montreal, Canada. Association for Computation… [find](https://scholar.google.com/scholar?q=Chris+Callison%2DBurch%2C+Philipp+Koehn%2C+Christof+Monz%2C+Matt+Post%2C+Radu+Soricut%2C+and+Lucia+Specia%2E+2012%2E+Findings+of+the+2012+workshop+on+statistical+machine+translation%2E+In+Proceedings+of+the+Seventh+Wor) [our card](https://md.research.elamur.ai/free/en/papers/burch-2012-findings-2012-workshop-statistical-machine/)
21. Zhiming Chen, Yiming Tan, Chenlin Zhang, Qingyu Xiang, Lilin Zhang, Maoxi Li, and Mingwen WANG. 2017. Improving Machine Translation Quality Estimation with Neural Network Features. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Ling… [find](https://scholar.google.com/scholar?q=Zhiming+Chen%2C+Yiming+Tan%2C+Chenlin+Zhang%2C+Qingyu+Xiang%2C+Lilin+Zhang%2C+Maoxi+Li%2C+and+Mingwen+WANG%2E+2017%2E+Improving+Machine+Translation+Quality+Estimation+with+Neural+Network+Features%2E+In+Proceedings+of+t)
22. Yongchao Deng, Jungi Kim, Guillaume Klein, Catherine KOBUS, Natalia Segal, Christophe Servan, Bo Wang, Dakun Zhang, Josep Crego, and Jean Senellart. 2017. SYSTRAN Purely Neural MT Engines for WMT2017. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association fo… [find](https://scholar.google.com/scholar?q=Yongchao+Deng%2C+Jungi+Kim%2C+Guillaume+Klein%2C+Catherine+KOBUS%2C+Natalia+Segal%2C+Christophe+Servan%2C+Bo+Wang%2C+Dakun+Zhang%2C+Josep+Crego%2C+and+Jean+Senellart%2E+2017%2E+SYSTRAN+Purely+Neural+MT+Engines+for+WMT2017%2E)
23. Mattia Antonino Di Gangi, Nicola Bertoldi, and Marcello Federico. 2017. FBK’s Participation to the English-to-German News Translation Task of WMT 2017. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mattia+Antonino+Di+Gangi%2C+Nicola+Bertoldi%2C+and+Marcello+Federico%2E+2017%2E+FBK%E2%80%99s+Participation+to+the+English%2Dto%2DGerman+News+Translation+Task+of+WMT+2017%2E+In+Proceedings+of+the+Second+Conference+on+Machi)
24. Chris Callison-Burch, Philipp Koehn, Christof Monz, and Josh Schroeder. 2009. Findings of the 2009 Workshop on Statistical Machine Translation. In Proceedings of the Fourth Workshop on Statistical Machine Translation, pages 1–28, Athens, Greece. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Chris+Callison%2DBurch%2C+Philipp+Koehn%2C+Christof+Monz%2C+and+Josh+Schroeder%2E+2009%2E+Findings+of+the+2009+Workshop+on+Statistical+Machine+Translation%2E+In+Proceedings+of+the+Fourth+Workshop+on+Statistical+Mac) [our card](https://md.research.elamur.ai/free/en/papers/burch-2009-findings-2009-workshop-statistical-machine/)
25. Shuoyang Ding, Huda Khayrallah, Philipp Koehn, Matt Post, Gaurav Kumar, and Kevin Duh. 2017. The JHU Machine Translation Systems for WMT 2017. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Shuoyang+Ding%2C+Huda+Khayrallah%2C+Philipp+Koehn%2C+Matt+Post%2C+Gaurav+Kumar%2C+and+Kevin+Duh%2E+2017%2E+The+JHU+Machine+Translation+Systems+for+WMT+2017%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Transl)
26. Chris Callison-Burch, Philipp Koehn, Christof Monz, and Omar Zaidan. 2011. Findings of the 2011 workshop on statistical machine translation. In Proceedings of the Sixth Workshop on Statistical Machine Translation, pages 22–64, Edinburgh, Scotland. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Chris+Callison%2DBurch%2C+Philipp+Koehn%2C+Christof+Monz%2C+and+Omar+Zaidan%2E+2011%2E+Findings+of+the+2011+workshop+on+statistical+machine+translation%2E+In+Proceedings+of+the+Sixth+Workshop+on+Statistical+Machine) [our card](https://md.research.elamur.ai/free/en/papers/burch-2011-findings-2011-workshop-statistical-machine/)
27. John Duchi and Yoram Singer. 2009. Efficient online and batch learning using forward backward splitting. Journal of Machine Learning Research, 10:2899– 2934. [find](https://scholar.google.com/scholar?q=John+Duchi+and+Yoram+Singer%2E+2009%2E+Efficient+online+and+batch+learning+using+forward+backward+splitting%2E+Journal+of+Machine+Learning+Research%2C+10%3A2899%E2%80%93+2934%2E)
28. Rajen Chatterjee, M. Amin Farajian, Matteo Negri, Marco Turchi, Ankit Srivastava, and Santanu Pal. 2017. Multi-source Neural Automatic Post-Editing: FBK’s participation in the WMT 2017 APE shared task. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association f… [find](https://scholar.google.com/scholar?q=Rajen+Chatterjee%2C+M%2E+Amin+Farajian%2C+Matteo+Negri%2C+Marco+Turchi%2C+Ankit+Srivastava%2C+and+Santanu+Pal%2E+2017%2E+Multi%2Dsource+Neural+Automatic+Post%2DEditing%3A+FBK%E2%80%99s+participation+in+the+WMT+2017+APE+shared+task)
29. Rajen Chatterjee, José G. C. de Souza, Matteo Negri, and Marco Turchi. 2016. The FBK Participation in the WMT 2016 Automatic Post-editing Shared Task. In Proceedings of the 11th Workshop on Statistical Machine Translation (WMT). [find](https://scholar.google.com/scholar?q=Rajen+Chatterjee%2C+Jose%CC%81+G%2E+C%2E+de+Souza%2C+Matteo+Negri%2C+and+Marco+Turchi%2E+2016%2E+The+FBK+Participation+in+the+WMT+2016+Automatic+Post%2Dediting+Shared+Task%2E+In+Proceedings+of+the+11th+Workshop+on+Statistic)
30. Rajen Chatterjee, Turchi Turchi, and Matteo Negri. 2015a. The FBK Participation in the WMT15 Automatic Post-editing Shared Task. In Proceedings of the 10th Workshop on Statistical Machine Translation (WMT). [find](https://scholar.google.com/scholar?q=Rajen+Chatterjee%2C+Turchi+Turchi%2C+and+Matteo+Negri%2E+2015a%2E+The+FBK+Participation+in+the+WMT15+Automatic+Post%2Dediting+Shared+Task%2E+In+Proceedings+of+the+10th+Workshop+on+Statistical+Machine+Translation+)
31. Rajen Chatterjee, Marion Weller, Matteo Negri, and Marco Turchi. 2015b. Exploring the Planet of the APEs: a Comparative Study of State-of-the-art Melania Duma and Wolfgang Menzel. 2017. UHH Submission to the WMT17 Quality Estimation Shared Task. In Proceedings of the Second Conference on Machine Tra… [find](https://scholar.google.com/scholar?q=Rajen+Chatterjee%2C+Marion+Weller%2C+Matteo+Negri%2C+and+Marco+Turchi%2E+2015b%2E+Exploring+the+Planet+of+the+APEs%3A+a+Comparative+Study+of+State%2Dof%2Dthe%2Dart+Melania+Duma+and+Wolfgang+Menzel%2E+2017%2E+UHH+Submission)
32. Desmond Elliott, Stella Frank, Loı̈c Barrault, Fethi Bougares, and Lucia Specia. 2017. Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computa… [find](https://scholar.google.com/scholar?q=Desmond+Elliott%2C+Stella+Frank%2C+Lo%C4%B1%CC%88c+Barrault%2C+Fethi+Bougares%2C+and+Lucia+Specia%2E+2017%2E+Findings+of+the+Second+Shared+Task+on+Multimodal+Machine+Translation+and+Multilingual+Image+Description%2E+In+Proce) [our card](https://md.research.elamur.ai/free/en/papers/elliott-2017-findings-second-shared-task-multimodal/)
33. Carlos Escolano, Marta R. Costa-jussà, and José A. R. Fonollosa. 2017. The TALP-UPC Neural Machine Translation System for German/Finnish-English Using the Inverse Direction Model in Rescoring. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Comp… [find](https://scholar.google.com/scholar?q=Carlos+Escolano%2C+Marta+R%2E+Costa%2Djussa%CC%80%2C+and+Jose%CC%81+A%2E+R%2E+Fonollosa%2E+2017%2E+The+TALP%2DUPC+Neural+Machine+Translation+System+for+German%2FFinnish%2DEnglish+Using+the+Inverse+Direction+Model+in+Rescoring%2E+In+Pr)
34. Christian Federmann. 2012. Appraise: an open-source toolkit for manual evaluation of mt output. The Prague Bulletin of Mathematical Linguistics, 98:25– 35. [find](https://scholar.google.com/scholar?q=Christian+Federmann%2E+2012%2E+Appraise%3A+an+open%2Dsource+toolkit+for+manual+evaluation+of+mt+output%2E+The+Prague+Bulletin+of+Mathematical+Linguistics%2C+98%3A25%E2%80%93+35%2E)
35. Qin Gao and Stephan Vogel. 2008. Parallel Implementations of Word Alignment Tool. In Proceedings of the ACL 2008 Software Engineering, Testing, and Quality Assurance Workshop, pages 49–57, Columbus, Ohio. [find](https://scholar.google.com/scholar?q=Qin+Gao+and+Stephan+Vogel%2E+2008%2E+Parallel+Implementations+of+Word+Alignment+Tool%2E+In+Proceedings+of+the+ACL+2008+Software+Engineering%2C+Testing%2C+and+Quality+Assurance+Workshop%2C+pages+49%E2%80%9357%2C+Columbus%2C+O)
36. Mercedes Garcı́a-Martı́nez, Ozan Caglayan, Walid Aransa, Adrien Bardet, Fethi Bougares, and Loı̈c Barrault. 2017. LIUM Machine Translation Systems for WMT17 News Translation Task. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Lingu… [find](https://scholar.google.com/scholar?q=Mercedes+Garc%C4%B1%CC%81a%2DMart%C4%B1%CC%81nez%2C+Ozan+Caglayan%2C+Walid+Aransa%2C+Adrien+Bardet%2C+Fethi+Bougares%2C+and+Lo%C4%B1%CC%88c+Barrault%2E+2017%2E+LIUM+Machine+Translation+Systems+for+WMT17+News+Translation+Task%2E+In+Proceedings+of+th)
37. Yvette Graham, Timothy Baldwin, Alistair Moffat, and Justin Zobel. 2013. Continuous measurement scales in human evaluation of machine translation. In Proceedings of the 7th Linguistic Annotation Workshop and Interoperability with Discourse, pages 33–41, Sofia, Bulgaria. Association for Computational… [find](https://scholar.google.com/scholar?q=Yvette+Graham%2C+Timothy+Baldwin%2C+Alistair+Moffat%2C+and+Justin+Zobel%2E+2013%2E+Continuous+measurement+scales+in+human+evaluation+of+machine+translation%2E+In+Proceedings+of+the+7th+Linguistic+Annotation+Works)
38. Yvette Graham, Timothy Baldwin, Alistair Moffat, and Justin Zobel. 2014. Is machine translation getting better over time? In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, pages 443–451, Gothenburg, Sweden. Association for Computational L… [find](https://scholar.google.com/scholar?q=Yvette+Graham%2C+Timothy+Baldwin%2C+Alistair+Moffat%2C+and+Justin+Zobel%2E+2014%2E+Is+machine+translation+getting+better+over+time%3F+In+Proceedings+of+the+14th+Conference+of+the+European+Chapter+of+the+Associati)
39. Yvette Graham, Timothy Baldwin, Alistair Moffat, and Justin Zobel. 2016. Can machine translation systems be evaluated by the crowd alone. Natural Language Engineering, pages 1–28. [find](https://scholar.google.com/scholar?q=Yvette+Graham%2C+Timothy+Baldwin%2C+Alistair+Moffat%2C+and+Justin+Zobel%2E+2016%2E+Can+machine+translation+systems+be+evaluated+by+the+crowd+alone%2E+Natural+Language+Engineering%2C+pages+1%E2%80%9328%2E)
40. Yvette Graham, Nitika Mathur, and Timothy Baldwin. 2015. Accurate evaluation of segment-level machine translation metrics. In Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics Human Language Technologies, Denver, Colorado. [find](https://scholar.google.com/scholar?q=Yvette+Graham%2C+Nitika+Mathur%2C+and+Timothy+Baldwin%2E+2015%2E+Accurate+evaluation+of+segment%2Dlevel+machine+translation+metrics%2E+In+Proceedings+of+the+2015+Conference+of+the+North+American+Chapter+of+the+As) [our card](https://md.research.elamur.ai/free/en/papers/graham-2015-accurate-evaluation-segment-level-machine/)
41. Ralf Herbrich, Tom Minka, and Thore Graepel. 2007. Trueskill TM : a bayesian skill rating system. In Advances in neural information processing systems, pages 569–576. [find](https://scholar.google.com/scholar?q=Ralf+Herbrich%2C+Tom+Minka%2C+and+Thore+Graepel%2E+2007%2E+Trueskill+TM+%3A+a+bayesian+skill+rating+system%2E+In+Advances+in+neural+information+processing+systems%2C+pages+569%E2%80%93576%2E)
42. Teresa Herrmann, Jan Niehues, and Alex Waibel. 2013. Combining Word Reordering Methods on different Linguistic Abstraction Levels for Statistical Machine Translation. In Proceedings of the Seventh Workshop on Syntax, Semantics and Structure in Statistical Translation, Altanta, Georgia, USA. [find](https://scholar.google.com/scholar?q=Teresa+Herrmann%2C+Jan+Niehues%2C+and+Alex+Waibel%2E+2013%2E+Combining+Word+Reordering+Methods+on+different+Linguistic+Abstraction+Levels+for+Statistical+Machine+Translation%2E+In+Proceedings+of+the+Seventh+Wor)
43. Chris Hokamp. 2017. Ensembling Factored Neural Machine Translation Models for Automatic Post-Editing and Quality Estimation. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Chris+Hokamp%2E+2017%2E+Ensembling+Factored+Neural+Machine+Translation+Models+for+Automatic+Post%2DEditing+and+Quality+Estimation%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C)
44. Chester Holtz, Chuyang Ke, and Daniel Gildea. 2017. University of Rochester WMT 2017 NMT System Submission. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Chester+Holtz%2C+Chuyang+Ke%2C+and+Daniel+Gildea%2E+2017%2E+University+of+Rochester+WMT+2017+NMT+System+Submission%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Associa)
45. Matthias Huck, Fabienne Braune, and Alexander Fraser. 2017. LMU Munich’s Neural Machine Translation Systems for News Articles and Health Information Texts. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Matthias+Huck%2C+Fabienne+Braune%2C+and+Alexander+Fraser%2E+2017%2E+LMU+Munich%E2%80%99s+Neural+Machine+Translation+Systems+for+News+Articles+and+Health+Information+Texts%2E+In+Proceedings+of+the+Second+Conference+on+M)
46. Arvi Hurskainen and Jörg Tiedemann. 2017. Rule-based Machine translation from English to Finnish. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Arvi+Hurskainen+and+Jo%CC%88rg+Tiedemann%2E+2017%2E+Rule%2Dbased+Machine+translation+from+English+to+Finnish%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Association+for+)
47. Stig-Arne Grönroos, Sami Virpioja, and Mikko Kurimo. 2017. Extending hybrid word-character neural machine translation with multi-task learning of morphological analysis. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Stig%2DArne+Gro%CC%88nroos%2C+Sami+Virpioja%2C+and+Mikko+Kurimo%2E+2017%2E+Extending+hybrid+word%2Dcharacter+neural+machine+translation+with+multi%2Dtask+learning+of+morphological+analysis%2E+In+Proceedings+of+the+Second+)
48. Antonio Jimeno Yepes, Aurelie Neveol, Mariana Neves, Karin Verspoor, Ondrej Bojar, Arthur Boyer, Cristian Grozea, Barry Haddow, Madeleine Kittner, Yvonne Lichtblau, Pavel Pecina, Roland Roller, Rudolf Rosa, Amy Siu, Philippe Thomas, and Saskia Trescher. 2017. Findings of the WMT 2017 Biomedical Tran… [find](https://scholar.google.com/scholar?q=Antonio+Jimeno+Yepes%2C+Aurelie+Neveol%2C+Mariana+Neves%2C+Karin+Verspoor%2C+Ondrej+Bojar%2C+Arthur+Boyer%2C+Cristian+Grozea%2C+Barry+Haddow%2C+Madeleine+Kittner%2C+Yvonne+Lichtblau%2C+Pavel+Pecina%2C+Roland+Roller%2C+Rudolf) [our card](https://md.research.elamur.ai/free/en/papers/yepes-2017-findings-wmt-2017-biomedical-translation/)
49. Jeremy Gwinnup, Timothy Anderson, Grant Erdmann, Katherine Young, Michaeel Kazi, Elizabeth Salesky, Brian Thompson, and Jonathan Taylor. 2017. The AFRL-MITLL WMT17 Systems: Old, New, Borrowed, BLEU. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for… [find](https://scholar.google.com/scholar?q=Jeremy+Gwinnup%2C+Timothy+Anderson%2C+Grant+Erdmann%2C+Katherine+Young%2C+Michaeel+Kazi%2C+Elizabeth+Salesky%2C+Brian+Thompson%2C+and+Jonathan+Taylor%2E+2017%2E+The+AFRL%2DMITLL+WMT17+Systems%3A+Old%2C+New%2C+Borrowed%2C+BLEU%2E+I)
50. Marcin Junczys-Dowmunt and Roman Grundkiewicz. 2016. Log-linear combinations of monolingual and bilingual neural machine translation models for automatic post-editing. In Proceedings of the First Conference on Machine Translation, pages 751– 758, Berlin, Germany. Association for Computational Lingui… [find](https://scholar.google.com/scholar?q=Marcin+Junczys%2DDowmunt+and+Roman+Grundkiewicz%2E+2016%2E+Log%2Dlinear+combinations+of+monolingual+and+bilingual+neural+machine+translation+models+for+automatic+post%2Dediting%2E+In+Proceedings+of+the+First+Conf) [our card](https://md.research.elamur.ai/free/en/papers/dowmunt-2016-log-linear-combinations-monolingual-bilingual/)
51. Kenneth Heafield. 2011. KenLM: Faster and Smaller Language Model Queries. In Proceedings of the EMNLP 2011 Sixth Workshop on Statistical Machine Translation, pages 187–197, Edinburgh, Scotland, United Kingdom. [find](https://scholar.google.com/scholar?q=Kenneth+Heafield%2E+2011%2E+KenLM%3A+Faster+and+Smaller+Language+Model+Queries%2E+In+Proceedings+of+the+EMNLP+2011+Sixth+Workshop+on+Statistical+Machine+Translation%2C+pages+187%E2%80%93197%2C+Edinburgh%2C+Scotland%2C+United) [our card](https://md.research.elamur.ai/free/en/papers/heafield-2011-kenlm-faster-smaller-language-model/)
52. Marcin Junczys-Dowmunt and Roman Grundkiewicz. 2017. An Exploration of Neural Sequence-to-Sequence Architecturesfor Automatic Post-Editing. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. [find](https://scholar.google.com/scholar?q=Marcin+Junczys%2DDowmunt+and+Roman+Grundkiewicz%2E+2017%2E+An+Exploration+of+Neural+Sequence%2Dto%2DSequence+Architecturesfor+Automatic+Post%2DEditing%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translati)
53. Hyun Kim and Jong-Hyeok Lee. 2016. Recurrent neural network based translation quality estimation. In Proceedings of the First Conference on Machine Translation, pages 787–792, Berlin, Germany. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Hyun+Kim+and+Jong%2DHyeok+Lee%2E+2016%2E+Recurrent+neural+network+based+translation+quality+estimation%2E+In+Proceedings+of+the+First+Conference+on+Machine+Translation%2C+pages+787%E2%80%93792%2C+Berlin%2C+Germany%2E+Associa)
54. Hyun Kim, Jong-Hyeok Lee, and Seung-Hoon Na. 2017. Predictor-Estimator using Multilevel Task Learning with Stack Propagation for Neural Quality Estimation. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Hyun+Kim%2C+Jong%2DHyeok+Lee%2C+and+Seung%2DHoon+Na%2E+2017%2E+Predictor%2DEstimator+using+Multilevel+Task+Learning+with+Stack+Propagation+for+Neural+Quality+Estimation%2E+In+Proceedings+of+the+Second+Conference+on+M) [our card](https://md.research.elamur.ai/free/en/papers/kim-2017-predictor-estimator-multilevel-task-learning/)
55. Philipp Koehn. 2004. Statistical Significance Tests for Machine Translation Evaluation. In Proceedings of EMNLP 2004, pages 388–395, Barcelona, Spain. [find](https://scholar.google.com/scholar?q=Philipp+Koehn%2E+2004%2E+Statistical+Significance+Tests+for+Machine+Translation+Evaluation%2E+In+Proceedings+of+EMNLP+2004%2C+pages+388%E2%80%93395%2C+Barcelona%2C+Spain%2E)
56. Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondrej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: Open Source Toolkit for Statistical Machine Translation. In Proc… [find](https://scholar.google.com/scholar?q=Philipp+Koehn%2C+Hieu+Hoang%2C+Alexandra+Birch%2C+Chris+Callison%2DBurch%2C+Marcello+Federico%2C+Nicola+Bertoldi%2C+Brooke+Cowan%2C+Wade+Shen%2C+Christine+Moran%2C+Richard+Zens%2C+Chris+Dyer%2C+Ondrej+Bojar%2C+Alexandra+Consta)
57. Pranava Swaroop Madhyastha, Xavier Carreras, and Ariadna Quattoni. 2014. Learning task-specific bilexical embeddings. In Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pages 161– 171, Dublin, Ireland. [find](https://scholar.google.com/scholar?q=Pranava+Swaroop+Madhyastha%2C+Xavier+Carreras%2C+and+Ariadna+Quattoni%2E+2014%2E+Learning+task%2Dspecific+bilexical+embeddings%2E+In+Proceedings+of+COLING+2014%2C+the+25th+International+Conference+on+Computational+)
58. André Martins, Marcin Junczys-Dowmunt, Fabio Kepler, Ramn Astudillo, Chris Hokamp, and Roman Grundkiewicz. 2017a. Pushing the limits of translation quality estimation. Transactions of the Association for Computational Linguistics, 5:205–218. [find](https://scholar.google.com/scholar?q=Andre%CC%81+Martins%2C+Marcin+Junczys%2DDowmunt%2C+Fabio+Kepler%2C+Ramn+Astudillo%2C+Chris+Hokamp%2C+and+Roman+Grundkiewicz%2E+2017a%2E+Pushing+the+limits+of+translation+quality+estimation%2E+Transactions+of+the+Association)
59. André F. T. Martins, Ramón Astudillo, Chris Hokamp, and Fabio Kepler. 2016. Unbabel’s participation in the wmt16 word-level translation quality estimation shared task. In Proceedings of the First Conference on Machine Translation, pages 806–811, Berlin, Germany. Association for Computational Lingu… [find](https://scholar.google.com/scholar?q=Andre%CC%81+F%2E+T%2E+Martins%2C+Ramo%CC%81n+Astudillo%2C+Chris+Hokamp%2C+and+Fabio+Kepler%2E+2016%2E+Unbabel%E2%80%99s+participation+in+the+wmt16+word%2Dlevel+translation+quality+estimation+shared+task%2E+In+Proceedings+of+the+First+Co)
60. André F. T. Martins, Fabio Kepler, and Jose Monteiro. 2017b. Unbabel’s Participation in the WMT17 Translation Quality Estimation Shared Task. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Andre%CC%81+F%2E+T%2E+Martins%2C+Fabio+Kepler%2C+and+Jose+Monteiro%2E+2017b%2E+Unbabel%E2%80%99s+Participation+in+the+WMT17+Translation+Quality+Estimation+Shared+Task%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Transl)
61. Philipp Koehn and Christof Monz. 2006. Manual and automatic evaluation of machine translation between european languages. In Proceedings on the Workshop on Statistical Machine Translation, pages 102– 121, New York City. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Philipp+Koehn+and+Christof+Monz%2E+2006%2E+Manual+and+automatic+evaluation+of+machine+translation+between+european+languages%2E+In+Proceedings+on+the+Workshop+on+Statistical+Machine+Translation%2C+pages+102%E2%80%93+) [our card](https://md.research.elamur.ai/free/en/papers/koehn-2006-manual-automatic-evaluation-machine-translation/)
62. Franz Josef Och. 2003. Minimum Error Rate Training in Statistical Machine Translation. In Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics, ACL ’03, pages 160– 167, Sapporo, Japan. [find](https://scholar.google.com/scholar?q=Franz+Josef+Och%2E+2003%2E+Minimum+Error+Rate+Training+in+Statistical+Machine+Translation%2E+In+Proceedings+of+the+41st+Annual+Meeting+of+the+Association+for+Computational+Linguistics%2C+ACL+%E2%80%9903%2C+pages+160%E2%80%93+1)
63. Julia Kreutzer, Shigehiko Schamoni, and Stefan Riezler. 2015. Quality estimation from scratch (quetch): Deep learning for word-level translation quality estimation. In Proceedings of the Tenth Workshop on Statistical Machine Translation, pages 316–322, Lisbon, Portugal. Association for Computational… [find](https://scholar.google.com/scholar?q=Julia+Kreutzer%2C+Shigehiko+Schamoni%2C+and+Stefan+Riezler%2E+2015%2E+Quality+estimation+from+scratch+%28quetch%29%3A+Deep+learning+for+word%2Dlevel+translation+quality+estimation%2E+In+Proceedings+of+the+Tenth+Worksho)
64. Naoaki Okazaki. 2007. CRFsuite: a fast implementation of Conditional Random Fields. [find](https://scholar.google.com/scholar?q=Naoaki+Okazaki%2E+2007%2E+CRFsuite%3A+a+fast+implementation+of+Conditional+Random+Fields%2E)
65. Jason Lee, Kyunghyun Cho, and Thomas Hofmann. 2016. Fully character-level neural machine translation without explicit segmentation. arXiv preprint arXiv:1610.03017. [find](https://scholar.google.com/scholar?q=Jason+Lee%2C+Kyunghyun+Cho%2C+and+Thomas+Hofmann%2E+2016%2E+Fully+character%2Dlevel+neural+machine+translation+without+explicit+segmentation%2E+arXiv+preprint+arXiv%3A1610%2E03017%2E) [our card](https://md.research.elamur.ai/free/en/papers/lee-2017-fully-character-level-neural-machine/)
66. Jindr̆ich Libovický, Jindr̆ich Helcl, Marek Tlustý, Ondr̆ej Bojar, and Pavel Pecina. 2016. CUNI at Post-editing and Multimodal Translation Tasks. In Proceedings of the 11th Workshop on Statistical Machine Translation (WMT), Berlin, Germany. [find](https://scholar.google.com/scholar?q=Jindr%CC%86ich+Libovicky%CC%81%2C+Jindr%CC%86ich+Helcl%2C+Marek+Tlusty%CC%81%2C+Ondr%CC%86ej+Bojar%2C+and+Pavel+Pecina%2E+2016%2E+CUNI+at+Post%2Dediting+and+Multimodal+Translation+Tasks%2E+In+Proceedings+of+the+11th+Workshop+on+Statistical+M)
67. Robert Östling, Yves Scherrer, Jörg Tiedemann, Gongbo Tang, and Tommi Nieminen. 2017. The Helsinki Neural Machine Translation System. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Robert+O%CC%88stling%2C+Yves+Scherrer%2C+Jo%CC%88rg+Tiedemann%2C+Gongbo+Tang%2C+and+Tommi+Nieminen%2E+2017%2E+The+Helsinki+Neural+Machine+Translation+System%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+)
68. Gustavo Paetzold and Lucia Specia. 2017. Feature-Enriched Character-Level Convolutions for Text Regression. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Gustavo+Paetzold+and+Lucia+Specia%2E+2017%2E+Feature%2DEnriched+Character%2DLevel+Convolutions+for+Text+Regression%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Associa)
69. Varvara Logacheva, Chris Hokamp, and Lucia Specia. 2016. MARMOT: A Toolkit for Translation Quality Estimation at the Word Level. In Proceedings of the 10th edition of the Language Resources and Evaluation Conference, Portorož, Slovenia. [find](https://scholar.google.com/scholar?q=Varvara+Logacheva%2C+Chris+Hokamp%2C+and+Lucia+Specia%2E+2016%2E+MARMOT%3A+A+Toolkit+for+Translation+Quality+Estimation+at+the+Word+Level%2E+In+Proceedings+of+the+10th+edition+of+the+Language+Resources+and+Evalua)
70. Santanu Pal, Sudip Kumar Naskar, and Josef van Genabith. 2016a. Multi-engine and multi-alignment based automatic post-editing and its impact on translation productivity. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 2559– 2570,… [find](https://scholar.google.com/scholar?q=Santanu+Pal%2C+Sudip+Kumar+Naskar%2C+and+Josef+van+Genabith%2E+2016a%2E+Multi%2Dengine+and+multi%2Dalignment+based+automatic+post%2Dediting+and+its+impact+on+translation+productivity%2E+In+Proceedings+of+COLING+2016%2C)
71. The COLING 2016 Organizing Committee. [find](https://scholar.google.com/scholar?q=The+COLING+2016+Organizing+Committee%2E)
72. Ngoc Quang Luong, Laurent Besacier, and Benjamin Lecouteux. 2014. Lig system for word level qe task at wmt14. In Proceedings of the Ninth Workshop on Statistical Machine Translation, pages 335–341, Baltimore, Maryland, USA. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ngoc+Quang+Luong%2C+Laurent+Besacier%2C+and+Benjamin+Lecouteux%2E+2014%2E+Lig+system+for+word+level+qe+task+at+wmt14%2E+In+Proceedings+of+the+Ninth+Workshop+on+Statistical+Machine+Translation%2C+pages+335%E2%80%93341%2C+Ba)
73. Santanu Pal, Sudip Kumar Naskar, Mihaela Vela, and Josef van Genabith. 2016b. A Neural Network based Approach to Automatic Post-Editing. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 281–286, Berlin, Germany. [find](https://scholar.google.com/scholar?q=Santanu+Pal%2C+Sudip+Kumar+Naskar%2C+Mihaela+Vela%2C+and+Josef+van+Genabith%2E+2016b%2E+A+Neural+Network+based+Approach+to+Automatic+Post%2DEditing%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association+fo)
74. Santanu Pal, Marcos Zampieri, and Josef van Genabith. 2016c. Usaar: An operation sequential model for automatic statistical post-editing. In Proceedings of the First Conference on Machine Translation, pages 759–763, Berlin, Germany. [find](https://scholar.google.com/scholar?q=Santanu+Pal%2C+Marcos+Zampieri%2C+and+Josef+van+Genabith%2E+2016c%2E+Usaar%3A+An+operation+sequential+model+for+automatic+statistical+post%2Dediting%2E+In+Proceedings+of+the+First+Conference+on+Machine+Translation%2C)
75. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002. BLEU: A Method for Automatic Evaluation of Machine Translation. In Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, ACL ’02, pages 311–318, Philadelphia, Pennsylvania. [find](https://scholar.google.com/scholar?q=Kishore+Papineni%2C+Salim+Roukos%2C+Todd+Ward%2C+and+Wei%2DJing+Zhu%2E+2002%2E+BLEU%3A+A+Method+for+Automatic+Evaluation+of+Machine+Translation%2E+In+Proceedings+of+the+40th+Annual+Meeting+on+Association+for+Computat) [our card](https://md.research.elamur.ai/free/en/papers/papineni-2002-bleu-method-automatic-evaluation-machine/)
76. Raj Nath Patel and Sasikumar M. 2016. Translation quality estimation using recurrent neural network. In Proceedings of the First Conference on Machine Translation, pages 819–824, Berlin, Germany. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Raj+Nath+Patel+and+Sasikumar+M%2E+2016%2E+Translation+quality+estimation+using+recurrent+neural+network%2E+In+Proceedings+of+the+First+Conference+on+Machine+Translation%2C+pages+819%E2%80%93824%2C+Berlin%2C+Germany%2E+Asso)
77. Jan-Thorsten Peter, Andreas Guta, Tamer Alkhouli, Parnia Bahar, Jan Rosendahl, Nick Rossenbach, Miguel Graça, and Hermann Ney. 2017a. The RWTH Aachen University English-German and German-English Machine Translation System for WMT 2017. In Proceedings of the Second Conference on Machine Translation,… [find](https://scholar.google.com/scholar?q=Jan%2DThorsten+Peter%2C+Andreas+Guta%2C+Tamer+Alkhouli%2C+Parnia+Bahar%2C+Jan+Rosendahl%2C+Nick+Rossenbach%2C+Miguel+Grac%CC%A7a%2C+and+Hermann+Ney%2E+2017a%2E+The+RWTH+Aachen+University+English%2DGerman+and+German%2DEnglish+Mach)
78. Jan-Thorsten Peter, Hermann Ney, Ondřej Bojar, Ngoc-Quan Pham, Jan Niehues, Alex Waibel, Franck Burlot, François Yvon, Mārcis Pinnis, Valters Sics, Joost Bastings, Miguel Rios, Wilker Aziz, Philip Williams, Frédéric Blain, and Lucia Specia. 2017b. The QT21 Combined Machine Translation System fo… [find](https://scholar.google.com/scholar?q=Jan%2DThorsten+Peter%2C+Hermann+Ney%2C+Ondr%CC%8Cej+Bojar%2C+Ngoc%2DQuan+Pham%2C+Jan+Niehues%2C+Alex+Waibel%2C+Franck+Burlot%2C+Franc%CC%A7ois+Yvon%2C+Ma%CC%84rcis+Pinnis%2C+Valters+Sics%2C+Joost+Bastings%2C+Miguel+Rios%2C+Wilker+Aziz%2C+Philip+)
79. Ngoc-Quan Pham, Jan Niehues, Thanh-Le Ha, Eunah Cho, Matthias Sperber, and Alexander Waibel. 2017. The Karlsruhe Institute of Technology Systems for the News Translation Task in WMT 2017. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computation… [find](https://scholar.google.com/scholar?q=Ngoc%2DQuan+Pham%2C+Jan+Niehues%2C+Thanh%2DLe+Ha%2C+Eunah+Cho%2C+Matthias+Sperber%2C+and+Alexander+Waibel%2E+2017%2E+The+Karlsruhe+Institute+of+Technology+Systems+for+the+News+Translation+Task+in+WMT+2017%2E+In+Proceedin)
80. Mārcis Pinnis, Rihards Krišlauks, Toms Miks, Daiga Deksne, and Valters Šics. 2017. Tilde’s Machine Translation Systems for WMT 2017. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Ma%CC%84rcis+Pinnis%2C+Rihards+Kris%CC%8Clauks%2C+Toms+Miks%2C+Daiga+Deksne%2C+and+Valters+S%CC%8Cics%2E+2017%2E+Tilde%E2%80%99s+Machine+Translation+Systems+for+WMT+2017%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+)
81. Sylvain Raybaud, David Langlois, and Kamel Smali. 2011. this sentence is wrong. detecting errors in machine-translated sentences. Machine Translation, 25(1):1–34. [find](https://scholar.google.com/scholar?q=Sylvain+Raybaud%2C+David+Langlois%2C+and+Kamel+Smali%2E+2011%2E+this+sentence+is+wrong%2E+detecting+errors+in+machine%2Dtranslated+sentences%2E+Machine+Translation%2C+25%281%29%3A1%E2%80%9334%2E)
82. Matı̄ss Rikters, Chantal Amrhein, Maksym Del, and Mark Fishel. 2017. C-3MA: Tartu-Riga-Zurich Translation Systems for WMT17. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mat%C4%B1%CC%84ss+Rikters%2C+Chantal+Amrhein%2C+Maksym+Del%2C+and+Mark+Fishel%2E+2017%2E+C%2D3MA%3A+Tartu%2DRiga%2DZurich+Translation+Systems+for+WMT17%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C)
83. Keisuke Sakaguchi, Matt Post, and Benjamin Van Durme. 2014. Efficient elicitation of annotations for human evaluation of machine translation. In Proceedings of the Workshop on Statistical Machine Translation, Baltimore, Maryland. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Keisuke+Sakaguchi%2C+Matt+Post%2C+and+Benjamin+Van+Durme%2E+2014%2E+Efficient+elicitation+of+annotations+for+human+evaluation+of+machine+translation%2E+In+Proceedings+of+the+Workshop+on+Statistical+Machine+Tran)
84. Carolina Scarton, Daniel Beck, Kashif Shah, Karin Sim Smith, and Lucia Specia. 2016. Word embeddings and discourse information for quality estimation. In Proceedings of the First Conference on Machine Translation, pages 831–837, Berlin, Germany. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Carolina+Scarton%2C+Daniel+Beck%2C+Kashif+Shah%2C+Karin+Sim+Smith%2C+and+Lucia+Specia%2E+2016%2E+Word+embeddings+and+discourse+information+for+quality+estimation%2E+In+Proceedings+of+the+First+Conference+on+Machine)
85. Rico Sennrich, Alexandra Birch, Anna Currey, Ulrich Germann, Barry Haddow, Kenneth Heafield, Antonio Valerio Miceli Barone, and Philip Williams. 2017. The University of Edinburgh’s Neural MT Systems for WMT17. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Assoc… [find](https://scholar.google.com/scholar?q=Rico+Sennrich%2C+Alexandra+Birch%2C+Anna+Currey%2C+Ulrich+Germann%2C+Barry+Haddow%2C+Kenneth+Heafield%2C+Antonio+Valerio+Miceli+Barone%2C+and+Philip+Williams%2E+2017%2E+The+University+of+Edinburgh%E2%80%99s+Neural+MT+Systems+f) [our card](https://md.research.elamur.ai/free/en/papers/sennrich-2017-university-edinburgh-s-neural-mt/)
86. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2015. Neural machine translation of rare words with subword units. arXiv preprint arXiv:1508.07909. [find](https://scholar.google.com/scholar?q=Rico+Sennrich%2C+Barry+Haddow%2C+and+Alexandra+Birch%2E+2015%2E+Neural+machine+translation+of+rare+words+with+subword+units%2E+arXiv+preprint+arXiv%3A1508%2E07909%2E)
87. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2016. Edinburgh neural machine translation systems for wmt 16. In Proceedings of the First Conference on Machine Translation, pages 371– 376, Berlin, Germany. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Rico+Sennrich%2C+Barry+Haddow%2C+and+Alexandra+Birch%2E+2016%2E+Edinburgh+neural+machine+translation+systems+for+wmt+16%2E+In+Proceedings+of+the+First+Conference+on+Machine+Translation%2C+pages+371%E2%80%93+376%2C+Berlin%2C+) [our card](https://md.research.elamur.ai/free/en/papers/sennrich-2016-edinburgh-neural-machine-translation-systems/)
88. Shiqi Shen, Yong Cheng, Zhongjun He, Wei He, Hua Wu, Maosong Sun, and Yang Liu. 2016. Minimum risk training for neural machine translation. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1683–1692, Berlin, Germany. [find](https://scholar.google.com/scholar?q=Shiqi+Shen%2C+Yong+Cheng%2C+Zhongjun+He%2C+Wei+He%2C+Hua+Wu%2C+Maosong+Sun%2C+and+Yang+Liu%2E+2016%2E+Minimum+risk+training+for+neural+machine+translation%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association) [our card](https://md.research.elamur.ai/free/en/papers/shen-2015-minimum-risk-training-neural-machine/)
89. Michel Simard, Cyril Goutte, and Pierre Isabelle. 2007. Statistical phrase-based post-editing. In Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Proceedings of the Main Conference, pages 508–515, Rochester, New York. A… [find](https://scholar.google.com/scholar?q=Michel+Simard%2C+Cyril+Goutte%2C+and+Pierre+Isabelle%2E+2007%2E+Statistical+phrase%2Dbased+post%2Dediting%2E+In+Human+Language+Technologies+2007%3A+The+Conference+of+the+North+American+Chapter+of+the+Association+for+)
90. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006a. A study of translation edit rate with targeted human annotation. In Proceedings of association for machine translation in the Americas, pages 223–231. [find](https://scholar.google.com/scholar?q=Matthew+Snover%2C+Bonnie+Dorr%2C+Richard+Schwartz%2C+Linnea+Micciulla%2C+and+John+Makhoul%2E+2006a%2E+A+study+of+translation+edit+rate+with+targeted+human+annotation%2E+In+Proceedings+of+association+for+machine+tra) [our card](https://md.research.elamur.ai/free/en/papers/snover-2006-study-translation-edit-rate-targeted/)
91. Matthew Snover, Bonnie J. Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. 2006b. A study of translation edit rate with targeted human annotation. In 5th Conference of the Association for Machine Translation in the Americas (AMTA), Boston, Massachusetts. [find](https://scholar.google.com/scholar?q=Matthew+Snover%2C+Bonnie+J%2E+Dorr%2C+Richard+Schwartz%2C+Linnea+Micciulla%2C+and+John+Makhoul%2E+2006b%2E+A+study+of+translation+edit+rate+with+targeted+human+annotation%2E+In+5th+Conference+of+the+Association+for+M) [our card](https://md.research.elamur.ai/free/en/papers/snover-2006-study-translation-edit-rate-targeted/)
92. Artem Sokolov, Julia Kreutzer, Kellen Sunderland, Pavel Danchenko, Witold Szymaniak, Hagen Fürstenau, and Stefan Riezler. 2017. A Shared Task on Bandit Learning for Machine Translation. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computationa… [find](https://scholar.google.com/scholar?q=Artem+Sokolov%2C+Julia+Kreutzer%2C+Kellen+Sunderland%2C+Pavel+Danchenko%2C+Witold+Szymaniak%2C+Hagen+Fu%CC%88rstenau%2C+and+Stefan+Riezler%2E+2017%2E+A+Shared+Task+on+Bandit+Learning+for+Machine+Translation%2E+In+Proceeding)
93. Lucia Specia, Frédéric Blain, Kim Harris, Aljoscha Burchardt, Viviven Macketanz, Inguna Skadiņa, Marco Turchi, and Matteo Negri. 2017a. Translation quality and productivity: A study on rich morphology languages. In Proceedings of the 16th Machine Translation Summit, Nagoya, Japan. [find](https://scholar.google.com/scholar?q=Lucia+Specia%2C+Fre%CC%81de%CC%81ric+Blain%2C+Kim+Harris%2C+Aljoscha+Burchardt%2C+Viviven+Macketanz%2C+Inguna+Skadin%CC%A7a%2C+Marco+Turchi%2C+and+Matteo+Negri%2E+2017a%2E+Translation+quality+and+productivity%3A+A+study+on+rich+morphol)
94. Lucia Specia, Kim Harris, Aljoscha Burchardt, Marco Turchi, Matteo Negri, and Inguna Skadina. 2017b. Translation Quality and Productivity: A Study on Rich Morphology Languages. In Proceedings of the 16th Machine Translation Summit, Nagoya, Japan. [find](https://scholar.google.com/scholar?q=Lucia+Specia%2C+Kim+Harris%2C+Aljoscha+Burchardt%2C+Marco+Turchi%2C+Matteo+Negri%2C+and+Inguna+Skadina%2E+2017b%2E+Translation+Quality+and+Productivity%3A+A+Study+on+Rich+Morphology+Languages%2E+In+Proceedings+of+the+1)
95. Lucia Specia, Gustavo Paetzold, and Carolina Scarton. 2015. Multi-level Translation Quality Prediction with QuEst++. In 53rd Annual Meeting of the Association for Computational Linguistics and Seventh International Joint Conference on Natural Language Processing of the Asian Federation of Natural La… [find](https://scholar.google.com/scholar?q=Lucia+Specia%2C+Gustavo+Paetzold%2C+and+Carolina+Scarton%2E+2015%2E+Multi%2Dlevel+Translation+Quality+Prediction+with+QuEst%2B%2B%2E+In+53rd+Annual+Meeting+of+the+Association+for+Computational+Linguistics+and+Seventh) [our card](https://md.research.elamur.ai/free/en/papers/specia-2015-multi-level-translation-quality-prediction/)
96. Lucia Specia, Kashif Shah, Jose G.C. de Souza, and Trevor Cohn. 2013. Quest - a translation quality estimation framework. In Proceedings of the 51st Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 79–84, Sofia, Bulgaria. [find](https://scholar.google.com/scholar?q=Lucia+Specia%2C+Kashif+Shah%2C+Jose+G%2EC%2E+de+Souza%2C+and+Trevor+Cohn%2E+2013%2E+Quest+%2D+a+translation+quality+estimation+framework%2E+In+Proceedings+of+the+51st+Annual+Meeting+of+the+Association+for+Computational) [our card](https://md.research.elamur.ai/free/en/papers/specia-2013-quest-translation-quality-estimation-framework/)
97. A. Stolcke. 2002. Srilm - an extensible language modeling toolkit. In ICSLP, pages 901–904, Denver, CO. [find](https://scholar.google.com/scholar?q=A%2E+Stolcke%2E+2002%2E+Srilm+%2D+an+extensible+language+modeling+toolkit%2E+In+ICSLP%2C+pages+901%E2%80%93904%2C+Denver%2C+CO%2E)
98. Roman Sudarikov, David Mareček, Tom Kocmi, Dušan Variš, and Ondřej Bojar. 2017. CUNI Submission in WMT17: Chimera Goes Neural. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Roman+Sudarikov%2C+David+Marec%CC%8Cek%2C+Tom+Kocmi%2C+Dus%CC%8Can+Varis%CC%8C%2C+and+Ondr%CC%8Cej+Bojar%2E+2017%2E+CUNI+Submission+in+WMT17%3A+Chimera+Goes+Neural%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copen)
99. Roman Sudarikov, Martin Popel, Ondřej Bojar, Aljoscha Burchardt, and Ondřej Klejch. 2016. Using MT-ComparEval. In Translation Evaluation: From Fragmented Tools and Data Sets to an Integrated Ecosystem, pages 76–82. [find](https://scholar.google.com/scholar?q=Roman+Sudarikov%2C+Martin+Popel%2C+Ondr%CC%8Cej+Bojar%2C+Aljoscha+Burchardt%2C+and+Ondr%CC%8Cej+Klejch%2E+2016%2E+Using+MT%2DComparEval%2E+In+Translation+Evaluation%3A+From+Fragmented+Tools+and+Data+Sets+to+an+Integrated+Ecosyst)
100. Yiming Tan, Zhiming Chen, Liu Huang, Lilin Zhang, Maoxi Li, and Mingwen Wang. 2017a. Neural Post-Editing Based on Quality Estimation. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yiming+Tan%2C+Zhiming+Chen%2C+Liu+Huang%2C+Lilin+Zhang%2C+Maoxi+Li%2C+and+Mingwen+Wang%2E+2017a%2E+Neural+Post%2DEditing+Based+on+Quality+Estimation%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Co)
101. Long Trieu, Trung-Tin Pham, and Le-Minh Nguyen. 2017. The JAIST Machine Translation Systems for WMT 17. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Long+Trieu%2C+Trung%2DTin+Pham%2C+and+Le%2DMinh+Nguyen%2E+2017%2E+The+JAIST+Machine+Translation+Systems+for+WMT+17%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Association)
102. Dušan Variš and Ondřej Bojar. 2017. CUNI System for WMT17 Automatic Post-Editing Task. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Dus%CC%8Can+Varis%CC%8C+and+Ondr%CC%8Cej+Bojar%2E+2017%2E+CUNI+System+for+WMT17+Automatic+Post%2DEditing+Task%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Association+for+Computati)
103. Yuguang Wang, Shanbo Cheng, Liyang Jiang, Jiajun Yang, Wei Chen, Muze Li, Lin Shi, Yanfeng Wang, and Hongtao Yang. 2017. Sogou Neural Machine Translation Systems for WMT17. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yuguang+Wang%2C+Shanbo+Cheng%2C+Liyang+Jiang%2C+Jiajun+Yang%2C+Wei+Chen%2C+Muze+Li%2C+Lin+Shi%2C+Yanfeng+Wang%2C+and+Hongtao+Yang%2E+2017%2E+Sogou+Neural+Machine+Translation+Systems+for+WMT17%2E+In+Proceedings+of+the+Secon)
104. Krzysztof Wolk and Krzysztof Marasek. 2017. PJIIT’s systems for WMT 2017 Conference. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Krzysztof+Wolk+and+Krzysztof+Marasek%2E+2017%2E+PJIIT%E2%80%99s+systems+for+WMT+2017+Conference%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C+Denmark%2E+Association+for+Computational+)
105. Jia Xu, Yi Zong Kuang, Shondell Baijoo, Jacob Hyun Lee, Uman Shahzad, Mir Ahmed, Meredith Lancaster, and Chris Carlan. 2017. Hunter MT: A Course for Young Researchers in WMT17. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguist… [find](https://scholar.google.com/scholar?q=Jia+Xu%2C+Yi+Zong+Kuang%2C+Shondell+Baijoo%2C+Jacob+Hyun+Lee%2C+Uman+Shahzad%2C+Mir+Ahmed%2C+Meredith+Lancaster%2C+and+Chris+Carlan%2E+2017%2E+Hunter+MT%3A+A+Course+for+Young+Researchers+in+WMT17%2E+In+Proceedings+of+the+S)
106. Alexander Yeh. 2000. More Accurate Tests for the Statistical Significance of Result Differences. In Coling-2000: the 18th Conference on Computational Linguistics, pages 947–953, Saarbrücken, Germany. [find](https://scholar.google.com/scholar?q=Alexander+Yeh%2E+2000%2E+More+Accurate+Tests+for+the+Statistical+Significance+of+Result+Differences%2E+In+Coling%2D2000%3A+the+18th+Conference+on+Computational+Linguistics%2C+pages+947%E2%80%93953%2C+Saarbru%CC%88cken%2C+Germany%2E)
107. Jinchao Zhang, Peerachet Porkaew, Jiawei Hu, Qiuye Zhao, and Qun Liu. 2017. CASICT-DCU Neural Machine Translation Systems for WMT17. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Jinchao+Zhang%2C+Peerachet+Porkaew%2C+Jiawei+Hu%2C+Qiuye+Zhao%2C+and+Qun+Liu%2E+2017%2E+CASICT%2DDCU+Neural+Machine+Translation+Systems+for+WMT17%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Cop)
108. Yuan Zhang and David Weiss. 2016. Stack-propagation: Improved representation learning for syntax. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1557–1566, Berlin, Germany. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Yuan+Zhang+and+David+Weiss%2E+2016%2E+Stack%2Dpropagation%3A+Improved+representation+learning+for+syntax%2E+In+Proceedings+of+the+54th+Annual+Meeting+of+the+Association+for+Computational+Linguistics+%28Volume+1%3A+)
109. Zhixing Tan, Boli Wang, Jinming Hu, Yidong Chen, and xiaodong shi. 2017b. XMU Neural Machine Translation Systems for WMT 17. In Proceedings of the Second Conference on Machine Translation, Copenhagen, Denmark. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Zhixing+Tan%2C+Boli+Wang%2C+Jinming+Hu%2C+Yidong+Chen%2C+and+xiaodong+shi%2E+2017b%2E+XMU+Neural+Machine+Translation+Systems+for+WMT+17%2E+In+Proceedings+of+the+Second+Conference+on+Machine+Translation%2C+Copenhagen%2C)