---
title: "Findings of the WMT 2019 Biomedical — Bawden 2019"
description: "This overview reports on the fourth edition of the WMT shared task on biomedical machine translation."
authors: ["Rachel Bawden", "Kevin Bretonnel Cohen", "Cristian Grozea", "Antonio Jimeno Yepes", "Madeleine Kittner", "Martin Krallinger", "Nancy Mah", "Aurelie Neveol", "Mariana Neves", "Felipe Soares", "Amy Siu", "Karin Verspoor", "Maika Vicente Navarro"]
year: 2019
venue: "Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2)"
source: "https://aclanthology.org/W19-5403/"
doi: "10.18653/v1/w19-5403"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/papers/bawden-2019-findings-wmt-2019-biomedical-translation/"
---
[Elamur Research](https://md.research.elamur.ai/) · [this page in HTML](https://research.elamur.ai/free/papers/bawden-2019-findings-wmt-2019-biomedical-translation/)

[home](https://md.research.elamur.ai/) / [papers](https://md.research.elamur.ai/free/papers/) / [2019](https://md.research.elamur.ai/free/papers/2019/page/2/) / Findings of the WMT 2019 Biomedical Translation Shared Task: Evaluation for MEDLINE Abstracts and Biomedical Terminologies

# Findings of the WMT 2019 Biomedical Translation Shared Task: Evaluation for MEDLINE Abstracts and Biomedical Terminologies

**Authors:** [Rachel Bawden](https://md.research.elamur.ai/free/authors/rachel-bawden/), Kevin Bretonnel Cohen, [Cristian Grozea](https://md.research.elamur.ai/free/authors/cristian-grozea/), [Antonio Jimeno Yepes](https://md.research.elamur.ai/free/authors/antonio-jimeno-yepes/), [Madeleine Kittner](https://md.research.elamur.ai/free/authors/madeleine-kittner/), Martin Krallinger, Nancy Mah, [Aurelie Neveol](https://md.research.elamur.ai/free/authors/aurelie-neveol/), [Mariana Neves](https://md.research.elamur.ai/free/authors/mariana-neves/), Felipe Soares, Amy Siu, [Karin Verspoor](https://md.research.elamur.ai/free/authors/karin-verspoor/) et al. (13 authors) · **Year:** 2019 · **Venue:** Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/W19-5403/) · [PDF](https://aclanthology.org/W19-5403.pdf) · [DOI 10.18653/v1/w19-5403](https://doi.org/10.18653/v1/w19-5403) · [OpenAlex](https://openalex.org/W2970758702)

**Citations:** 20 citations (openalex-snapshot · 2026-10-14) · [34](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
This overview reports on the fourth edition of the WMT shared task on biomedical machine translation. The task covered ten translation directions between English and five other languages: Chinese, French, German, Portuguese and Spanish. The organisers built parallel data from MEDLINE abstracts. They used language detection to discard mislabelled abstracts, split documents into sentences, aligned them automatically with GMA or Champollion, and checked every test-set alignment by hand in Appraise.

A new sub-task asked systems to translate biomedical terminology from English to Spanish. Its motivation is that only a small share of UMLS concepts currently have Spanish entries.

The organisers provided three neural baselines. Eleven teams submitted 59 runs, covering every test set. BLEU scores near 0.5 were reached for es/en, en/es, en/pt and the terminology sub-task. In the manual evaluation, some primary runs were preferred over the human reference translations.

The campaign matters because it supplies reusable biomedical benchmarks, measures progress over earlier editions, and exposes weaknesses in both the test data and the systems.

## Key points
- **Data:**
  - MEDLINE training data was released for eight directions (fr, de, pt and es paired with English), ranging from about 40k to 100k sentences per pair.
  - Test sets for all ten directions contained 50 documents each.
  - The en/es terminology test set held 6,624 terms.
- **Pipeline tools:** langdetect flagged 156 abstracts with the wrong language. Sentence splitting used syntok and LingPipe; alignment used GMA and Champollion.
- **Baselines:** Shallow RNN encoder-decoders were trained with Moses preprocessing and joint BPE via FastBPE (85,000 merges). They used UFAL data, plus Scielo for Portuguese and the UN Parallel Corpus for Chinese.
- **Participation and results:**
  - 11 teams submitted 59 runs.
  - Some outputs were judged better than the references for de/en, en/es and es/en.
- **Observed errors and future plans:**
  - Common errors included mishandled acronyms, wrong word order inside technical terms, subject-verb agreement mistakes and omitted information.
  - The organisers plan to replace pairwise comparison with direct assessment in future editions.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/shelves/linguistics/) · [Machine translation](https://md.research.elamur.ai/free/shelves/machine-translation/)

## Cited by

Cited by

34 papers of our library cite it (of the 140673 whose bibliographies we read); 4 of them have a page here, 30 not yet.

- [Findings of the 2019 Conference on Machine Translation (WMT19)](https://md.research.elamur.ai/free/papers/barrault-2019-findings-2019-conference-machine-translation/)
- [Evaluating Large Language Models: A Comprehensive Survey](https://md.research.elamur.ai/free/papers/guo-2023-evaluating-large-language-models-comprehensive/)
- [Is ChatGPT A Good Translator? Yes With GPT-4 As The Engine](https://md.research.elamur.ai/free/papers/jiao-2023-chatgpt-good-translator-yes-gpt/)
- [Towards Making the Most of ChatGPT for Machine Translation](https://md.research.elamur.ai/free/papers/peng-2023-making-most-chatgpt-machine-translation/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{bawden2019findings,
  title = {{Findings of the WMT 2019 Biomedical Translation Shared Task: Evaluation for MEDLINE Abstracts and Biomedical Terminologies}},
  author = {Bawden, Rachel and Cohen, Kevin Bretonnel and Grozea, Cristian and Yepes, Antonio Jimeno and Kittner, Madeleine and Krallinger, Martin and Mah, Nancy and Neveol, Aurelie and Neves, Mariana and Soares, Felipe and Siu, Amy and Verspoor, Karin and Navarro, Maika Vicente},
  booktitle = {Proceedings of the Fourth Conference on Machine Translation (Volume 3: Shared Task Papers, Day 2)},
  year = {2019},
  doi = {10.18653/v1/w19-5403},
  url = {https://doi.org/10.18653/v1/w19-5403}
}
```

- [← previous Findings of the 2019 Conference on Machine Translation (WMT19)](https://md.research.elamur.ai/free/papers/barrault-2019-findings-2019-conference-machine-translation/)
- [next → Findings of the WMT 2019 Shared Task on Automatic Post-Editing](https://md.research.elamur.ai/free/papers/chatterjee-2019-findings-wmt-2019-shared-task/)
- [↑ back to papers of 2019](https://md.research.elamur.ai/free/papers/2019/page/2/)

## References

32 references, 6 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. UFAL medical corpus 1.0. [https://ufal.mff.cuni.cz/ufal_medical_corpus](https://ufal.mff.cuni.cz/ufal_medical_corpus). Accessed: 2018-07-24. [↗](https://ufal.mff.cuni.cz/ufal_medical_corpus)
2. Sadaf Abdul-Rauf, Holger Schwenk, Patrik Lambert, and Mohammad Nawaz. 2016. Empirical use of information retrieval to build synthetic data for smt domain adaptation. IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP), 24(4):745–754. [↗](https://doi.org/10.1109/taslp.2016.2517318)
3. Marcin Junczys-Dowmunt, Roman Grundkiewicz, Tomasz Dwojak, Hieu Hoang, Kenneth Heafield, Tom Neckermann, Frank Seide, Ulrich Germann, Alham Fikri Aji, Nikolay Bogoychev, André F. T. Martins, and Alexandra Birch. 2018. Marian: Fast Neural Machine Translation in C++. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 116–121, Melbourne, Australia. [find](https://scholar.google.com/scholar?q=Marcin+Junczys%2DDowmunt%2C+Roman+Grundkiewicz%2C+Tomasz+Dwojak%2C+Hieu+Hoang%2C+Kenneth+Heafield%2C+Tom+Neckermann%2C+Frank+Seide%2C+Ulrich+Germann%2C+Alham+Fikri+Aji%2C+Nikolay+Bogoychev%2C+Andre%CC%81+F%2E+T%2E+Martins%2C+and+Alex) [our card](https://md.research.elamur.ai/free/papers/junczys-2018-dowmunt-marian-fast-neural-machine-translation/)
4. Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Yvette Graham, Barry Haddow, Matthias Huck, Antonio Jimeno Yepes, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Aurelie Neveol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi, Karin Verspoor, and Marcos Zampieri. 2016. Findings of the 2016 Conference on Machine Translation. In Proceedings of the First Conference on Machine Translation: Volume 2, Shared Task Papers, pages 131–198. [find](https://scholar.google.com/scholar?q=Ondr%CC%8Cej+Bojar%2C+Rajen+Chatterjee%2C+Christian+Federmann%2C+Yvette+Graham%2C+Barry+Haddow%2C+Matthias+Huck%2C+Antonio+Jimeno+Yepes%2C+Philipp+Koehn%2C+Varvara+Logacheva%2C+Christof+Monz%2C+Matteo+Negri%2C+Aurelie+Neveol%2C+M) [our card](https://md.research.elamur.ai/free/papers/bojar-2016-findings-2016-conference-machine-translation/)
5. Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, and Alexander M. Rush. 2017. Open-NMT: Open-Source Toolkit for Neural Machine Translation. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, pages 67–72, Vancouver, Canada. [find](https://scholar.google.com/scholar?q=Guillaume+Klein%2C+Yoon+Kim%2C+Yuntian+Deng%2C+Jean+Senellart%2C+and+Alexander+M%2E+Rush%2E+2017%2E+Open%2DNMT%3A+Open%2DSource+Toolkit+for+Neural+Machine+Translation%2E+In+Proceedings+of+the+55th+Annual+Meeting+of+the+Ass)
6. Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, Chris Dyer, Ondřej Bojar, Alexandra Constantin, and Evan Herbst. 2007. Moses: Open Source Toolkit for Statistical Machine Translation. In Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions, pages 177–180, Prague, Czech Republic. [find](https://scholar.google.com/scholar?q=Philipp+Koehn%2C+Hieu+Hoang%2C+Alexandra+Birch%2C+Chris+Callison%2DBurch%2C+Marcello+Federico%2C+Nicola+Bertoldi%2C+Brooke+Cowan%2C+Wade+Shen%2C+Christine+Moran%2C+Richard+Zens%2C+Chris+Dyer%2C+Ondr%CC%8Cej+Bojar%2C+Alexandra+Const)
7. Pi-Chuan Chang, Michel Galley, and Christopher D. Manning. 2008. Optimizing Chinese Word Segmentation for Machine Translation Performance. In Proceedings of the Third Workshop on Statistical Machine Translation, pages 224–232, Columbus, Ohio. Mirela-Stefania Duma and Wolfgang Menzel. Translation of Biomedical Documents with Focus on Spanish-English. In Proceedings of the Third Conference on Machine Translation: Shared Task Papers. [find](https://scholar.google.com/scholar?q=Pi%2DChuan+Chang%2C+Michel+Galley%2C+and+Christopher+D%2E+Manning%2E+2008%2E+Optimizing+Chinese+Word+Segmentation+for+Machine+Translation+Performance%2E+In+Proceedings+of+the+Third+Workshop+on+Statistical+Machine+T) [our card](https://md.research.elamur.ai/free/papers/chang-2008-optimizing-chinese-word-segmentation-machine/)
8. Quoc Le and Tomas Mikolov. 2014. Distributed Representations of Sentences and Documents. In Pavel Pecina, Antonio Toral, Vassilis Papavassiliou, Prokopis Prokopidis, Ales Tamchyna, Andy Way, and Josef van Genabith. 2015. Domain adaptation of statistical machine translation with domain-focused web crawling. Language resources and evaluation, 49(1):147–193. 26120290[pmid]. Proceedings of the 31st International Conference on International Conference on Machine Learning - Volume 32, ICML’14, pages II–1188–II–1196. JMLR.org. [↗](https://doi.org/10.48550/arxiv.1405.4053) [our card](https://md.research.elamur.ai/free/papers/le-2014-distributed-representations-sentences-documents/)
9. Robert Leaman, Rezarta Islamaj Doğan, and Zhiyong Lu. 2013. DNorm: disease name normalization with pairwise learning to rank. Bioinformatics, 29(22):2909–2917. [↗](https://doi.org/10.1093/bioinformatics/btt474)
10. Casimiro Pio Carrino, Bardia Rafieian, Marta R. Costa-jussà, and José A. R. Fonollosa. 2019. Terminology-aware segmentation and domain feature data enriching strategy for the WMT19 Biomedical Translation Task. In Proceedings of the Fourth Conference on Machine Translation. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Casimiro+Pio+Carrino%2C+Bardia+Rafieian%2C+Marta+R%2E+Costa%2Djussa%CC%80%2C+and+Jose%CC%81+A%2E+R%2E+Fonollosa%2E+2019%2E+Terminology%2Daware+segmentation+and+domain+feature+data+enriching+strategy+for+the+WMT19+Biomedical+Transl)
11. Roberto Navigli and Simone Paolo Ponzetto. 2012. BabelNet: The automatic construction, evaluation and application of a wide-coverage multilingual semantic network. Artificial Intelligence, 193:217– 250. [↗](https://doi.org/10.1016/j.artint.2012.07.001)
12. Danielle Saunders, Felix Stahlberg, and Bill Byrne. 2019. UCAM Biomedical translation at WMT19: Transfer learning multi-domain ensembles. In Proceedings of the Fourth Conference on Machine Translation. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Danielle+Saunders%2C+Felix+Stahlberg%2C+and+Bill+Byrne%2E+2019%2E+UCAM+Biomedical+translation+at+WMT19%3A+Transfer+learning+multi%2Ddomain+ensembles%2E+In+Proceedings+of+the+Fourth+Conference+on+Machine+Translation)
13. Aurélie Névéol, Antonio Jimeno Yepes, Mariana Neves, and Karin Verspoor. 2018. Parallel corpora for the biomedical domain. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018). European Language Resource Association. [find](https://scholar.google.com/scholar?q=Aure%CC%81lie+Ne%CC%81ve%CC%81ol%2C+Antonio+Jimeno+Yepes%2C+Mariana+Neves%2C+and+Karin+Verspoor%2E+2018%2E+Parallel+corpora+for+the+biomedical+domain%2E+In+Proceedings+of+the+Eleventh+International+Conference+on+Language+Resour)
14. Rico Sennrich, Barry Haddow, and Alexandra Birch. 2015. Neural machine translation of rare words with subword units. CoRR, abs/1508.07909. [↗](https://arxiv.org/abs/1508.07909)
15. Mariana Neves. 2017. A parallel collection of clinical trials in portuguese and english. In Proceedings of the 10th Workshop on Building and Using Comparable Corpora, pages 36–40. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mariana+Neves%2E+2017%2E+A+parallel+collection+of+clinical+trials+in+portuguese+and+english%2E+In+Proceedings+of+the+10th+Workshop+on+Building+and+Using+Comparable+Corpora%2C+pages+36%E2%80%9340%2E+Association+for+Comp)
16. Felipe Soares and Martin Krallinger. 2019. BSC participation in the WMT biomedical task. In Proceedings of the Fourth Conference on Machine Translation. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Felipe+Soares+and+Martin+Krallinger%2E+2019%2E+BSC+participation+in+the+WMT+biomedical+task%2E+In+Proceedings+of+the+Fourth+Conference+on+Machine+Translation%2E+Association+for+Computational+Linguistics%2E)
17. Mariana Neves, Antonio Jimeno Yepes, Aurélie Névéol, Cristian Grozea, Amy Siu, Madeleine Kittner, and Karin Verspoor. 2018. Findings of the wmt 2018 biomedical translation shared task: Evaluation on medline test sets. In Proceedings of the Third Conference on Machine Translation: Shared Task Papers, pages 324–339. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mariana+Neves%2C+Antonio+Jimeno+Yepes%2C+Aure%CC%81lie+Ne%CC%81ve%CC%81ol%2C+Cristian+Grozea%2C+Amy+Siu%2C+Madeleine+Kittner%2C+and+Karin+Verspoor%2E+2018%2E+Findings+of+the+wmt+2018+biomedical+translation+shared+task%3A+Evaluation+o)
18. Felipe Soares, Viviane Moreira, and Karin Becker. 2018a. A large parallel corpus of full-text scientific articles. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018). European Language Resource Association. [↗](https://doi.org/10.48550/arxiv.1905.01852)
19. Felipe Soares, Gabrielli Harumi Yamashita, and Michel Jose Anzanello. 2018b. A parallel corpus of theses and dissertations abstracts. In International Conference on Computational Processing of the Portuguese Language, pages 345–352. Springer. [find](https://scholar.google.com/scholar?q=Felipe+Soares%2C+Gabrielli+Harumi+Yamashita%2C+and+Michel+Jose+Anzanello%2E+2018b%2E+A+parallel+corpus+of+theses+and+dissertations+abstracts%2E+In+International+Conference+on+Computational+Processing+of+the+Por)
20. Mariana Neves, Antonio Jimeno Yepes, and Aurélie Névéol. 2016. The scielo corpus: a parallel corpus of scientific publications for biomedicine. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), Paris, France. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Mariana+Neves%2C+Antonio+Jimeno+Yepes%2C+and+Aure%CC%81lie+Ne%CC%81ve%CC%81ol%2E+2016%2E+The+scielo+corpus%3A+a+parallel+corpus+of+scientific+publications+for+biomedicine%2E+In+Proceedings+of+the+Tenth+International+Conference+)
21. Jörg Tiedemann. 2012. Parallel data, tools and interfaces in opus. In Proceedings of the Eight International Conference on Language Resources and Evaluation (LREC’12), Istanbul, Turkey. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Jo%CC%88rg+Tiedemann%2E+2012%2E+Parallel+data%2C+tools+and+interfaces+in+opus%2E+In+Proceedings+of+the+Eight+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%E2%80%9912%29%2C+Istanbul%2C+Turkey%2E+European+Lang)
22. Noor-e-Hira, Sadaf Abdul Rauf, Kiran Kiani, Ammara Zafar, and Raheel Nawaz. 2019. Translation of Medical texts using Transfer Learning and Selective Data Training: NRPU-FJ Participation in WMT19. In Proceedings of the Fourth Conference on Machine Translation. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Noor%2De%2DHira%2C+Sadaf+Abdul+Rauf%2C+Kiran+Kiani%2C+Ammara+Zafar%2C+and+Raheel+Nawaz%2E+2019%2E+Translation+of+Medical+texts+using+Transfer+Learning+and+Selective+Data+Training%3A+NRPU%2DFJ+Participation+in+WMT19%2E+In+P)
23. Anne M Turner, Yong K Choi, Kristin Dew, Ming-Tse Tsai, Alyssa L Bosold, Shuyang Wu, Donahue Smith, and Hendrika Meischke. 2019. Evaluating the usefulness of translation technologies for emergency response communication: A scenario-based study. JMIR Public Health Surveill, 5(1):e11171. [↗](https://doi.org/10.2196/11171)
24. Pavel Pecina, Ondřej Dušek, Lorraine Goeuriot, Jan Hajič, Jaroslava Hlaváčová, Gareth J.F. Jones, Liadh Kelly, Johannes Leveling, David Mareček, Michal Novák, Martin Popel, Rudolf Rosa, Aleš Tamchyna, and Zdeňka Urešová. 2014. Adaptation of machine translation for multilingual information retrieval in the medical domain. Artificial Intelligence in Medicine, 61(3):165 – 185. Text Mining and Information Analysis of Health Documents. [↗](https://doi.org/10.1016/j.artmed.2014.01.004)
25. Ashish Vaswani, Samy Bengio, Eugene Brevdo, Francois Chollet, Aidan Gomez, Stephan Gouws, Llion Jones, Łukasz Kaiser, Nal Kalchbrenner, Niki Parmar, Ryan Sepassi, Noam Shazeer, and Jakob Uszkoreit. 2018. Tensor2Tensor for neural machine translation. In Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Volume 1: Research Papers), pages 193– 199, Boston, MA. Association for Machine Translation in the Americas. [↗](https://doi.org/10.48550/arxiv.1803.07416) [our card](https://md.research.elamur.ai/free/papers/vaswani-2018-tensor2tensor-neural-machine-translation/)
26. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems 30, pages 5998–6008. Curran Associates, Inc. [find](https://scholar.google.com/scholar?q=Ashish+Vaswani%2C+Noam+Shazeer%2C+Niki+Parmar%2C+Jakob+Uszkoreit%2C+Llion+Jones%2C+Aidan+N%2E+Gomez%2C+%C5%81ukasz+Kaiser%2C+and+Illia+Polosukhin%2E+2017%2E+Attention+is+all+you+need%2E+In+Advances+in+Neural+Information+Process)
27. Marta Villegas, Ander Intxaurrondo, Aitor Gonzalez-Agirre, Montserrat Marimón, and Martin Krallinger. 2018. The mespen resource for english-spanish medical machine translation and terminologies: Census of parallel corpora, glossaries and term translations. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Paris, France. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Marta+Villegas%2C+Ander+Intxaurrondo%2C+Aitor+Gonzalez%2DAgirre%2C+Montserrat+Marimo%CC%81n%2C+and+Martin+Krallinger%2E+2018%2E+The+mespen+resource+for+english%2Dspanish+medical+machine+translation+and+terminologies%3A+Cens)
28. Mingxuan Wang, Li Gong, Wenhuan Zhu, Jun Xie, and Chao Bian. 2018. Tencent neural machine translation systems for WMT18. In Proceedings of the Third Conference on Machine Translation: Shared Task Papers, pages 522–527, Belgium, Brussels. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Mingxuan+Wang%2C+Li+Gong%2C+Wenhuan+Zhu%2C+Jun+Xie%2C+and+Chao+Bian%2E+2018%2E+Tencent+neural+machine+translation+systems+for+WMT18%2E+In+Proceedings+of+the+Third+Conference+on+Machine+Translation%3A+Shared+Task+Pape)
29. Peng Wei, Liu Jianfeng, Li Liangyou, and Liu Qun. 2019. Huawei’s NMT systems for the WMT 2019 biomedical translation task. In Proceedings of the Fourth Conference on Machine Translation. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Peng+Wei%2C+Liu+Jianfeng%2C+Li+Liangyou%2C+and+Liu+Qun%2E+2019%2E+Huawei%E2%80%99s+NMT+systems+for+the+WMT+2019+biomedical+translation+task%2E+In+Proceedings+of+the+Fourth+Conference+on+Machine+Translation%2E+Association+f)
30. Cuijun Wu, Fei Xia, Louise Deleger, and Imre Solti. 2011. Statistical machine translation for biomedical text: are we there yet? AMIA ... Annual Symposium proceedings. AMIA Symposium, 2011:1290– 1299. 22195190[pmid]. [find](https://scholar.google.com/scholar?q=Cuijun+Wu%2C+Fei+Xia%2C+Louise+Deleger%2C+and+Imre+Solti%2E+2011%2E+Statistical+machine+translation+for+biomedical+text%3A+are+we+there+yet%3F+AMIA+%2E%2E%2E+Annual+Symposium+proceedings%2E+AMIA+Symposium%2C+2011%3A1290%E2%80%93+1299%2E)
31. Weijia Xu and Marine Carpuat. 2018. The university of Maryland’s Chinese-English neural machine translation systems at WMT18. In Proceedings of the Third Conference on Machine Translation: Shared Task Papers, pages 535–540, Belgium, Brussels. Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Weijia+Xu+and+Marine+Carpuat%2E+2018%2E+The+university+of+Maryland%E2%80%99s+Chinese%2DEnglish+neural+machine+translation+systems+at+WMT18%2E+In+Proceedings+of+the+Third+Conference+on+Machine+Translation%3A+Shared+Task)
32. Michał Ziemski, Marcin Junczys-Dowmunt, and Bruno Pouliquen. 2016. The united nations parallel corpus v1.0. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016), Paris, France. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Micha%C5%82+Ziemski%2C+Marcin+Junczys%2DDowmunt%2C+and+Bruno+Pouliquen%2E+2016%2E+The+united+nations+parallel+corpus+v1%2E0%2E+In+Proceedings+of+the+Tenth+International+Conference+on+Language+Resources+and+Evaluation+%28L) [our card](https://md.research.elamur.ai/free/papers/ziemski-2016-united-nations-parallel-corpus-v1/)