---
title: "Cross-lingual Transfer Learning for — Schuster 2019"
description: "Task-oriented assistants must detect what a user wants (intent) and extract its arguments (slots), but labeling data for every new language is expensive."
authors: ["Sebastian Schuster", "Sonal Gupta", "Rushin Shah", "Mike Lewis"]
year: 2019
venue: "Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)"
source: "https://aclanthology.org/N19-1380/"
doi: "10.18653/v1/n19-1380"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/schuster-2019-cross-lingual-transfer-learning-multilingual/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/schuster-2019-cross-lingual-transfer-learning-multilingual/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2019](https://md.research.elamur.ai/free/en/papers/2019/page/2/) / Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog

# Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog

**Authors:** [Sebastian Schuster](https://md.research.elamur.ai/free/en/authors/sebastian-schuster/), [Sonal Gupta](https://md.research.elamur.ai/free/en/authors/sonal-gupta/), [Rushin Shah](https://md.research.elamur.ai/free/en/authors/rushin-shah/), [Mike Lewis](https://md.research.elamur.ai/free/en/authors/mike-lewis/) · **Year:** 2019 · **Venue:** Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/N19-1380/) · [PDF](https://aclanthology.org/N19-1380.pdf) · [DOI 10.18653/v1/n19-1380](https://doi.org/10.18653/v1/n19-1380) · [OpenAlex](https://openalex.org/W2898856000)

**Citations:** 246 citations (openalex-snapshot · 2026-10-14) · [144](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Task-oriented assistants must detect what a user wants (intent) and extract its arguments (slots), but labeling data for every new language is expensive. Research on cross-language transfer for this task had been held back by the lack of multilingual corpora annotated under one scheme. The authors release about 57k utterances covering alarm, reminder and weather requests: roughly 43k in English, plus 8.6k Spanish and 5k Thai utterances. Native speakers translated sampled English utterances, and the translations were annotated with the same guidelines. Using a joint biLSTM-CRF model with self-attention for intent prediction, the authors compare three transfer strategies: machine-translating the English training set, cross-lingual static (XLU) embeddings, and a new approach that reuses a multilingual NMT encoder (Multilingual CoVe) as contextual word representations. Translation is best only in the zero-shot case. Once a few hundred target examples exist, the embedding-based methods do better, and multilingual contextual vectors beat static ones when data is very scarce. Monolingual ELMo still beats every cross-lingual option for Spanish, which shows that transfer methods need further work. The dataset gives a shared benchmark for low-resource dialog NLU.

## Key points
- Dataset splits (train/dev/test): English 30,521/4,181/8,621; Spanish 3,617/1,983/3,043; Thai 2,156/1,235/1,692. It covers 12 intent types and 11 slot types, with datetime shared across domains. Thai items with annotator disagreement were dropped because no bilingual adjudicator was available.
- The encoder variants are CoVe (low-resource→English), Multilingual CoVe (both translation directions, with language-specific decoder start tokens) and Multilingual CoVe with an added autoencoder objective. All are 2-layer biLSTMs built on fairseq, with 1024-dimensional outputs.
- The MT encoders were trained on Europarl v7, Paracrawl and newstest data for Spanish, and on IWSLT-based data for Thai.
- Joint training on English plus target-language data consistently helped across languages, data sizes and embedding types. The choice of embedding mattered little, which suggests the gains come mainly from sharing the biLSTM and CRF layers.
- The data is released at https://fb.me/multilingual_task_oriented_data.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

144 papers of our library cite it (of the 140673 whose bibliographies we read); 7 of them have a page here, 137 not yet.

- [SLURP: A Spoken Language Understanding Resource Package](https://md.research.elamur.ai/free/en/papers/bastianelli-2020-slurp-spoken-language-understanding-resource/)
- [An Empirical Survey of Data Augmentation for Limited Data Learning in NLP](https://md.research.elamur.ai/free/en/papers/chen-2023-empirical-survey-data-augmentation-limited/)
- [CONAN - COunter NArratives through Nichesourcing: a Multilingual Dataset of Responses to Fight Online Hate Speech](https://md.research.elamur.ai/free/en/papers/chung-2019-conan-counter-narratives-through-nichesourcing/)
- [WikiLingua: A New Benchmark Dataset for Cross-Lingual Abstractive Summarization](https://md.research.elamur.ai/free/en/papers/ladhak-2020-wikilingua-new-benchmark-dataset-cross/)
- [MTOP: A Comprehensive Multilingual Task-Oriented Semantic Parsing Benchmark](https://md.research.elamur.ai/free/en/papers/li-2021-mtop-comprehensive-multilingual-task-oriented/)
- [Bangla Key2Text: Text Generation from Keywords for a Low Resource Language](https://md.research.elamur.ai/free/en/papers/talukder-2026-bangla-key2text-text-generation-keywords/)
- [End-to-End Slot Alignment and Recognition for Cross-Lingual NLU](https://md.research.elamur.ai/free/en/papers/xu-2020-end-end-slot-alignment-recognition/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{schuster2019cross,
  title = {{Cross-lingual Transfer Learning for Multilingual Task Oriented Dialog}},
  author = {Schuster, Sebastian and Gupta, Sonal and Shah, Rushin and Lewis, Mike},
  booktitle = {Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)},
  year = {2019},
  doi = {10.18653/v1/n19-1380},
  url = {https://doi.org/10.18653/v1/n19-1380}
}
```

- [← previous Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing](https://md.research.elamur.ai/free/en/papers/schuster-2019-cross-lingual-alignment-contextual-word/)
- [next → Crowdsourced Hedge Term Disambiguation](https://md.research.elamur.ai/free/en/papers/ulinski-2019-crowdsourced-hedge-term-disambiguation/)
- [↑ back to papers of 2019](https://md.research.elamur.ai/free/en/papers/2019/page/2/)

## References

44 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Ahmed Aly, Kushal Lakhotia, Shicong Zhao, Mrinal Mohit, Barlas Oguz, Abhinav Arora, Sonal Gupta, Christopher Dewan, Stef Nelson-Lindall, and Rushin Shah. 2018. PyText: A seamless path from NLP research to production. ArXiv preprint. [find](https://scholar.google.com/scholar?q=Ahmed+Aly%2C+Kushal+Lakhotia%2C+Shicong+Zhao%2C+Mrinal+Mohit%2C+Barlas+Oguz%2C+Abhinav+Arora%2C+Sonal+Gupta%2C+Christopher+Dewan%2C+Stef+Nelson%2DLindall%2C+and+Rushin+Shah%2E+2018%2E+PyText%3A+A+seamless+path+from+NLP+researc)
2. Waleed Ammar, George Mulcaire, Miguel Ballesteros, Chris Dyer, and Noah A. Smith. 2016. Many languages, one parser. Transactions of the Association for Computational Linguistics, 4:431–444. [find](https://scholar.google.com/scholar?q=Waleed+Ammar%2C+George+Mulcaire%2C+Miguel+Ballesteros%2C+Chris+Dyer%2C+and+Noah+A%2E+Smith%2E+2016%2E+Many+languages%2C+one+parser%2E+Transactions+of+the+Association+for+Computational+Linguistics%2C+4%3A431%E2%80%93444%2E) [our card](https://md.research.elamur.ai/free/en/papers/ammar-2016-many-languages-one-parser/)
3. Mauro Cettolo, Christian Girardi, and Marcello Federico. 2012. Wit 3 : Web inventory of transcribed and translated talks. In Proceedings of the 16 th Conference of the European Association for Machine Translation (EAMT), Trento, Italy. [find](https://scholar.google.com/scholar?q=Mauro+Cettolo%2C+Christian+Girardi%2C+and+Marcello+Federico%2E+2012%2E+Wit+3+%3A+Web+inventory+of+transcribed+and+translated+talks%2E+In+Proceedings+of+the+16+th+Conference+of+the+European+Association+for+Machine)
4. Wanxiang Che, Yijia Liu, Yuxuan Wang, Bo Zheng, and Ting Liu. 2018. Towards better UD parsing: Deep contextualized word embeddings, ensemble, and treebank concatenation. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. [find](https://scholar.google.com/scholar?q=Wanxiang+Che%2C+Yijia+Liu%2C+Yuxuan+Wang%2C+Bo+Zheng%2C+and+Ting+Liu%2E+2018%2E+Towards+better+UD+parsing%3A+Deep+contextualized+word+embeddings%2C+ensemble%2C+and+treebank+concatenation%2E+In+Proceedings+of+the+CoNLL+20)
5. Wenhu Chen, Jianshu Chen, Yu Su, Xin Wang, Dong Yu, Xifeng Yan, and William Yang Wang. 2018. XL-NBT: A cross-lingual neural belief tracking framework. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), pages 414–424. [find](https://scholar.google.com/scholar?q=Wenhu+Chen%2C+Jianshu+Chen%2C+Yu+Su%2C+Xin+Wang%2C+Dong+Yu%2C+Xifeng+Yan%2C+and+William+Yang+Wang%2E+2018%2E+XL%2DNBT%3A+A+cross%2Dlingual+neural+belief+tracking+framework%2E+In+Proceedings+of+the+2018+Conference+on+Empirica)
6. Alexis Conneau, Guillaume Lample, Marc’Aurelio Ranzato, Ludovic Denoyer, and Hervé Jégou. 2017. Word translation without parallel data. In Proceedings of ICLR 2018. [find](https://scholar.google.com/scholar?q=Alexis+Conneau%2C+Guillaume+Lample%2C+Marc%E2%80%99Aurelio+Ranzato%2C+Ludovic+Denoyer%2C+and+Herve%CC%81+Je%CC%81gou%2E+2017%2E+Word+translation+without+parallel+data%2E+In+Proceedings+of+ICLR+2018%2E)
7. Alexis Conneau, Guillaume Lample, Ruty Rinott, Holger Schwenk, Ves Stoyanov, Adina Williams, and Samuel R. Bowman. 2018. XNLI: Evaluating cross-lingual sentence representations. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), pages 2475–2485. [find](https://scholar.google.com/scholar?q=Alexis+Conneau%2C+Guillaume+Lample%2C+Ruty+Rinott%2C+Holger+Schwenk%2C+Ves+Stoyanov%2C+Adina+Williams%2C+and+Samuel+R%2E+Bowman%2E+2018%2E+XNLI%3A+Evaluating+cross%2Dlingual+sentence+representations%2E+In+Proceedings+of+the+)
8. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. ArXiv preprint. [find](https://scholar.google.com/scholar?q=Jacob+Devlin%2C+Ming%2DWei+Chang%2C+Kenton+Lee%2C+and+Kristina+Toutanova%2E+2018%2E+BERT%3A+Pre%2Dtraining+of+deep+bidirectional+transformers+for+language+understanding%2E+ArXiv+preprint%2E)
9. Timothy Dozat, Peng Qi, and Christopher D. Manning. 2017. Stanford’s graph-based neural dependency parser at the CoNLL 2017 shared task. In Proceedings of the CoNLL 2017 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. [find](https://scholar.google.com/scholar?q=Timothy+Dozat%2C+Peng+Qi%2C+and+Christopher+D%2E+Manning%2E+2017%2E+Stanford%E2%80%99s+graph%2Dbased+neural+dependency+parser+at+the+CoNLL+2017+shared+task%2E+In+Proceedings+of+the+CoNLL+2017+Shared+Task%3A+Multilingual+Pars) [our card](https://md.research.elamur.ai/free/en/papers/ud-2017-dozat-stanford-s-graph-based-neural/)
10. Long Duong, Trevor Cohn, Steven Bird, and Paul Cook. 2015. Low resource dependency parsing: Cross-lingual parameter sharing in a neural network parser. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Lan… [find](https://scholar.google.com/scholar?q=Long+Duong%2C+Trevor+Cohn%2C+Steven+Bird%2C+and+Paul+Cook%2E+2015%2E+Low+resource+dependency+parsing%3A+Cross%2Dlingual+parameter+sharing+in+a+neural+network+parser%2E+In+Proceedings+of+the+53rd+Annual+Meeting+of+the)
11. Akiko Eriguchi, Melvin Johnson, Orhan Firat, Hideto Kazawa, and Wolfgang Macherey. 2018. Zero-shot cross-lingual classification using multilingual neural machine translation. ArXiv preprint. [find](https://scholar.google.com/scholar?q=Akiko+Eriguchi%2C+Melvin+Johnson%2C+Orhan+Firat%2C+Hideto+Kazawa%2C+and+Wolfgang+Macherey%2E+2018%2E+Zero%2Dshot+cross%2Dlingual+classification+using+multilingual+neural+machine+translation%2E+ArXiv+preprint%2E)
12. Murhaf Fares, Andrey Kutuzov, Stephan Oepen, and Erik Velldal. 2017. Word vectors, reuse, and replicability: Towards a community repository of large-text resources. In Proceedings of the 21st Nordic Conference on Computational Linguistics, pages 271– 276. [find](https://scholar.google.com/scholar?q=Murhaf+Fares%2C+Andrey+Kutuzov%2C+Stephan+Oepen%2C+and+Erik+Velldal%2E+2017%2E+Word+vectors%2C+reuse%2C+and+replicability%3A+Towards+a+community+repository+of+large%2Dtext+resources%2E+In+Proceedings+of+the+21st+Nordic+C)
13. Jonas Gehring, Michael Auli, David Grangier, and Yann N Dauphin. 2016. A Convolutional Encoder Model for Neural Machine Translation. ArXiv preprint. [find](https://scholar.google.com/scholar?q=Jonas+Gehring%2C+Michael+Auli%2C+David+Grangier%2C+and+Yann+N+Dauphin%2E+2016%2E+A+Convolutional+Encoder+Model+for+Neural+Machine+Translation%2E+ArXiv+preprint%2E) [our card](https://md.research.elamur.ai/free/en/papers/gehring-2017-convolutional-encoder-model-neural-machine/)
14. Jonas Gehring, Michael Auli, David Grangier, Denis Yarats, and Yann N Dauphin. 2017. Convolutional Sequence to Sequence Learning. ArXiv preprint. [find](https://scholar.google.com/scholar?q=Jonas+Gehring%2C+Michael+Auli%2C+David+Grangier%2C+Denis+Yarats%2C+and+Yann+N+Dauphin%2E+2017%2E+Convolutional+Sequence+to+Sequence+Learning%2E+ArXiv+preprint%2E) [our card](https://md.research.elamur.ai/free/en/papers/gehring-2017-convolutional-sequence-sequence-learning/)
15. Diederik P. Kingma and Jimmy Lei Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of ICLR 2015. [find](https://scholar.google.com/scholar?q=Diederik+P%2E+Kingma+and+Jimmy+Lei+Ba%2E+2015%2E+Adam%3A+A+method+for+stochastic+optimization%2E+In+Proceedings+of+ICLR+2015%2E)
16. Philipp Koehn. 2005. Europarl: A parallel corpus for statistical machine translation. In MT summit. [find](https://scholar.google.com/scholar?q=Philipp+Koehn%2E+2005%2E+Europarl%3A+A+parallel+corpus+for+statistical+machine+translation%2E+In+MT+summit%2E)
17. Guillaume Lample, Miguel Ballesteros, Sandeep Subramanian, Kazuya Kawakami, and Chris Dyer. 2016. Neural architectures for named entity recognition. In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAAC… [find](https://scholar.google.com/scholar?q=Guillaume+Lample%2C+Miguel+Ballesteros%2C+Sandeep+Subramanian%2C+Kazuya+Kawakami%2C+and+Chris+Dyer%2E+2016%2E+Neural+architectures+for+named+entity+recognition%2E+In+Proceedings+of+the+2016+Conference+of+the+North+)
18. Zhouhan Lin, Minwei Feng, Cicero Nogueira dos Santos, Mo Yu, Bing Xiang, Bowen Zhou, and Yoshua Bengio. 2017. A structured self-attentive sentence embedding. In Proceedings of ICLR 2017. [find](https://scholar.google.com/scholar?q=Zhouhan+Lin%2C+Minwei+Feng%2C+Cicero+Nogueira+dos+Santos%2C+Mo+Yu%2C+Bing+Xiang%2C+Bowen+Zhou%2C+and+Yoshua+Bengio%2E+2017%2E+A+structured+self%2Dattentive+sentence+embedding%2E+In+Proceedings+of+ICLR+2017%2E) [our card](https://md.research.elamur.ai/free/en/papers/lin-2017-structured-self-attentive-sentence-embedding/)
19. Pierre Lison, Jörg Tiedemann, and Milen Kouylekov. 2018. OpenSubtitles2018: Statistical rescoring of sentence alignments in large, noisy parallel corpora. In Proceedings of the 11th edition of the Language Resources and Evaluation Conference (LREC 2018), pages 1364–1369. [find](https://scholar.google.com/scholar?q=Pierre+Lison%2C+Jo%CC%88rg+Tiedemann%2C+and+Milen+Kouylekov%2E+2018%2E+OpenSubtitles2018%3A+Statistical+rescoring+of+sentence+alignments+in+large%2C+noisy+parallel+corpora%2E+In+Proceedings+of+the+11th+edition+of+the+La) [our card](https://md.research.elamur.ai/free/en/papers/lison-2018-opensubtitles2018-statistical-rescoring-sentence-alignments/)
20. Bing Liu and Ian Lane. 2016. Attention-based recurrent neural network models for joint intent detection and slot filling. In Proceedings of Interspeech 2016. [find](https://scholar.google.com/scholar?q=Bing+Liu+and+Ian+Lane%2E+2016%2E+Attention%2Dbased+recurrent+neural+network+models+for+joint+intent+detection+and+slot+filling%2E+In+Proceedings+of+Interspeech+2016%2E)
21. Minh-Thang Luong, Hieu Pham, and Christopher D. Manning. 2015. Effective approaches to attention-based neural machine translation. In Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing (EMNLP 2015), pages 1412–1421. [find](https://scholar.google.com/scholar?q=Minh%2DThang+Luong%2C+Hieu+Pham%2C+and+Christopher+D%2E+Manning%2E+2015%2E+Effective+approaches+to+attention%2Dbased+neural+machine+translation%2E+In+Proceedings+of+the+2015+Conference+on+Empirical+Methods+in+Natural)
22. Bryan McCann, James Bradbury, and Richard Socher. 2017. Learned in translation: Contextualized word vectors. In Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017). [find](https://scholar.google.com/scholar?q=Bryan+McCann%2C+James+Bradbury%2C+and+Richard+Socher%2E+2017%2E+Learned+in+translation%3A+Contextualized+word+vectors%2E+In+Proceedings+of+the+31st+Conference+on+Neural+Information+Processing+Systems+%28NIPS+2017%29%2E) [our card](https://md.research.elamur.ai/free/en/papers/mccann-2017-learned-translation-contextualized-word-vectors/)
23. Ryan McDonald, Slav Petrov, and Keith Hall. 2011. Multi-source transfer of delexicalized dependency parsers. In Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing (EMNLP 2011), pages 62–72. [find](https://scholar.google.com/scholar?q=Ryan+McDonald%2C+Slav+Petrov%2C+and+Keith+Hall%2E+2011%2E+Multi%2Dsource+transfer+of+delexicalized+dependency+parsers%2E+In+Proceedings+of+the+2011+Conference+on+Empirical+Methods+in+Natural+Language+Processing+%28) [our card](https://md.research.elamur.ai/free/en/papers/mcdonald-2011-multi-source-transfer-delexicalized-dependency/)
24. Grégoire Mesnil, Xiaodong He, Li Deng, and Yoshua Bengio. 2013. Investigation of recurrent-neural-network architectures and learning methods for spoken language understanding. In Proceedings of Interspeech 2013. [find](https://scholar.google.com/scholar?q=Gre%CC%81goire+Mesnil%2C+Xiaodong+He%2C+Li+Deng%2C+and+Yoshua+Bengio%2E+2013%2E+Investigation+of+recurrent%2Dneural%2Dnetwork+architectures+and+learning+methods+for+spoken+language+understanding%2E+In+Proceedings+of+Inter)
25. Guillaume Lample and Alexis Conneau. 2019. Cross-lingual language model pretraining. ArXiv preprint. [find](https://scholar.google.com/scholar?q=Guillaume+Lample+and+Alexis+Conneau%2E+2019%2E+Cross%2Dlingual+language+model+pretraining%2E+ArXiv+preprint%2E)
26. Nikola Mrkšić, Ivan Vulić, Diarmuid Ó Séaghdha, Ira Leviant, Roi Reichart, Milica Gašić, Anna Korhonen, and Steve Young. 2017. Semantic specialization of distributional word vector spaces using monolingual and cross-lingual constraints. Transactions of the Association for Computational Lingui… [find](https://scholar.google.com/scholar?q=Nikola+Mrks%CC%8Cic%CC%81%2C+Ivan+Vulic%CC%81%2C+Diarmuid+O%CC%81+Se%CC%81aghdha%2C+Ira+Leviant%2C+Roi+Reichart%2C+Milica+Gas%CC%8Cic%CC%81%2C+Anna+Korhonen%2C+and+Steve+Young%2E+2017%2E+Semantic+specialization+of+distributional+word+vector+spaces+using)
27. Miryam de Lhoneux, Johannes Bjerva, Isabelle Augenstein, and Anders Søgaard. 2018. Parameter sharing between dependency parsers for related languages. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), pages 4992–4997. [find](https://scholar.google.com/scholar?q=Miryam+de+Lhoneux%2C+Johannes+Bjerva%2C+Isabelle+Augenstein%2C+and+Anders+S%C3%B8gaard%2E+2018%2E+Parameter+sharing+between+dependency+parsers+for+related+languages%2E+In+Proceedings+of+the+2018+Conference+on+Empirica)
28. Phoebe Mulcaire, Jungo Kasai, and Noah A. Smith. 2019. Polyglot contextual representations improve crosslingual transfer. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL 2019). [find](https://scholar.google.com/scholar?q=Phoebe+Mulcaire%2C+Jungo+Kasai%2C+and+Noah+A%2E+Smith%2E+2019%2E+Polyglot+contextual+representations+improve+crosslingual+transfer%2E+In+Proceedings+of+the+2019+Conference+of+the+North+American+Chapter+of+the+Ass)
29. Gurvan L’Hostis, David Grangier, and Michael Auli. 2016. Vocabulary selection strategies for neural machine translation. ArXiv preprint. [find](https://scholar.google.com/scholar?q=Gurvan+L%E2%80%99Hostis%2C+David+Grangier%2C+and+Michael+Auli%2E+2016%2E+Vocabulary+selection+strategies+for+neural+machine+translation%2E+ArXiv+preprint%2E)
30. Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolog… [find](https://scholar.google.com/scholar?q=Matthew+Peters%2C+Mark+Neumann%2C+Mohit+Iyyer%2C+Matt+Gardner%2C+Christopher+Clark%2C+Kenton+Lee%2C+and+Luke+Zettlemoyer%2E+2018%2E+Deep+contextualized+word+representations%2E+In+Proceedings+of+the+2018+Conference+of+t)
31. Ying Lin, Shengqi Yang, Veselin Stoyanov, and Heng Ji. 2018. A multi-lingual multi-task architecture for low-resource sequence labeling. In Proceedings of Barbara Plank and Željko Agić. 2018. Distant supervision from disparate sources for low-resource part-of-speech tagging. In Proceedings of the… [find](https://scholar.google.com/scholar?q=Ying+Lin%2C+Shengqi+Yang%2C+Veselin+Stoyanov%2C+and+Heng+Ji%2E+2018%2E+A+multi%2Dlingual+multi%2Dtask+architecture+for+low%2Dresource+sequence+labeling%2E+In+Proceedings+of+Barbara+Plank+and+Z%CC%8Celjko+Agic%CC%81%2E+2018%2E+Distan)
32. Katherin Yu, Haoran Li, and Barlas Oguz. 2018a. Multilingual seq2seq training with similarity loss for cross-lingual document classification. In Proceedings of The Third Workshop on Representation Learning for NLP, pages 175–179. [find](https://scholar.google.com/scholar?q=Katherin+Yu%2C+Haoran+Li%2C+and+Barlas+Oguz%2E+2018a%2E+Multilingual+seq2seq+training+with+similarity+loss+for+cross%2Dlingual+document+classification%2E+In+Proceedings+of+The+Third+Workshop+on+Representation+Lea)
33. Sebastian Ruder, Ivan Vulić, and Anders Søgaard. 2017. A survey of cross-lingual word embedding models. ArXiv preprint. [find](https://scholar.google.com/scholar?q=Sebastian+Ruder%2C+Ivan+Vulic%CC%81%2C+and+Anders+S%C3%B8gaard%2E+2017%2E+A+survey+of+cross%2Dlingual+word+embedding+models%2E+ArXiv+preprint%2E)
34. Xiaodong Yu, Stephen Mayhew, Mark Sammons, and Dan Roth. 2018b. On the strength of character language models for multilingual named entity recognition. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), pages 3073–3077. [find](https://scholar.google.com/scholar?q=Xiaodong+Yu%2C+Stephen+Mayhew%2C+Mark+Sammons%2C+and+Dan+Roth%2E+2018b%2E+On+the+strength+of+character+language+models+for+multilingual+named+entity+recognition%2E+In+Proceedings+of+the+2018+Conference+on+Empiric)
35. Tal Schuster, Ori Ram, Regina Barzilay, and Amir Globerson. 2019. Cross-lingual alignment of contextual word embeddings, with applications to zero-shot dependency parsing. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Lang… [find](https://scholar.google.com/scholar?q=Tal+Schuster%2C+Ori+Ram%2C+Regina+Barzilay%2C+and+Amir+Globerson%2E+2019%2E+Cross%2Dlingual+alignment+of+contextual+word+embeddings%2C+with+applications+to+zero%2Dshot+dependency+parsing%2E+In+Proceedings+of+the+2019+C) [our card](https://md.research.elamur.ai/free/en/papers/schuster-2019-cross-lingual-alignment-contextual-word/)
36. Daniel Zeman and Philip Resnik. 2008. Cross-language parser adaptation between related languages. In Proceedings of the IJCNLP-08 Workshop on NLP for Less Privileged Languages. [find](https://scholar.google.com/scholar?q=Daniel+Zeman+and+Philip+Resnik%2E+2008%2E+Cross%2Dlanguage+parser+adaptation+between+related+languages%2E+In+Proceedings+of+the+IJCNLP%2D08+Workshop+on+NLP+for+Less+Privileged+Languages%2E) [our card](https://md.research.elamur.ai/free/en/papers/zeman-2008-cross-language-parser-adaptation-between/)
37. Karan Singla, Dogan Can, and Shrikanth Narayanan. 2018. A multi-task approach to learning multilingual representations. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL 2018), pages 214–220. [find](https://scholar.google.com/scholar?q=Karan+Singla%2C+Dogan+Can%2C+and+Shrikanth+Narayanan%2E+2018%2E+A+multi%2Dtask+approach+to+learning+multilingual+representations%2E+In+Proceedings+of+the+56th+Annual+Meeting+of+the+Association+for+Computational+L)
38. Aaron Smith, Bernd Bohnet, and Miryam de Lhoneux. 2018. 82 treebanks, 34 models: Universal Dependency parsing with multi-treebank models. In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies. [find](https://scholar.google.com/scholar?q=Aaron+Smith%2C+Bernd+Bohnet%2C+and+Miryam+de+Lhoneux%2E+2018%2E+82+treebanks%2C+34+models%3A+Universal+Dependency+parsing+with+multi%2Dtreebank+models%2E+In+Proceedings+of+the+CoNLL+2018+Shared+Task%3A+Multilingual+Par)
39. Raymond Hendy Susanto and Wei Lu. 2017. Neural architectures for multilingual semantic parsing. In Proceedings of the 55th Annual Meeting ofthe Association for Computational Linguistics (ACL 2017), pages 38–44. [find](https://scholar.google.com/scholar?q=Raymond+Hendy+Susanto+and+Wei+Lu%2E+2017%2E+Neural+architectures+for+multilingual+semantic+parsing%2E+In+Proceedings+of+the+55th+Annual+Meeting+ofthe+Association+for+Computational+Linguistics+%28ACL+2017%29%2C+pa)
40. Shyam Upadhyay, Manaal Faruqui, Gokhan Tür, Dilek Hakkani-Tür, and Larry Heck. 2018. (Almost) zero-shot cross-lingual spoken language understanding. In Proceedings of the IEEE ICASSP 2018. [find](https://scholar.google.com/scholar?q=Shyam+Upadhyay%2C+Manaal+Faruqui%2C+Gokhan+Tu%CC%88r%2C+Dilek+Hakkani%2DTu%CC%88r%2C+and+Larry+Heck%2E+2018%2E+%28Almost%29+zero%2Dshot+cross%2Dlingual+spoken+language+understanding%2E+In+Proceedings+of+the+IEEE+ICASSP+2018%2E)
41. Ngoc Thang Vu. 2016. Sequential convolutional neural networks for slot filling in spoken language understanding. In Proceedings of Interspeech 2016, pages 3250–3254. [find](https://scholar.google.com/scholar?q=Ngoc+Thang+Vu%2E+2016%2E+Sequential+convolutional+neural+networks+for+slot+filling+in+spoken+language+understanding%2E+In+Proceedings+of+Interspeech+2016%2C+pages+3250%E2%80%933254%2E)
42. Jiateng Xie, Zhilin Yang, Graham Neubig, Noah A. Smith, and Jaime Carbonell. 2018. Neural cross-lingual named entity recognition with minimal resources. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), pages 369–379. [find](https://scholar.google.com/scholar?q=Jiateng+Xie%2C+Zhilin+Yang%2C+Graham+Neubig%2C+Noah+A%2E+Smith%2C+and+Jaime+Carbonell%2E+2018%2E+Neural+cross%2Dlingual+named+entity+recognition+with+minimal+resources%2E+In+Proceedings+of+the+2018+Conference+on+Empiri) [our card](https://md.research.elamur.ai/free/en/papers/xie-2018-neural-cross-lingual-named-entity/)
43. Zhilin Yang, Ruslan Salakhutdinov, and William W. Cohen. 2017. Transfer learning for sequence tagging with hierarchical recurrent networks. In Proceedings of ICLR 2017. [find](https://scholar.google.com/scholar?q=Zhilin+Yang%2C+Ruslan+Salakhutdinov%2C+and+William+W%2E+Cohen%2E+2017%2E+Transfer+learning+for+sequence+tagging+with+hierarchical+recurrent+networks%2E+In+Proceedings+of+ICLR+2017%2E)
44. David Yarowsky, Grace Ngai, and Richard Wicentowski. 2001. Inducing multilingual text analysis tools via robust projection across aligned corpora. In Proceedings of the First International Conference on Human Language Technology Research. [find](https://scholar.google.com/scholar?q=David+Yarowsky%2C+Grace+Ngai%2C+and+Richard+Wicentowski%2E+2001%2E+Inducing+multilingual+text+analysis+tools+via+robust+projection+across+aligned+corpora%2E+In+Proceedings+of+the+First+International+Conference+) [our card](https://md.research.elamur.ai/free/en/papers/yarowsky-2001-inducing-multilingual-text-analysis-tools/)