---
title: "Empower Sequence Labeling with Task-Aware Neural — Liu 2017"
description: "Neural sequence labelers for POS tagging, chunking and NER have many parameters, but annotated corpora are usually small."
authors: ["Liyuan Liu", "Jingbo Shang", "Frank F. Xu", "Xiang Ren", "Huan Gui", "Jian Peng", "Jiawei Han"]
year: 2017
venue: "arXiv:1709.04109"
source: "https://arxiv.org/abs/1709.04109"
doi: "10.48550/arxiv.1709.04109"
arxiv: "1709.04109"
licence: "arXiv — non-exclusive license to distribute"
licence_url: "http://arxiv.org/licenses/nonexclusive-distrib/1.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/liu-2017-empower-sequence-labeling-task-aware/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/liu-2017-empower-sequence-labeling-task-aware/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2017](https://md.research.elamur.ai/free/en/papers/2017/page/2/) / Empower Sequence Labeling with Task-Aware Neural Language Model

# Empower Sequence Labeling with Task-Aware Neural Language Model

**Authors:** [Liyuan Liu](https://md.research.elamur.ai/free/en/authors/liyuan-liu/), [Jingbo Shang](https://md.research.elamur.ai/free/en/authors/jingbo-shang/), [Frank F. Xu](https://md.research.elamur.ai/free/en/authors/frank-f-xu/), [Xiang Ren](https://md.research.elamur.ai/free/en/authors/xiang-ren/), Huan Gui, [Jian Peng](https://md.research.elamur.ai/free/en/authors/jian-peng/), [Jiawei Han](https://md.research.elamur.ai/free/en/authors/jiawei-han/) · **Year:** 2017 · **Venue:** arXiv:1709.04109 · **Licence:** [arXiv — non-exclusive license to distribute](http://arxiv.org/licenses/nonexclusive-distrib/1.0/)

**Links:** [Publisher's page](https://arxiv.org/abs/1709.04109) · [PDF](https://arxiv.org/pdf/1709.04109) · [DOI 10.48550/arxiv.1709.04109](https://doi.org/10.48550/arxiv.1709.04109) · [arXiv 1709.04109](https://arxiv.org/abs/1709.04109) · [OpenAlex](https://openalex.org/W2756381707)

**Citations:** 333 citations (openalex-snapshot · 2026-10-14) · [86](#cited-by) in our library, of the 140884 papers whose bibliographies we read

## Summary
Neural sequence labelers for POS tagging, chunking and NER have many parameters, but annotated corpora are usually small. Extra supervision from related tasks is often unavailable, especially for low-resource languages or niche domains. Large pre-trained language models can supply character-level knowledge, but they need external corpora and very costly training. The authors propose LM-LSTM-CRF, which trains a character-level language model jointly with the tagger on the same training sentences, so no extra annotation or corpus is required.

A shared forward and backward character LSTM predicts the next word at each word boundary. Separate highway layers then map its output into one space for the language model and another for the tagger. These features are concatenated with fine-tuned pre-trained word embeddings and passed to a word-level bi-LSTM with a CRF on top.

Evaluated on CoNLL03 NER, CoNLL00 chunking and WSJ Penn Treebank POS, the model reports state-of-the-art results. On CoNLL03 it reaches F1 91.71±0.10 after about 6 hours on one GPU. This shows that task-guided co-training can replace expensive pre-training.

## Key points
- Benchmarks: CoNLL 2003 NER, CoNLL 2000 chunking, and the WSJ portion of the Penn Treebank for POS tagging. The authors report state-of-the-art results on all three.
- On CoNLL03 NER, F1 is 91.71±0.10, with training taking roughly 6 hours on a single GPU. No additional annotations are used.
- For contrast, one language model in the earlier pre-training approach (Peters et al. 2017) needed 32 GPUs for over half a month.
- The design uses four highway units (forward/backward × LM/SL) with ReLU, a word-level bi-LSTM, and a CRF over BIOES-style labels.
- Ablations on CoNLL03:
  - Co-training without highway layers (NH) does worse than using highway layers with no LM objective (NL).
  - As hidden size grows, LM-LSTM-CRF keeps improving. LSTM-CNN-CRF peaks at size 200, and LSTM-CRF drops at that size.

## Interesting ideas
- **Self-supervision from the labeled data itself.** A language-model objective on the training sentences adds a learning signal without any new data. This is attractive for low-resource languages such as Ukrainian, where both annotations and compute are limited.
- **Task-specific adapters over a shared encoder.** When the auxiliary and main tasks pull in different directions, give each its own transformation layer (here, highway units) on top of the shared features. The paper shows that naive sharing can actually hurt, so this mediation step is worth copying in any multi-task setup.
- **Word-level LM objective on a character encoder.** Predicting the next word only at word boundaries pushes the character LSTM toward lexical features rather than memorizing spelling. This is a cheap way to get morphology-aware representations.
- **Choose the transfer strategy by parameter budget.** The word level holds most of the parameters, so pre-trained embeddings are simply fine-tuned. The character level has few parameters, so it is co-trained instead. This split avoids costly full pre-training.
- **Scaling hidden size as an overfitting probe.** Comparing how each model behaves as hidden size grows shows whether an auxiliary objective really regularizes the model. It is a simple diagnostic that can be reused in other experiments.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/) · [Computing & GPUs](https://md.research.elamur.ai/free/en/shelves/computing/)

Topics: [Named entity recognition](https://md.research.elamur.ai/free/en/topics/named-entity-recognition/) · [Treebanks](https://md.research.elamur.ai/free/en/topics/treebanks/) · [Part-of-speech tagging](https://md.research.elamur.ai/free/en/topics/part-of-speech-tagging/)

## Cited by

Cited by

86 papers of our library cite it (of the 140884 whose bibliographies we read); 5 of them have a page here, 81 not yet.

- [Contextual String Embeddings for Sequence Labeling](https://md.research.elamur.ai/free/en/papers/akbik-2018-contextual-string-embeddings-sequence-labeling/)
- [Unicoder: A Universal Language Encoder by Pre-training with Multiple Cross-lingual Tasks](https://md.research.elamur.ai/free/en/papers/huang-2019-unicoder-universal-language-encoder-pre/)
- [Learning Named Entity Tagger using Domain-Specific Dictionary](https://md.research.elamur.ai/free/en/papers/shang-2018-learning-named-entity-tagger-domain/)
- [How to Fine-Tune BERT for Text Classification?](https://md.research.elamur.ai/free/en/papers/sun-2019-fine-tune-bert-text-classification/)
- [Chinese NER Using Lattice LSTM](https://md.research.elamur.ai/free/en/papers/zhang-2018-chinese-ner-lattice-lstm/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@misc{liu2017empower,
  title = {{Empower Sequence Labeling with Task-Aware Neural Language Model}},
  author = {Liu, Liyuan and Shang, Jingbo and Xu, Frank F. and Ren, Xiang and Gui, Huan and Peng, Jian and Han, Jiawei},
  year = {2017},
  doi = {10.48550/arxiv.1709.04109},
  eprint = {1709.04109},
  archivePrefix = {arXiv},
  url = {https://doi.org/10.48550/arxiv.1709.04109}
}
```

- [← previous Employing Language Typology for Teaching Biblical Hebrew: A Test Case in Cantonese-Chinese](https://md.research.elamur.ai/free/en/papers/chau-2017-employing-language-typology-teaching-biblical/)
- [next → Encoding Sentences with Graph Convolutional Networks for Semantic Role Labeling](https://md.research.elamur.ai/free/en/papers/marcheggiani-2017-encoding-sentences-graph-convolutional-networks/)
- [↑ back to papers of 2017](https://md.research.elamur.ai/free/en/papers/2017/page/2/)

## References

34 references, 13 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Chieu, H. L., and Ng, H. T. 2002. Named entity recognition: A maximum entropy approach using global information. In COLING. [find](https://scholar.google.com/scholar?q=Chieu%2C+H%2E+L%2E%2C+and+Ng%2C+H%2E+T%2E+2002%2E+Named+entity+recognition%3A+A+maximum+entropy+approach+using+global+information%2E+In+COLING%2E)
2. Chiu, J. P. C., and Nichols, E. 2016. Named entity recognition with bidirectional lstm-cnns. [find](https://scholar.google.com/scholar?q=Chiu%2C+J%2E+P%2E+C%2E%2C+and+Nichols%2C+E%2E+2016%2E+Named+entity+recognition+with+bidirectional+lstm%2Dcnns%2E) [our card](https://md.research.elamur.ai/free/en/papers/chiu-2015-named-entity-recognition-bidirectional-lstm/)
3. TACL. Collobert, R.; Weston, J.; Bottou, L.; Karlen, M.; Kavukcuoglu, K.; and Kuksa, P. P. 2011. Natural language processing (almost) from scratch. JMLR. [find](https://scholar.google.com/scholar?q=TACL%2E+Collobert%2C+R%2E%3B+Weston%2C+J%2E%3B+Bottou%2C+L%2E%3B+Karlen%2C+M%2E%3B+Kavukcuoglu%2C+K%2E%3B+and+Kuksa%2C+P%2E+P%2E+2011%2E+Natural+language+processing+%28almost%29+from+scratch%2E+JMLR%2E) [our card](https://md.research.elamur.ai/free/en/papers/collobert-2011-natural-language-processing-almost-scratch/)
4. Fernandez, J.; Yu, Z.; and Downey, D. 2017. Vecshare: A framework for sharing word representation vectors. [find](https://scholar.google.com/scholar?q=Fernandez%2C+J%2E%3B+Yu%2C+Z%2E%3B+and+Downey%2C+D%2E+2017%2E+Vecshare%3A+A+framework+for+sharing+word+representation+vectors%2E)
5. Florian, R.; Ittycheriah, A.; Jing, H.; and Zhang, T. 2003. Named entity recognition through classifier combination. In CoNLL. [find](https://scholar.google.com/scholar?q=Florian%2C+R%2E%3B+Ittycheriah%2C+A%2E%3B+Jing%2C+H%2E%3B+and+Zhang%2C+T%2E+2003%2E+Named+entity+recognition+through+classifier+combination%2E+In+CoNLL%2E) [our card](https://md.research.elamur.ai/free/en/papers/florian-2003-named-entity-recognition-through-classifier/)
6. Glorot, X., and Bengio, Y. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. [find](https://scholar.google.com/scholar?q=Glorot%2C+X%2E%2C+and+Bengio%2C+Y%2E+2010%2E+Understanding+the+difficulty+of+training+deep+feedforward+neural+networks%2E+In+Proceedings+of+the+Thirteenth+International+Conference+on+Artificial+Intelligence+and+Sta)
7. Hashimoto, K.; Xiong, C.; Tsuruoka, Y.; and Socher, R. 2016. A joint many-task model: Growing a neural network for multiple nlp tasks. arXiv:1611.01587. [find](https://scholar.google.com/scholar?q=Hashimoto%2C+K%2E%3B+Xiong%2C+C%2E%3B+Tsuruoka%2C+Y%2E%3B+and+Socher%2C+R%2E+2016%2E+A+joint+many%2Dtask+model%3A+Growing+a+neural+network+for+multiple+nlp+tasks%2E+arXiv%3A1611%2E01587%2E) [our card](https://md.research.elamur.ai/free/en/papers/hashimoto-2016-joint-many-task-model-growing/)
8. Jozefowicz, R.; Vinyals, O.; Schuster, M.; Shazeer, N.; and Wu, Y. 2016. Exploring the limits of language modeling. arXiv:1602.02410. [find](https://scholar.google.com/scholar?q=Jozefowicz%2C+R%2E%3B+Vinyals%2C+O%2E%3B+Schuster%2C+M%2E%3B+Shazeer%2C+N%2E%3B+and+Wu%2C+Y%2E+2016%2E+Exploring+the+limits+of+language+modeling%2E+arXiv%3A1602%2E02410%2E)
9. Jozefowicz, R.; Zaremba, W.; and Sutskever, I. 2015. An empirical exploration of recurrent network architectures. In ICML. [find](https://scholar.google.com/scholar?q=Jozefowicz%2C+R%2E%3B+Zaremba%2C+W%2E%3B+and+Sutskever%2C+I%2E+2015%2E+An+empirical+exploration+of+recurrent+network+architectures%2E+In+ICML%2E)
10. Karpathy, A. 2015. The unreasonable effectiveness of recurrent neural networks. [http://karpathy.github.io/2015/05/21/rnn-effectiveness/](http://karpathy.github.io/2015/05/21/rnn-effectiveness/). Accessed: 2017-08-22. [↗](http://karpathy.github.io/2015/05/21/rnn-effectiveness/)
11. Lafferty, J. D.; McCallum, A.; and Pereira, F. 2001. Conditional random fields: Probabilistic models for segmenting and labeling sequence data. In ICML. [find](https://scholar.google.com/scholar?q=Lafferty%2C+J%2E+D%2E%3B+McCallum%2C+A%2E%3B+and+Pereira%2C+F%2E+2001%2E+Conditional+random+fields%3A+Probabilistic+models+for+segmenting+and+labeling+sequence+data%2E+In+ICML%2E)
12. Lample, G.; Ballesteros, M.; Kawakami, K.; Subramanian, S.; and Dyer, C. 2016. Neural architectures for named entity recognition. In NAACL-HLT. [find](https://scholar.google.com/scholar?q=Lample%2C+G%2E%3B+Ballesteros%2C+M%2E%3B+Kawakami%2C+K%2E%3B+Subramanian%2C+S%2E%3B+and+Dyer%2C+C%2E+2016%2E+Neural+architectures+for+named+entity+recognition%2E+In+NAACL%2DHLT%2E)
13. Liu, L.; Ren, X.; Zhu, Q.; Zhi, S.; Gui, H.; Ji, H.; and Han, J. 2017. Heterogeneous Supervision for Relation Extraction: A Representation Learning Approach. Proc. EMNLP. [find](https://scholar.google.com/scholar?q=Liu%2C+L%2E%3B+Ren%2C+X%2E%3B+Zhu%2C+Q%2E%3B+Zhi%2C+S%2E%3B+Gui%2C+H%2E%3B+Ji%2C+H%2E%3B+and+Han%2C+J%2E+2017%2E+Heterogeneous+Supervision+for+Relation+Extraction%3A+A+Representation+Learning+Approach%2E+Proc%2E+EMNLP%2E)
14. Luo, G.; Huang, X.; Lin, C.-Y.; and Nie, Z. 2015. Joint named entity recognition and disambiguation. In EMNLP. [find](https://scholar.google.com/scholar?q=Luo%2C+G%2E%3B+Huang%2C+X%2E%3B+Lin%2C+C%2E%2DY%2E%3B+and+Nie%2C+Z%2E+2015%2E+Joint+named+entity+recognition+and+disambiguation%2E+In+EMNLP%2E)
15. Ma, X., and Hovy, E. 2016. End-to-end sequence labeling via bi-directional lstm-cnns-crf. In ACL. [find](https://scholar.google.com/scholar?q=Ma%2C+X%2E%2C+and+Hovy%2C+E%2E+2016%2E+End%2Dto%2Dend+sequence+labeling+via+bi%2Ddirectional+lstm%2Dcnns%2Dcrf%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/ma-2016-end-end-sequence-labeling-bi/)
16. Manning, C. D. 2011. Part-of-speech tagging from 97% to 100%: is it time for some linguistics? In International Conference on Intelligent Text Processing and Computational Linguistics. Springer. [find](https://scholar.google.com/scholar?q=Manning%2C+C%2E+D%2E+2011%2E+Part%2Dof%2Dspeech+tagging+from+97%25+to+100%25%3A+is+it+time+for+some+linguistics%3F+In+International+Conference+on+Intelligent+Text+Processing+and+Computational+Linguistics%2E+Springer%2E) [our card](https://md.research.elamur.ai/free/en/papers/enud-2011-manning-part-speech-tagging-97-100/)
17. Marcus, M. P.; Marcinkiewicz, M. A.; and Santorini, B. 1993. Building a large annotated corpus of english: The penn treebank. Computational linguistics. [find](https://scholar.google.com/scholar?q=Marcus%2C+M%2E+P%2E%3B+Marcinkiewicz%2C+M%2E+A%2E%3B+and+Santorini%2C+B%2E+1993%2E+Building+a+large+annotated+corpus+of+english%3A+The+penn+treebank%2E+Computational+linguistics%2E) [our card](https://md.research.elamur.ai/free/en/papers/bank-1993-marcus-building-large-annotated-corpus-english/)
18. McCallum, A., and Li, W. 2003. Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. In CoNLL. [find](https://scholar.google.com/scholar?q=McCallum%2C+A%2E%2C+and+Li%2C+W%2E+2003%2E+Early+results+for+named+entity+recognition+with+conditional+random+fields%2C+feature+induction+and+web%2Denhanced+lexicons%2E+In+CoNLL%2E) [our card](https://md.research.elamur.ai/free/en/papers/mccallum-2003-early-results-named-entity-recognition/)
19. Mikolov, T.; Sutskever, I.; Chen, K.; Corrado, G. S.; and Dean, J. 2013. Distributed representations of words and phrases and their compositionality. In NIPS. [find](https://scholar.google.com/scholar?q=Mikolov%2C+T%2E%3B+Sutskever%2C+I%2E%3B+Chen%2C+K%2E%3B+Corrado%2C+G%2E+S%2E%3B+and+Dean%2C+J%2E+2013%2E+Distributed+representations+of+words+and+phrases+and+their+compositionality%2E+In+NIPS%2E)
20. Peng, N., and Dredze, M. 2016. Improving named entity recognition for chinese social media with word segmentation representation learning. In ACL. [find](https://scholar.google.com/scholar?q=Peng%2C+N%2E%2C+and+Dredze%2C+M%2E+2016%2E+Improving+named+entity+recognition+for+chinese+social+media+with+word+segmentation+representation+learning%2E+In+ACL%2E)
21. Pennington, J.; Socher, R.; and Manning, C. D. 2014. Glove: Global vectors for word representation. In EMNLP. [find](https://scholar.google.com/scholar?q=Pennington%2C+J%2E%3B+Socher%2C+R%2E%3B+and+Manning%2C+C%2E+D%2E+2014%2E+Glove%3A+Global+vectors+for+word+representation%2E+In+EMNLP%2E)
22. Peters, M. E.; Ammar, W.; Bhagavatula, C.; and Power, R. 2017. Semi-supervised sequence tagging with bidirectional language models. arXiv:1705.00108. [find](https://scholar.google.com/scholar?q=Peters%2C+M%2E+E%2E%3B+Ammar%2C+W%2E%3B+Bhagavatula%2C+C%2E%3B+and+Power%2C+R%2E+2017%2E+Semi%2Dsupervised+sequence+tagging+with+bidirectional+language+models%2E+arXiv%3A1705%2E00108%2E) [our card](https://md.research.elamur.ai/free/en/papers/peters-2017-semi-supervised-sequence-tagging-bidirectional/)
23. Ratinov, L., and Roth, D. 2009. Design challenges and misconceptions in named entity recognition. In CoNLL. [find](https://scholar.google.com/scholar?q=Ratinov%2C+L%2E%2C+and+Roth%2C+D%2E+2009%2E+Design+challenges+and+misconceptions+in+named+entity+recognition%2E+In+CoNLL%2E) [our card](https://md.research.elamur.ai/free/en/papers/ratinov-2009-design-challenges-misconceptions-named-entity/)
24. Rei, M. 2017. Semi-supervised multitask learning for sequence labeling. In ACL. [find](https://scholar.google.com/scholar?q=Rei%2C+M%2E+2017%2E+Semi%2Dsupervised+multitask+learning+for+sequence+labeling%2E+In+ACL%2E)
25. Reimers, N., and Gurevych, I. 2017. Reporting score distributions makes a difference: Performance study of lstm-networks for sequence tagging. arXiv preprint arXiv:1707.09861. [find](https://scholar.google.com/scholar?q=Reimers%2C+N%2E%2C+and+Gurevych%2C+I%2E+2017%2E+Reporting+score+distributions+makes+a+difference%3A+Performance+study+of+lstm%2Dnetworks+for+sequence+tagging%2E+arXiv+preprint+arXiv%3A1707%2E09861%2E) [our card](https://md.research.elamur.ai/free/en/papers/reimers-2017-reporting-score-distributions-makes-difference/)
26. Sha, F., and Pereira, F. 2003. Shallow parsing with conditional random fields. In NAACL-HLT. [find](https://scholar.google.com/scholar?q=Sha%2C+F%2E%2C+and+Pereira%2C+F%2E+2003%2E+Shallow+parsing+with+conditional+random+fields%2E+In+NAACL%2DHLT%2E)
27. Shang, J.; Liu, J.; Jiang, M.; Ren, X.; Voss, C. R.; and Han, J. 2017. Automated phrase mining from massive text corpora. arXiv:1702.04457. — [arXiv:1702.04457](https://arxiv.org/abs/1702.04457) [find](https://scholar.google.com/scholar?q=Shang%2C+J%2E%3B+Liu%2C+J%2E%3B+Jiang%2C+M%2E%3B+Ren%2C+X%2E%3B+Voss%2C+C%2E+R%2E%3B+and+Han%2C+J%2E+2017%2E+Automated+phrase+mining+from+massive+text+corpora%2E+arXiv%3A1702%2E04457%2E+%E2%80%94+%5BarXiv%3A1702%2E04457%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1702%2E04457%29)
28. Søgaard, A., and Goldberg, Y. 2016. Deep multi-task learning with low level tasks supervised at lower layers. In ACL. [find](https://scholar.google.com/scholar?q=S%C3%B8gaard%2C+A%2E%2C+and+Goldberg%2C+Y%2E+2016%2E+Deep+multi%2Dtask+learning+with+low+level+tasks+supervised+at+lower+layers%2E+In+ACL%2E) [our card](https://md.research.elamur.ai/free/en/papers/sogaard-2016-deep-multi-task-learning-low/)
29. Søgaard, A. 2011. Semisupervised condensed nearest neighbor for part-of-speech tagging. In NAACL-HLT. [find](https://scholar.google.com/scholar?q=S%C3%B8gaard%2C+A%2E+2011%2E+Semisupervised+condensed+nearest+neighbor+for+part%2Dof%2Dspeech+tagging%2E+In+NAACL%2DHLT%2E)
30. Srivastava, R. K.; Greff, K.; and Schmidhuber, J. 2015. [find](https://scholar.google.com/scholar?q=Srivastava%2C+R%2E+K%2E%3B+Greff%2C+K%2E%3B+and+Schmidhuber%2C+J%2E+2015%2E)
31. Sun, X. 2014. Structure regularization for structured prediction. In NIPS. [find](https://scholar.google.com/scholar?q=Sun%2C+X%2E+2014%2E+Structure+regularization+for+structured+prediction%2E+In+NIPS%2E)
32. Tjong Kim Sang, E. F., and Buchholz, S. 2000. Introduction to the conll-2000 shared task: Chunking. In Learning language in logic and CoNLL. [find](https://scholar.google.com/scholar?q=Tjong+Kim+Sang%2C+E%2E+F%2E%2C+and+Buchholz%2C+S%2E+2000%2E+Introduction+to+the+conll%2D2000+shared+task%3A+Chunking%2E+In+Learning+language+in+logic+and+CoNLL%2E) [our card](https://md.research.elamur.ai/free/en/papers/sang-2000-introduction-conll-2000-shared-task/)
33. Tjong Kim Sang, E. F., and De Meulder, F. 2003. Introduction to the conll-2003 shared task: Language-independent named entity recognition. In Natural language learning at NAACL-HLT. [find](https://scholar.google.com/scholar?q=Tjong+Kim+Sang%2C+E%2E+F%2E%2C+and+De+Meulder%2C+F%2E+2003%2E+Introduction+to+the+conll%2D2003+shared+task%3A+Language%2Dindependent+named+entity+recognition%2E+In+Natural+language+learning+at+NAACL%2DHLT%2E)
34. Yang, Z.; Salakhutdinov, R.; and Cohen, W. W. 2017. Transfer learning for sequence tagging with hierarchical recurrent networks. arXiv:1703.06345. — [arXiv:1703.06345](https://arxiv.org/abs/1703.06345) [find](https://scholar.google.com/scholar?q=Yang%2C+Z%2E%3B+Salakhutdinov%2C+R%2E%3B+and+Cohen%2C+W%2E+W%2E+2017%2E+Transfer+learning+for+sequence+tagging+with+hierarchical+recurrent+networks%2E+arXiv%3A1703%2E06345%2E+%E2%80%94+%5BarXiv%3A1703%2E06345%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1703%2E06345)