--- title: "Adversarial Deep Averaging Networks for — Chen 2018" description: "The paper addresses sentiment classification in languages with little or no annotated data." authors: ["Xilun Chen", "Yu Sun", "Ben Athiwaratkun", "Claire Cardie", "Kilian Weinberger"] year: 2018 venue: "Transactions of the Association for Computational Linguistics" source: "https://aclanthology.org/Q18-1039/" doi: "10.1162/tacl_a_00039" licence: "CC BY 4.0 (ACL Anthology)" licence_url: "https://creativecommons.org/licenses/by/4.0/" summary_licence: "Elamur Cosmic License" canonical: "https://research.elamur.ai/free/en/papers/chen-2018-adversarial-deep-averaging-networks-cross/" --- [Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/chen-2018-adversarial-deep-averaging-networks-cross/) [home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2018](https://md.research.elamur.ai/free/en/papers/2018/) / Adversarial Deep Averaging Networks for Cross-Lingual Sentiment Classification # Adversarial Deep Averaging Networks for Cross-Lingual Sentiment Classification **Authors:** [Xilun Chen](https://md.research.elamur.ai/free/en/authors/xilun-chen/), [Yu Sun](https://md.research.elamur.ai/free/en/authors/yu-sun/), [Ben Athiwaratkun](https://md.research.elamur.ai/free/en/authors/ben-athiwaratkun/), [Claire Cardie](https://md.research.elamur.ai/free/en/authors/claire-cardie/), Kilian Weinberger · **Year:** 2018 · **Venue:** Transactions of the Association for Computational Linguistics · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/) **Links:** [Publisher's page](https://aclanthology.org/Q18-1039/) · [PDF](https://aclanthology.org/Q18-1039.pdf) · [DOI 10.1162/tacl\_a\_00039](https://doi.org/10.1162/tacl_a_00039) · [OpenAlex](https://openalex.org/W2963729324) **Citations:** 293 citations (openalex-snapshot · 2026-10-14) · [100](#cited-by) in our library, of the 140884 papers whose bibliographies we read ## Summary The paper addresses sentiment classification in languages with little or no annotated data. It transfers knowledge from labeled English (SOURCE) texts to a TARGET language that has only unlabeled text. The authors propose ADAN, which feeds a Deep Averaging Network (DAN) feature extractor into two branches: a sentiment classifier trained on English labels and an adversarial language discriminator. The extractor is pushed to produce features that predict sentiment well but do not reveal the input's language. Instead of the usual Gradient Reversal Layer, ADAN reduces the Wasserstein distance between the English and target feature distributions, which makes training smoother. The only bilingual resource is a set of bilingual word embeddings (BWEs), which need far less parallel data than a full MT system. On Chinese and Arabic, ADAN significantly beats baselines and state-of-the-art CLSC systems, including an MT-based approach and Xu and Yang's (2017) distillation method. It also stays ahead when some target labels are available. This makes ADAN a cheap option for building sentiment tools in low-resource languages. ## Key points - The setup uses English as SOURCE and Chinese and Arabic as TARGETs. The comparison systems are a DAN trained only on English with BWEs, the mSDA domain-adaptation method (Chen et al., 2012), an LR+MT baseline, and cross-lingual distillation (Xu and Yang, 2017). - With randomly initialized embeddings and no bitext at all, ADAN still beats the BWE-based DAN and mSDA baselines and matches LR+MT. Results are also robust to which BWEs are chosen. - A grid search over k ∈ {1, 2, 4, 8, 16} and λ from 0.00625 to 0.8 shows that the Wasserstein version is more accurate and more stable than ADAN-GRL on the Chinese dev set. - Implementation details: - F has 3 ReLU layers, and P and Q have 2 layers each, all with 900 hidden units. - Both optimizers are Adam with a learning rate of 0.0005. - Q's weights are clipped to [−0.01, 0.01]. - Training runs for 30 epochs with early stopping, in PyTorch. - The code is public at github.com/ccsasuke/adan, and the paper is CC-BY 4.0 (TACL vol. 6, 2018). *Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.* Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/) ## Cited by Cited by 100 papers of our library cite it (of the 140884 whose bibliographies we read); 11 of them have a page here, 89 not yet. - [Sentiment Analysis for Arabic in Social Media Network: A Systematic Mapping Study](https://md.research.elamur.ai/free/en/papers/abo-2019-sentiment-analysis-arabic-social-media/) - [Adversarial Multitask Learning for Joint Multi-Feature and Multi-Dialect Morphological Modeling](https://md.research.elamur.ai/free/en/papers/acl-2019-zalmout-adversarial-multitask-learning-joint-multi/) - [ArSentD-LEV: A Multi-Topic Corpus for Target-based Sentiment Analysis in Arabic Levantine Tweets](https://md.research.elamur.ai/free/en/papers/baly-2019-arsentd-lev-multi-topic-corpus/) - [XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond](https://md.research.elamur.ai/free/en/papers/barbieri-2022-xlm-t-multilingual-language-models/) - [Adversarial Removal of Demographic Attributes from Text Data](https://md.research.elamur.ai/free/en/papers/elazar-2018-adversarial-removal-demographic-attributes-text/) - [A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios](https://md.research.elamur.ai/free/en/papers/hedderich-2021-survey-recent-approaches-natural-language/) - [Adversarial Learning for Neural Dialogue Generation](https://md.research.elamur.ai/free/en/papers/li-2017-adversarial-learning-neural-dialogue-generation/) - [Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processing](https://md.research.elamur.ai/free/en/papers/ponti-2019-modeling-language-variation-universals-survey/) - [Adversarial Connective-exploiting Networks for Implicit Discourse Relation Classification](https://md.research.elamur.ai/free/en/papers/qin-2017-adversarial-connective-exploiting-networks-implicit/) - [End-to-End Slot Alignment and Recognition for Cross-Lingual NLU](https://md.research.elamur.ai/free/en/papers/xu-2020-end-end-slot-alignment-recognition/) - [Adversarial Training for Unsupervised Bilingual Lexicon Induction](https://md.research.elamur.ai/free/en/papers/zhang-2017-adversarial-training-unsupervised-bilingual-lexicon/) ## Cite The paper itself, not this page. BibTeX from the library's record of the work. ```bibtex @article{chen2018adversarial, title = {{Adversarial Deep Averaging Networks for Cross-Lingual Sentiment Classification}}, author = {Chen, Xilun and Sun, Yu and Athiwaratkun, Ben and Cardie, Claire and Weinberger, Kilian}, journal = {Transactions of the Association for Computational Linguistics}, year = {2018}, doi = {10.1162/tacl\_a\_00039}, url = {https://doi.org/10.1162/tacl_a_00039} } ``` - [← previous Achieving Human Parity on Automatic Chinese to English News Translation](https://md.research.elamur.ai/free/en/papers/hassan-2018-achieving-human-parity-automatic-chinese/) - [next → Adversarial Example Generation with Syntactically Controlled Paraphrase Networks](https://md.research.elamur.ai/free/en/papers/iyyer-2018-adversarial-example-generation-syntactically-controlled/) - [↑ back to papers of 2018](https://md.research.elamur.ai/free/en/papers/2018/) ## References 2 references, 0 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet. 1. Martin Arjovsky, Soumith Chintala, and Léon Bottou. 2017. Wasserstein generative adversarial networks. In Proceedings of the 34th International Conference on Machine Learning, volume 70, pages 214–223, Sydney, Australia. [find](https://scholar.google.com/scholar?q=Martin+Arjovsky%2C+Soumith+Chintala%2C+and+L%C3%A9on+Bottou%2E+2017%2E+Wasserstein+generative+adversarial+networks%2E+In+Proceedings+of+the+34th+International+Conference+on+Machine+Learning%2C+volume+70%2C+pages+214%E2%80%93223) 2. Conclusion and Future Work Carmen Banea, Rada Mihalcea, and Janyce Wiebe. 2010. Multilingual subjectivity: Are more languages better? In Proceedings of the 23rd International Conference on Computational Linguistics (COLING 2010), pages 28–36, Beijing, China. [find](https://scholar.google.com/scholar?q=Conclusion+and+Future+Work+Carmen+Banea%2C+Rada+Mihalcea%2C+and+Janyce+Wiebe%2E+2010%2E+Multilingual+subjectivity%3A+Are+more+languages+better%3F+In+Proceedings+of+the+23rd+International+Conference+on+Computation)