---
title: "Multimodal Language Analysis in the Wild — Zadeh 2018"
description: "Studying how people combine words, facial expressions and voice requires large, varied multimodal data, but earlier corpora were small and covered few…"
authors: ["AmirAli Bagher Zadeh", "Paul Pu Liang", "Soujanya Poria", "Erik Cambria", "Louis-Philippe Morency"]
year: 2018
venue: "Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)"
source: "https://aclanthology.org/P18-1208/"
doi: "10.18653/v1/p18-1208"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/zadeh-2018-multimodal-language-analysis-wild-cmu/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/zadeh-2018-multimodal-language-analysis-wild-cmu/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2018](https://md.research.elamur.ai/free/en/papers/2018/page/3/) / Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph

# Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph

**Authors:** [AmirAli Bagher Zadeh](https://md.research.elamur.ai/free/en/authors/amirali-bagher-zadeh/), [Paul Pu Liang](https://md.research.elamur.ai/free/en/authors/paul-pu-liang/), [Soujanya Poria](https://md.research.elamur.ai/free/en/authors/soujanya-poria/), [Erik Cambria](https://md.research.elamur.ai/free/en/authors/erik-cambria/), [Louis-Philippe Morency](https://md.research.elamur.ai/free/en/authors/louis-philippe-morency/) · **Year:** 2018 · **Venue:** Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/P18-1208/) · [PDF](https://aclanthology.org/P18-1208.pdf) · [DOI 10.18653/v1/p18-1208](https://doi.org/10.18653/v1/p18-1208) · [OpenAlex](https://openalex.org/W2883409523)

**Citations:** 1342 citations (openalex-snapshot · 2026-10-14) · [164](#cited-by) in our library, of the 140673 papers whose bibliographies we read

## Summary
Studying how people combine words, facial expressions and voice requires large, varied multimodal data, but earlier corpora were small and covered few speakers, topics and label types. The authors address this with CMU-MOSEI, a collection of YouTube monologue videos annotated for both sentiment and emotion. Videos were selected automatically: face detection confirmed a single speaker, moving-camera recordings were rejected, and each channel could contribute only a limited number of videos. Transcripts are manually written and aligned with the audio down to phonemes. The second contribution is the Dynamic Fusion Graph (DFG). This fusion module links unimodal, bimodal and trimodal representations through learned "efficacies," which make the fusion process inspectable. Inside the Memory Fusion Network pipeline, DFG beats previous models on sentiment and is competitive on emotion recognition. Its efficacies show that language and audio are fused consistently, while vision is used only when it carries useful signal. The release gives NLP researchers a large, freely available benchmark for multimodal affect analysis.

## Key points
- CMU-MOSEI comprises 23,453 labeled segments of video drawn from 1,000 different speakers (proxied by YouTube channels, with at most 10 videos each) and 250 topics. Its total running time is about 65 hours and 54 minutes.
- In the authors' comparison table, it is the largest sentiment/emotion dataset that includes all three modalities (language, vision, audio) and both label types. Its predecessor, CMU-MOSI, has 2,199 clips from 98 speakers.
- The topic distribution is fairly flat: reviews make up 16.2%, debate 2.9% and consulting 1.8%, with the remaining topics spread nearly evenly. The data is distributed through the CMU Multimodal Data SDK on GitHub.
- DFG's interpretable efficacies show three recurring patterns:
  - language→(language, audio) links are consistently strong;
  - single-modality links to the final output are weak;
  - visual paths switch on only when the visual signal is informative.
- Baselines include MFN, MARN, TFN, MV-LSTM, EF-LSTM, BC-LSTM and several language-only and acoustic-only models.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

## Cited by

Cited by

164 papers of our library cite it (of the 140673 whose bibliographies we read); 7 of them have a page here, 157 not yet.

- [A Survey of the State of Explainable AI for Natural Language Processing](https://md.research.elamur.ai/free/en/papers/danilevsky-2020-survey-state-explainable-ai-natural/)
- [Towards Arabic Multimodal Dataset for Sentiment Analysis](https://md.research.elamur.ai/free/en/papers/haouhat-2023-towards-arabic-multimodal-dataset-sentiment/)
- [MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversations](https://md.research.elamur.ai/free/en/papers/poria-2018-meld-multimodal-multi-party-dataset/)
- [Integrating Multimodal Information in Large Pretrained Transformers](https://md.research.elamur.ai/free/en/papers/rahman-2020-integrating-multimodal-information-large-pretrained/)
- [Towards Emotion-aided Multi-modal Dialogue Act Classification](https://md.research.elamur.ai/free/en/papers/saha-2020-emotion-aided-multi-modal-dialogue/)
- [Multimodal Transformer for Unaligned Multimodal Language Sequences](https://md.research.elamur.ai/free/en/papers/tsai-2019-multimodal-transformer-unaligned-multimodal-language/)
- [Early Fusion with Contrastive Learning: A Lightweight Alternative for Multi-modal Classification](https://md.research.elamur.ai/free/en/papers/wernlein-2026-early-fusion-contrastive-learning-lightweight/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{zadeh2018multimodal,
  title = {{Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph}},
  author = {Zadeh, AmirAli Bagher and Liang, Paul Pu and Poria, Soujanya and Cambria, Erik and Morency, Louis-Philippe},
  booktitle = {Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
  year = {2018},
  doi = {10.18653/v1/p18-1208},
  url = {https://doi.org/10.18653/v1/p18-1208}
}
```

- [← previous Multi-Turn Response Selection for Chatbots with Deep Attention Matching Network](https://md.research.elamur.ai/free/en/papers/zhou-2018-multi-turn-response-selection-chatbots/)
- [next → Neural Coreference Resolution with Deep Biaffine Attention by Joint Mention Detection and Mention Clustering](https://md.research.elamur.ai/free/en/papers/zhang-2018-neural-coreference-resolution-deep-biaffine/)
- [↑ back to papers of 2018](https://md.research.elamur.ai/free/en/papers/2018/page/3/)

## References

60 references, 9 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Paavo Alku, Tom Bäckström, and Erkki Vilkman. 2002. Normalized amplitude quotient for parametrization of the glottal flow. the Journal of the Acoustical Society of America 112(2):701–710. [find](https://scholar.google.com/scholar?q=Paavo+Alku%2C+Tom+Ba%CC%88ckstro%CC%88m%2C+and+Erkki+Vilkman%2E+2002%2E+Normalized+amplitude+quotient+for+parametrization+of+the+glottal+flow%2E+the+Journal+of+the+Acoustical+Society+of+America+112%282%29%3A701%E2%80%93710%2E)
2. Paavo Alku, Helmer Strik, and Erkki Vilkman. 1997. Parabolic spectral parameter—a new method for quantification of the glottal flow. Speech Communication 22(1):67–79. [find](https://scholar.google.com/scholar?q=Paavo+Alku%2C+Helmer+Strik%2C+and+Erkki+Vilkman%2E+1997%2E+Parabolic+spectral+parameter%E2%80%94a+new+method+for+quantification+of+the+glottal+flow%2E+Speech+Communication+22%281%29%3A67%E2%80%9379%2E)
3. Tadas Baltrušaitis, Chaitanya Ahuja, and Louis-Philippe Morency. 2017. Multimodal machine learning: A survey and taxonomy. arXiv preprint arXiv:1705.09406 . — [arXiv:1705.09406](https://arxiv.org/abs/1705.09406) [find](https://scholar.google.com/scholar?q=Tadas+Baltrus%CC%8Caitis%2C+Chaitanya+Ahuja%2C+and+Louis%2DPhilippe+Morency%2E+2017%2E+Multimodal+machine+learning%3A+A+survey+and+taxonomy%2E+arXiv+preprint+arXiv%3A1705%2E09406+%2E+%E2%80%94+%5BarXiv%3A1705%2E09406%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs)
4. Tadas Baltrušaitis, Peter Robinson, and Louis-Philippe Morency. 2016. Openface: an open source facial behavior analysis toolkit. In Applications of Computer Vision (WACV), 2016 IEEE Winter Conference on. IEEE, pages 1–10. [find](https://scholar.google.com/scholar?q=Tadas+Baltrus%CC%8Caitis%2C+Peter+Robinson%2C+and+Louis%2DPhilippe+Morency%2E+2016%2E+Openface%3A+an+open+source+facial+behavior+analysis+toolkit%2E+In+Applications+of+Computer+Vision+%28WACV%29%2C+2016+IEEE+Winter+Conference)
5. Minghai Chen, Sen Wang, Paul Pu Liang, Tadas Bal-trušaitis, Amir Zadeh, and Louis-Philippe Morency. 2017. Multimodal sentiment analysis with word-level fusion and reinforcement learning. In Proceedings of the 19th ACM International Conference on Multimodal Interaction. [find](https://scholar.google.com/scholar?q=Minghai+Chen%2C+Sen+Wang%2C+Paul+Pu+Liang%2C+Tadas+Bal%2Dtrus%CC%8Caitis%2C+Amir+Zadeh%2C+and+Louis%2DPhilippe+Morency%2E+2017%2E+Multimodal+sentiment+analysis+with+word%2Dlevel+fusion+and+reinforcement+learning%2E+In+Proceedin)
6. ACM, New York, NY, USA, ICMI 2017, pages 163–171. https://doi.org/10.1145/3136755.3136801. — [doi:10.1145/3136755.3136801](https://doi.org/10.1145/3136755.3136801) [↗](https://doi.org/10.1145/3136755.3136801)
7. Glen Coppersmith and Erin Kelly. 2014. Dynamic wordclouds and vennclouds for exploratory data analysis. In Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces. Association for Computational Linguistics, Baltimore, Maryland, USA, pages 22–29. [find](https://scholar.google.com/scholar?q=Glen+Coppersmith+and+Erin+Kelly%2E+2014%2E+Dynamic+wordclouds+and+vennclouds+for+exploratory+data+analysis%2E+In+Proceedings+of+the+Workshop+on+Interactive+Language+Learning%2C+Visualization%2C+and+Interfaces%2E+)
8. Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Mach. Learn. 20(3):273–297. https://doi.org/10.1023/A:1022627411411. [↗](https://doi.org/10.1023/A:1022627411411)
9. Gilles Degottex, John Kane, Thomas Drugman, Tuomo Raitio, and Stefan Scherer. 2014. Covarep—a collaborative voice analysis repository for speech technologies. In Acoustics, Speech and Signal Processing (ICASSP), 2014 IEEE International Conference on. IEEE, pages 960–964. [find](https://scholar.google.com/scholar?q=Gilles+Degottex%2C+John+Kane%2C+Thomas+Drugman%2C+Tuomo+Raitio%2C+and+Stefan+Scherer%2E+2014%2E+Covarep%E2%80%94a+collaborative+voice+analysis+repository+for+speech+technologies%2E+In+Acoustics%2C+Speech+and+Signal+Processin)
10. A. Dhall, R. Goecke, S. Lucey, and T. Gedeon. 2012. Collecting large, richly annotated facial-expression databases from movies. IEEE MultiMedia 19(3):34– 41. https://doi.org/10.1109/MMUL.2012.26. — [doi:10.1109/mmul.2012.26](https://doi.org/10.1109/mmul.2012.26) [↗](https://doi.org/10.1109/MMUL.2012.26)
11. Abhinav Dhall, O.V. Ramana Murthy, Roland Goecke, Jyoti Joshi, and Tom Gedeon. 2015. Video and image based emotion recognition challenges in the wild: Emotiw 2015. In Proceedings of the 2015 ACM on International Conference on Multimodal Interaction. ACM, New York, NY, USA, ICMI ’15, pages 423–426. h… — [doi:10.1145/2818346.2829994](https://doi.org/10.1145/2818346.2829994) [find](https://scholar.google.com/scholar?q=Abhinav+Dhall%2C+O%2EV%2E+Ramana+Murthy%2C+Roland+Goecke%2C+Jyoti+Joshi%2C+and+Tom+Gedeon%2E+2015%2E+Video+and+image+based+emotion+recognition+challenges+in+the+wild%3A+Emotiw+2015%2E+In+Proceedings+of+the+2015+ACM+on+In)
12. Thomas Drugman and Abeer Alwan. 2011. Joint robust voicing detection and pitch estimation based on residual harmonics. In Interspeech. pages 1973– 1976. [find](https://scholar.google.com/scholar?q=Thomas+Drugman+and+Abeer+Alwan%2E+2011%2E+Joint+robust+voicing+detection+and+pitch+estimation+based+on+residual+harmonics%2E+In+Interspeech%2E+pages+1973%E2%80%93+1976%2E)
13. Thomas Drugman, Mark Thomas, Jon Gudnason, Patrick Naylor, and Thierry Dutoit. 2012. Detection of glottal closure instants from speech signals: A quantitative review. IEEE Transactions on Audio, Speech, and Language Processing 20(3):994–1006. [find](https://scholar.google.com/scholar?q=Thomas+Drugman%2C+Mark+Thomas%2C+Jon+Gudnason%2C+Patrick+Naylor%2C+and+Thierry+Dutoit%2E+2012%2E+Detection+of+glottal+closure+instants+from+speech+signals%3A+A+quantitative+review%2E+IEEE+Transactions+on+Audio%2C+Speec)
14. Sanjay Bilakhia, Stavros Petridis, Anton Nijholt, and Maja Pantic. 2015. The mahnob mimicry database: A database of naturalistic human interactions. Pattern Recognition Letters 66(Supplement C):52 – 61. Paul Ekman, Wallace V Freisen, and Sonia Ancoli. Pattern Recognition in Human Computer Interactio… — [doi:10.1016/j.patrec.2015.03.005](https://doi.org/10.1016/j.patrec.2015.03.005) [find](https://scholar.google.com/scholar?q=Sanjay+Bilakhia%2C+Stavros+Petridis%2C+Anton+Nijholt%2C+and+Maja+Pantic%2E+2015%2E+The+mahnob+mimicry+database%3A+A+database+of+naturalistic+human+interactions%2E+Pattern+Recognition+Letters+66%28Supplement+C%29%3A52+%E2%80%93+6)
15. Leo Breiman. 2001. Random forests. Mach. Learn. 45(1):5–32. https://doi.org/10.1023/A:1010933404324. [↗](https://doi.org/10.1023/A:1010933404324)
16. Carlos Busso, Murtaza Bulut, Chi-Chun Lee, Abe Kazemzadeh, Emily Mower, Samuel Kim, Jeannette Chang, Sungbok Lee, and Shrikanth S. Narayanan. 2008. Iemocap: Interactive emotional dyadic motion capture database. Journal of Language Resources and Evaluation 42(4):335–359. https://doi.org/10.1007/s1057… — [doi:10.1007/s10579-008-9076-6](https://doi.org/10.1007/s10579-008-9076-6) [↗](https://doi.org/10.1007/s1057…)
17. A. Graves, A. r. Mohamed, and G. Hinton. 2013. Speech recognition with deep recurrent neural networks. In 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. pages 6645–6649. https://doi.org/10.1109/ICASSP.2013.6638947. — [doi:10.1109/icassp.2013.6638947](https://doi.org/10.1109/icassp.2013.6638947) [↗](https://doi.org/10.1109/ICASSP.2013.6638947)
18. Michael Grimm, Kristian Kroschel, and Shrikanth Narayanan. 2008. The vera am mittag german audiovisual emotional speech database. In ICME. IEEE, pages 865–868. [find](https://scholar.google.com/scholar?q=Michael+Grimm%2C+Kristian+Kroschel%2C+and+Shrikanth+Narayanan%2E+2008%2E+The+vera+am+mittag+german+audiovisual+emotional+speech+database%2E+In+ICME%2E+IEEE%2C+pages+865%E2%80%93868%2E)
19. Devamanyu Hazarika, Soujanya Poria, Amir Zadeh, Erik Cambria, Louis-Philippe Morency, and Roger Zimmerman. 2018. Memn: Multimodal emotional memory network for emotion recognition in dyadic conversational videos. In NAACL. [find](https://scholar.google.com/scholar?q=Devamanyu+Hazarika%2C+Soujanya+Poria%2C+Amir+Zadeh%2C+Erik+Cambria%2C+Louis%2DPhilippe+Morency%2C+and+Roger+Zimmerman%2E+2018%2E+Memn%3A+Multimodal+emotional+memory+network+for+emotion+recognition+in+dyadic+conversatio)
20. Louis-Philippe Morency, Rada Mihalcea, and Payal Doshi. 2011. Towards multimodal sentiment analysis: Harvesting opinions from the web. In Proceedings of the 13th International Conference on Multimodal Interactions. ACM, pages 169–176. [find](https://scholar.google.com/scholar?q=Louis%2DPhilippe+Morency%2C+Rada+Mihalcea%2C+and+Payal+Doshi%2E+2011%2E+Towards+multimodal+sentiment+analysis%3A+Harvesting+opinions+from+the+web%2E+In+Proceedings+of+the+13th+International+Conference+on+Multimodal)
21. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9(8):1735– 1780. [find](https://scholar.google.com/scholar?q=Sepp+Hochreiter+and+Ju%CC%88rgen+Schmidhuber%2E+1997%2E+Long+short%2Dterm+memory%2E+Neural+computation+9%288%29%3A1735%E2%80%93+1780%2E)
22. Friedrich Max Müller. 1866. Lectures on the science of language: Delivered at the Royal Institution of Great Britain in April, May, & June 1861, volume 1. Longmans, Green. iMotions. 2017. goo.gl/1rh1JN. [find](https://scholar.google.com/scholar?q=Friedrich+Max+Mu%CC%88ller%2E+1866%2E+Lectures+on+the+science+of+language%3A+Delivered+at+the+Royal+Institution+of+Great+Britain+in+April%2C+May%2C+%26+June+1861%2C+volume+1%2E+Longmans%2C+Green%2E+iMotions%2E+2017%2E+goo%2Egl%2F1rh1)
23. Behnaz Nojavanasghari, Deepak Gopinath, Jayanth Koushik, Tadas Baltrušaitis, and Louis-Philippe Morency. 2016. Deep multimodal fusion for persuasiveness prediction. In Proceedings of the 18th ACM International Conference on Multimodal Interaction. [find](https://scholar.google.com/scholar?q=Behnaz+Nojavanasghari%2C+Deepak+Gopinath%2C+Jayanth+Koushik%2C+Tadas+Baltrus%CC%8Caitis%2C+and+Louis%2DPhilippe+Morency%2E+2016%2E+Deep+multimodal+fusion+for+persuasiveness+prediction%2E+In+Proceedings+of+the+18th+ACM+Int)
24. ACM, New York, NY, USA, ICMI 2016, pages 284– 288. https://doi.org/10.1145/2993148.2993176. — [doi:10.1145/2993148.2993176](https://doi.org/10.1145/2993148.2993176) [↗](https://doi.org/10.1145/2993148.2993176)
25. Facial expression analysis. Mohit Iyyer, Varun Manjunatha, Jordan L Boyd-Graber, and Hal Daumé III. 2015. Deep unordered composition rivals syntactic methods for text classification. In ACL (1). pages 1681–1691. [find](https://scholar.google.com/scholar?q=Facial+expression+analysis%2E+Mohit+Iyyer%2C+Varun+Manjunatha%2C+Jordan+L+Boyd%2DGraber%2C+and+Hal+Daume%CC%81+III%2E+2015%2E+Deep+unordered+composition+rivals+syntactic+methods+for+text+classification%2E+In+ACL+%281%29%2E+page) [our card](https://md.research.elamur.ai/free/en/papers/iyyer-2015-deep-unordered-composition-rivals-syntactic/)
26. Shuiwang Ji, Wei Xu, Ming Yang, and Kai Yu. 2013. 3d convolutional neural networks for human action recognition. IEEE Trans. Pattern Anal. Mach. Intell. 35(1):221–231. https://doi.org/10.1109/TPAMI.2012.59. — [doi:10.1109/tpami.2012.59](https://doi.org/10.1109/tpami.2012.59) [↗](https://doi.org/10.1109/TPAMI.2012.59)
27. Nal Kalchbrenner, Edward Grefenstette, and Phil Blunsom. 2014. A convolutional neural network for modelling sentences. arXiv preprint arXiv:1404.2188 . [find](https://scholar.google.com/scholar?q=Nal+Kalchbrenner%2C+Edward+Grefenstette%2C+and+Phil+Blunsom%2E+2014%2E+A+convolutional+neural+network+for+modelling+sentences%2E+arXiv+preprint+arXiv%3A1404%2E2188+%2E) [our card](https://md.research.elamur.ai/free/en/papers/kalchbrenner-2014-convolutional-neural-network-modelling-sentences/)
28. John Kane and Christer Gobl. 2013. Wavelet maxima dispersion for breathy to tense voice discrimination. IEEE Transactions on Audio, Speech, and Language Processing 21(6):1170–1179. [find](https://scholar.google.com/scholar?q=John+Kane+and+Christer+Gobl%2E+2013%2E+Wavelet+maxima+dispersion+for+breathy+to+tense+voice+discrimination%2E+IEEE+Transactions+on+Audio%2C+Speech%2C+and+Language+Processing+21%286%29%3A1170%E2%80%931179%2E)
29. Wootaek Lim, Daeyoung Jang, and Taejin Lee. 2016. Speech emotion recognition using convolutional and recurrent neural networks. In Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2016 Asia-Pacific. IEEE, pages 1–4. [find](https://scholar.google.com/scholar?q=Wootaek+Lim%2C+Daeyoung+Jang%2C+and+Taejin+Lee%2E+2016%2E+Speech+emotion+recognition+using+convolutional+and+recurrent+neural+networks%2E+In+Signal+and+Information+Processing+Association+Annual+Summit+and+Confe)
30. Weiyang Liu, Yandong Wen, Zhiding Yu, Ming Li, Bhiksha Raj, and Le Song. 2017. Sphereface: Deep hypersphere embedding for face recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. [find](https://scholar.google.com/scholar?q=Weiyang+Liu%2C+Yandong+Wen%2C+Zhiding+Yu%2C+Ming+Li%2C+Bhiksha+Raj%2C+and+Le+Song%2E+2017%2E+Sphereface%3A+Deep+hypersphere+embedding+for+face+recognition%2E+In+Proceedings+of+the+IEEE+conference+on+computer+vision+and)
31. Andrew L. Maas, Raymond E. Daly, Peter T. Pham, Dan Huang, Andrew Y. Ng, and Christopher Potts. 2011. Learning word vectors for sentiment analysis. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. Association for Computational L… [find](https://scholar.google.com/scholar?q=Andrew+L%2E+Maas%2C+Raymond+E%2E+Daly%2C+Peter+T%2E+Pham%2C+Dan+Huang%2C+Andrew+Y%2E+Ng%2C+and+Christopher+Potts%2E+2011%2E+Learning+word+vectors+for+sentiment+analysis%2E+In+Proceedings+of+the+49th+Annual+Meeting+of+the+Ass) [our card](https://md.research.elamur.ai/free/en/papers/maas-2011-learning-word-vectors-sentiment-analysis/)
32. Christopher D. Manning, Mihai Surdeanu, John Bauer, Jenny Finkel, Steven J. Bethard, and David McClosky. 2014. The Stanford CoreNLP natural language processing toolkit. In Association for Computational Linguistics (ACL) System Demonstrations. pages 55–60. [http://www.aclweb.org/anthology/P/P14/P14-50…](http://www.aclweb.org/anthology/P/P14/P14-50…) [↗](http://www.aclweb.org/anthology/P/P14/P14-50…) [our card](https://md.research.elamur.ai/free/en/papers/manning-2014-stanford-corenlp-natural-language-processing/)
33. Bo Pang, Lillian Lee, and Shivakumar Vaithyanathan. 2002. Thumbs up? sentiment classification using machine learning techniques. In Proceedings of EMNLP. pages 79–86. [find](https://scholar.google.com/scholar?q=Bo+Pang%2C+Lillian+Lee%2C+and+Shivakumar+Vaithyanathan%2E+2002%2E+Thumbs+up%3F+sentiment+classification+using+machine+learning+techniques%2E+In+Proceedings+of+EMNLP%2E+pages+79%E2%80%9386%2E) [our card](https://md.research.elamur.ai/free/en/papers/pang-2002-thumbs-up-sentiment-classification-machine/)
34. Sunghyun Park, Han Suk Shim, Moitreya Chatterjee, Kenji Sagae, and Louis-Philippe Morency. 2014. Computational analysis of persuasiveness in social multimedia: A novel dataset and multimodal prediction approach. In Proceedings of the 16th International Conference on Multimodal Interaction. ACM, New… — [doi:10.1145/2663204.2663260](https://doi.org/10.1145/2663204.2663260) [find](https://scholar.google.com/scholar?q=Sunghyun+Park%2C+Han+Suk+Shim%2C+Moitreya+Chatterjee%2C+Kenji+Sagae%2C+and+Louis%2DPhilippe+Morency%2E+2014%2E+Computational+analysis+of+persuasiveness+in+social+multimedia%3A+A+novel+dataset+and+multimodal+predictio)
35. Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In EMNLP. volume 14, pages 1532– 1543. [find](https://scholar.google.com/scholar?q=Jeffrey+Pennington%2C+Richard+Socher%2C+and+Christopher+D+Manning%2E+2014%2E+Glove%3A+Global+vectors+for+word+representation%2E+In+EMNLP%2E+volume+14%2C+pages+1532%E2%80%93+1543%2E)
36. Veronica Perez-Rosas, Rada Mihalcea, and Louis-Philippe Morency. 2013. Utterance-Level Multimodal Sentiment Analysis. In Association for Computational Linguistics (ACL). Sofia, Bulgaria. [find](https://scholar.google.com/scholar?q=Veronica+Perez%2DRosas%2C+Rada+Mihalcea%2C+and+Louis%2DPhilippe+Morency%2E+2013%2E+Utterance%2DLevel+Multimodal+Sentiment+Analysis%2E+In+Association+for+Computational+Linguistics+%28ACL%29%2E+Sofia%2C+Bulgaria%2E)
37. Soujanya Poria, Erik Cambria, Devamanyu Hazarika, Navonil Mazumder, Amir Zadeh, and Louis-Philippe Morency. 2017a. Context dependent sentiment analysis in user generated videos. In Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Soujanya+Poria%2C+Erik+Cambria%2C+Devamanyu+Hazarika%2C+Navonil+Mazumder%2C+Amir+Zadeh%2C+and+Louis%2DPhilippe+Morency%2E+2017a%2E+Context+dependent+sentiment+analysis+in+user+generated+videos%2E+In+Association+for+Com) [our card](https://md.research.elamur.ai/free/en/papers/poria-2017-context-dependent-sentiment-analysis-user/)
38. Soujanya Poria, Erik Cambria, Devamanyu Hazarika, Navonil Mazumder, Amir Zadeh, and Louis-Philippe Morency. 2017b. Context-dependent sentiment analysis in user-generated videos. In Association for Computational Linguistics. [find](https://scholar.google.com/scholar?q=Soujanya+Poria%2C+Erik+Cambria%2C+Devamanyu+Hazarika%2C+Navonil+Mazumder%2C+Amir+Zadeh%2C+and+Louis%2DPhilippe+Morency%2E+2017b%2E+Context%2Ddependent+sentiment+analysis+in+user%2Dgenerated+videos%2E+In+Association+for+Com) [our card](https://md.research.elamur.ai/free/en/papers/poria-2017-context-dependent-sentiment-analysis-user/)
39. Soujanya Poria, Iti Chaturvedi, Erik Cambria, and Amir Hussain. 2016. Convolutional mkl based multimodal emotion recognition and sentiment analysis. In Data Mining (ICDM), 2016 IEEE 16th International Conference on. IEEE, pages 439–448. [find](https://scholar.google.com/scholar?q=Soujanya+Poria%2C+Iti+Chaturvedi%2C+Erik+Cambria%2C+and+Amir+Hussain%2E+2016%2E+Convolutional+mkl+based+multimodal+emotion+recognition+and+sentiment+analysis%2E+In+Data+Mining+%28ICDM%29%2C+2016+IEEE+16th+International)
40. Shyam Sundar Rajagopalan, Louis-Philippe Morency, Tadas Baltrušaitis, and Roland Goecke. 2016. Extending long short-term memory for multi-view structured learning. In European Conference on Computer Vision. [find](https://scholar.google.com/scholar?q=Shyam+Sundar+Rajagopalan%2C+Louis%2DPhilippe+Morency%2C+Tadas+Baltrus%CC%8Caitis%2C+and+Roland+Goecke%2E+2016%2E+Extending+long+short%2Dterm+memory+for+multi%2Dview+structured+learning%2E+In+European+Conference+on+Computer+)
41. Fabien Ringeval, Andreas Sonderegger, Jürgen S. Sauer, and Denis Lalanne. 2013. Introducing the recola multimodal corpus of remote collaborative and affective interactions. In FG. IEEE Computer Society, pages 1–8. [find](https://scholar.google.com/scholar?q=Fabien+Ringeval%2C+Andreas+Sonderegger%2C+Ju%CC%88rgen+S%2E+Sauer%2C+and+Denis+Lalanne%2E+2013%2E+Introducing+the+recola+multimodal+corpus+of+remote+collaborative+and+affective+interactions%2E+In+FG%2E+IEEE+Computer+Socie)
42. Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015. Facenet: A unified embedding for face recognition and clustering. In CVPR. IEEE Computer Society, pages 815–823. [find](https://scholar.google.com/scholar?q=Florian+Schroff%2C+Dmitry+Kalenichenko%2C+and+James+Philbin%2E+2015%2E+Facenet%3A+A+unified+embedding+for+face+recognition+and+clustering%2E+In+CVPR%2E+IEEE+Computer+Society%2C+pages+815%E2%80%93823%2E) [our card](https://md.research.elamur.ai/free/en/papers/schroff-2015-facenet-unified-embedding-face-recognition/)
43. M. Schuster and K.K. Paliwal. 1997. Bidirectional recurrent neural networks. Trans. Sig. Proc. 45(11):2673–2681. https://doi.org/10.1109/78.650093. — [doi:10.1109/78.650093](https://doi.org/10.1109/78.650093) [↗](https://doi.org/10.1109/78.650093)
44. Richard Socher, Alex Perelygin, Jean Y Wu, Jason Chuang, Christopher D Manning, Andrew Y Ng, Christopher Potts, et al. 2013. Recursive deep models for semantic compositionality over a sentiment treebank. In Proceedings of the conference on empirical methods in natural language processing (EMNLP). Ci… [find](https://scholar.google.com/scholar?q=Richard+Socher%2C+Alex+Perelygin%2C+Jean+Y+Wu%2C+Jason+Chuang%2C+Christopher+D+Manning%2C+Andrew+Y+Ng%2C+Christopher+Potts%2C+et+al%2E+2013%2E+Recursive+deep+models+for+semantic+compositionality+over+a+sentiment+treeba)
45. Rupesh K Srivastava, Klaus Greff, and Juergen Schmidhuber. 2015. Training very deep networks. In C. Cortes, N. D. Lawrence, D. D. Lee, M. Sugiyama, and R. Garnett, editors, Advances in Neural Information Processing Systems 28, Curran Associates, Inc., pages 2377–2385. [http://papers.nips.cc/paper/585…](http://papers.nips.cc/paper/585…) [↗](http://papers.nips.cc/paper/585…)
46. Yaniv Taigman, Ming Yang, Marc’Aurelio Ranzato, and Lior Wolf. 2014. Deepface: Closing the gap to human-level performance in face verification. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, Washington, DC, USA, CVPR ’14, pages 1701–1708… — [doi:10.1109/cvpr.2014.220](https://doi.org/10.1109/cvpr.2014.220) [find](https://scholar.google.com/scholar?q=Yaniv+Taigman%2C+Ming+Yang%2C+Marc%E2%80%99Aurelio+Ranzato%2C+and+Lior+Wolf%2E+2014%2E+Deepface%3A+Closing+the+gap+to+human%2Dlevel+performance+in+face+verification%2E+In+Proceedings+of+the+2014+IEEE+Conference+on+Computer+V)
47. Edmund Tong, Amir Zadeh, Cara Jones, and Louis-Philippe Morency. 2017. Combating human trafficking with multimodal deep models. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). volume 1, pages 1547–1556. [find](https://scholar.google.com/scholar?q=Edmund+Tong%2C+Amir+Zadeh%2C+Cara+Jones%2C+and+Louis%2DPhilippe+Morency%2E+2017%2E+Combating+human+trafficking+with+multimodal+deep+models%2E+In+Proceedings+of+the+55th+Annual+Meeting+of+the+Association+for+Computa)
48. George Trigeorgis, Fabien Ringeval, Raymond Brueckner, Erik Marchi, Mihalis A Nicolaou, Björn Schuller, and Stefanos Zafeiriou. 2016. Adieu features? end-to-end speech emotion recognition using a deep convolutional recurrent network. In Acoustics, Speech and Signal Processing (ICASSP), 2016 IEEE In… [find](https://scholar.google.com/scholar?q=George+Trigeorgis%2C+Fabien+Ringeval%2C+Raymond+Brueckner%2C+Erik+Marchi%2C+Mihalis+A+Nicolaou%2C+Bjo%CC%88rn+Schuller%2C+and+Stefanos+Zafeiriou%2E+2016%2E+Adieu+features%3F+end%2Dto%2Dend+speech+emotion+recognition+using+a+dee)
49. Sentiment analysis in an audio-visual context. IEEE Intelligent Systems 28(3):46–53. [find](https://scholar.google.com/scholar?q=Sentiment+analysis+in+an+audio%2Dvisual+context%2E+IEEE+Intelligent+Systems+28%283%29%3A46%E2%80%9353%2E)
50. Jiahong Yuan and Mark Liberman. 2008. Speaker identification on the scotus corpus. Journal of the Acoustical Society of America 123(5):3878. [find](https://scholar.google.com/scholar?q=Jiahong+Yuan+and+Mark+Liberman%2E+2008%2E+Speaker+identification+on+the+scotus+corpus%2E+Journal+of+the+Acoustical+Society+of+America+123%285%29%3A3878%2E)
51. Amir Zadeh, Minghai Chen, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency. 2017. Tensor fusion network for multimodal sentiment analysis. In Empirical Methods in Natural Language Processing, EMNLP. [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Minghai+Chen%2C+Soujanya+Poria%2C+Erik+Cambria%2C+and+Louis%2DPhilippe+Morency%2E+2017%2E+Tensor+fusion+network+for+multimodal+sentiment+analysis%2E+In+Empirical+Methods+in+Natural+Language+Processing%2C+) [our card](https://md.research.elamur.ai/free/en/papers/zadeh-2017-tensor-fusion-network-multimodal-sentiment/)
52. Amir Zadeh, Paul Pu Liang, Navonil Mazumder, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency. 2018a. Memory fusion network for multi-view sequential learning. arXiv preprint arXiv:1802.00927 . — [arXiv:1802.00927](https://arxiv.org/abs/1802.00927) [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Paul+Pu+Liang%2C+Navonil+Mazumder%2C+Soujanya+Poria%2C+Erik+Cambria%2C+and+Louis%2DPhilippe+Morency%2E+2018a%2E+Memory+fusion+network+for+multi%2Dview+sequential+learning%2E+arXiv+preprint+arXiv%3A1802%2E00927+)
53. Amir Zadeh, Paul Pu Liang, Soujanya Poria, Prateek Vij, Erik Cambria, and Louis-Philippe Morency. 2018b. Multi-attention recurrent network for human communication comprehension. arXiv preprint arXiv:1802.00923 . — [arXiv:1802.00923](https://arxiv.org/abs/1802.00923) [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Paul+Pu+Liang%2C+Soujanya+Poria%2C+Prateek+Vij%2C+Erik+Cambria%2C+and+Louis%2DPhilippe+Morency%2E+2018b%2E+Multi%2Dattention+recurrent+network+for+human+communication+comprehension%2E+arXiv+preprint+arXiv%3A1)
54. Amir Zadeh, Rowan Zellers, Eli Pincus, and Louis-Philippe Morency. 2016a. Mosi: Multimodal corpus of sentiment intensity and subjectivity analysis in online opinion videos. arXiv preprint arXiv:1606.06259 . — [arXiv:1606.06259](https://arxiv.org/abs/1606.06259) [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Rowan+Zellers%2C+Eli+Pincus%2C+and+Louis%2DPhilippe+Morency%2E+2016a%2E+Mosi%3A+Multimodal+corpus+of+sentiment+intensity+and+subjectivity+analysis+in+online+opinion+videos%2E+arXiv+preprint+arXiv%3A1606%2E0)
55. Amir Zadeh, Rowan Zellers, Eli Pincus, and Louis-Philippe Morency. 2016b. Multimodal sentiment intensity analysis in videos: Facial gestures and verbal messages. IEEE Intelligent Systems 31(6):82–88. [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Rowan+Zellers%2C+Eli+Pincus%2C+and+Louis%2DPhilippe+Morency%2E+2016b%2E+Multimodal+sentiment+intensity+analysis+in+videos%3A+Facial+gestures+and+verbal+messages%2E+IEEE+Intelligent+Systems+31%286%29%3A82%E2%80%9388%2E)
56. Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li, and Yu Qiao. 2016. Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Processing Letters 23(10):1499–1503. [find](https://scholar.google.com/scholar?q=Kaipeng+Zhang%2C+Zhanpeng+Zhang%2C+Zhifeng+Li%2C+and+Yu+Qiao%2E+2016%2E+Joint+face+detection+and+alignment+using+multitask+cascaded+convolutional+networks%2E+IEEE+Signal+Processing+Letters+23%2810%29%3A1499%E2%80%931503%2E)
57. Chunting Zhou, Chonglin Sun, Zhiyuan Liu, and Francis C. M. Lau. 2015. A c-lstm neural network for text classification. CoRR abs/1511.08630. — [arXiv:1511.08630](https://arxiv.org/abs/1511.08630) [find](https://scholar.google.com/scholar?q=Chunting+Zhou%2C+Chonglin+Sun%2C+Zhiyuan+Liu%2C+and+Francis+C%2E+M%2E+Lau%2E+2015%2E+A+c%2Dlstm+neural+network+for+text+classification%2E+CoRR+abs%2F1511%2E08630%2E+%E2%80%94+%5BarXiv%3A1511%2E08630%5D%28https%3A%2F%2Farxiv%2Eorg%2Fabs%2F1511%2E08630%29)
58. Julian Georg Zilly, Rupesh Kumar Srivastava, Jan Koutnı́k, and Jürgen Schmidhuber. 2016. Recurrent Highway Networks. arXiv preprint arXiv:1607.03474 . [find](https://scholar.google.com/scholar?q=Julian+Georg+Zilly%2C+Rupesh+Kumar+Srivastava%2C+Jan+Koutn%C4%B1%CC%81k%2C+and+Ju%CC%88rgen+Schmidhuber%2E+2016%2E+Recurrent+Highway+Networks%2E+arXiv+preprint+arXiv%3A1607%2E03474+%2E)
59. Haohan Wang, Aaksha Meghawat, Louis-Philippe Morency, and Eric P Xing. 2016. Select-additive learning: Improving cross-individual generalization in multimodal sentiment analysis. arXiv preprint arXiv:1609.05244 . — [arXiv:1609.05244](https://arxiv.org/abs/1609.05244) [find](https://scholar.google.com/scholar?q=Haohan+Wang%2C+Aaksha+Meghawat%2C+Louis%2DPhilippe+Morency%2C+and+Eric+P+Xing%2E+2016%2E+Select%2Dadditive+learning%3A+Improving+cross%2Dindividual+generalization+in+multimodal+sentiment+analysis%2E+arXiv+preprint+arXiv%3A)
60. Martin Wöllmer, Felix Weninger, Tobias Knaup, Björn Schuller, Congkai Sun, Kenji Sagae, and Louis-Philippe Morency. 2013. Youtube movie reviews: [find](https://scholar.google.com/scholar?q=Martin+Wo%CC%88llmer%2C+Felix+Weninger%2C+Tobias+Knaup%2C+Bjo%CC%88rn+Schuller%2C+Congkai+Sun%2C+Kenji+Sagae%2C+and+Louis%2DPhilippe+Morency%2E+2013%2E+Youtube+movie+reviews%3A)