---
title: "Integrating Multimodal Information in Large — Rahman 2020"
description: "Pretrained Transformers such as BERT and XLNet accept only text."
authors: ["Wasifur Rahman", "Md Kamrul Hasan", "Sangwu Lee", "AmirAli Bagher Zadeh", "Chengfeng Mao", "Louis-Philippe Morency", "Ehsan Hoque"]
year: 2020
venue: "Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics"
source: "https://aclanthology.org/2020.acl-main.214/"
doi: "10.18653/v1/2020.acl-main.214"
licence: "CC BY 4.0 (ACL Anthology)"
licence_url: "https://creativecommons.org/licenses/by/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/rahman-2020-integrating-multimodal-information-large-pretrained/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/rahman-2020-integrating-multimodal-information-large-pretrained/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2020](https://md.research.elamur.ai/free/en/papers/2020/) / Integrating Multimodal Information in Large Pretrained Transformers

# Integrating Multimodal Information in Large Pretrained Transformers

**Authors:** Wasifur Rahman, Md Kamrul Hasan, Sangwu Lee, [AmirAli Bagher Zadeh](https://md.research.elamur.ai/free/en/authors/amirali-bagher-zadeh/), Chengfeng Mao, [Louis-Philippe Morency](https://md.research.elamur.ai/free/en/authors/louis-philippe-morency/), [Ehsan Hoque](https://md.research.elamur.ai/free/en/authors/ehsan-hoque/) · **Year:** 2020 · **Venue:** Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · **Licence:** [CC BY 4.0 (ACL Anthology)](https://creativecommons.org/licenses/by/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2020.acl-main.214/) · [PDF](https://aclanthology.org/2020.acl-main.214.pdf) · [DOI 10.18653/v1/2020.acl-main.214](https://doi.org/10.18653/v1/2020.acl-main.214) · [OpenAlex](https://openalex.org/W3034266838)

**Citations:** 673 citations (OpenAlex, 2026-10-14) · [69](https://md.research.elamur.ai/free/en/papers/rahman-2020-integrating-multimodal-information-large-pretrained/cited-by/) in our library, of the 140884 papers whose bibliographies we read

## Summary
Pretrained Transformers such as BERT and XLNet accept only text. Applying them to multimodal language, where spoken words come with voice and facial cues, has therefore meant one of two compromises: discarding the nonverbal signals, or using the models only to produce word features for a separate fusion network. The authors propose the Multimodal Adaptation Gate (MAG), a lightweight attachment that leaves the original architecture unchanged. For each word, MAG pairs the lexical vector with its aligned acoustic and visual features. Gating turns these pairs into a displacement vector that shifts the word's internal representation, and the whole model is then fine-tuned end to end. The authors evaluate the approach on multimodal sentiment analysis using CMU-MOSI and CMU-MOSEI. MAG-BERT and MAG-XLNet outperform text-only fine-tuning, fusion models fed with BERT, XLNet or GloVe features (including MulT), and naive input-level fusion. On CMU-MOSI, MAG-XLNet is reported to match human-level performance. The work shows that large text-pretrained models can absorb nonverbal information with minimal overhead, and the code is publicly released.

## Key points
- On CMU-MOSEI, binary accuracy / F1 results are:
  - BERT category: MAG-BERT 84.7 / 84.5, plain BERT 83.9 / 83.9, MulT with BERT embeddings 83.5 / 82.9.
  - XLNet category: MAG-XLNet 85.6 / 85.7, XLNet 85.4 / 85.2, MulT with XLNet embeddings 84.1 / 83.7.
- The authors tested inserting MAG after the embedding layer, after XLNet layers 1, 4, 6, 8 and 12, and at all layers. Early placement works best, since abstract upper-layer vectors are harder to shift with word-level nonverbal cues.
- Simply concatenating or adding acoustic and visual features to the text input performs poorly, which supports the case for a dedicated gate.
- Pretraining is essential. With randomly initialized weights, binary accuracy drops to 70.1 (MAG-BERT) and 70.7 (MAG-XLNet) on CMU-MOSI, and to 76.8 and 78.4 on CMU-MOSEI.
- Qualitative examples show nonverbal cues changing predictions. Cues such as a tense voice, a frown, or a sarcastic tone can adjust sentiment intensity or even reverse the polarity predicted from text alone.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Natural language processing](https://md.research.elamur.ai/free/en/shelves/nlp/)

Topics: [Vision & language](https://md.research.elamur.ai/free/en/topics/multimodal/)

## Institutions

- [Carnegie Mellon University](https://md.research.elamur.ai/free/en/universities/carnegie-mellon-university/) — University, Pittsburgh, United States · 278 works · 138 810 citations
- [University of Rochester](https://md.research.elamur.ai/free/en/universities/university-of-rochester/) — University, Rochester, United States · 22 works · 6 510 citations

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{rahman2020integrating,
  title = {{Integrating Multimodal Information in Large Pretrained Transformers}},
  author = {Rahman, Wasifur and Hasan, Md Kamrul and Lee, Sangwu and Zadeh, AmirAli Bagher and Mao, Chengfeng and Morency, Louis-Philippe and Hoque, Ehsan},
  booktitle = {Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics},
  year = {2020},
  doi = {10.18653/v1/2020.acl-main.214},
  url = {https://doi.org/10.18653/v1/2020.acl-main.214}
}
```

- [← previous Towards Faithfully Interpretable NLP Systems: How Should We Define and Evaluate Faithfulness?](https://md.research.elamur.ai/free/en/papers/jacovi-2020-faithfully-interpretable-nlp-systems-how/)
- [next → Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps](https://md.research.elamur.ai/free/en/papers/ho-2020-constructing-multi-hop-qa-dataset/)
- [↑ back to papers of 2020](https://md.research.elamur.ai/free/en/papers/2020/)

## References

28 references, 12 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Minghai Chen, Sen Wang, Paul Pu Liang, Tadas Bal-trušaitis, Amir Zadeh, and Louis-Philippe Morency. 2017. Multimodal sentiment analysis with word-level fusion and reinforcement learning. In Proceedings of the 19th ACM International Conference on Multimodal Interaction, pages 163–171. ACM. [find](https://scholar.google.com/scholar?q=Minghai+Chen%2C+Sen+Wang%2C+Paul+Pu+Liang%2C+Tadas+Bal%2Dtrus%CC%8Caitis%2C+Amir+Zadeh%2C+and+Louis%2DPhilippe+Morency%2E+2017%2E+Multimodal+sentiment+analysis+with+word%2Dlevel+fusion+and+reinforcement+learning%2E+In+Proceedin)
2. Andy Coenen, Emily Reif, Ann Yuan, Been Kim, Adam Pearce, Fernanda Viégas, and Martin Wattenberg. 2019. Visualizing and measuring the geometry of bert. arXiv preprint arXiv:1906.02715. [find](https://scholar.google.com/scholar?q=Andy+Coenen%2C+Emily+Reif%2C+Ann+Yuan%2C+Been+Kim%2C+Adam+Pearce%2C+Fernanda+Vie%CC%81gas%2C+and+Martin+Wattenberg%2E+2019%2E+Visualizing+and+measuring+the+geometry+of+bert%2E+arXiv+preprint+arXiv%3A1906%2E02715%2E) [our card](https://md.research.elamur.ai/free/en/papers/coenen-2019-visualizing-measuring-geometry-bert/)
3. Zihang Dai, Zhilin Yang, Yiming Yang, William W Cohen, Jaime Carbonell, Quoc V Le, and Ruslan Salakhutdinov. 2019. Transformer-xl: Attentive language models beyond a fixed-length context. arXiv preprint arXiv:1901.02860. [find](https://scholar.google.com/scholar?q=Zihang+Dai%2C+Zhilin+Yang%2C+Yiming+Yang%2C+William+W+Cohen%2C+Jaime+Carbonell%2C+Quoc+V+Le%2C+and+Ruslan+Salakhutdinov%2E+2019%2E+Transformer%2Dxl%3A+Attentive+language+models+beyond+a+fixed%2Dlength+context%2E+arXiv+prepri)
4. Gilles Degottex, John Kane, Thomas Drugman, Tuomo Raitio, and Stefan Scherer. 2014. Covarep—a collaborative voice analysis repository for speech technologies. In 2014 ieee international conference on acoustics, speech and signal processing (icassp), pages 960–964. IEEE. [find](https://scholar.google.com/scholar?q=Gilles+Degottex%2C+John+Kane%2C+Thomas+Drugman%2C+Tuomo+Raitio%2C+and+Stefan+Scherer%2E+2014%2E+Covarep%E2%80%94a+collaborative+voice+analysis+repository+for+speech+technologies%2E+In+2014+ieee+international+conference+on+)
5. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep 2 [https://github.com/WasifurRahman/](https://github.com/WasifurRahman/) BERT_multimodal_transformer bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805. [↗](https://github.com/WasifurRahman/) [our card](https://md.research.elamur.ai/free/en/papers/devlin-2019-bert-pre-training-deep-bidirectional/)
6. Devamanyu Hazarika, Soujanya Poria, Amir Zadeh, Erik Cambria, Louis-Philippe Morency, and Roger Zimmermann. 2018. Conversational memory network for emotion recognition in dyadic dialogue videos. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational… [find](https://scholar.google.com/scholar?q=Devamanyu+Hazarika%2C+Soujanya+Poria%2C+Amir+Zadeh%2C+Erik+Cambria%2C+Louis%2DPhilippe+Morency%2C+and+Roger+Zimmermann%2E+2018%2E+Conversational+memory+network+for+emotion+recognition+in+dyadic+dialogue+videos%2E+In+Pr) [our card](https://md.research.elamur.ai/free/en/papers/hazarika-2018-conversational-memory-network-emotion-recognition/)
7. Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980. [find](https://scholar.google.com/scholar?q=Diederik+P+Kingma+and+Jimmy+Ba%2E+2014%2E+Adam%3A+A+method+for+stochastic+optimization%2E+arXiv+preprint+arXiv%3A1412%2E6980%2E)
8. Paul Pu Liang, Ziyin Liu, Amir Zadeh, and Louis-Philippe Morency. 2018. Multimodal language analysis with recurrent multistage fusion. arXiv preprint arXiv:1808.03920. [find](https://scholar.google.com/scholar?q=Paul+Pu+Liang%2C+Ziyin+Liu%2C+Amir+Zadeh%2C+and+Louis%2DPhilippe+Morency%2E+2018%2E+Multimodal+language+analysis+with+recurrent+multistage+fusion%2E+arXiv+preprint+arXiv%3A1808%2E03920%2E)
9. Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems, pages 3111–3119. [find](https://scholar.google.com/scholar?q=Tomas+Mikolov%2C+Ilya+Sutskever%2C+Kai+Chen%2C+Greg+S+Corrado%2C+and+Jeff+Dean%2E+2013%2E+Distributed+representations+of+words+and+phrases+and+their+compositionality%2E+In+Advances+in+neural+information+processing+) [our card](https://md.research.elamur.ai/free/en/papers/mikolov-2013-distributed-representations-words-phrases-their/)
10. Sunghyun Park, Han Suk Shim, Moitreya Chatterjee, Kenji Sagae, and Louis-Philippe Morency. 2014. Computational analysis of persuasiveness in social multimedia: A novel dataset and multimodal prediction approach. In Proceedings of the 16th International Conference on Multimodal Interaction, pages 50–… [find](https://scholar.google.com/scholar?q=Sunghyun+Park%2C+Han+Suk+Shim%2C+Moitreya+Chatterjee%2C+Kenji+Sagae%2C+and+Louis%2DPhilippe+Morency%2E+2014%2E+Computational+analysis+of+persuasiveness+in+social+multimedia%3A+A+novel+dataset+and+multimodal+predictio)
11. Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), pages 1532–1543. [find](https://scholar.google.com/scholar?q=Jeffrey+Pennington%2C+Richard+Socher%2C+and+Christopher+Manning%2E+2014%2E+Glove%3A+Global+vectors+for+word+representation%2E+In+Proceedings+of+the+2014+conference+on+empirical+methods+in+natural+language+process) [our card](https://md.research.elamur.ai/free/en/papers/pennington-2014-glove-global-vectors-word-representation/)
12. Matthew E Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep contextualized word representations. arXiv preprint arXiv:1802.05365. [find](https://scholar.google.com/scholar?q=Matthew+E+Peters%2C+Mark+Neumann%2C+Mohit+Iyyer%2C+Matt+Gardner%2C+Christopher+Clark%2C+Kenton+Lee%2C+and+Luke+Zettlemoyer%2E+2018%2E+Deep+contextualized+word+representations%2E+arXiv+preprint+arXiv%3A1802%2E05365%2E) [our card](https://md.research.elamur.ai/free/en/papers/peters-2018-deep-contextualized-word-representations/)
13. Hai Pham, Paul Pu Liang, Thomas Manzini, Louis-Philippe Morency, and Barnabas Poczos. 2019. Found in translation: Learning robust joint representations by cyclic translations between modalities. arXiv preprint arXiv:1812.07809. — [arXiv:1812.07809](https://arxiv.org/abs/1812.07809) [find](https://scholar.google.com/scholar?q=Hai+Pham%2C+Paul+Pu+Liang%2C+Thomas+Manzini%2C+Louis%2DPhilippe+Morency%2C+and+Barnabas+Poczos%2E+2019%2E+Found+in+translation%3A+Learning+robust+joint+representations+by+cyclic+translations+between+modalities%2E+arXiv)
14. Soujanya Poria, Amir Hussain, and Erik Cambria. 2018. Multimodal Sentiment Analysis, volume 8. Springer. [find](https://scholar.google.com/scholar?q=Soujanya+Poria%2C+Amir+Hussain%2C+and+Erik+Cambria%2E+2018%2E+Multimodal+Sentiment+Analysis%2C+volume+8%2E+Springer%2E)
15. Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. 2018. Improving language understanding by generative pre-training. URL [https://s3-us-west-2.amazonaws](https://s3-us-west-2.amazonaws). com/openai-assets/research-covers/languageunsupervised/language understanding paper. pdf. [↗](https://s3-us-west-2.amazonaws)
16. Chen Sun, Austin Myers, Carl Vondrick, Kevin Murphy, and Cordelia Schmid. 2019. Videobert: A joint model for video and language representation learning. arXiv preprint arXiv:1904.01766. [find](https://scholar.google.com/scholar?q=Chen+Sun%2C+Austin+Myers%2C+Carl+Vondrick%2C+Kevin+Murphy%2C+and+Cordelia+Schmid%2E+2019%2E+Videobert%3A+A+joint+model+for+video+and+language+representation+learning%2E+arXiv+preprint+arXiv%3A1904%2E01766%2E) [our card](https://md.research.elamur.ai/free/en/papers/sun-2019-videobert-joint-model-video-language/)
17. Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, J Zico Kolter, Louis-Philippe Morency, and Ruslan Salakhutdinov. 2019. Multimodal transformer for unaligned multimodal language sequences. arXiv preprint arXiv:1906.00295. [find](https://scholar.google.com/scholar?q=Yao%2DHung+Hubert+Tsai%2C+Shaojie+Bai%2C+Paul+Pu+Liang%2C+J+Zico+Kolter%2C+Louis%2DPhilippe+Morency%2C+and+Ruslan+Salakhutdinov%2E+2019%2E+Multimodal+transformer+for+unaligned+multimodal+language+sequences%2E+arXiv+prepr) [our card](https://md.research.elamur.ai/free/en/papers/tsai-2019-multimodal-transformer-unaligned-multimodal-language/)
18. Yao-Hung Hubert Tsai, Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency, and Ruslan Salakhutdinov. 2018. Learning factorized multimodal representations. arXiv preprint arXiv:1806.06176. — [arXiv:1806.06176](https://arxiv.org/abs/1806.06176) [find](https://scholar.google.com/scholar?q=Yao%2DHung+Hubert+Tsai%2C+Paul+Pu+Liang%2C+Amir+Zadeh%2C+Louis%2DPhilippe+Morency%2C+and+Ruslan+Salakhutdinov%2E+2018%2E+Learning+factorized+multimodal+representations%2E+arXiv+preprint+arXiv%3A1806%2E06176%2E+%E2%80%94+%5BarXiv%3A1806%2E)
19. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems, pages 5998–6008. [find](https://scholar.google.com/scholar?q=Ashish+Vaswani%2C+Noam+Shazeer%2C+Niki+Parmar%2C+Jakob+Uszkoreit%2C+Llion+Jones%2C+Aidan+N+Gomez%2C+%C5%81ukasz+Kaiser%2C+and+Illia+Polosukhin%2E+2017%2E+Attention+is+all+you+need%2E+In+Advances+in+Neural+Information+Processi) [our card](https://md.research.elamur.ai/free/en/papers/vaswani-2017-attention-all-need/)
20. Yansen Wang, Ying Shen, Zhun Liu, Paul Pu Liang, Amir Zadeh, and Louis-Philippe Morency. 2018. Words can shift: Dynamically adjusting word representations using nonverbal behaviors. arXiv preprint arXiv:1811.09362. — [arXiv:1811.09362](https://arxiv.org/abs/1811.09362) [find](https://scholar.google.com/scholar?q=Yansen+Wang%2C+Ying+Shen%2C+Zhun+Liu%2C+Paul+Pu+Liang%2C+Amir+Zadeh%2C+and+Louis%2DPhilippe+Morency%2E+2018%2E+Words+can+shift%3A+Dynamically+adjusting+word+representations+using+nonverbal+behaviors%2E+arXiv+preprint+arX)
21. Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Ruslan Salakhutdinov, and Quoc V Le. 2019. Xlnet: Generalized autoregressive pretraining for language understanding. arXiv preprint arXiv:1906.08237. [find](https://scholar.google.com/scholar?q=Zhilin+Yang%2C+Zihang+Dai%2C+Yiming+Yang%2C+Jaime+Carbonell%2C+Ruslan+Salakhutdinov%2C+and+Quoc+V+Le%2E+2019%2E+Xlnet%3A+Generalized+autoregressive+pretraining+for+language+understanding%2E+arXiv+preprint+arXiv%3A1906%2E08) [our card](https://md.research.elamur.ai/free/en/papers/yang-2019-xlnet-generalized-autoregressive-pretraining-language/)
22. Jiahong Yuan and Mark Liberman. 2008. Speaker identification on the scotus corpus. Journal of the Acoustical Society of America, 123(5):3878. [find](https://scholar.google.com/scholar?q=Jiahong+Yuan+and+Mark+Liberman%2E+2008%2E+Speaker+identification+on+the+scotus+corpus%2E+Journal+of+the+Acoustical+Society+of+America%2C+123%285%29%3A3878%2E)
23. Amir Zadeh, Minghai Chen, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency. 2017. Tensor fusion network for multimodal sentiment analysis. arXiv preprint arXiv:1707.07250. [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Minghai+Chen%2C+Soujanya+Poria%2C+Erik+Cambria%2C+and+Louis%2DPhilippe+Morency%2E+2017%2E+Tensor+fusion+network+for+multimodal+sentiment+analysis%2E+arXiv+preprint+arXiv%3A1707%2E07250%2E) [our card](https://md.research.elamur.ai/free/en/papers/zadeh-2017-tensor-fusion-network-multimodal-sentiment/)
24. Amir Zadeh, Paul Pu Liang, Navonil Mazumder, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency. 2018a. Memory fusion network for multi-view sequential learning. In Thirty-Second AAAI Conference on Artificial Intelligence. [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Paul+Pu+Liang%2C+Navonil+Mazumder%2C+Soujanya+Poria%2C+Erik+Cambria%2C+and+Louis%2DPhilippe+Morency%2E+2018a%2E+Memory+fusion+network+for+multi%2Dview+sequential+learning%2E+In+Thirty%2DSecond+AAAI+Conference)
25. Amir Zadeh, Paul Pu Liang, Louis-Philippe Morency, Soujanya Poria, Erik Cambria, and Stefan Scherer. 2018b. Proceedings of grand challenge and workshop on human multimodal language (challenge-hml). In Proceedings of Grand Challenge and Workshop on Human Multimodal Language (Challenge-HML). [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Paul+Pu+Liang%2C+Louis%2DPhilippe+Morency%2C+Soujanya+Poria%2C+Erik+Cambria%2C+and+Stefan+Scherer%2E+2018b%2E+Proceedings+of+grand+challenge+and+workshop+on+human+multimodal+language+%28challenge%2Dhml%29%2E+In)
26. Amir Zadeh, Paul Pu Liang, Soujanya Poria, Prateek Vij, Erik Cambria, and Louis-Philippe Morency. 2018c. Multi-attention recurrent network for human communication comprehension. In Thirty-Second AAAI Conference on Artificial Intelligence. [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Paul+Pu+Liang%2C+Soujanya+Poria%2C+Prateek+Vij%2C+Erik+Cambria%2C+and+Louis%2DPhilippe+Morency%2E+2018c%2E+Multi%2Dattention+recurrent+network+for+human+communication+comprehension%2E+In+Thirty%2DSecond+AAAI+)
27. Amir Zadeh, Rowan Zellers, Eli Pincus, and Louis-Philippe Morency. 2016. Mosi: multimodal corpus of sentiment intensity and subjectivity analysis in online opinion videos. arXiv preprint arXiv:1606.06259. — [arXiv:1606.06259](https://arxiv.org/abs/1606.06259) [find](https://scholar.google.com/scholar?q=Amir+Zadeh%2C+Rowan+Zellers%2C+Eli+Pincus%2C+and+Louis%2DPhilippe+Morency%2E+2016%2E+Mosi%3A+multimodal+corpus+of+sentiment+intensity+and+subjectivity+analysis+in+online+opinion+videos%2E+arXiv+preprint+arXiv%3A1606%2E06)
28. AmirAli Bagher Zadeh, Paul Pu Liang, Soujanya Poria, Erik Cambria, and Louis-Philippe Morency. 2018d. Multimodal language analysis in the wild: Cmu-mosei dataset and interpretable dynamic fusion graph. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume… [find](https://scholar.google.com/scholar?q=AmirAli+Bagher+Zadeh%2C+Paul+Pu+Liang%2C+Soujanya+Poria%2C+Erik+Cambria%2C+and+Louis%2DPhilippe+Morency%2E+2018d%2E+Multimodal+language+analysis+in+the+wild%3A+Cmu%2Dmosei+dataset+and+interpretable+dynamic+fusion+graph) [our card](https://md.research.elamur.ai/free/en/papers/zadeh-2018-multimodal-language-analysis-wild-cmu/)