---
title: "Multimodal Entrainment and Feedback in Online — Paggio 2026"
description: "The authors ask whether people in online group calls show coordinated head motion (\"entrainment\") when they exchange short verbal feedback such as…"
authors: ["Patrizia Paggio", "Manex Agirrezabal", "Giulia Di Cristina", "Bart Jongejan", "Costanza Navarretta"]
year: 2026
venue: "Proceedings of the Fifteenth Language Resources and Evaluation Conference"
source: "https://aclanthology.org/2026.lrec-1.718/"
doi: "10.63317/3e7gn6grbki4"
licence: "CC BY-NC 4.0 (ELRA, LREC proceedings)"
licence_url: "https://creativecommons.org/licenses/by-nc/4.0/"
summary_licence: "Elamur Cosmic License"
canonical: "https://research.elamur.ai/free/en/papers/paggio-2026-multimodal-entrainment-feedback-online-group/"
---
[Elamur Research](https://md.research.elamur.ai/free/en/) · [this page in HTML](https://research.elamur.ai/free/en/papers/paggio-2026-multimodal-entrainment-feedback-online-group/)

[home](https://md.research.elamur.ai/free/en/) / [papers](https://md.research.elamur.ai/free/en/papers/) / [2026](https://md.research.elamur.ai/free/en/papers/2026/page/7/) / Multimodal Entrainment and Feedback in Online Group Meetings

# Multimodal Entrainment and Feedback in Online Group Meetings

**Authors:** [Patrizia Paggio](https://md.research.elamur.ai/free/en/authors/patrizia-paggio/), Manex Agirrezabal, Giulia Di Cristina, [Bart Jongejan](https://md.research.elamur.ai/free/en/authors/bart-jongejan/), [Costanza Navarretta](https://md.research.elamur.ai/free/en/authors/costanza-navarretta/) · **Year:** 2026 · **Venue:** Proceedings of the Fifteenth Language Resources and Evaluation Conference · **Licence:** [CC BY-NC 4.0 (ELRA, LREC proceedings)](https://creativecommons.org/licenses/by-nc/4.0/)

**Links:** [Publisher's page](https://aclanthology.org/2026.lrec-1.718/) · [PDF](https://aclanthology.org/2026.lrec-1.718.pdf) · [DOI 10.63317/3e7gn6grbki4](https://doi.org/10.63317/3e7gn6grbki4) · [OpenAlex](https://openalex.org/W7160181271)

**Citations:** 0 citations (openalex-snapshot · 2026-10-14)

## Summary
The authors ask whether people in online group calls show coordinated head motion ("entrainment") when they exchange short verbal feedback such as backchannels. They used the GEHM Zoom meeting corpus, which has per-participant video, audio, transcripts and OpenPose keypoints. Ten of its twelve meetings were analysed. Each recording was split into fixed bins of 15 or 30 seconds. A bin counted as a target if at least two participants produced a feedback word; other bins served as controls. The authors took x/y velocities of six head-related keypoints and squared them to get motion energy. From this they derived two measures: average energy per speaker and average difference across speaker pairs. Linear mixed models then compared target and control bins. Participants moved their heads more during feedback exchanges, but their movements also became less alike. Qualitative inspection traced this to two causes: people give different kinds of gestural feedback, and non-communicative motion such as repositioning or reaching for objects adds noise. The study extends entrainment research to virtual meetings, which are now widespread but rarely studied.

## Key points
- Data: GEHM corpus, 12 English-language Zoom meetings (about 40 min each, 5–9 participants of mixed nationalities). Two meetings were dropped because of heavy screen sharing.
- Features: energy from the velocity of Nose, Neck, both Eyes and both Ears (OpenPose). The method is adapted from the prosodic entrainment approach of Litman et al. (2016).
- Target intervals required feedback words (e.g., yes, yeah, okay, mhm, right) from at least two speakers. The bin lengths were supported by feedback-word latencies of up to about 12.45 s, compared against six four-person AMI corpus conversations.
- Result: energy rose in feedback intervals, but inter-speaker difference also grew. Horizontal movement showed an additive effect in two models.
- Planned future work includes filtering non-communicative movements, using sliding windows, adding prosody, and testing on other online and in-person meeting corpora.

*Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.*

Fields: [Linguistics & languages](https://md.research.elamur.ai/free/en/shelves/linguistics/)

## Cite

The paper itself, not this page. BibTeX from the library's record of the work.

```bibtex
@inproceedings{paggio2026multimodal,
  title = {{Multimodal Entrainment and Feedback in Online Group Meetings}},
  author = {Paggio, Patrizia and Agirrezabal, Manex and Cristina, Giulia Di and Jongejan, Bart and Navarretta, Costanza},
  booktitle = {Proceedings of the Fifteenth Language Resources and Evaluation Conference},
  year = {2026},
  doi = {10.63317/3e7gn6grbki4},
  url = {https://doi.org/10.63317/3e7gn6grbki4}
}
```

- [← previous Multilingual Target-Stance Extraction](https://md.research.elamur.ai/free/en/papers/mines-2026-multilingual-target-stance-extraction/)
- [next → Multimodal LLMs Do Not Compose Skills Optimally across Modalities](https://md.research.elamur.ai/free/en/papers/ontalvilla-2026-multimodal-llms-do-not-compose/)
- [↑ back to papers of 2026](https://md.research.elamur.ai/free/en/papers/2026/page/7/)

## References

34 references, 1 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

1. Douglas Bates, Martin Mächler, Ben Bolker, and Steve Walker. 2015. Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1):1–48. [find](https://scholar.google.com/scholar?q=Douglas+Bates%2C+Martin+M%C3%A4chler%2C+Ben+Bolker%2C+and+Steve+Walker%2E+2015%2E+Fitting+linear+mixed%2Deffects+models+using+lme4%2E+Journal+of+Statistical+Software%2C+67%281%29%3A1%E2%80%9348%2E) [our card](https://md.research.elamur.ai/free/en/papers/bates-2015-fitting-linear-mixed-effects-models/)
2. Luca Béres, Péter Nagy, Tibor Pólya, Béla Weiss, Ádám Boncz, and István Winkler. 2026. Interpersonal coordination in communication: Effects of alignment in multiple modalities on objective and subjective task outcomes. Frontiers in Psychology, 17:1655164. [find](https://scholar.google.com/scholar?q=Luca+B%C3%A9res%2C+P%C3%A9ter+Nagy%2C+Tibor+P%C3%B3lya%2C+B%C3%A9la+Weiss%2C+%C3%81d%C3%A1m+Boncz%2C+and+Istv%C3%A1n+Winkler%2E+2026%2E+Interpersonal+coordination+in+communication%3A+Effects+of+alignment+in+multiple+modalities+on+objective+and+subject)
3. Kirsten Bergmann and Stefan Kopp. 2012. Gestural alignment in natural dialogue. In Proceedings of the Annual Meeting of the Cognitive Science Society, 34. [find](https://scholar.google.com/scholar?q=Kirsten+Bergmann+and+Stefan+Kopp%2E+2012%2E+Gestural+alignment+in+natural+dialogue%2E+In+Proceedings+of+the+Annual+Meeting+of+the+Cognitive+Science+Society%2C+34%2E)
4. Peter Blomsma, Julija Vaitonyté, Gabriel Skantze, and Marc Swerts. 2024. Backchannel behavior is idiosyncratic. Language and Cognition, 16(4):1158–1181. [find](https://scholar.google.com/scholar?q=Peter+Blomsma%2C+Julija+Vaitonyt%C3%A9%2C+Gabriel+Skantze%2C+and+Marc+Swerts%2E+2024%2E+Backchannel+behavior+is+idiosyncratic%2E+Language+and+Cognition%2C+16%284%29%3A1158%E2%80%931181%2E)
5. Zhe Cao, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2017. Realtime multi-person 2d pose estimation using part affinity fields. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 7291–7299. [find](https://scholar.google.com/scholar?q=Zhe+Cao%2C+Tomas+Simon%2C+Shih%2DEn+Wei%2C+and+Yaser+Sheikh%2E+2017%2E+Realtime+multi%2Dperson+2d+pose+estimation+using+part+affinity+fields%2E+In+Proceedings+of+the+IEEE+conference+on+computer+vision+and+pattern+rec)
6. Jean Carletta, Simone Ashby, Sebastien Bourban, Mike Flynn, Mael Guillemot, Thomas Hain, Jaroslav Kadlec, Vasilis Karaiskos, Wessel Kraaij, Melissa Kronenthal, et al. 2005. The AMI meeting corpus: A pre-announcement. In International workshop on machine learning for multimodal interaction, pages 28–… [find](https://scholar.google.com/scholar?q=Jean+Carletta%2C+Simone+Ashby%2C+Sebastien+Bourban%2C+Mike+Flynn%2C+Mael+Guillemot%2C+Thomas+Hain%2C+Jaroslav+Kadlec%2C+Vasilis+Karaiskos%2C+Wessel+Kraaij%2C+Melissa+Kronenthal%2C+et+al%2E+2005%2E+The+AMI+meeting+corpus%3A+A+p)
7. Douglas Curran-Everett. 2018. Explorations in statistics: the log transformation. Advances in Physiology Education, 42(2):343–347. PMID: 29761718. [find](https://scholar.google.com/scholar?q=Douglas+Curran%2DEverett%2E+2018%2E+Explorations+in+statistics%3A+the+log+transformation%2E+Advances+in+Physiology+Education%2C+42%282%29%3A343%E2%80%93347%2E+PMID%3A+29761718%2E)
8. CC Derchi, E Mikulan, A Mazza, S Casarotto, A Comanducci, M Fecchio, J Navarro, G Devalle, M Massimini, and C Sinigaglia. 2023. Distinguishing intentional from nonintentional actions through EEG and kinematic markers. Scientific Reports, 13(1):8496. [find](https://scholar.google.com/scholar?q=CC+Derchi%2C+E+Mikulan%2C+A+Mazza%2C+S+Casarotto%2C+A+Comanducci%2C+M+Fecchio%2C+J+Navarro%2C+G+Devalle%2C+M+Massimini%2C+and+C+Sinigaglia%2E+2023%2E+Distinguishing+intentional+from+nonintentional+actions+through+EEG+and+k)
9. Christina Dideriksen, Riccardo Fusaroli, Kristian Tylén, Mark Dingemanse, and Morten H Christiansen. 2019. Contextualizing conversational strategies: backchannel, repair and linguistic alignment in spontaneous and task-oriented conversations. In CogSci’19, pages 261–267. Cognitive Science Society. [find](https://scholar.google.com/scholar?q=Christina+Dideriksen%2C+Riccardo+Fusaroli%2C+Kristian+Tyl%C3%A9n%2C+Mark+Dingemanse%2C+and+Morten+H+Christiansen%2E+2019%2E+Contextualizing+conversational+strategies%3A+backchannel%2C+repair+and+linguistic+alignment+in+sp)
10. Ilanit Gordon, Alon Tomashin, and Oded Mayo. 2025. A theory of flexible multimodal synchrony. Psychological Review, 132(3):680–718. [find](https://scholar.google.com/scholar?q=Ilanit+Gordon%2C+Alon+Tomashin%2C+and+Oded+Mayo%2E+2025%2E+A+theory+of+flexible+multimodal+synchrony%2E+Psychological+Review%2C+132%283%29%3A680%E2%80%93718%2E)
11. Joanna Hale, Jamie A. Ward, Francesco Buccheri, Dominic Oliver, and Antonia F. de C. Hamilton. 2020. Are You on My Wavelength? Interpersonal Coordination in Dyadic Conversations. Journal of Nonverbal Behavior, 44(1):63–83. [find](https://scholar.google.com/scholar?q=Joanna+Hale%2C+Jamie+A%2E+Ward%2C+Francesco+Buccheri%2C+Dominic+Oliver%2C+and+Antonia+F%2E+de+C%2E+Hamilton%2E+2020%2E+Are+You+on+My+Wavelength%3F+Interpersonal+Coordination+in+Dyadic+Conversations%2E+Journal+of+Nonverbal+)
12. Antonia Hamilton, Victoria Southgate, Kamilla Miskowiak, Anne J Bjertrup, Arianna S Lomoriello, Sara De Felice, Rui Liu, and Ivana Konvalinka. 2025. Rhythms of interaction – the timescales of social synchrony and why they matter. [find](https://scholar.google.com/scholar?q=Antonia+Hamilton%2C+Victoria+Southgate%2C+Kamilla+Miskowiak%2C+Anne+J+Bjertrup%2C+Arianna+S+Lomoriello%2C+Sara+De+Felice%2C+Rui+Liu%2C+and+Ivana+Konvalinka%2E+2025%2E+Rhythms+of+interaction+%E2%80%93+the+timescales+of+social+s)
13. Judith Holler and Katie Wilkin. 2011. Co-speech gesture mimicry in the process of collaborative referring during face-to-face dialogue. Journal of Nonverbal Behavior, 35:133–153. [find](https://scholar.google.com/scholar?q=Judith+Holler+and+Katie+Wilkin%2E+2011%2E+Co%2Dspeech+gesture+mimicry+in+the+process+of+collaborative+referring+during+face%2Dto%2Dface+dialogue%2E+Journal+of+Nonverbal+Behavior%2C+35%3A133%E2%80%93153%2E)
14. Benjamin Inden, Zofia Malisz, Petra Wagner, and Ipke Wachsmuth. 2013. Timing and entrainment of multimodal backchanneling behavior for an embodied conversational agent. In Proceedings of the 15th ACM on International Conference on Multimodal Interaction, ICMI ’13, page 181–188, New York, NY, USA. As… [find](https://scholar.google.com/scholar?q=Benjamin+Inden%2C+Zofia+Malisz%2C+Petra+Wagner%2C+and+Ipke+Wachsmuth%2E+2013%2E+Timing+and+entrainment+of+multimodal+backchanneling+behavior+for+an+embodied+conversational+agent%2E+In+Proceedings+of+the+15th+ACM+)
15. Adam Kendon et al. 1980. Gesticulation and speech: Two aspects of the process of utterance. The relationship of verbal and nonverbal communication, 25(1980):207–227. [find](https://scholar.google.com/scholar?q=Adam+Kendon+et+al%2E+1980%2E+Gesticulation+and+speech%3A+Two+aspects+of+the+process+of+utterance%2E+The+relationship+of+verbal+and+nonverbal+communication%2C+25%281980%29%3A207%E2%80%93227%2E)
16. Zohreh Khosrobeigi, Maria Koutsombogera, and Carl Vogel. 2025. Methods and findings in the analysis of alignment of bodily motion in cooperative dyadic dialogue. Multimodal Technologies and Interaction, 9(6). [find](https://scholar.google.com/scholar?q=Zohreh+Khosrobeigi%2C+Maria+Koutsombogera%2C+and+Carl+Vogel%2E+2025%2E+Methods+and+findings+in+the+analysis+of+alignment+of+bodily+motion+in+cooperative+dyadic+dialogue%2E+Multimodal+Technologies+and+Interactio)
17. Maria Koutsombogera and Carl Vogel. 2018. Modeling collaborative multimodal behavior in group dialogues: The MULTISIMO corpus. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Paris, France. European Language Resources Association (ELRA). [find](https://scholar.google.com/scholar?q=Maria+Koutsombogera+and+Carl+Vogel%2E+2018%2E+Modeling+collaborative+multimodal+behavior+in+group+dialogues%3A+The+MULTISIMO+corpus%2E+In+Proceedings+of+the+Eleventh+International+Conference+on+Language+Resou)
18. Rivka Levitan and Julia Hirschberg. 2011. Measuring acoustic-prosodic entrainment with respect to multiple levels and dimensions. In Interspeech. [find](https://scholar.google.com/scholar?q=Rivka+Levitan+and+Julia+Hirschberg%2E+2011%2E+Measuring+acoustic%2Dprosodic+entrainment+with+respect+to+multiple+levels+and+dimensions%2E+In+Interspeech%2E)
19. Diane Litman, Susannah Paletz, Zahra Rahimi, Stefani Allegretti, and Caitlin Rice. 2016. The TEAMS corpus and entrainment in multi-party spoken dialogues. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 1421–1431. [find](https://scholar.google.com/scholar?q=Diane+Litman%2C+Susannah+Paletz%2C+Zahra+Rahimi%2C+Stefani+Allegretti%2C+and+Caitlin+Rice%2E+2016%2E+The+TEAMS+corpus+and+entrainment+in+multi%2Dparty+spoken+dialogues%2E+In+Proceedings+of+the+2016+Conference+on+Empi)
20. Max M Louwerse, Rick Dale, Ellen G Bard, and Patrick Jeuniaux. 2012. Behavior matching in multimodal communication is synchronized. Cognitive science, 36(8):1404–1426. [find](https://scholar.google.com/scholar?q=Max+M+Louwerse%2C+Rick+Dale%2C+Ellen+G+Bard%2C+and+Patrick+Jeuniaux%2E+2012%2E+Behavior+matching+in+multimodal+communication+is+synchronized%2E+Cognitive+science%2C+36%288%29%3A1404%E2%80%931426%2E)
21. Daniel Lüdecke. 2018. ggeffects: Tidy data frames of marginal effects from regression models. Journal of Open Source Software, 3(26):772. [find](https://scholar.google.com/scholar?q=Daniel+L%C3%BCdecke%2E+2018%2E+ggeffects%3A+Tidy+data+frames+of+marginal+effects+from+regression+models%2E+Journal+of+Open+Source+Software%2C+3%2826%29%3A772%2E)
22. Daniel Lüdecke. 2025. sjPlot: Data Visualization for Statistics in Social Science. R package version 2.9.0. [find](https://scholar.google.com/scholar?q=Daniel+L%C3%BCdecke%2E+2025%2E+sjPlot%3A+Data+Visualization+for+Statistics+in+Social+Science%2E+R+package+version+2%2E9%2E0%2E)
23. Tamami Nakano and Shigeru Kitazawa. 2010. Eye-blink entrainment at breakpoints of speech. Experimental brain research, 205:577–581. [find](https://scholar.google.com/scholar?q=Tamami+Nakano+and+Shigeru+Kitazawa%2E+2010%2E+Eye%2Dblink+entrainment+at+breakpoints+of+speech%2E+Experimental+brain+research%2C+205%3A577%E2%80%93581%2E)
24. Costanza Navarretta. 2016. Mirroring facial expressions and emotions in dyadic conversations. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), pages 469–474. [find](https://scholar.google.com/scholar?q=Costanza+Navarretta%2E+2016%2E+Mirroring+facial+expressions+and+emotions+in+dyadic+conversations%2E+In+Proceedings+of+the+Tenth+International+Conference+on+Language+Resources+and+Evaluation+%28LREC%E2%80%9916%29%2C+pages)
25. Patrizia Paggio, Manex Agirrezabal, Costanza Navarretta, and Leo Vitasovic. 2024. Multimodal behaviour in an online environment: The GEHM Zoom corpus collection. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 202… [find](https://scholar.google.com/scholar?q=Patrizia+Paggio%2C+Manex+Agirrezabal%2C+Costanza+Navarretta%2C+and+Leo+Vitasovic%2E+2024%2E+Multimodal+behaviour+in+an+online+environment%3A+The+GEHM+Zoom+corpus+collection%2E+In+Proceedings+of+the+2024+Joint+Inter)
26. Martin J Pickering and Simon Garrod. 2004. Toward a mechanistic psychology of dialogue. Behavioral and brain sciences, 27(2):169–190. [find](https://scholar.google.com/scholar?q=Martin+J+Pickering+and+Simon+Garrod%2E+2004%2E+Toward+a+mechanistic+psychology+of+dialogue%2E+Behavioral+and+brain+sciences%2C+27%282%29%3A169%E2%80%93190%2E)
27. R Core Team. 2024. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. [find](https://scholar.google.com/scholar?q=R+Core+Team%2E+2024%2E+R%3A+A+Language+and+Environment+for+Statistical+Computing%2E+R+Foundation+for+Statistical+Computing%2C+Vienna%2C+Austria%2E)
28. Marlou Rasenberg, Asli Özyürek, and Mark Dingemanse. 2020. Alignment in multimodal interaction: An integrative framework. Cognitive science, 44(11):e12911. [find](https://scholar.google.com/scholar?q=Marlou+Rasenberg%2C+Asli+%C3%96zy%C3%BCrek%2C+and+Mark+Dingemanse%2E+2020%2E+Alignment+in+multimodal+interaction%3A+An+integrative+framework%2E+Cognitive+science%2C+44%2811%29%3Ae12911%2E)
29. Marlou Rasenberg, Asli Özyürek, Sara Bögels, and Mark Dingemanse. 2022. The primacy of multimodal alignment in converging on shared symbols for novel referents. Discourse Processes, 59(3):209–236. [find](https://scholar.google.com/scholar?q=Marlou+Rasenberg%2C+Asli+%C3%96zy%C3%BCrek%2C+Sara+B%C3%B6gels%2C+and+Mark+Dingemanse%2E+2022%2E+The+primacy+of+multimodal+alignment+in+converging+on+shared+symbols+for+novel+referents%2E+Discourse+Processes%2C+59%283%29%3A209%E2%80%93236%2E)
30. Justine Reverdy, Sam O’Connor Russell, Louise Duquenne, Diego Garaialde, Benjamin R. Cowan, and Naomi Harte. 2022. RoomReader: A multimodal corpus of online multiparty conversational interactions. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 2517–2527, Marseil… [find](https://scholar.google.com/scholar?q=Justine+Reverdy%2C+Sam+O%E2%80%99Connor+Russell%2C+Louise+Duquenne%2C+Diego+Garaialde%2C+Benjamin+R%2E+Cowan%2C+and+Naomi+Harte%2E+2022%2E+RoomReader%3A+A+multimodal+corpus+of+online+multiparty+conversational+interactions%2E+In+)
31. James P Trujillo, Christina Dideriksen, Kristian Tylén, Morten H Christiansen, and Riccardo Fusaroli. 2023. The dynamic interplay of kinetic and linguistic coordination in Danish and Norwegian conversation. Cognitive Science, 47(6):e13298. [find](https://scholar.google.com/scholar?q=James+P+Trujillo%2C+Christina+Dideriksen%2C+Kristian+Tyl%C3%A9n%2C+Morten+H+Christiansen%2C+and+Riccardo+Fusaroli%2E+2023%2E+The+dynamic+interplay+of+kinetic+and+linguistic+coordination+in+Danish+and+Norwegian+convers)
32. James P Trujillo, Irina Simanova, Harold Bekkering, and Asli Özyürek. 2018. Communicative intent modulates production and comprehension of actions and gestures: A kinect study. Cognition, 180:38–51. [find](https://scholar.google.com/scholar?q=James+P+Trujillo%2C+Irina+Simanova%2C+Harold+Bekkering%2C+and+Asli+%C3%96zy%C3%BCrek%2E+2018%2E+Communicative+intent+modulates+production+and+comprehension+of+actions+and+gestures%3A+A+kinect+study%2E+Cognition%2C+180%3A38%E2%80%9351%2E)
33. Bodo Winter. 2013. Linear models and linear mixed effects models in R with linguistic applications. [find](https://scholar.google.com/scholar?q=Bodo+Winter%2E+2013%2E+Linear+models+and+linear+mixed+effects+models+in+R+with+linguistic+applications%2E)
34. Figure 8: Visualisation of effects for models predicting speakers’ overall energy levels [find](https://scholar.google.com/scholar?q=Figure+8%3A+Visualisation+of+effects+for+models+predicting+speakers%E2%80%99+overall+energy+levels)