Tootfinder

Multimodal Emotion Coupling via Speech-to-Facial and Bodily Gestures in Dyadic Interaction
Von Ralph Dane Marquez Herbuela, Yukie Nagai
https://arxiv.org/abs/2506.10010

Multimodal Emotion Coupling via Speech-to-Facial and Bodily Gestures in Dyadic Interaction
Human emotional expression emerges through coordinated vocal, facial, and gestural signals. While speech face alignment is well established, the broader dynamics linking emotionally expressive speech to regional facial and hand motion remains critical for gaining a deeper insight into how emotional and behavior cues are communicated in real interactions. Further modulating the coordination is the structure of conversational exchange like sequential turn taking, which creates stable temporal win…