Interpersonal synchrony: from social perception to social interaction

Mohamed Chetouani (1, 2) , Emilie Delaherche (3) , Guillaume Dumas (4) , David Cohen (2, 5)

1 ISIR - Institut des Systèmes Intelligents et de Robotique
2 SU - Sorbonne Université
3 UPMC - Université Pierre et Marie Curie - Paris 6
4 LGC - Laboratoire de Gestion et de Cognition
5 AP-HP - Hopital Saint-Louis [AP-HP]

Introduction Synchrony refers to individuals’ temporal coordination during social interactions (Cappella, 2005). The analysis of this phenomenon is complex, requiring the perception and integration of multimodal communicative signals. The evaluation of synchrony has received multidisciplinary attention because of its role in early development (Feldman, 2003), language learning (Goldstein, King, & West, 2003), and social connection (Harrist & Waugh, 2002). Initially, instances of synchrony were directly perceived in the data by trained observers. Several methods have been proposed to evaluate interactional synchrony, ranging from behavior microanalysis (Cappella, 1997) to global perception of synchrony (Bernieri, Reznick, & Rosenthal, 1988). Behavioral synchrony has now captured the interest of researchers in such fields as social signal processing, robotics, and machine learning (Prepin & Pelachaud, 2011; Kozima, Michalowski, & Nakagawa, 2009). In this chapter, we focus especially on description and definition of synchrony for the development of computational models. The chapter begins with a review of evidences of interpersonal synchrony from different research domains (psychology, clinics, neuroscience and biology). Then, we introduce a working definition of interpersonal synchrony (see Proposed Definition). The chapter surveys evaluation models and methods from the literature of psychology (see Non-computational Methods of Synchrony Assessment) and social signal processing (see Fully Automatic Measures of Synchrony). Finally, the chapter discusses a number of challenges that need to be addressed (see Conclusions and Main Challenges). Non-verbal Evidence of Interpersonal Synchrony Among social signals, synchrony and coordination have been considered lately (Ramseyer & Tschacher, 2010; Delaherche et al., 2012). Condon and Ogston (1967) initially proposed a microanalysis of human behavior (body motion and speech intonation) and evidenced the existence of interactional synchrony, the coordination between listener's and speaker's body movements, or between the listener's body movement and the speaker's pitch and stress variations. Bernieri et al. (1988) define coordination as the “degree to which the behaviors in an interaction are non-random, patterned or synchronized in both form and timing”. (Kendon, 1970) raises fundamental questions about the condition of interactional synchrony arousal and its function in interaction. When he synchronizes with the speaker, the listener demonstrates his ability to anticipate what the speaker is going to say. In this way, he gives feedback to the speaker and smoothens the running of the encounter.

Domaines: Intelligence artificielle [cs.AI]; Traitement du signal et de l'image [eess.SP]; Vision par ordinateur et reconnaissance de formes [cs.CV]; Robotique [cs.RO]; Informatique; Psychologie; Neurosciences

Mohamed Chetouani, Emilie Delaherche, Guillaume Dumas, David Cohen. Interpersonal synchrony: from social perception to social interaction. Edited by Judee K. Burgoon, University of Arizona Nadia Magnenat-Thalmann, Université de Genève Maja Pantic, Imperial College London Alessandro Vinciarelli, University of Glasgow. Social Signal Processing Part II - Machine Analysis of Social Signals, Cambridge University Press, pp.202-212, 2017, Social Signal Processing, 9781316676202. ⟨10.1017/9781316676202.015⟩. ⟨hal-02422930⟩