The socio-affective dimension in digital innovations : toward a new understanding of Human-Machine Interactions in health and education

Jury

• M. Jacques Fischer Lokou, Université Bretagne Sud IUT de Vannes, Reviewer.
• M. Thierry Meyer, Université Paris Nanterre, Reviewer
• Mme Estelle Michinov, Université de Rennes 2, Reviewer
• Mme Beatrice Cahour, Institut Interdisciplinaire de l’Innovation, Examiner
• M. Jean-Claude Martin, Université Paris Saclay, Examiner

Abstract

Modern lifestyles, characterized by inadequate dietary habits and a lack of physical activity, contribute to the rise of non-communicable diseases, exacerbating public health issues while negatively impacting the environment. In response to these challenges, sustainable behavioral changes are essential to promoting healthier and more environmentally friendly lifestyles.

Psychology has long been concerned with the mechanisms of behavior change and the factors that facilitate it. Emerging technologies, particularly virtual agents, present promising perspectives for studying and influencing these dynamics. These agents, more than mere interfaces, are perceived by users as social entities capable of fostering rich interactions, where mental states, for instance, may be attributed to them. The primary aim of this research is to enhance the theoretical understanding of socio-emotional interactions between humans and machines while guiding the development of interactive technologies that meet the emotional and social needs of users.

Our research highlights the importance of congruent multimodal cues and context in recognizing emotions expressed by virtual agents. These findings underscore the necessity for accurate modeling of interactions to optimize the human-machine relationship. Additionally, personalizing interactions, combined with the integration of socio-affective competencies in virtual agents tailored to user profiles, is crucial for improving engagement, the quality of exchanges, and the adoption of technologies in complex environments.

Moreover, our work on multisensory interactions demonstrates that targeted improvements in virtual environments and assistive technologies can significantly enhance user experience, increase accessibility, and maximize the efficiency of these devices.

Our research project advances these contributions by focusing on three main areas: (1) emotional dynamics in human-machine interactions, (2) collaborative processes between humans and virtual agents, and (3) long-term user engagement in digital interventions. We believe that addressing the socio-affective dimension of Human-Machine Interaction and personalizing design are key elements in creating effective and widely adopted digital interventions, thereby addressing current challenges in education and public health.