Papers about Body motion

Embodied Conversational Agents (ECAs) are life-like CG characters that interact with human users in face-to-face conversations. To achieve natural multi-modal conversations, ECA systems are sophisticated and are composed with assemblies of various functions. They are thus difficult for an individual research group to develop. To address this problem, we are developing a Generic ECA Framework to integrate those assemblies with each other seamlessly. It is composed with a low-level communication platform, a high-level protocol and... Read more

DEIRA is a virtual agent commenting on virtual horse races in real time. DEIRA analyses the state of the race, acts emotionally and comments about the situation in a believable and engaging way, using synthesized speech and facial expressions. In this paper we discuss the challenges, explain the computational models for the cognitive, emotional and communicative behavior, and account on implementation and feedback from users. Read more

This paper presents the NECA approach to the generation of dialogues between Embodied Conversational Agents (ECAs). This approach consist of the automated constructtion of an abstract script for an entire dialogue (cast in terms of dialogue acts), which is incrementally enhanced by a series of modules and finally ”performed” by means of text, speech and body language, by a cast of ECAs. The approach makes it possible to automatically produce a large variety of highly... Read more

In face-to-face dialogue, the participants have visible as well as audible resources for social communication, that is, not just words and prosody, but also hand gestures, facial displays, gaze direction and timing, body orientation, and objects in their shared environment. We propose that some non-verbal acts play an important role in the participants' collaboration, so that the study ofthese non-verbal acts in dialogue is a promising way to understand basic processes in social communication. Read more

We performed an empirical study exploring people’s interactions with an embodied conversational agent (ECA) while performing two tasks. Conditions varied with respect to 1) whether participants were allowed to choose an agent and its characteristics and 2) the putative quality or appropriateness of the agent for the tasks. For both tasks, selection combined with the illusion of further customization significantly improved participants’ overall subjective impressions of the ECAs while putative quality had little or no... Read more

Against the background that recent studies on embodied conversational agents demonstrate the importance of their behavior, an experimental study is presented that assessed the effects of different nonverbal behaviors of an embodied conversational agent on the experiences and evaluations of the user as well as on their behavior. 50 participants conducted a conversation with different versions of the virtual agent Max, whose nonverbal communication was manipulated with regard to eyebrow movements and self-touching gestures. In... Read more

In Virtual Reality environments, real humans can meet virtual humans to collaborate on tasks. The agent Max is such a virtual human, providing the human user with a face-toface collaboration partner in the SFB 360 construction tasks. This paper describes how Max can assist by combining manipulative capabilities for assembly actions with conversational capabilities for mixed-initiative dialogue. During the interaction, Max employs speech, gaze, facial expression, and gesture and is able to initiate assembly actions.... Read more

This paper proposes two simple and robust algorithmic solutions for two frequently encountered problems in in-habited virtual heritage worlds: a) the 'still-frozen' behavior of virtual actors once their predefined-scripted anima-tion is executed and b) their real-time rendering which is mostly often based on non physically-principled local il-lumination models. Our described framework thus provides a) a procedural keyframe generator for realistic idle motions blended with the virtual actor's scripted behavior and b) an extension to precomputed... Read more

At most institutions, medical students learn communication skills through the use of standardized patients (SP’s). Virtual patients (VP’s) may offer several advantages over SP’s, but little data exists regarding the use of VP’s in teaching communication skills. Therefore, we report our initial efforts to create an interactive virtual clinical scenario of a patient with acute abdominal pain to teach medical students history-taking and communication skills. Read more

Individuality of Embodied Conversational Agents (ECAs) may depend on both the look of the agent and the way it combines different modalities such as speech and gesture. In this chapter, we describe a study in which male and female users had to listen to three short technical presentations made by ECAs. Three multimodal strategies of ECAs for using arm gestures with speech were compared: redundancy, complementarity, and speech-specialization. These strategies were randomly attributed to different-looking... Read more