Papers about Agent's Expression

In Virtual Reality environments, real humans can meet virtual humans to collaborate on tasks. The agent Max is such a virtual human, providing the human user with a face-toface collaboration partner in the SFB 360 construction tasks. This paper describes how Max can assist by combining manipulative capabilities for assembly actions with conversational capabilities for mixed-initiative dialogue. During the interaction, Max employs speech, gaze, facial expression, and gesture and is able to initiate assembly actions.... Read more

This paper proposes two simple and robust algorithmic solutions for two frequently encountered problems in in-habited virtual heritage worlds: a) the 'still-frozen' behavior of virtual actors once their predefined-scripted anima-tion is executed and b) their real-time rendering which is mostly often based on non physically-principled local il-lumination models. Our described framework thus provides a) a procedural keyframe generator for realistic idle motions blended with the virtual actor's scripted behavior and b) an extension to precomputed... Read more

At most institutions, medical students learn communication skills through the use of standardized patients (SP’s). Virtual patients (VP’s) may offer several advantages over SP’s, but little data exists regarding the use of VP’s in teaching communication skills. Therefore, we report our initial efforts to create an interactive virtual clinical scenario of a patient with acute abdominal pain to teach medical students history-taking and communication skills. Read more

Individuality of Embodied Conversational Agents (ECAs) may depend on both the look of the agent and the way it combines different modalities such as speech and gesture. In this chapter, we describe a study in which male and female users had to listen to three short technical presentations made by ECAs. Three multimodal strategies of ECAs for using arm gestures with speech were compared: redundancy, complementarity, and speech-specialization. These strategies were randomly attributed to different-looking... Read more

Conversational agents integrate computational linguistics techniques with the communication channel of the Web to interpret and respond to statements made by users in ordinary natural language. Web-based conversational agents deliver high-volumes of interactive text-based dialogs. Recent years have seen significant activity in enterprise-class conversational agents. This chapter describes the principal applications of conversational agents in the enterprise and the technical challenges posed by their design and large-scale deployments. These technical challenges fall into two categories:... Read more

In this paper, we propose a facial animation system for capturing both geometrical information and illumination changes of surface details, called expression details, from video clips simultaneously and the captured data can be widely applied to different 2D face images and 3D face models. While tracking the geometric data, we record the expression details by ratio images. For 2D facial animation synthesis, these ratio images are used to generate dynamic textures. Because a ratio image... Read more

AIML - A recently developed standard for describing knowledge for Robots using XML data structures is introduced. A very large English-based robot knowledge base developed using the standard is described. Many other knowledge-based projects based on other international languages are described. The English-based knowledge base is currently interacting with people at a rate of 100,000 inquiries per day. A unique web-based computer architecture (http://www.pandorabots.com) supporting the on-going development of the knowledge base is described. The... Read more

We discuss how simulating emotional dialogs with an Embodied Agent requires endowing it with ability to manifest appropriately emotions but also to exploit them in controlling behavior. We then describe a domain-independent testbed to simulate dialogs in affective domains and verify how they change when the context in which interaction occurs is varied. Emotion activation is simulated by dynamic belief networks while dialog simulation is implemented within a logical framework. Read more

This paper presents a pilot study involving 99 participants analysing conversations between Judges 2, 4 and 7, hidden humans (Confederates), and Jabberwock, bronze prize winner for most human-like machine from Loebner’s 2003 Contest, instantiation of Turing’s Test for machine intelligence. The transcripts from these conversations were given to children (aged between 8 and 12), and adults (aged between 18-35). The machine was identified in its conversation with Judge 7, but the Confederate Effect featured in... Read more

In this paper, we describe an application of responsive virtual humans to train law enforcement personnel in dealing with subjects that present symptoms of serious mental illness. JUST-TALK provides a computerized virtual person to interact with the student in a role-playing environment. Students were able to converse with the virtual person using spoken natural language and see and hear the virtual human s responses a combination of facial gesture, body movements, and spoken language. The... Read more