Steve Di Paola of the Simon Fraser University demonstrated a real-time, emotion aware, parameterized virtual agent system to Chatbots.org. This system interprets real time emotions in input such as voice, and shows facial expressions and gestures.

During the 9th International Conference on Intelligent Virtual Agents, Steve showed us how his parameterized facial animation system operates. His goal is to develop a system that can handle any face type, behavior, and voice to be used in games, movies and virtual agent worlds. Their current focus is on how emotions should be expressed.

Video and images are available on Chatbots.org:
http://www.chatbots.org/conversational/agent/lip_sync_facial_expres...