Conversation Scene Analysis with Dynamic Bayesian Network based on Visual Head Tracking
IEEE ICME'06, July, 2006
[Demo movies]

Modeling and Probabilistic Inference of Conversation Structures in Multiparty Face-to-Face Setting based on Visual Head Tracking
MIRU 2006, July 2006
Note: Japanese Domestic Conference. Content is the same as ICME'06
[Demo movies]

Communication Scene Analysis based on Probabilstic Modeling of Human Gaze Behavior
MIT CSAIL HCI Seminar Series Spring 2006
[Abstract][Presentation]

Any reproduction, modification, distribution, or republication of materials contained on this Web site, without prior explicit permission of the copyright holder, is strictly prohibited.

All rights reserved, Copyright(C) 2005, 2006, 2007 NTT Communication Science Laboratories

I was working on automatic video editing system for conversation scenes, with Dr. Takemae who was with NTT CS Lab. It is based on the gaze direction of participants in conversations.

2005年

2006年

2007年

Ealier than 2004

A Probabilistic Inference of Multiparty-Conversation Structure Based on
Markov-Switching Models of Gaze Patterns, Head Directions, and Utterances
ACM Int. Conf Multimodal Interfaces (ICMI)'05, October, 2005.
[Abstract][Paper][Presentation][Movies]

We proposed a method for esimatating the structure of multiparty conversations. It was presented at Int. Workshop on Conversational Informatics (hosted by Prof. Nishida at Kyoto Univ.). Also, I present it at ICMI2005 and Transaction of IPSJ.

We tried to replace the sensors for measuring head directions with vision-based face tracking method. This method was presented at ICME2006 and MIRU2006. Also, I had a chance to give a talk at MIT seminar and JSAI-SLUD.

Quantifying Interpersonal Influence in Face-to-face Conversations based on Visual Attention Patterns
ACM CHI (Work-In-Progress Session), April, 2006
[Abstract][Paper][Poster]

As an application of estimated conversation structure and gaze directions, we proposed a measure for interpersonal influences in conversation. This work was presented at CHI poster session.

We extended the previous method to infer the action-reaction relationship in conversations, i.e. "who responds to whom". I presented this work at ICMI2007 and received an award.

Recently, I have been working with intern students. Their topics are fact and accurate face tracking in video, and facial expression recognition. We presented a demo system of face tracking at MIRU2007.

Pose-Invariant Facial Expression Recognition Using Variable-Intensity Templates
Proc. Asian Conference on Computer Vision, 2007
[To Shiro Kumano's papge, who is the first author of this work]

Sorry, Under construction.