|
Published Articles >> Table of Contents >> Abstract
Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
p. 384
Audio-Visual Speaker Detection Using Dynamic Bayesian Networks
Ashutosh Garg, University of Illinois at Urbana-Champaign
Vladimir Pavlovic, Compaq Computer Corporation
James M. Rehg, Compaq Computer Corporation
Full Article Text:
  
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/AFGR.2000.840663
Send link to a friend
| Abstract |
|
The development of human-computer interfaces poses a challenging problem: actions and intentions of different users have to be inferred from sequences of noisy and ambiguous sensory data. Temporal fusion of multiple sensors can be efficiently formulated using dynamic Bayesian networks (DBNs). DBN framework allows the power of statistical inference and learning to be combined with contextual knowledge of the problem. We demonstrate the use of DBNs in tackling the problem of audio/visual speaker detection. "Off-the-shelf" visual and audio sensors (face, skin, texture, mouth motion, and silence detectors) are optimally fused along with contextual information in a DBN architecture that infers instances when an individual is speaking. Results obtained in the setup of an actual human-machine interaction system (Genie Casino Kiosk) demonstrate superiority of our approach over that of static, context-free fusion architecture.
|
 Additional Information
|
Index Terms- speaker detection, dynamic Bayesian networks, multimodal HCI
Citation:
Ashutosh Garg, Vladimir Pavlovic, James M. Rehg,
"Audio-Visual Speaker Detection Using Dynamic Bayesian Networks,"
fg,
p. 384,
Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000,
2000
|
|
