'Selective Perception Policies for Guiding Sensing and
Computation in Multimodal Systems: A Comparative Analysis', Nuria Oliver &
Eric Horvitz. Paper presented at ICMI 2003 (Vancouver, BC, Canada, November
2003)In this project, we explore the use of expected value of information (EVI) to
control the use and analysis of data coming from multiple perceptual sensors
used in the SEER system for identifying office
activities. SEER uses a layering of HMMs (LHMMs)
at different temporal granularities for diagnosing situations in offices from
real-time streams of evidence (video, audio
and computer interactions). We review the overall architecture of the legacy
SEER system, describe how we integrated the EVI analyses, and show how EVI
computations endow SEER's descendant, named Selective SEER or just
S-SEER, with the ability to balance computation required for perceptual analysis
with the discriminatory power of the sensors. Finally, we report on several
experiments to probe the value of using EVI in the system.
'Selective Perception Policies for Guiding Sensing and Computation in Multimodal Systems: A Comparative Analysis', Nuria Oliver & Eric Horvitz. Submitted to CVIU Journal.
'Layered Representations for Learning and Inferring Office Activity from Multiple Sensory Channels', Nuria Oliver, Ashutosh Garg & Eric Horvitz. To appear in CVIU Journal.
'Selective Perception Policies for Guiding Sensing and
Computation in Multimodal Systems: A Comparative Analysis', Nuria Oliver &
Eric Horvitz. Paper presented at ICMI 2003 (Vancouver, BC, Canada, November
2003)
'Layered
Representations for Human Activity Recognition', Nuria Oliver, Eric Horvitz
& Ashutosh Garg. Paper presented at ICMI 2002 (Pittsburgh, October 2002)
Paper presented at CVPR2001 (Cues in Communication Workshop),
Nuria Oliver, Eric Horvitz & Ashutosh Garg
Video showing S-SEER in action as of June 2004
Live demonstration during
Bill Gates
invited speech at IJCAI2001