Description
This paper presents a multi-camera system that performs face detection and pose estimation in real-time and may be used for intelligent computing within a visual sensor network for surveillance or humancomputer interaction. The system consists of a Scene View Camera (SVC), which operates at a fixed zoom level, and an Object View Camera (OVC), which continuously adjusts its zoom level to match objects of interest. The SVC is set to survey the whole filed of view. Once a region has been identified by the SVC as a potential object of interest, e.g. a face, the OVC zooms in to locate specific features. In this system, face candidate regions are selected based on skin color and face detection is accomplished using a Support Vector Machine classifier. The locations of the eyes and mouth are detected inside the face region using neural network feature detectors. Pose estimation is performed based on a geometrical model, where the head is modeled as a spherical object that rotates upon the vertical axis. The triangle formed by the mouth and eyes defines a vertical plane that intersects the head sphere. By projecting the eyes-mouth triangle onto a two dimensional viewing plane, equations were obtained that describe the change in its angles as the yaw pose angle increases. These equations are then combined and used for efficient pose estimation. The system achieves real-time performance for live video input. Testing results assessing system performance are presented for both still images and video.
Date of creation, presentation, or exhibit
4-30-2007
Document Type
Conference Paper
Department, Program, or Center
Computer Engineering (KGCOE)
Recommended Citation
Andreas Savakis, Matthew Erhard, James Schimmel, Justin Hnatow, "A multi-camera system for real-time pose estimation", Proc. SPIE 6560, Intelligent Computing: Theory and Applications V, 656006 (30 April 2007); doi: 10.1117/12.719633; https://doi.org/10.1117/12.719633
Campus
RIT – Main Campus
Comments
Copyright 2007 Society of Photo-Optical Instrumentation Engineers. One print or electronic copy may be made for personal use only. Systematic reproduction and distribution, duplication of any material in this paper for a fee or for commercial purposes, or modification of the content of the paper are prohibited.
Note: imported from RIT’s Digital Media Library running on DSpace to RIT Scholar Works in February 2014.