Pictorial Structures for Object Recognition
Pedro F. FelzenszwalbDaniel P. Huttenlocher
Develops a computationally efficient statistical framework for part-based deformable object recognition, utilizing tree-structured models and generalized distance transforms to find globally optimal matches and sample posterior configurations in linear time.
The article addresses the challenge of recognizing generic classes of objects, such as faces and human bodies, in images. Traditional methods often struggle with deformable shapes and require manual model construction or inefficient search techniques, limiting their practicality for real-world applications where objects vary in pose and appearance.
The work evaluates an improved pictorial structure framework for part-based modeling. It sets out to develop efficient algorithms for matching models to images and for learning model parameters automatically from training examples.
The approach relies on tree-structured graphs with specific spring-like connections between parts. Experiments use labeled training images to learn appearance and spatial parameters via maximum likelihood estimation, followed by dynamic programming with generalized distance transforms for matching and posterior sampling for multiple hypotheses. Tests cover frontal faces from the Yale database and articulated human figures in binary images obtained by background subtraction.
The analysis shows that globally optimal matches can be found in time linear in the number of possible part locations rather than quadratic. Models learned from twenty face examples and ten body examples correctly locate objects in novel images, including cases with partial occlusion or noise. Sampling from the posterior distribution yields multiple high-quality hypotheses when the model is imprecise.
These results indicate that part-based deformable models can be made computationally practical and automatically constructed, reducing reliance on hand-tuned parameters or local search. The framework supports generic recognition tasks by jointly considering part appearance and geometric relations without early binary decisions about feature locations.
Further work is needed to handle more complex objects and larger pose spaces before broad deployment. The main limitations are the restriction to tree-structured models, discretization of part locations, and the need for post-sampling verification when parts overlap. Overall confidence in the reported efficiency and detection performance is high given the explicit experimental results.
- Paper: Comparing Images Using the Hausdorff Distance, Daniel P. Huttenlocher et al. (1993). Introduces the distance transform algorithms essential for computing optimal part configurations in pictorial structures in linear time.
- Paper: Active Appearance Models, Timothy F. Cootes et al. (1998). Establishes statistical modeling of deformable shape and appearance variations that motivates flexible part-based object matching.
- Paper: Object Detection with Discriminatively Trained Part-Based Models, Pedro F. Felzenszwalb et al. (2010). Directly builds on the pictorial structures framework by adding discriminatively trained mixtures of deformable part models with latent SVMs.
- Paper: DeepPose: Human Pose Estimation via Deep Neural Networks, Alexander Toshev et al. (2014). Modernizes articulated human pose estimation by transitioning from tree-structured pictorial models to deep convolutional neural networks.
- Paper: Convolutional Pose Machines, Shih-En Wei et al. (2016). Advances articulated part-based pose estimation beyond tree-structured graphical models by learning spatial part dependencies via sequential convolutional belief maps.
- Paper: Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields, Zhe Cao et al. (2016). Scales articulated part association to real-time multi-person scenes by replacing traditional tree-structured matching with nonparametric Part Affinity Fields.
