Active Conditional Models

People

Ying Chen
Fernando de la Torre

Abstract

Matching images with large geometric and iconic changes (e.g. faces under different pose and facial expressions) is an open research problem in computer vision. There are two fundamental approaches to solve the correspondence problem in images: Feature-based matching and model-based matching. Feature-based matching relies on the assumption that features are stable across view-point and iconic changes, and it uses some unary, pair-wise or higher-order constraints as a measure of correspondence. On the other hand, model-based approaches such as Active Shape Models (ASMs) align appearance features with respect to a model. The model is learned with samples under rigid, non-rigid and iconic changes. However, model- based approaches typically suffer from lack of generalization to untrained situations. This paper proposes Active Conditional Models (ACM) that combines the benefits of both approaches. ACM learns the (a) Feature-based matching(SIFT) Training conditional relation (both in shape and appearance) between a reference view of the object and other view-points with iconic changes. The ACM model generalizes better to untrained situations, because it has less number of parameters (less prone to overfitting) and directly learns variations w.r.t a reference image (similar to feature-based methods). Several examples in the context of facial feature matching across pose and expression illustrate the benefits of ACMs.

Citation

Ying Chen and Fernando de la Torre,
"Active Conditional Models",
IEEE Conference on Automatic Face and Gestures Recognition (FG), 2011

[PDF] [Bibtex]

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

Component Analysis Lab