Skip to main content

Simultaneous object classification and segmentation with high-order multiple shape models.

Publication ,  Journal Article
Lecumberry, F; Pardo, A; Sapiro, G
Published in: IEEE transactions on image processing : a publication of the IEEE Signal Processing Society
March 2010

Shape models (SMs), capturing the common features of a set of training shapes, represent a new incoming object based on its projection onto the corresponding model. Given a set of learned SMs representing different objects classes, and an image with a new shape, this work introduces a joint classification-segmentation framework with a twofold goal. First, to automatically select the SM that best represents the object, and second, to accurately segment the image taking into account both the image information and the features and variations learned from the online selected model. A new energy functional is introduced that simultaneously accomplishes both goals. Model selection is performed based on a shape similarity measure, online determining which model to use at each iteration of the steepest descent minimization, allowing for model switching and adaptation to the data. High-order SMs are used in order to deal with very similar object classes and natural variability within them. Position and transformation invariance is included as part of the modeling as well. The presentation of the framework is complemented with examples for the difficult task of simultaneously classifying and segmenting closely related shapes, such as stages of human activities, in images with severe occlusions.

Duke Scholars

Published In

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society

DOI

EISSN

1941-0042

ISSN

1057-7149

Publication Date

March 2010

Volume

19

Issue

3

Start / End Page

625 / 635

Related Subject Headings

  • Whole Body Imaging
  • Walking
  • Reproducibility of Results
  • Principal Component Analysis
  • Pattern Recognition, Automated
  • Normal Distribution
  • Mouth
  • Models, Theoretical
  • Lip
  • Image Processing, Computer-Assisted
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Lecumberry, F., Pardo, A., & Sapiro, G. (2010). Simultaneous object classification and segmentation with high-order multiple shape models. IEEE Transactions on Image Processing : A Publication of the IEEE Signal Processing Society, 19(3), 625–635. https://doi.org/10.1109/tip.2009.2038759
Lecumberry, Federico, Alvaro Pardo, and Guillermo Sapiro. “Simultaneous object classification and segmentation with high-order multiple shape models.IEEE Transactions on Image Processing : A Publication of the IEEE Signal Processing Society 19, no. 3 (March 2010): 625–35. https://doi.org/10.1109/tip.2009.2038759.
Lecumberry F, Pardo A, Sapiro G. Simultaneous object classification and segmentation with high-order multiple shape models. IEEE transactions on image processing : a publication of the IEEE Signal Processing Society. 2010 Mar;19(3):625–35.
Lecumberry, Federico, et al. “Simultaneous object classification and segmentation with high-order multiple shape models.IEEE Transactions on Image Processing : A Publication of the IEEE Signal Processing Society, vol. 19, no. 3, Mar. 2010, pp. 625–35. Epmc, doi:10.1109/tip.2009.2038759.
Lecumberry F, Pardo A, Sapiro G. Simultaneous object classification and segmentation with high-order multiple shape models. IEEE transactions on image processing : a publication of the IEEE Signal Processing Society. 2010 Mar;19(3):625–635.

Published In

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society

DOI

EISSN

1941-0042

ISSN

1057-7149

Publication Date

March 2010

Volume

19

Issue

3

Start / End Page

625 / 635

Related Subject Headings

  • Whole Body Imaging
  • Walking
  • Reproducibility of Results
  • Principal Component Analysis
  • Pattern Recognition, Automated
  • Normal Distribution
  • Mouth
  • Models, Theoretical
  • Lip
  • Image Processing, Computer-Assisted