Skip to main content

Simultaneous compaction and factorization of sparse image motion matrices

Publication ,  Journal Article
Ricco, S; Tomasi, C
Published in: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
October 30, 2012

Matrices that collect the image coordinates of point features tracked through video - one column per feature - have often low rank, either exactly or approximately. This observation has led to many matrix factorization methods for 3D reconstruction, motion segmentation, or regularization of feature trajectories. However, temporary occlusions, image noise, and variations in lighting, pose, or object geometry often confound trackers. A feature that reappears after a temporary tracking failure - whatever the cause - is regarded as a new feature by typical tracking systems, resulting in very sparse matrices with many columns and rendering factorization problematic. We propose a method to simultaneously factor and compact such a matrix by merging groups of columns that correspond to the same feature into single columns. This combination of compaction and factorization makes trackers more resilient to changes in appearance and short occlusions. Preliminary experiments show that imputation of missing matrix entries - and therefore matrix factorization - becomes significantly more reliable as a result. Clean column merging also required us to develop a history-sensitive feature reinitialization method we call feature snapping that aligns merged feature trajectory segments precisely to each other. © 2012 Springer-Verlag.

Duke Scholars

Published In

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

DOI

EISSN

1611-3349

ISSN

0302-9743

Publication Date

October 30, 2012

Volume

7577 LNCS

Issue

PART 6

Start / End Page

456 / 469

Related Subject Headings

  • Artificial Intelligence & Image Processing
  • 46 Information and computing sciences
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Ricco, S., & Tomasi, C. (2012). Simultaneous compaction and factorization of sparse image motion matrices. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 7577 LNCS(PART 6), 456–469. https://doi.org/10.1007/978-3-642-33783-3_33
Ricco, S., and C. Tomasi. “Simultaneous compaction and factorization of sparse image motion matrices.” Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 7577 LNCS, no. PART 6 (October 30, 2012): 456–69. https://doi.org/10.1007/978-3-642-33783-3_33.
Ricco S, Tomasi C. Simultaneous compaction and factorization of sparse image motion matrices. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2012 Oct 30;7577 LNCS(PART 6):456–69.
Ricco, S., and C. Tomasi. “Simultaneous compaction and factorization of sparse image motion matrices.” Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7577 LNCS, no. PART 6, Oct. 2012, pp. 456–69. Scopus, doi:10.1007/978-3-642-33783-3_33.
Ricco S, Tomasi C. Simultaneous compaction and factorization of sparse image motion matrices. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2012 Oct 30;7577 LNCS(PART 6):456–469.

Published In

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

DOI

EISSN

1611-3349

ISSN

0302-9743

Publication Date

October 30, 2012

Volume

7577 LNCS

Issue

PART 6

Start / End Page

456 / 469

Related Subject Headings

  • Artificial Intelligence & Image Processing
  • 46 Information and computing sciences