Skip to main content

Dictionary learning and sparse coding for unsupervised clustering

Publication ,  Journal Article
Sprechmann, P; Sapiro, G
Published in: ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
January 1, 2010

A clustering framework within the sparse modeling and dictionary learning setting is introduced in this work. Instead of searching for the set of centroid that best fit the data, as in k-means type of approaches that model the data as distributions around discrete points, we optimize for a set of dictionaries, one for each cluster, for which the signals are best reconstructed in a sparse coding manner. Thereby, we are modeling the data as the of union of learned low dimensional subspaces, and data points associated to subspaces spanned by just a few atoms of the same learned dictionary are clustered together. Using learned dictionaries makes this method robust and well suited to handle large datasets. The proposed clustering algorithm uses a novel measurement for the quality of the sparse representation, inspired by the robustness of the ℓ1 regularization term in sparse coding. We first illustrate this measurement with examples on standard image and speech datasets in the supervised classification setting, showing with a simple approach its discriminative power and obtaining results comparable to the state-of-the-art. We then conclude with experiments for fully unsupervised clustering on extended standard datasets and texture images, obtaining excellent performance. ©2010 IEEE.

Duke Scholars

Altmetric Attention Stats
Dimensions Citation Stats

Published In

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

DOI

ISSN

1520-6149

Publication Date

January 1, 2010

Start / End Page

2042 / 2045
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Sprechmann, P., & Sapiro, G. (2010). Dictionary learning and sparse coding for unsupervised clustering. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2042–2045. https://doi.org/10.1109/ICASSP.2010.5494985
Sprechmann, P., and G. Sapiro. “Dictionary learning and sparse coding for unsupervised clustering.” ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, January 1, 2010, 2042–45. https://doi.org/10.1109/ICASSP.2010.5494985.
Sprechmann P, Sapiro G. Dictionary learning and sparse coding for unsupervised clustering. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2010 Jan 1;2042–5.
Sprechmann, P., and G. Sapiro. “Dictionary learning and sparse coding for unsupervised clustering.” ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, Jan. 2010, pp. 2042–45. Scopus, doi:10.1109/ICASSP.2010.5494985.
Sprechmann P, Sapiro G. Dictionary learning and sparse coding for unsupervised clustering. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2010 Jan 1;2042–2045.

Published In

ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

DOI

ISSN

1520-6149

Publication Date

January 1, 2010

Start / End Page

2042 / 2045