Skip to main content

CRAFT: ClusteR-specific Assorted Feature selecTion

Publication ,  Conference
Garg, VK; Rudin, C; Jaakkola, T
Published in: Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016
January 1, 2016

We present a hierarchical Bayesian framework for clustering with cluster-specific feature selection. We derive a simplified model, CRAFT, by analyzing the asymptotic behavior of the log posterior formulations in a nonparametric MAP-based clustering setting in this framework. CRAFT handles assorted data, i.e., both numeric and categorical data, and the underlying objective functions are intuitively appealing. The resulting algorithm is simple to implement and scales nicely, requires minimal parameter tuning, obviates the need to specify the number of clusters a priori, and compares favorably with other state-of-the-art methods on several datasets. We provide empirical evidence on carefully designed synthetic data sets to highlight the robustness of the algorithm to recover the underlying feature subspaces, even when the average dimensionality of the features across clusters is misspecified. Besides, the framework seamlessly allows for multiple views of clustering by interpolating between the two extremes of cluster-specific feature selection and global selection, and recovers the DP-means objective [14] under the degenerate setting of clustering without feature selection.

Duke Scholars

Published In

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016

Publication Date

January 1, 2016

Start / End Page

305 / 313
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Garg, V. K., Rudin, C., & Jaakkola, T. (2016). CRAFT: ClusteR-specific Assorted Feature selecTion. In Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016 (pp. 305–313).
Garg, V. K., C. Rudin, and T. Jaakkola. “CRAFT: ClusteR-specific Assorted Feature selecTion.” In Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016, 305–13, 2016.
Garg VK, Rudin C, Jaakkola T. CRAFT: ClusteR-specific Assorted Feature selecTion. In: Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016. 2016. p. 305–13.
Garg, V. K., et al. “CRAFT: ClusteR-specific Assorted Feature selecTion.” Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016, 2016, pp. 305–13.
Garg VK, Rudin C, Jaakkola T. CRAFT: ClusteR-specific Assorted Feature selecTion. Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016. 2016. p. 305–313.

Published In

Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, AISTATS 2016

Publication Date

January 1, 2016

Start / End Page

305 / 313