Skip to main content

A bayesian approach to unsupervised feature selection and density estimation using expectation propagation

Publication ,  Journal Article
Chang, S; Dasgupta, N; Carin, L
Published in: Proceedings - 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005
January 1, 2005

We propose an approximate Bayesian approach for unsupervised feature selection and density estimation, where the importance of the features for clustering is used as the measure for feature selection. Traditional maximum-likelihood (ML) model-parameter optimization schemes estimate the feature saliencies for a fixed model structure (i.e., a fixed number of clusters). In practice, the number of clusters present in the data for mixture-based modeling is unknown. In an ML framework, the number of clusters typically needs to be ascertained prior to estimating the feature saliencies. We propose a density estimation scheme that addresses model complexity (number of clusters present) and model-parameter estimation (feature saliencies) in a single optimization framework. The approximate Bayesian approach presented here, based on the expectation propagation method, obtains a full posterior distribution on the saliency of the features, along with full posterior distribution of other model parameters (including the number of clusters) that represent the underlying statistics of the data. The performance of the algorithm, is analyzed based on its ability to identify the features salient for clustering the multivariate data.

Duke Scholars

Published In

Proceedings - 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005

DOI

Publication Date

January 1, 2005

Volume

II

Start / End Page

1043 / 1050
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Chang, S., Dasgupta, N., & Carin, L. (2005). A bayesian approach to unsupervised feature selection and density estimation using expectation propagation. Proceedings - 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, II, 1043–1050. https://doi.org/10.1109/CVPR.2005.15
Chang, S., N. Dasgupta, and L. Carin. “A bayesian approach to unsupervised feature selection and density estimation using expectation propagation.” Proceedings - 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005 II (January 1, 2005): 1043–50. https://doi.org/10.1109/CVPR.2005.15.
Chang S, Dasgupta N, Carin L. A bayesian approach to unsupervised feature selection and density estimation using expectation propagation. Proceedings - 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005. 2005 Jan 1;II:1043–50.
Chang, S., et al. “A bayesian approach to unsupervised feature selection and density estimation using expectation propagation.” Proceedings - 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. II, Jan. 2005, pp. 1043–50. Scopus, doi:10.1109/CVPR.2005.15.
Chang S, Dasgupta N, Carin L. A bayesian approach to unsupervised feature selection and density estimation using expectation propagation. Proceedings - 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005. 2005 Jan 1;II:1043–1050.

Published In

Proceedings - 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005

DOI

Publication Date

January 1, 2005

Volume

II

Start / End Page

1043 / 1050