Skip to main content

Active learning for large-scale factor analysis

Publication ,  Journal Article
Silva, J; Carin, L
Published in: 2012 IEEE Statistical Signal Processing Workshop, SSP 2012
November 6, 2012

A method for Bayesian factor analysis (FA) of large matrices is proposed. It is assumed that a small number of matrix elements are initially observed, and the statistical FA model is employed to actively and sequentially select which new matrix entries would be most informative, in order to estimate the remaining missing entries, i.e., complete the matrix. The model inference and active learning are performed within an online variational Bayes (VB) framework. A fast and provably near-optimal greedy algorithm is used to sequentially maximize the mutual information contribution from new observations, taking advantage of submodularity properties. Additionally, a simple alternative procedure is proposed, in which the posterior parameters learned by the Bayesian approach are directly used. This alternative procedure is shown to achieve slightly higher prediction error, but requires much fewer computational resources. The methods are demonstrated on a very large matrix factorization problem, namely the Yahoo! Music ratings dataset. © 2012 IEEE.

Duke Scholars

Published In

2012 IEEE Statistical Signal Processing Workshop, SSP 2012

DOI

Publication Date

November 6, 2012

Start / End Page

161 / 164
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Silva, J., & Carin, L. (2012). Active learning for large-scale factor analysis. 2012 IEEE Statistical Signal Processing Workshop, SSP 2012, 161–164. https://doi.org/10.1109/SSP.2012.6319648
Silva, J., and L. Carin. “Active learning for large-scale factor analysis.” 2012 IEEE Statistical Signal Processing Workshop, SSP 2012, November 6, 2012, 161–64. https://doi.org/10.1109/SSP.2012.6319648.
Silva J, Carin L. Active learning for large-scale factor analysis. 2012 IEEE Statistical Signal Processing Workshop, SSP 2012. 2012 Nov 6;161–4.
Silva, J., and L. Carin. “Active learning for large-scale factor analysis.” 2012 IEEE Statistical Signal Processing Workshop, SSP 2012, Nov. 2012, pp. 161–64. Scopus, doi:10.1109/SSP.2012.6319648.
Silva J, Carin L. Active learning for large-scale factor analysis. 2012 IEEE Statistical Signal Processing Workshop, SSP 2012. 2012 Nov 6;161–164.

Published In

2012 IEEE Statistical Signal Processing Workshop, SSP 2012

DOI

Publication Date

November 6, 2012

Start / End Page

161 / 164