The matrix stick-breaking process for flexible multi-task learning

Journal Article

In multi-task learning our goal is to design regression or classification models for each of the tasks and appropriately share information between tasks. A Dirichlet process (DP) prior can be used to encourage task clustering. However, the DP prior does not allow local clustering of tasks with respect to a subset of the feature vector without making independence assumptions. Motivated by this problem, we develop a new multitask-learning prior, termed the matrix stick-breaking process (MSBP), which encourages cross-task sharing of data. However, the MSBP allows separate clustering and borrowing of information for the different feature components. This is important when tasks are more closely related for certain features than for others. Bayesian inference proceeds by a Gibbs sampling algorithm and the approach is illustrated using a simulated example and a multi-national application.

Full Text

Duke Authors

Cited Authors

  • Xue, Y; Dunson, D; Carin, L

Published Date

  • August 23, 2007

Published In

  • Acm International Conference Proceeding Series

Volume / Issue

  • 227 /

Start / End Page

  • 1063 - 1070

Digital Object Identifier (DOI)

  • 10.1145/1273496.1273630

Citation Source

  • Scopus