The matrix stick-breaking process for flexible multi-task learning

Ya Xue, David Dunson, Lawrence Carin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Scopus citations

Abstract

In multi-task learning our goal is to design regression or classification models for each of the tasks and appropriately share information between tasks. A Dirichlet process (DP) prior can be used to encourage task clustering. However, the DP prior does not allow local clustering of tasks with respect to a subset of the feature vector without making independence assumptions. Motivated by this problem, we develop a new multitask-learning prior, termed the matrix stick-breaking process (MSBP), which encourages cross-task sharing of data. However, the MSBP allows separate clustering and borrowing of information for the different feature components. This is important when tasks are more closely related for certain features than for others. Bayesian inference proceeds by a Gibbs sampling algorithm and the approach is illustrated using a simulated example and a multi-national application.
Original languageEnglish (US)
Title of host publicationACM International Conference Proceeding Series
Pages1063-1070
Number of pages8
DOIs
StatePublished - Aug 23 2007
Externally publishedYes

Fingerprint Dive into the research topics of 'The matrix stick-breaking process for flexible multi-task learning'. Together they form a unique fingerprint.

Cite this