A Sequential Algorithm for Fast Fitting of Dirichlet Process Mixture Models

Xiaole Zhang, David J. Nott, Christopher Yau, Ajay Jasra

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

In this article, we propose an improvement on the sequential updating and greedy search (SUGS) algorithm for fast fitting of Dirichlet process mixture models. The SUGS algorithm provides a means for very fast approximate Bayesian inference for mixture data which is particularly of use when datasets are so large that many standard Markov chain Monte Carlo (MCMC) algorithms cannot be applied efficiently, or take a prohibitively long time to converge. In particular, these ideas are used to initially interrogate the data, and to refine models such that one can potentially apply exact data analysis later on. SUGS relies upon sequentially allocating data to clusters and proceeding with an update of the posterior on the subsequent allocations and parameters which assumes this allocation is correct. Our modification softens this approach, by providing a probability distribution over allocations, with a similar computational cost; this approach has an interpretation as a variational Bayes procedure and hence we term it variational SUGS (VSUGS). It is shown in simulated examples that VSUGS can outperform, in terms of density estimation and classification, a version of the SUGS algorithm in many scenarios. In addition, we present a data analysis for flow cytometry data, and SNP data via a three-class Dirichlet process mixture model, illustrating the apparent improvement over the original SUGS algorithm.
Original languageEnglish (US)
JournalJournal of Computational and Graphical Statistics
Volume23
Issue number4
DOIs
StatePublished - Jan 1 2014
Externally publishedYes

Fingerprint

Dive into the research topics of 'A Sequential Algorithm for Fast Fitting of Dirichlet Process Mixture Models'. Together they form a unique fingerprint.

Cite this