Data augmentation for models based on rejection sampling.

Journal Article (Journal Article)

We present a data augmentation scheme to perform Markov chain Monte Carlo inference for models where data generation involves a rejection sampling algorithm. Our idea is a simple scheme to instantiate the rejected proposals preceding each data point. The resulting joint probability over observed and rejected variables can be much simpler than the marginal distribution over the observed variables, which often involves intractable integrals. We consider three problems: modelling flow-cytometry measurements subject to truncation; the Bayesian analysis of the matrix Langevin distribution on the Stiefel manifold; and Bayesian inference for a nonparametric Gaussian process density model. The latter two are instances of doubly-intractable Markov chain Monte Carlo problems, where evaluating the likelihood is intractable. Our experiments demonstrate superior performance over state-of-the-art sampling algorithms for such problems.

Full Text

Duke Authors

Cited Authors

  • Rao, V; Lin, L; Dunson, DB

Published Date

  • June 2016

Published In

Volume / Issue

  • 103 / 2

Start / End Page

  • 319 - 335

PubMed ID

  • 27279660

Pubmed Central ID

  • PMC4890134

Electronic International Standard Serial Number (EISSN)

  • 1464-3510

International Standard Serial Number (ISSN)

  • 0006-3444

Digital Object Identifier (DOI)

  • 10.1093/biomet/asw005


  • eng