Scalable Control Variates for Monte Carlo Methods via Stochastic Optimization

Shijing Si, Chris J. Oates, Andrew B. Duncan, Lawrence Carin, François-Xavier Briol

Research output: Contribution to journalArticlepeer-review

Abstract

Control variates are a well-established tool to reduce the variance of Monte Carlo estimators. However, for large-scale problems including high-dimensional and large-sample settings, their advantages can be outweighed by a substantial computational cost. This paper considers control variates based on Stein operators, presenting a framework that encompasses and generalizes existing approaches that use polynomials, kernels and neural networks. A learning strategy based on minimising a variational objective through stochastic optimization is proposed, leading to scalable and effective control variates. Our results are both empirical, based on a range of test functions and problems in Bayesian inference, and theoretical, based on an analysis of the variance reduction that can be achieved.
Original languageEnglish (US)
JournalArxiv preprint
StatePublished - Jun 12 2020
Externally publishedYes

Keywords

  • stat.ML
  • cs.LG
  • G.3

Fingerprint Dive into the research topics of 'Scalable Control Variates for Monte Carlo Methods via Stochastic Optimization'. Together they form a unique fingerprint.

Cite this