Adaptive MCMC for multiple changepoint analysis with applications to large datasets
Files in This Item:
|adaptive_changepoint_alanbenson_nialfriel_revisedv2.pdf||1.3 MB||Adobe PDF||Download|
|Title:||Adaptive MCMC for multiple changepoint analysis with applications to large datasets||Authors:||Benson, Alan; Friel, Nial||Permanent link:||http://hdl.handle.net/10197/10567||Date:||9-Oct-2018||Online since:||2019-05-21T10:00:40Z||Abstract:||We consider the problem of Bayesian inference for changepoints where the number and position of the changepoints are both unknown. In particular, we consider product partition models where it is possible to integrate out model parameters for the regime between each changepoint, leaving a posterior distribution over a latent vector indicating the presence or not of a changepoint at each observation. The same problem setting has been considered by Fearnhead (2006) where one can use filtering recursions to make exact inference. However, the complexity of this filtering recursions algorithm is quadratic in the number of observations. Our approach relies on an adaptive Markov Chain Monte Carlo (MCMC) method for finite discrete state spaces. We develop an adaptive algorithm which can learn from the past states of the Markov chain in order to build proposal distributions which can quickly discover where changepoint are likely to be located. We prove that our algorithm leaves the posterior distribution ergodic. Crucially, we demonstrate that our adaptive MCMC algorithm is viable for large datasets for which the filtering recursions approach is not. Moreover, we show that inference is possible in a reasonable time thus making Bayesian changepoint detection computationally efficient.||Funding Details:||Science Foundation Ireland||Type of material:||Journal Article||Publisher:||Institute of Mathematical Statistics||Journal:||Electronic Journal of Statistics||Volume:||12||Issue:||2||Start page:||3365||End page:||3396||Copyright (published version):||2018 the Authors||Keywords:||Adaptive MCMC; Changepoint detection; Large datasets||DOI:||10.1214/18-EJS1418||Language:||en||Status of Item:||Peer reviewed|
|Appears in Collections:||Mathematics and Statistics Research Collection|
Show full item record
This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.