Adaptive MCMC for multiple changepoint analysis with applications to large datasets

Files in This Item:
File Description SizeFormat 
adaptive_changepoint_alanbenson_nialfriel_revisedv2.pdf1.3 MBAdobe PDFDownload
Title: Adaptive MCMC for multiple changepoint analysis with applications to large datasets
Authors: Benson, AlanFriel, Nial
Permanent link:
Date: 9-Oct-2018
Online since: 2019-05-21T10:00:40Z
Abstract: We consider the problem of Bayesian inference for changepoints where the number and position of the changepoints are both unknown. In particular, we consider product partition models where it is possible to integrate out model parameters for the regime between each changepoint, leaving a posterior distribution over a latent vector indicating the presence or not of a changepoint at each observation. The same problem setting has been considered by Fearnhead (2006) where one can use filtering recursions to make exact inference. However, the complexity of this filtering recursions algorithm is quadratic in the number of observations. Our approach relies on an adaptive Markov Chain Monte Carlo (MCMC) method for finite discrete state spaces. We develop an adaptive algorithm which can learn from the past states of the Markov chain in order to build proposal distributions which can quickly discover where changepoint are likely to be located. We prove that our algorithm leaves the posterior distribution ergodic. Crucially, we demonstrate that our adaptive MCMC algorithm is viable for large datasets for which the filtering recursions approach is not. Moreover, we show that inference is possible in a reasonable time thus making Bayesian changepoint detection computationally efficient.
Funding Details: Science Foundation Ireland
Type of material: Journal Article
Publisher: Institute of Mathematical Statistics
Journal: Electronic Journal of Statistics
Volume: 12
Issue: 2
Start page: 3365
End page: 3396
Copyright (published version): 2018 the Authors
Keywords: Adaptive MCMCChangepoint detectionLarge datasets
DOI: 10.1214/18-EJS1418
Language: en
Status of Item: Peer reviewed
Appears in Collections:Mathematics and Statistics Research Collection

Show full item record

Citations 50

Last Week
Last month
checked on Jan 18, 2020

Page view(s)

Last Week
Last month
checked on Jan 20, 2020


checked on Jan 20, 2020

Google ScholarTM



This item is available under the Attribution-NonCommercial-NoDerivs 3.0 Ireland. No item may be reproduced for commercial purposes. For other possible restrictions on use please refer to the publisher's URL where this is made available, or to notes contained in the item itself. Other terms may apply.