Conditional backward sampling particle filters are great MCMC updates for general hidden Markov model smoothing. We (together with Joona Karjalainen, Anthony Lee & Sumeetpal Singh) proved that their mixing time is O(log T), where T is time horizon, with fixed number of particles: http://arxiv.org/abs/2312.17572 The proof is based on analysis of an implementable coupling algorithm, so unbiased smoothing is also available with O(T log T) expected cost. Coupling develops progressively over time indices 👇
Mixing time of the conditional backward sampling particle filter

The conditional backward sampling particle filter (CBPF) is a powerful Markov chain Monte Carlo algorithm for general state space hidden Markov model smoothing. We show that, under a general (strong mixing) condition, its mixing time is upper bounded by $O(\log T)$ where $T$ is the time horizon. The result holds for a fixed number of particles $N$ which is sufficiently large (depending on the strong mixing constants), and therefore guarantees an overall computational complexity of $O(T\log T)$ f or general hidden Markov model smoothing. We provide an example which shows that the mixing time $O(\log T)$ is optimal. Our proof relies on analysis of a novel coupling of two CBPFs, which involves a maximal coupling of two particle systems at each time instant. The coupling is implementable, and can be used to construct unbiased, finite variance estimates of functionals which have arbitrary dependence on the latent state path, with expected $O(T \log T)$ cost. We also investigate related couplings, some of which have improved empirical behaviour.

arXiv.org
We revised our paper on conditional backward sampling particle filters https://arxiv.org/abs/2312.17572 focusing on implementable couplings:
• We use unbiased gradients for maximum likelihood estimation
• Generalised coupling algorithm which can handle potentials/weights that depend on current and previous state variable (a coupling of conditional marginal particle filters)
Happy to announce that this got accepted to the JRSS B. The advance article is available online: https://doi.org/10.1093/jrsssb/qkaf078
Mixing time of the conditional backward sampling particle filter

Abstract. The conditional backward sampling particle filter (CBPF) is a powerful Markov chain Monte Carlo sampler for general state space hidden Markov mod

OUP Academic