On Single Variable Transformation Approach to Markov Chain Monte Carlo

• Activity Number: 401
• Type: Contributed
• Date/Time: Tuesday, August 5, 2014 : 2:00 PM to 3:50 PM
• Sponsor: Section on Statistical Computing
• Author(s): Kushal Dey*+ and Sourabh Bhattacharya
• Companies: and Indian Statistical Institute
• Keywords: Random Walk Metropolis Hastings ; Transformation based Markov chain Monte Carlo ; geometric ergodicity ; diffusion process ; optimal scaling

Abstract

Random Walk Metropolis Hastings (RWMH) algorithm, is quite inefficient in high dimensions because of its abysmally slow acceptance rate. The slow acceptance rate results from the fact that RWMH separately updates each coordinate of the chain at every step. Dutta and Bhattacharya (2013) proposed a new technique called Transformation based Markov Chain Monte Carlo (TMCMC) aimed at overcoming these problems. This method updates all co-ordinates at a time- ensuring stable acceptance in all dimensions.

We have shown here that geometric ergodicity is achieved for sub-exponential targets for two versions of TMCMC- the additive and the additive-multiplicative hybrid TMCMC schemes. Also, we obtain the optimal scaling by maximizing the diffusion speed of the limiting time-scaled diffusion process for TMCMC. We show that the optimal acceptance rate is 0.439 for TMCMC which is almost twice as large as RWMH (0.234). We observe that convergence to stationarity for TMCMC is faster than RWMH but the mixing property in RWMH is relatively better. However TMCMC is more robust with respect to scaling and dimensionality. This is attested by simulation runs on Gaussian and nearest neighbor models.