IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i4p341-d495872.html
   My bibliography  Save this article

Geometric Ergodicity of the Random Walk Metropolis with Position-Dependent Proposal Covariance

Author

Listed:
  • Samuel Livingstone

    (Department of Statistical Science, University College London, London WC1E 6BT, UK)

Abstract

We consider a Metropolis–Hastings method with proposal N ( x , h G ( x ) − 1 ) , where x is the current state, and study its ergodicity properties. We show that suitable choices of G ( x ) can change these ergodicity properties compared to the Random Walk Metropolis case N ( x , h Σ ) , either for better or worse. We find that if the proposal variance is allowed to grow unboundedly in the tails of the distribution then geometric ergodicity can be established when the target distribution for the algorithm has tails that are heavier than exponential, in contrast to the Random Walk Metropolis case, but that the growth rate must be carefully controlled to prevent the rejection rate approaching unity. We also illustrate that a judicious choice of G ( x ) can result in a geometrically ergodic chain when probability concentrates on an ever narrower ridge in the tails, something that is again not true for the Random Walk Metropolis.

Suggested Citation

  • Samuel Livingstone, 2021. "Geometric Ergodicity of the Random Walk Metropolis with Position-Dependent Proposal Covariance," Mathematics, MDPI, vol. 9(4), pages 1-14, February.
    • Handle: RePEc:gam:jmathe:v:9:y:2021:i:4:p:341-:d:495872
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/4/341/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/9/4/341/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jarner, Søren Fiig & Hansen, Ernst, 2000. "Geometric ergodicity of Metropolis algorithms," Stochastic Processes and their Applications, Elsevier, vol. 85(2), pages 341-361, February.
    2. Mark Girolami & Ben Calderhead, 2011. "Riemann manifold Langevin and Hamiltonian Monte Carlo methods," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(2), pages 123-214, March.
    3. S Livingstone & M F Faulkner & G O Roberts, 2019. "Kinetic energy choice in Hamiltonian/hybrid Monte Carlo," Biometrika, Biometrika Trust, vol. 106(2), pages 303-319.
    4. Craiu, Radu V. & Rosenthal, Jeffrey & Yang, Chao, 2009. "Learn From Thy Neighbor: Parallel-Chain and Regional Adaptive MCMC," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1454-1466.
    5. Søren F. Jarner & Gareth O. Roberts, 2007. "Convergence of Heavy‐tailed Monte Carlo Markov Chain Algorithms," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(4), pages 781-815, December.
    6. Xifara, T. & Sherlock, C. & Livingstone, S. & Byrne, S. & Girolami, M., 2014. "Langevin diffusions and the Metropolis-adjusted Langevin algorithm," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 14-19.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arnak S. Dalalyan, 2017. "Theoretical guarantees for approximate sampling from smooth and log-concave densities," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(3), pages 651-676, June.
    2. E. Zanini & E. Eastoe & M. J. Jones & D. Randell & P. Jonathan, 2020. "Flexible covariate representations for extremes," Environmetrics, John Wiley & Sons, Ltd., vol. 31(5), August.
    3. Dimitris Korobilis & Davide Pettenuzzo, 2020. "Machine Learning Econometrics: Bayesian algorithms and methods," Working Papers 2020_09, Business School - Economics, University of Glasgow.
    4. Allassonnière, Stéphanie & Kuhn, Estelle, 2015. "Convergent stochastic Expectation Maximization algorithm with efficient sampling in high dimension. Application to deformable template model estimation," Computational Statistics & Data Analysis, Elsevier, vol. 91(C), pages 4-19.
    5. Tore Selland Kleppe, 2016. "Adaptive Step Size Selection for Hessian-Based Manifold Langevin Samplers," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(3), pages 788-805, September.
    6. Takaaki Koike & Marius Hofert, 2020. "Markov Chain Monte Carlo Methods for Estimating Systemic Risk Allocations," Risks, MDPI, vol. 8(1), pages 1-33, January.
    7. Kamatani, Kengo, 2020. "Random walk Metropolis algorithm in high dimension with non-Gaussian target distributions," Stochastic Processes and their Applications, Elsevier, vol. 130(1), pages 297-327.
    8. Matti Vihola & Jouni Helske & Jordan Franks, 2020. "Importance sampling type estimators based on approximate marginal Markov chain Monte Carlo," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1339-1376, December.
    9. Rigat, F. & Mira, A., 2012. "Parallel hierarchical sampling: A general-purpose interacting Markov chains Monte Carlo algorithm," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1450-1467.
    10. Bédard, Mylène, 2017. "Hierarchical models: Local proposal variances for RWM-within-Gibbs and MALA-within-Gibbs," Computational Statistics & Data Analysis, Elsevier, vol. 109(C), pages 231-246.
    11. Ranjan, Rakesh & Sen, Rijji & Upadhyay, Satyanshu K., 2021. "Bayes analysis of some important lifetime models using MCMC based approaches when the observations are left truncated and right censored," Reliability Engineering and System Safety, Elsevier, vol. 214(C).
    12. Bournakis, Ioannis & Tsionas, Mike G., 2023. "A Non-Parametric Estimation of Productivity with Idiosyncratic and Aggregate Shocks: The Role of Research and Development (R&D) and Corporate Tax," MPRA Paper 118100, University Library of Munich, Germany.
    13. Chen, Zhongfei & Wanke, Peter & Tsionas, Mike G., 2018. "Assessing the strategic fit of potential M&As in Chinese banking: A novel Bayesian stochastic frontier approach," Economic Modelling, Elsevier, vol. 73(C), pages 254-263.
    14. Atkinson, Scott E. & Tsionas, Mike G., 2021. "Generalized estimation of productivity with multiple bad outputs: The importance of materials balance constraints," European Journal of Operational Research, Elsevier, vol. 292(3), pages 1165-1186.
    15. Caroline Khan & Mike G. Tsionas, 2021. "Constraints in models of production and cost via slack-based measures," Empirical Economics, Springer, vol. 61(6), pages 3347-3374, December.
    16. Liu, Jia & Maheu, John M & Song, Yong, 2023. "Identification and Forecasting of Bull and Bear Markets using Multivariate Returns," MPRA Paper 119515, University Library of Munich, Germany.
    17. Dimitrakopoulos, Stefanos & Tsionas, Mike, 2019. "Ordinal-response GARCH models for transaction data: A forecasting exercise," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1273-1287.
    18. Vanhatalo, Jarno & Veneranta, Lari & Hudd, Richard, 2012. "Species distribution modeling with Gaussian processes: A case study with the youngest stages of sea spawning whitefish (Coregonus lavaretus L. s.l.) larvae," Ecological Modelling, Elsevier, vol. 228(C), pages 49-58.
    19. Stephen G. Hall & Heather D. Gibson & G. S. Tavlas & Mike G. Tsionas, 2020. "A Monte Carlo Study of Time Varying Coefficient (TVC) Estimation," Computational Economics, Springer;Society for Computational Economics, vol. 56(1), pages 115-130, June.
    20. Will Penny & Biswa Sengupta, 2016. "Annealed Importance Sampling for Neural Mass Models," PLOS Computational Biology, Public Library of Science, vol. 12(3), pages 1-25, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:4:p:341-:d:495872. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.