IDEAS home Printed from https://ideas.repec.org/a/eee/spapps/v199y2026ics0304414926000694.html

Theoretical guarantees for lifted samplers

Author

Listed:
  • Gagnon, Philippe
  • Maire, Florian

Abstract

Lifted samplers form a class of Markov chain Monte Carlo methods which has drawn a lot attention in recent years due to superior performance in challenging Bayesian applications. A canonical example of lifted samplers is the one that is derived from a random walk Metropolis algorithm for a totally-ordered state space such as the integers or the real numbers. The lifted sampler is derived by splitting into two the proposal distribution: one part in the increasing direction, and the other part in the decreasing direction. It keeps following a direction, until a rejection occurs, upon which it flips the direction. In terms of asymptotic variances, it outperforms the random walk Metropolis algorithm, regardless of the target distribution, at no additional computational cost. Other studies show, however, that beyond this simple case, lifted samplers do not always outperform their Metropolis counterparts. In this paper, we leverage the celebrated work of Tierney (1998) [1] to provide an analysis in a general framework encompassing a broad class of lifted samplers. Our finding is that, essentially, the asymptotic variances cannot increase by a factor of more than 2, regardless of the target distribution, the way the directions are induced, and the type of algorithm from which the lifted sampler is derived (be it a Metropolis–Hastings algorithm, a reversible jump algorithm, etc.). This result indicates that, while there is potentially a lot to gain from lifting a sampler, there is not much to lose.

Suggested Citation

  • Gagnon, Philippe & Maire, Florian, 2026. "Theoretical guarantees for lifted samplers," Stochastic Processes and their Applications, Elsevier, vol. 199(C).
  • Handle: RePEc:eee:spapps:v:199:y:2026:i:c:s0304414926000694
    DOI: 10.1016/j.spa.2026.104937
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304414926000694
    Download Restriction: Full text may be restricted for ScienceDirect subscribers

    File URL: https://libkey.io/10.1016/j.spa.2026.104937?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Apers, Simon & Sarlette, Alain & Ticozzi, Francesco, 2021. "Characterizing limits and opportunities in speeding up Markov chain mixing," Stochastic Processes and their Applications, Elsevier, vol. 136(C), pages 145-191.
    2. W. K. Hastings, 1970. "Monte Carlo sampling methods using Markov chains and their applications," Biometrika, Biometrika Trust, vol. 57(1), pages 97-109.
    3. Giacomo Zanella, 2020. "Informed Proposals for Local MCMC in Discrete Spaces," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 852-865, April.
    4. Marie Vialaret & Florian Maire, 2020. "On the Convergence Time of Some Non-Reversible Markov Chain Monte Carlo Methods," Methodology and Computing in Applied Probability, Springer, vol. 22(3), pages 1349-1387, September.
    5. Alexandre Bouchard-Côté & Sebastian J. Vollmer & Arnaud Doucet, 2018. "The Bouncy Particle Sampler: A Nonreversible Rejection-Free Markov Chain Monte Carlo Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 855-867, April.
    6. Samuel Livingstone & Giacomo Zanella, 2022. "The Barker proposal: Combining robustness and efficiency in gradient‐based MCMC," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 496-523, April.
    7. Saifuddin Syed & Alexandre Bouchard‐Côté & George Deligiannidis & Arnaud Doucet, 2022. "Non‐reversible parallel tempering: A scalable highly parallel MCMC scheme," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 321-350, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mylène Bédard, 2025. "Non-stationary Phase of the Metropolis-adjusted Langevin Algorithm with Annealed Proposals," Methodology and Computing in Applied Probability, Springer, vol. 27(4), pages 1-40, December.
    2. Jure Vogrinc & Samuel Livingstone & Giacomo Zanella, 2023. "Optimal design of the Barker proposal and other locally balanced Metropolis–Hastings algorithms," Biometrika, Biometrika Trust, vol. 110(3), pages 579-595.
    3. Quan Zhou & Jun Yang & Dootika Vats & Gareth O. Roberts & Jeffrey S. Rosenthal, 2022. "Dimension‐free mixing for high‐dimensional Bayesian variable selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(5), pages 1751-1784, November.
    4. Lu Yao & Taotao Cheng & Jiao Luo & Xintian Liu, 2026. "Weibull distribution-based reliability evaluation of cutting tool via improved Bayesian-Bootstrap method," Journal of Risk and Reliability, , vol. 240(1), pages 185-199, February.
    5. Mitra Kharabati & Morteza Amini & Mohammad Arashi, 2026. "Variational inference for sparse poisson regression," Computational Statistics, Springer, vol. 41(3), pages 1-50, April.
    6. Akanksha Kumari & Vikas Kumar Sharma, 2025. "Bayes estimation of defective proportion for single shot device testing data with information on masking and manufacturing defects," Journal of Risk and Reliability, , vol. 239(5), pages 1041-1060, October.
    7. Franco Bagnoli & Tommaso Matteuzzi, 2025. "Metastability in the diluted parallel Ising model," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 98(10), pages 1-10, October.
    8. Yuanying Zhao & Xingde Duan, 2022. "Bayesian Adaptive Lasso for Regression Models with Nonignorable Missing Responses," Journal of Mathematics, John Wiley & Sons, vol. 2022(1).
    9. Dobson, Paul & Bierkens, Joris, 2023. "Infinite dimensional Piecewise Deterministic Markov Processes," Stochastic Processes and their Applications, Elsevier, vol. 165(C), pages 337-396.
    10. Matthias Schmal & Patrick Mäder, 2026. "Reliable uncertainty estimates in deep learning with efficient Metropolis-Hastings algorithms," Nature Communications, Nature, vol. 17(1), pages 1-12, December.
    11. M Ludkin & C Sherlock, 2023. "Hug and hop: a discrete-time, nonreversible Markov chain Monte Carlo algorithm," Biometrika, Biometrika Trust, vol. 110(2), pages 301-318.
    12. Lindhe, Adam & Orrenius, Johan, 2026. "Defining Geographic Markets Through Choice Sets: An Empirical Method Applied to Real Estate Brokerage," Working Paper Series 1558, Research Institute of Industrial Economics.
    13. Ye-Mao Xia & Jian-Wei Gou, 2016. "Assessing Heterogeneity for Factor Analysis Model with Continuous and Ordinal Outcomes," Journal of Applied Mathematics, John Wiley & Sons, vol. 2016(1).
    14. Bertazzi, Andrea & Bierkens, Joris & Dobson, Paul, 2022. "Approximations of Piecewise Deterministic Markov Processes and their convergence properties," Stochastic Processes and their Applications, Elsevier, vol. 154(C), pages 91-153.
    15. Donia Besher & Rajdeep Pathak & Madhurima Panja & Tanujit Chakraborty, 2026. "Beyond Point Forecasts: A Survey on Probabilistic Forecasting for Time Series and Spatiotemporal Data," Papers 2609.13345, arXiv.org.
    16. Bulat Mukhamediyev & Azimzhan Khitakhunov & Zhansaya Temerbulatova & Aliya Mukhamediyeva & Aidana Sabikenova, 2026. "Oil Revenue Absorption and Macroeconomic Vulnerability: Evidence from a DSGE Model of a Small Open Oil-Exporting Economy," Economies, MDPI, vol. 14(9), pages 1-32, September.
    17. Gregor Steiner & Mark Steel, 2026. "Bayesian Model Averaging in Causal Instrumental Variable Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 41(5), pages 669-683, August.
    18. Andrés Ramírez–Hassan & Juan David Rengifo–Castro & Miguel Manzur & Estephania Rueda-Ramírez, 2025. "Approximate Bayesian computation to estimate persistent and transient efficiency in stochastic frontier panel data models," Journal of Productivity Analysis, Springer, vol. 64(2), pages 145-166, October.
    19. Romain Loup & François Bavaud, 2026. "Spatial autocorrelation of political opinions: a kernel approach," Journal of Geographical Systems, Springer, vol. 28(1), pages 77-103, January.
    20. Mattia Stival & Stefano F. Tonellato, 2026. "Bayesian Contiguous Gaussian and Generalized Linear Dynamic Models on Graphs: Theory, Computation, and Simulation," Working Papers 2026: 21, Department of Economics, University of Venice "Ca' Foscari".

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:spapps:v:199:y:2026:i:c:s0304414926000694. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/505572/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.