IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v54y2010i11p2814-2835.html
   My bibliography  Save this article

Efficient parallelisation of Metropolis-Hastings algorithms using a prefetching approach

Author

Listed:
  • Strid, Ingvar

Abstract

Prefetching is a simple and general method for single-chain parallelisation of the Metropolis-Hastings algorithm based on the idea of evaluating the posterior in parallel and ahead of time. Improved Metropolis-Hastings prefetching algorithms are presented and evaluated. It is shown how to use available information to make better predictions of the future states of the chain and increase the efficiency of prefetching considerably. The optimal acceptance rate for the prefetching random walk Metropolis-Hastings algorithm is obtained for a special case and it is shown to decrease in the number of processors employed. The performance of the algorithms is illustrated using a well-known macroeconomic model. Bayesian estimation of DSGE models, linearly or nonlinearly approximated, is identified as a potential area of application for prefetching methods. The generality of the proposed method, however, suggests that it could be applied in other contexts as well.

Suggested Citation

  • Strid, Ingvar, 2010. "Efficient parallelisation of Metropolis-Hastings algorithms using a prefetching approach," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2814-2835, November.
    • Handle: RePEc:eee:csdana:v:54:y:2010:i:11:p:2814-2835
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(09)00432-0
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Amisano, Gianni & Tristani, Oreste, 2010. "Euro area inflation persistence in an estimated nonlinear DSGE model," Journal of Economic Dynamics and Control, Elsevier, vol. 34(10), pages 1837-1858, October.
    2. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    3. Steinsland, Ingelin, 2007. "Parallel exact sampling and evaluation of Gaussian Markov random fields," Computational Statistics & Data Analysis, Elsevier, vol. 51(6), pages 2969-2981, March.
    4. Takahashi, Makoto & Omori, Yasuhiro & Watanabe, Toshiaki, 2009. "Estimating stochastic volatility models using daily returns and realized volatility simultaneously," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 2404-2426, April.
    5. Alessandro Cigno & Annalisa Luporini, 2018. "On the evolution of individual preferences and family rules," Working Paper series 18-07, Rimini Centre for Economic Analysis.
    6. Lombardi, Marco J., 2007. "Bayesian inference for [alpha]-stable distributions: A random walk MCMC approach," Computational Statistics & Data Analysis, Elsevier, vol. 51(5), pages 2688-2700, February.
    7. Adolfson, Malin & Laseen, Stefan & Linde, Jesper & Villani, Mattias, 2007. "Bayesian estimation of an open economy DSGE model with incomplete pass-through," Journal of International Economics, Elsevier, vol. 72(2), pages 481-511, July.
    8. Strickland, Chris M. & Forbes, Catherine S. & Martin, Gael M., 2006. "Bayesian analysis of the stochastic conditional duration model," Computational Statistics & Data Analysis, Elsevier, vol. 50(9), pages 2247-2267, May.
    9. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178, Decembrie.
    10. Marco Del Negro & Frank Schorfheide & Frank Smets & Raf Wouters, 2004. "On the fit and forecasting performance of New Keynesian models," FRB Atlanta Working Paper 2004-37, Federal Reserve Bank of Atlanta.
    11. Ingvar Strid & Karl Walentin, 2009. "Block Kalman Filtering for Large-Scale DSGE Models," Computational Economics, Springer;Society for Computational Economics, vol. 33(3), pages 277-304, April.
    12. Gamerman, Dani & Moreira, Ajax R. B. & Rue, Havard, 2003. "Space-varying regression models: specifications and simulation," Computational Statistics & Data Analysis, Elsevier, vol. 42(3), pages 513-533, March.
    13. Wilkinson, Darren J & KH Yeung, Stephen, 2004. "A sparse matrix approach to Bayesian computation in large linear models," Computational Statistics & Data Analysis, Elsevier, vol. 44(3), pages 493-516, January.
    14. Strickland, Chris M. & Turner, Ian. W. & Denham, Robert & Mengersen, Kerrie L., 2009. "Efficient Bayesian estimation of multivariate state space models," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4116-4125, October.
    15. Omori, Yasuhiro & Watanabe, Toshiaki, 2008. "Block sampler and posterior mode estimation for asymmetric stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 2892-2910, February.
    16. Schmitt-Grohe, Stephanie & Uribe, Martin, 2004. "Solving dynamic general equilibrium models using a second-order approximation to the policy function," Journal of Economic Dynamics and Control, Elsevier, vol. 28(4), pages 755-775, January.
    17. Klein, Paul, 2000. "Using the generalized Schur form to solve a multivariate linear rational expectations model," Journal of Economic Dynamics and Control, Elsevier, vol. 24(10), pages 1405-1423, September.
    18. Ingvar Strid, 2006. "Parallel particle filters for likelihood evaluation in DSGE models: An assessment," Computing in Economics and Finance 2006 395, Society for Computational Economics.
    19. Anatoliy Belaygorod & Michael J. Dueker, 2007. "The price puzzle and indeterminacy in an estimated DSGE model," Working Papers 2006-025, Federal Reserve Bank of St. Louis.
    20. Leonhard Knorr‐Held & Håvard Rue, 2002. "On Block Updating in Markov Random Field Models for Disease Mapping," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 29(4), pages 597-614, December.
    21. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mahani, Alireza S. & Sharabiani, Mansour T.A., 2015. "SIMD parallel MCMC sampling with applications for big-data Bayesian analytics," Computational Statistics & Data Analysis, Elsevier, vol. 88(C), pages 75-99.
    2. Edward Herbst & Frank Schorfheide, 2014. "Sequential Monte Carlo Sampling For Dsge Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(7), pages 1073-1098, November.
    3. White, Gentry & Porter, Michael D., 2014. "GPU accelerated MCMC for modeling terrorist activity," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 643-651.
    4. Guido Ascari & Paolo Bonomolo & Hedibert Lopes, 2018. "Walk on the wild side: Multiplicative sunspots and temporarily unstable paths," DNB Working Papers 597, Netherlands Central Bank, Research Department.
    5. Sergei Seleznev, 2016. "Solving DSGE models with stochastic trends," Bank of Russia Working Paper Series wps15, Bank of Russia.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Strid, Ingvar, 2008. "Metropolis-Hastings prefetching algorithms," SSE/EFI Working Paper Series in Economics and Finance 706, Stockholm School of Economics, revised 02 Dec 2009.
    2. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    3. Flury, Thomas & Shephard, Neil, 2011. "Bayesian Inference Based Only On Simulated Likelihood: Particle Filter Analysis Of Dynamic Economic Models," Econometric Theory, Cambridge University Press, vol. 27(05), pages 933-956, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:54:y:2010:i:11:p:2814-2835. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.