IDEAS home Printed from https://ideas.repec.org/p/ems/eureir/1722.html
   My bibliography  Save this paper

Adaptive radial-based direction sampling; Some flexible and robust Monte Carlo integration methods

Author

Listed:
  • Bauwens, L.
  • Bos, C.S.
  • van Dijk, H.K.
  • van Oest, R.D.

Abstract

Adaptive radial-based direction sampling (ARDS) algorithms are specified for Bayesian analysis of models with nonelliptical, possibly, multimodal target distributions. A key step is a radial-based transformation to directions and distances. After the transformations a Metropolis-Hastings method or, alternatively, an importance sampling method is applied to evaluate generated directions. Next, distances are generated from the exact target distribution by means of the numerical inverse transformation method. An adaptive procedure is applied to update the initial location and covariance matrix in order to sample directions in an efficient way. Tested on a set of canonical mixture models that feature multimodality, strong correlation, and skewness, the ARDS algorithms compare favourably with the standard Metropolis-Hastings and importance samplers in terms of flexibility and robustness. The empirical examples include a regression model with scale contamination and a mixture model for economic growth of the USA.

Suggested Citation

  • Bauwens, L. & Bos, C.S. & van Dijk, H.K. & van Oest, R.D., 2003. "Adaptive radial-based direction sampling; Some flexible and robust Monte Carlo integration methods," Econometric Institute Research Papers EI 2003-22, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
  • Handle: RePEc:ems:eureir:1722
    as

    Download full text from publisher

    File URL: https://repub.eur.nl/pub/1722/feweco20030806161348.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    2. Roberts, G. O. & Gilks, W. R., 1994. "Convergence of Adaptive Direction Sampling," Journal of Multivariate Analysis, Elsevier, vol. 49(2), pages 287-298, May.
    3. Kleibergen, Frank & van Dijk, Herman K., 1994. "On the Shape of the Likelihood/Posterior in Cointegration Models," Econometric Theory, Cambridge University Press, vol. 10(3-4), pages 514-551, August.
    4. Koop, Gary & Dijk, Herman K. Van, 2000. "Testing for integration using evolving trend and seasonals models: A Bayesian approach," Journal of Econometrics, Elsevier, vol. 97(2), pages 261-291, August.
    5. Van Dijk, Herman K. & Kloek, Teun & Boender, C. Guus E., 1985. "Posterior moments computed by mixed integration," Journal of Econometrics, Elsevier, vol. 29(1-2), pages 3-18.
    6. Fruhwirth-Schnatter S., 2001. "Markov Chain Monte Carlo Estimation of Classical and Dynamic Switching and Mixture Models," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 194-209, March.
    7. Bauwens, L. & Bos, C.S. & van Dijk, H.K. & van Oest, R.D., 2002. "Adaptive polar sampling, a class of flexibel and robust Monte Carlo integration methods," Econometric Institute Research Papers EI 2002-27, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    8. van Dijk, H. K. & Kloek, T., 1980. "Further experience in Bayesian analysis using Monte Carlo integration," Journal of Econometrics, Elsevier, vol. 14(3), pages 307-328, December.
    9. Kleibergen, Frank & van Dijk, Herman K., 1998. "Bayesian Simultaneous Equations Analysis Using Reduced Rank Structures," Econometric Theory, Cambridge University Press, vol. 14(6), pages 701-743, December.
    10. Luc Bauwens & Charles S. Bos & Herman K. van Dijk & Rutger D. van Oest, 2002. "Adaptive Polar Sampling," Computing in Economics and Finance 2002 307, Society for Computational Economics.
    11. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. L. Bauwens & J.V.K. Rombouts, 2007. "Bayesian inference for the mixed conditional heteroskedasticity model," Econometrics Journal, Royal Economic Society, vol. 10(2), pages 408-425, July.
    2. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    3. Tsionas, Mike G., 2019. "Multi-objective optimization using statistical models," European Journal of Operational Research, Elsevier, vol. 276(1), pages 364-378.
    4. Burda Martin & Maheu John M., 2013. "Bayesian adaptively updated Hamiltonian Monte Carlo with an application to high-dimensional BEKK GARCH models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 17(4), pages 345-372, September.
    5. Hoogerheide, L.F. & van Dijk, H.K. & van Oest, R.D., 2007. "Simulation based bayesian econometric inference: principles and some recent computational advances," Econometric Institute Research Papers EI 2007-03, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Waggoner, Daniel F. & Wu, Hongwei & Zha, Tao, 2016. "Striated Metropolis–Hastings sampler for high-dimensional models," Journal of Econometrics, Elsevier, vol. 192(2), pages 406-420.
    7. McCausland, William J., 2008. "On Bayesian analysis and computation for functions with monotonicity and curvature restrictions," Journal of Econometrics, Elsevier, vol. 142(1), pages 484-507, January.
    8. Ardia, David & Baştürk, Nalan & Hoogerheide, Lennart & van Dijk, Herman K., 2012. "A comparative study of Monte Carlo methods for efficient evaluation of marginal likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3398-3414.
    9. Rodney Strachan & Herman K. van Dijk, "undated". "Bayesian Model Averaging in Vector Autoregressive Processes with an Investigation of Stability of the US Great Ratios and Risk of a Liquidity Trap in the USA, UK and Japan," MRG Discussion Paper Series 1407, School of Economics, University of Queensland, Australia.
    10. Dellaportas, Petros & Tsionas, Mike G., 2019. "Importance sampling from posterior distributions using copula-like approximations," Journal of Econometrics, Elsevier, vol. 210(1), pages 45-57.
    11. David Ardia & Lennart Hoogerheide & Herman K. van Dijk, 2009. "To Bridge, to Warp or to Wrap? A Comparative Study of Monte Carlo Methods for Efficient Evaluation of Marginal Likelihoods," Tinbergen Institute Discussion Papers 09-017/4, Tinbergen Institute.
    12. Martin Burda & John Maheu, 2011. "Bayesian Adaptive Hamiltonian Monte Carlo with an Application to High-Dimensional BEKK GARCH Models," Working Papers tecipa-438, University of Toronto, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lennart F. Hoogerheide & Johan F. Kaashoek, 2004. "Functional Approximations to Likelihoods/Posterior Densities: A Neural Network Approach to Efficient Sampling," Computing in Economics and Finance 2004 74, Society for Computational Economics.
    2. Luc Bauwens & Charles S. Bos & Herman K. van Dijk, 1999. "Adaptive Polar Sampling with an Application to a Bayes Measure of Value-at-Risk," Tinbergen Institute Discussion Papers 99-082/4, Tinbergen Institute.
    3. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    4. HOOGERHEIDE, Lennart F. & VAN DIJK, Herman K. & VAN OEST, Rutger D., 2007. "Simulation based Bayesian econometric inference: principles and some recent computational advances," LIDAM Discussion Papers CORE 2007015, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    5. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2014. "On the Rise of Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 14-085/III, Tinbergen Institute, revised 04 Sep 2014.
    6. Lennart Hoogerheide & Herman K. van Dijk, 2008. "Possibly Ill-behaved Posteriors in Econometric Models," Tinbergen Institute Discussion Papers 08-036/4, Tinbergen Institute, revised 18 Apr 2008.
    7. Nalan Basturk & Cem Cakmakli & S. Pinar Ceyhan & Herman K. van Dijk, 2013. "Historical Developments in Bayesian Econometrics after Cowles Foundation Monographs 10, 14," Tinbergen Institute Discussion Papers 13-191/III, Tinbergen Institute.
    8. Dellaportas, Petros & Tsionas, Mike G., 2019. "Importance sampling from posterior distributions using copula-like approximations," Journal of Econometrics, Elsevier, vol. 210(1), pages 45-57.
    9. Kleibergen, Frank & Paap, Richard, 2002. "Priors, posteriors and bayes factors for a Bayesian analysis of cointegration," Journal of Econometrics, Elsevier, vol. 111(2), pages 223-249, December.
    10. Villani, Mattias, 2006. "Bayesian point estimation of the cointegration space," Journal of Econometrics, Elsevier, vol. 134(2), pages 645-664, October.
    11. Denis Fougère & Thierry Kamionka, 2003. "Bayesian inference for the mover-stayer model in continuous time with an application to labour market transition data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(6), pages 697-723.
    12. Hoogerheide, Lennart & Opschoor, Anne & van Dijk, Herman K., 2012. "A class of adaptive importance sampling weighted EM algorithms for efficient and robust posterior and predictive simulation," Journal of Econometrics, Elsevier, vol. 171(2), pages 101-120.
    13. Ni, Shawn & Sun, Dongchu, 2003. "Noninformative priors and frequentist risks of bayesian estimators of vector-autoregressive models," Journal of Econometrics, Elsevier, vol. 115(1), pages 159-197, July.
    14. Ardia, David & Baştürk, Nalan & Hoogerheide, Lennart & van Dijk, Herman K., 2012. "A comparative study of Monte Carlo methods for efficient evaluation of marginal likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3398-3414.
    15. Michiel D. de Pooter & René Segers & Herman K. van Dijk, 2006. "On the Practice of Bayesian Inference in Basic Economic Time Series Models using Gibbs Sampling," Tinbergen Institute Discussion Papers 06-076/4, Tinbergen Institute.
    16. Andrea Carriero & George Kapetanios & Massimiliano Marcellino, 2011. "Forecasting large datasets with Bayesian reduced rank multivariate models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(5), pages 735-761, August.
    17. Ardia, David & Hoogerheide, Lennart F., 2010. "Efficient Bayesian estimation and combination of GARCH-type models," MPRA Paper 22919, University Library of Munich, Germany.
    18. VAN DIJK, Herman K., 1987. "Some advances in Bayesian estimations methods using Monte Carlo Integration," LIDAM Reprints CORE 783, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    19. Baştürk, Nalan & Grassi, Stefano & Hoogerheide, Lennart & Opschoor, Anne & van Dijk, Herman K., 2017. "The R Package MitISEM: Efficient and Robust Simulation Procedures for Bayesian Inference," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 79(i01).
    20. Heckelei, Thomas & Mittelhammer, Ronald C., 1996. "Bayesian Bootstrap Analysis of Systems of Equations," Discussion Papers 18786, University of Bonn, Institute for Food and Resource Economics.

    More about this item

    Keywords

    Markov chain Monte Carlo; importance sampling; radial coordinates;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ems:eureir:1722. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/feeurnl.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RePub (email available below). General contact details of provider: https://edirc.repec.org/data/feeurnl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.