IDEAS home Printed from https://ideas.repec.org/p/fri/dqewps/wp0009.html
   My bibliography  Save this paper

Adaptive mixture of Student-t distributions as a flexible candidate distribution for efficient simulation: the R package AdMit

Author

Listed:

Abstract

This paper presents the R package AdMit which provides flexible functions to approximate a certain target distribution and to efficiently generate a sample of random draws from it, given only a kernel of the target density function given only a kernel of the target density function. The core algorithm consists of the function AdMit which fits an adaptive mixture of Student-t distributions to the density of interest via its kernel function. Then, importance sampling or the independence chain Metropolis-Hastings algorithm is used to obtain quantities of interest for the target density, using the fitted mixture as the importance or candidate density. The estimation procedure is fully automatic and thus avoids the time-consuming and difficult task of tuning a sampling algorithm. The relevance of the package is shown in two examples. The first aims at illustrating in detail the use of the functions provided by the package in a bivariate bimodal distribution. The second shows the relevance of the adaptive mixture procedure through the Bayesian estimation of a mixture of ARCH model fitted to foreign exchange log-returns data. The methodology is compared to standard cases of importance sampling and the Metropolis-Hastings algorithm using a naive candidate and with the Griddy-Gibbs approach.

Suggested Citation

  • Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2008. "Adaptive mixture of Student-t distributions as a flexible candidate distribution for efficient simulation: the R package AdMit," DQE Working Papers 9, Department of Quantitative Economics, University of Freiburg/Fribourg Switzerland, revised 07 Jan 2009.
  • Handle: RePEc:fri:dqewps:wp0009
    as

    Download full text from publisher

    File URL: http://doc.rero.ch/record/30835/files/WP_DQE_09.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hoogerheide, Lennart & van Dijk, Herman K., 2010. "Bayesian forecasting of Value at Risk and Expected Shortfall using adaptive importance sampling," International Journal of Forecasting, Elsevier, vol. 26(2), pages 231-247, April.
    2. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    3. Marcucci Juri, 2005. "Forecasting Stock Market Volatility with Regime-Switching GARCH Models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 9(4), pages 1-55, December.
    4. Geweke, John, 2007. "Interpretation and inference in mixture models: Simple MCMC works," Computational Statistics & Data Analysis, Elsevier, vol. 51(7), pages 3529-3550, April.
    5. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    6. Hoogerheide, Lennart F. & Kaashoek, Johan F. & van Dijk, Herman K., 2007. "On the shape of posterior densities and credible sets in instrumental variable regression models with reduced rank: An application of flexible sampling methods using neural networks," Journal of Econometrics, Elsevier, vol. 139(1), pages 154-180, July.
    7. Heij, Christiaan & de Boer, Paul & Franses, Philip Hans & Kloek, Teun & van Dijk, Herman K., 2004. "Econometric Methods with Applications in Business and Economics," OUP Catalogue, Oxford University Press, number 9780199268016.
    8. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
    9. Bollerslev, Tim & Ghysels, Eric, 1996. "Periodic Autoregressive Conditional Heteroscedasticity," Journal of Business & Economic Statistics, American Statistical Association, vol. 14(2), pages 139-151, April.
    10. Franc Klaassen, 2002. "Improving GARCH volatility forecasts with regime-switching GARCH," Empirical Economics, Springer, vol. 27(2), pages 363-394.
    11. Dueker, Michael J, 1997. "Markov Switching in GARCH Processes and Mean-Reverting Stock-Market Volatility," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(1), pages 26-34, January.
    12. Lamoureux, Christopher G & Lastrapes, William D, 1990. "Persistence in Variance, Structural Change, and the GARCH Model," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(2), pages 225-234, April.
    13. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2008. "AdMit: Adaptive Mixtures of Student-t Distributions," DQE Working Papers 10, Department of Quantitative Economics, University of Freiburg/Fribourg Switzerland, revised 07 Jan 2009.
    14. Sylvia Frühwirth-Schnatter, 2001. "Fully Bayesian Analysis of Switching Gaussian State Space Models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 53(1), pages 31-49, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jean-Francois Richard, 2016. "Finite Gaussian Mixture Approximations to Analytically Intractable Density Kerkels," Working Paper 5980, Department of Economics, University of Pittsburgh.
    2. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2008. "AdMit: Adaptive Mixtures of Student-t Distributions," DQE Working Papers 10, Department of Quantitative Economics, University of Freiburg/Fribourg Switzerland, revised 07 Jan 2009.
    3. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    4. Kleppe, Tore Selland & Liesenfeld, Roman, 2011. "Efficient high-dimensional importance sampling in mixture frameworks," Economics Working Papers 2011-11, Christian-Albrechts-University of Kiel, Department of Economics.
    5. Ardia, David & Baştürk, Nalan & Hoogerheide, Lennart & van Dijk, Herman K., 2012. "A comparative study of Monte Carlo methods for efficient evaluation of marginal likelihood," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3398-3414.
    6. Ardia, David & Hoogerheide, Lennart F., 2010. "Efficient Bayesian estimation and combination of GARCH-type models," MPRA Paper 22919, University Library of Munich, Germany.
    7. Nalan Basturk & Stefano Grassi & Lennart Hoogerheide & Anne Opschoor & Herman K. van Dijk, 2015. "The R-package MitISEM: Efficient and Robust Simulation Procedures for Bayesian Inference," Tinbergen Institute Discussion Papers 15-042/III, Tinbergen Institute, revised 04 Jul 2017.
    8. Kleppe, Tore Selland & Liesenfeld, Roman, 2014. "Efficient importance sampling in mixture frameworks," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 449-463.
    9. Hautsch, Nikolaus & Yang, Fuyu, 2012. "Bayesian inference in a Stochastic Volatility Nelson–Siegel model," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3774-3792.
    10. repec:jss:jstsof:v:079:i01 is not listed on IDEAS
    11. David, D. & Hoogerheide, L.F. & van Dijk, H.K., 2008. "The AdMit Package," Econometric Institute Research Papers EI 2008-17, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    12. Nalan Basturk & Lennart Hoogerheide & Anne Opschoor & Herman K. van Dijk, 2012. "The R Package MitISEM: Mixture of Student-t Distributions using Importance Sampling Weighted Expectation Maximization for Efficient and Robust Simulation," Tinbergen Institute Discussion Papers 12-096/III, Tinbergen Institute.
    13. David Ardia & Lennart Hoogerheide & Herman K. van Dijk, 2009. "To Bridge, to Warp or to Wrap? A Comparative Study of Monte Carlo Methods for Efficient Evaluation of Marginal Likelihoods," Tinbergen Institute Discussion Papers 09-017/4, Tinbergen Institute.

    More about this item

    Keywords

    adaptive mixture; Student-t distributions; importance sampling; independence chain Metropolis-Hastings algorithm; Bayesian; R software;

    JEL classification:

    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fri:dqewps:wp0009. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ivo raemy). General contact details of provider: http://edirc.repec.org/data/dqefrch.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.