IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v76y2014icp449-463.html
   My bibliography  Save this article

Efficient importance sampling in mixture frameworks

Author

Listed:
  • Kleppe, Tore Selland
  • Liesenfeld, Roman

Abstract

A flexible importance sampling procedure for the likelihood evaluation of dynamic latent variable models involving mixtures of distributions leading to possibly heavy tailed or multi-modal target densities is provided. The procedure is based upon the efficient importance sampling (EIS) approach and exploits the mixture structure of the model via data augmentation when constructing importance sampling distributions as mixtures of distributions. The proposed mixture EIS procedure is illustrated with ML estimation of a Student-t state space model for realized volatilities. MC simulations are used to characterize the sampling distribution of the ML estimator based upon the mixture EIS approach.

Suggested Citation

  • Kleppe, Tore Selland & Liesenfeld, Roman, 2014. "Efficient importance sampling in mixture frameworks," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 449-463.
    • Handle: RePEc:eee:csdana:v:76:y:2014:i:c:p:449-463
    DOI: 10.1016/j.csda.2013.01.025
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947313000406
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2013.01.025?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jung, Robert C. & Liesenfeld, Roman & Richard, Jean-François, 2011. "Dynamic Factor Models for Multivariate Count Data: An Application to Stock-Market Trading Activity," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 73-85.
    2. Geweke, John, 1989. "Bayesian Inference in Econometric Models Using Monte Carlo Integration," Econometrica, Econometric Society, vol. 57(6), pages 1317-1339, November.
    3. Robert C. Jung & Roman Liesenfeld & Jean-François Richard, 2011. "Dynamic Factor Models for Multivariate Count Data: An Application to Stock-Market Trading Activity," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 73-85, January.
    4. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    5. J. Durbin & S. J. Koopman, 2000. "Time series analysis of non‐Gaussian observations based on state space models from both classical and Bayesian perspectives," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 3-56.
    6. Kloek, Tuen & van Dijk, Herman K, 1978. "Bayesian Estimates of Equation System Parameters: An Application of Integration by Monte Carlo," Econometrica, Econometric Society, vol. 46(1), pages 1-19, January.
    7. John C. Cox & Jonathan E. Ingersoll Jr. & Stephen A. Ross, 2005. "A Theory Of The Term Structure Of Interest Rates," World Scientific Book Chapters, in: Sudipto Bhattacharya & George M Constantinides (ed.), Theory Of Valuation, chapter 5, pages 129-164, World Scientific Publishing Co. Pte. Ltd..
    8. Bauwens, L. & Galli, F., 2009. "Efficient importance sampling for ML estimation of SCD models," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 1974-1992, April.
    9. Roxana Chiriac & Valeri Voev, 2011. "Modelling and forecasting multivariate realized volatility," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(6), pages 922-947, September.
    10. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    11. Sylvia FrüHwirth-Schnatter & Helga Wagner, 2006. "Auxiliary mixture sampling for parameter-driven models of time series of counts with applications to state space modelling," Biometrika, Biometrika Trust, vol. 93(4), pages 827-841, December.
    12. Liesenfeld, Roman & Richard, Jean-Francois, 2003. "Univariate and multivariate stochastic volatility models: estimation and diagnostics," Journal of Empirical Finance, Elsevier, vol. 10(4), pages 505-531, September.
    13. Ole E. Barndorff‐Nielsen & Neil Shephard, 2002. "Econometric analysis of realized volatility and its use in estimating stochastic volatility models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 253-280, May.
    14. Jean-Francois Richard, 2007. "Efficient High-Dimensional Importance Sampling," Working Paper 321, Department of Economics, University of Pittsburgh, revised Jan 2007.
    15. Malik, Sheheryar & Pitt, Michael K., 2011. "Particle filters for continuous likelihood evaluation and maximisation," Journal of Econometrics, Elsevier, vol. 165(2), pages 190-209.
    16. Liesenfeld, Roman & Richard, Jean-François, 2010. "Efficient estimation of probit models with correlated errors," Journal of Econometrics, Elsevier, vol. 156(2), pages 367-376, June.
    17. Bjørn Eraker & Michael Johannes & Nicholas Polson, 2003. "The Impact of Jumps in Volatility and Returns," Journal of Finance, American Finance Association, vol. 58(3), pages 1269-1300, June.
    18. McCausland, William J., 2012. "The HESSIAN method: Highly efficient simulation smoothing, in a nutshell," Journal of Econometrics, Elsevier, vol. 168(2), pages 189-206.
    19. Geweke, J, 1993. "Bayesian Treatment of the Independent Student- t Linear Model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 19-40, Suppl. De.
    20. Ardia, David & Hoogerheide, Lennart F. & van Dijk, Herman K., 2009. "Adaptive Mixture of Student-t Distributions as a Flexible Candidate Distribution for Efficient Simulation: The R Package AdMit," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 29(i03).
    21. Richard, Jean-Francois & Zhang, Wei, 2007. "Efficient high-dimensional importance sampling," Journal of Econometrics, Elsevier, vol. 141(2), pages 1385-1411, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    2. Mengheng Li & Marcel Scharth, 2022. "Leverage, Asymmetry, and Heavy Tails in the High-Dimensional Factor Stochastic Volatility Model," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(1), pages 285-301, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kleppe, Tore Selland & Liesenfeld, Roman, 2011. "Efficient high-dimensional importance sampling in mixture frameworks," Economics Working Papers 2011-11, Christian-Albrechts-University of Kiel, Department of Economics.
    2. Siem Jan Koopman & Rutger Lit & Thuy Minh Nguyen, 2012. "Fast Efficient Importance Sampling by State Space Methods," Tinbergen Institute Discussion Papers 12-008/4, Tinbergen Institute, revised 16 Oct 2014.
    3. Scharth, Marcel & Kohn, Robert, 2016. "Particle efficient importance sampling," Journal of Econometrics, Elsevier, vol. 190(1), pages 133-147.
    4. Siem Jan Koopman & André Lucas & Marcel Scharth, 2015. "Numerically Accelerated Importance Sampling for Nonlinear Non-Gaussian State-Space Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 114-127, January.
    5. Falk Bräuning & Siem Jan Koopman, 2016. "The dynamic factor network model with an application to global credit risk," Working Papers 16-13, Federal Reserve Bank of Boston.
    6. Kleppe, Tore Selland & Skaug, Hans Julius, 2012. "Fitting general stochastic volatility models using Laplace accelerated sequential importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3105-3119.
    7. Skaug, Hans J. & Yu, Jun, 2014. "A flexible and automated likelihood based framework for inference in stochastic volatility models," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 642-654.
    8. Durham, Garland B., 2006. "Monte Carlo methods for estimating, smoothing, and filtering one- and two-factor stochastic volatility models," Journal of Econometrics, Elsevier, vol. 133(1), pages 273-305, July.
    9. Bräuning, Falk & Koopman, Siem Jan, 2020. "The dynamic factor network model with an application to international trade," Journal of Econometrics, Elsevier, vol. 216(2), pages 494-515.
    10. Tore Selland Kleppe & Jun Yu & H.J. Skaug, 2010. "Simulated maximum likelihood estimation of continuous time stochastic volatility models," Advances in Econometrics, in: Maximum Simulated Likelihood Methods and Applications, pages 137-161, Emerald Group Publishing Limited.
    11. Mesters, G. & Koopman, S.J., 2014. "Generalized dynamic panel data models with random effects for cross-section and time," Journal of Econometrics, Elsevier, vol. 180(2), pages 127-140.
    12. Liesenfeld, Roman & Richard, Jean-François, 2008. "Improving MCMC, using efficient importance sampling," Computational Statistics & Data Analysis, Elsevier, vol. 53(2), pages 272-288, December.
    13. Garland Durham, 2004. "Likelihood-based estimation and specification analysis of one- and two-factor SV models with leverage effects," Econometric Society 2004 North American Summer Meetings 294, Econometric Society.
    14. Siem Jan Koopman & Rutger Lit & André Lucas, 2017. "Intraday Stochastic Volatility in Discrete Price Changes: The Dynamic Skellam Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1490-1503, October.
    15. Pastorello, S. & Rossi, E., 2010. "Efficient importance sampling maximum likelihood estimation of stochastic differential equations," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2753-2762, November.
    16. Siem Jan Koopman & Rutger Lit & André Lucas, 2014. "The Dynamic Skellam Model with Applications," Tinbergen Institute Discussion Papers 14-032/IV/DSF73, Tinbergen Institute, revised 06 Jul 2015.
    17. Koopman, Siem Jan & Shephard, Neil & Creal, Drew, 2009. "Testing the assumptions behind importance sampling," Journal of Econometrics, Elsevier, vol. 149(1), pages 2-11, April.
    18. Jean-François Richard, 2015. "Likelihood Evaluation of High-Dimensional Spatial Latent Gaussian Models with Non-Gaussian Response Variables," Working Paper 5778, Department of Economics, University of Pittsburgh.
    19. Tsyplakov, Alexander, 2010. "Revealing the arcane: an introduction to the art of stochastic volatility models," MPRA Paper 25511, University Library of Munich, Germany.
    20. McCausland, William J., 2012. "The HESSIAN method: Highly efficient simulation smoothing, in a nutshell," Journal of Econometrics, Elsevier, vol. 168(2), pages 189-206.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:76:y:2014:i:c:p:449-463. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.