IDEAS home Printed from https://ideas.repec.org/p/ecm/ausm04/120.html

Bandwidth Selection for Multivariate Kernel Density Estimation Using MCMC

Author

Listed:
  • Rob L. Hyndman
  • Xibin Zhang
  • Maxwell L. King,

Abstract

Kernel density estimation for multivariate data is an important technique that has a wide range of applications in econometrics and finance. However, it has received significantly less attention than its univariate counterpart. The lower level of interest in multivariate kernel density estimation is mainly due to the increased difficulty in deriving an optimal data-driven bandwidth as the dimension of data increases. We provide Markov chain Monte Carlo (MCMC) algorithms for estimating optimal bandwidth matrices for multivariate kernel density estimation. Our approach is based on treating the elements of the bandwidth matrix as parameters whose posterior density can be obtained through the likelihood cross-validation criterion. Numerical studies for bivariate data show that the MCMC algorithm generally performs better than the plug-in algorithm under the Kullback-Leibler information criterion, and is as good as the plug-in algorithm under the mean integrated squared errors (MISE) criterion. Numerical studies for 5 dimensional data show that our algorithm is superior to the normal reference rule. Our MCMC algorithm is the first data-driven bandwidth selector for kernel density estimation with more than two variables, and the sampling algorithm involves no increased difficulty as the dimension of data increase

Suggested Citation

  • Rob L. Hyndman & Xibin Zhang & Maxwell L. King,, 2004. "Bandwidth Selection for Multivariate Kernel Density Estimation Using MCMC," Econometric Society 2004 Australasian Meetings 120, Econometric Society.
    • Handle: RePEc:ecm:ausm04:120
    as

    Download full text from publisher

    File URL: http://repec.org/esAUSM04/up.1603.1077410300.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Tse, Y.K. & Zhang, Bill & Yu, Jun, 2002. "Estimation of Hyperbolic Diffusion using MCMC Method," Working Papers 182, Department of Economics, The University of Auckland.
    2. Luc Bauwens & Michel Lubrano, 1998. "Bayesian inference on GARCH models using the Gibbs sampler," Econometrics Journal, Royal Economic Society, vol. 1(Conferenc), pages 23-46.
    3. repec:bla:jfinan:v:53:y:1998:i:2:p:499-547 is not listed on IDEAS
    4. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    5. Y. K. Tse & Xibin Zhang & Jun Yu, 2004. "Estimation of hyperbolic diffusion using the Markov chain Monte Carlo method," Quantitative Finance, Taylor & Francis Journals, vol. 4(2), pages 158-169.
    6. Stephen G. Donald, 1997. "Inference Concerning the Number of Factors in a Multivariate Nonparametric Relationship," Econometrica, Econometric Society, vol. 65(1), pages 103-132, January.
    7. Adelchi Azzalini & Antonella Capitanio, 2003. "Distributions generated by perturbation of symmetry with emphasis on a multivariate skew t‐distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 367-389, May.
    8. Ait-Sahalia, Yacine, 1996. "Testing Continuous-Time Models of the Spot Interest Rate," The Review of Financial Studies, Society for Financial Studies, vol. 9(2), pages 385-426.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kenneth L. Sørensen & Rune Vejlin, 2014. "Return To Experience And Initial Wage Level: Do Low Wage Workers Catch Up?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 29(6), pages 984-1006, September.
    2. Zhang, Xibin & King, Maxwell L., 2008. "Box-Cox stochastic volatility models with heavy-tails and correlated errors," Journal of Empirical Finance, Elsevier, vol. 15(3), pages 549-566, June.
    3. Chauveau, Didier & Hoang, Vy Thuy Lynh, 2016. "Nonparametric mixture models with conditionally independent multivariate component densities," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 1-16.
    4. H. Poulos, 2010. "Spatially explicit mapping of hurricane risk in New England, USA using ArcGIS," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 54(3), pages 1015-1023, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Xibin & King, Maxwell L. & Hyndman, Rob J., 2006. "A Bayesian approach to bandwidth selection for multivariate kernel density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 50(11), pages 3009-3031, July.
    2. Zhang, Xibin & Brooks, Robert D. & King, Maxwell L., 2009. "A Bayesian approach to bandwidth selection for multivariate kernel regression with an application to state-price density estimation," Journal of Econometrics, Elsevier, vol. 153(1), pages 21-32, November.
    3. Zhang, Xibin & King, Maxwell L., 2008. "Box-Cox stochastic volatility models with heavy-tails and correlated errors," Journal of Empirical Finance, Elsevier, vol. 15(3), pages 549-566, June.
    4. Zhang, Xibin & King, Maxwell L. & Shang, Han Lin, 2014. "A sampling algorithm for bandwidth estimation in a nonparametric regression model with a flexible error density," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 218-234.
    5. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2016. "Bayesian Bandwidth Selection for a Nonparametric Regression Model with Mixed Types of Regressors," Econometrics, MDPI, vol. 4(2), pages 1-27, April.
    6. Malmsten, Hans & Teräsvirta, Timo, 2004. "Stylized Facts of Financial Time Series and Three Popular Models of Volatility," SSE/EFI Working Paper Series in Economics and Finance 563, Stockholm School of Economics, revised 03 Sep 2004.
    7. Han Shang, 2014. "Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density," Computational Statistics, Springer, vol. 29(3), pages 829-848, June.
    8. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2011. "Bayesian estimation of bandwidths for a nonparametric regression model with a flexible error density," Monash Econometrics and Business Statistics Working Papers 10/11, Monash University, Department of Econometrics and Business Statistics.
    9. Oleg Korenok & Stanislav Radchenko, 2005. "The smooth transition autoregressive target zone model with the Gaussian stochastic volatility and TGARCH error terms with applications," Econometrics 0508015, University Library of Munich, Germany.
    10. Zhao, Zhibiao, 2011. "Nonparametric model validations for hidden Markov models with applications in financial econometrics," Journal of Econometrics, Elsevier, vol. 162(2), pages 225-239, June.
    11. Hu, Shuowen & Poskitt, D.S. & Zhang, Xibin, 2012. "Bayesian adaptive bandwidth kernel density estimation of irregular multivariate distributions," Computational Statistics & Data Analysis, Elsevier, vol. 56(3), pages 732-740.
    12. Andrew D. Sanford & Gael Martin, 2004. "Bayesian Analysis of Continuous Time Models of the Australian Short Rate," Monash Econometrics and Business Statistics Working Papers 11/04, Monash University, Department of Econometrics and Business Statistics.
    13. Xibin Zhang & Maxwell L. King, 2011. "Bayesian semiparametric GARCH models," Monash Econometrics and Business Statistics Working Papers 24/11, Monash University, Department of Econometrics and Business Statistics.
    14. Xibin Zhang & Maxwell L. King, 2013. "Gaussian kernel GARCH models," Monash Econometrics and Business Statistics Working Papers 19/13, Monash University, Department of Econometrics and Business Statistics.
    15. Asai, Manabu, 2009. "Bayesian analysis of stochastic volatility models with mixture-of-normal distributions," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 79(8), pages 2579-2596.
    16. Gabriele Fiorentini & Enrique Sentana & Neil Shephard, 2004. "Likelihood-Based Estimation of Latent Generalized ARCH Structures," Econometrica, Econometric Society, vol. 72(5), pages 1481-1517, September.
    17. Bontemps, Christian & Meddahi, Nour, 2005. "Testing normality: a GMM approach," Journal of Econometrics, Elsevier, vol. 124(1), pages 149-186, January.
    18. Aknouche, Abdelhakim & Demmouche, Nacer & Touche, Nassim, 2018. "Bayesian MCMC analysis of periodic asymmetric power GARCH models," MPRA Paper 91136, University Library of Munich, Germany.
    19. Manabu Asai & Michael McAleer, 2022. "Bayesian Analysis of Realized Matrix-Exponential GARCH Models," Computational Economics, Springer;Society for Computational Economics, vol. 59(1), pages 103-123, January.
    20. Song Li & Mervyn J. Silvapulle & Param Silvapulle & Xibin Zhang, 2015. "Bayesian Approaches to Nonparametric Estimation of Densities on the Unit Interval," Econometric Reviews, Taylor & Francis Journals, vol. 34(3), pages 394-412, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecm:ausm04:120. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christopher F. Baum (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.