IDEAS home Printed from https://ideas.repec.org/a/gam/jecnmx/v4y2016i2p24-d68757.html
   My bibliography  Save this article

Bayesian Bandwidth Selection for a Nonparametric Regression Model with Mixed Types of Regressors

Author

Listed:
  • Xibin Zhang

    (Department of Econometrics and Business Statistics, Monash Business School, Monash University, 900 Dandenong Road, Caulfield East, VIC 3145, Australia)

  • Maxwell L. King

    (Department of Econometrics and Business Statistics, Monash Business School, Monash University, 900 Dandenong Road, Caulfield East, VIC 3145, Australia)

  • Han Lin Shang

    (Research School of Finance, Actuarial Studies and Statistics, Australian National University, Canberra, ACT 2601, Australia)

Abstract

This paper develops a sampling algorithm for bandwidth estimation in a nonparametric regression model with continuous and discrete regressors under an unknown error density. The error density is approximated by the kernel density estimator of the unobserved errors, while the regression function is estimated using the Nadaraya-Watson estimator admitting continuous and discrete regressors. We derive an approximate likelihood and posterior for bandwidth parameters, followed by a sampling algorithm. Simulation results show that the proposed approach typically leads to better accuracy of the resulting estimates than cross-validation, particularly for smaller sample sizes. This bandwidth estimation approach is applied to nonparametric regression model of the Australian All Ordinaries returns and the kernel density estimation of gross domestic product (GDP) growth rates among the organisation for economic co-operation and development (OECD) and non-OECD countries.

Suggested Citation

  • Xibin Zhang & Maxwell L. King & Han Lin Shang, 2016. "Bayesian Bandwidth Selection for a Nonparametric Regression Model with Mixed Types of Regressors," Econometrics, MDPI, vol. 4(2), pages 1-27, April.
    • Handle: RePEc:gam:jecnmx:v:4:y:2016:i:2:p:24-:d:68757
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2225-1146/4/2/24/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2225-1146/4/2/24/
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Peter Hall & Qi Li & Jeffrey S. Racine, 2007. "Nonparametric Estimation of Regression Functions in the Presence of Irrelevant Regressors," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 784-789, November.
    2. Xibin Zhang & Maxwell L. King, 2011. "Bayesian semiparametric GARCH models," Monash Econometrics and Business Statistics Working Papers 24/11, Monash University, Department of Econometrics and Business Statistics.
    3. Zhang, Xibin & King, Maxwell L. & Hyndman, Rob J., 2006. "A Bayesian approach to bandwidth selection for multivariate kernel density estimation," Computational Statistics & Data Analysis, Elsevier, vol. 50(11), pages 3009-3031, July.
    4. Racine, Jeff & Li, Qi, 2004. "Nonparametric estimation of regression functions with both categorical and continuous data," Journal of Econometrics, Elsevier, vol. 119(1), pages 99-130, March.
    5. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    6. Zhang, Xibin & Brooks, Robert D. & King, Maxwell L., 2009. "A Bayesian approach to bandwidth selection for multivariate kernel regression with an application to state-price density estimation," Journal of Econometrics, Elsevier, vol. 153(1), pages 21-32, November.
    7. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    8. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2011. "Bayesian estimation of bandwidths for a nonparametric regression model with a flexible error density," Monash Econometrics and Business Statistics Working Papers 10/11, Monash University, Department of Econometrics and Business Statistics.
    9. Michael G. Akritas & Ingrid Van Keilegom, 2001. "Non‐parametric Estimation of the Residual Distribution," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 28(3), pages 549-567, September.
    10. Shujie Ma & Jeffrey S. Racine, 2012. "Additive Regression Splines With Irrelevant Categorical and Continuous Regressors," Department of Economics Working Papers 2012-07, McMaster University.
    11. Maasoumi, Esfandiar & Racine, Jeff & Stengos, Thanasis, 2007. "Growth and convergence: A profile of distribution dynamics and mobility," Journal of Econometrics, Elsevier, vol. 136(2), pages 483-508, February.
    12. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2016. "Bayesian Bandwidth Selection for a Nonparametric Regression Model with Mixed Types of Regressors," Econometrics, MDPI, vol. 4(2), pages 1-27, April.
    13. Li, Qi & Zhou, Jianxin, 2005. "The Uniqueness Of Cross-Validation Selected Smoothing Parameters In Kernel Estimation Of Nonparametric Models," Econometric Theory, Cambridge University Press, vol. 21(5), pages 1017-1025, October.
    14. Cong Li & Desheng Ouyang & Jeffrey Racine, 2009. "Nonparametric regression with weakly dependent data: the discrete and continuous regressor case," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(6), pages 697-711.
    15. Ao Yuan & Jan G. De Gooijer, 2007. "Semiparametric Regression with Kernel Error Model," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(4), pages 841-869, December.
    16. Renate Meyer & Jun Yu, 2000. "BUGS for a Bayesian analysis of stochastic volatility models," Econometrics Journal, Royal Economic Society, vol. 3(2), pages 198-215.
    17. David J. Nott & Robert Kohn, 2005. "Adaptive sampling for Bayesian variable selection," Biometrika, Biometrika Trust, vol. 92(4), pages 747-763, December.
    18. Xibin Zhang & Maxwell L. King, 2013. "Gaussian kernel GARCH models," Monash Econometrics and Business Statistics Working Papers 19/13, Monash University, Department of Econometrics and Business Statistics.
    19. Y. K. Tse & Xibin Zhang & Jun Yu, 2004. "Estimation of hyperbolic diffusion using the Markov chain Monte Carlo method," Quantitative Finance, Taylor & Francis Journals, vol. 4(2), pages 158-169.
    20. Escanciano, Juan Carlos & Jacho-Chávez, David T., 2012. "n-uniformly consistent density estimation in nonparametric regression models," Journal of Econometrics, Elsevier, vol. 167(2), pages 305-316.
    21. Li, Qi & Racine, Jeff, 2003. "Nonparametric estimation of distributions with categorical and continuous data," Journal of Multivariate Analysis, Elsevier, vol. 86(2), pages 266-292, August.
    22. Hayfield, Tristen & Racine, Jeffrey S., 2008. "Nonparametric Econometrics: The np Package," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i05).
    23. Zhang, Xibin & King, Maxwell L. & Shang, Han Lin, 2014. "A sampling algorithm for bandwidth estimation in a nonparametric regression model with a flexible error density," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 218-234.
    24. Tse, Y.K. & Zhang, Bill & Yu, Jun, 2002. "Estimation of Hyperbolic Diffusion using MCMC Method," Working Papers 182, Department of Economics, The University of Auckland.
    25. Han Lin Shang, 2014. "Bayesian bandwidth estimation for a functional nonparametric regression model with mixed types of regressors and unknown error density," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(3), pages 599-615, September.
    26. N. Zougab & S. Adjabi & C. Kokonendji, 2012. "Binomial kernel and Bayes local bandwidth in discrete function estimation," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(3), pages 783-795.
    27. Zheng, Qi & Kulasekera, K.B. & Gallagher, Colin, 2010. "Local adaptive smoothing in kernel regression estimation," Statistics & Probability Letters, Elsevier, vol. 80(7-8), pages 540-547, April.
    28. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    29. Cheng, Fuxia & Sun, Shuxia, 2008. "A goodness-of-fit test of the errors in nonlinear autoregressive time series models," Statistics & Probability Letters, Elsevier, vol. 78(1), pages 50-59, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2016. "Bayesian Bandwidth Selection for a Nonparametric Regression Model with Mixed Types of Regressors," Econometrics, MDPI, vol. 4(2), pages 1-27, April.
    2. Xu, Bin & Lin, Boqiang, 2017. "Assessing CO2 emissions in China's iron and steel industry: A nonparametric additive regression approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 72(C), pages 325-337.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shang, Han Lin, 2013. "Bayesian bandwidth estimation for a nonparametric functional regression model with unknown error density," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 185-198.
    2. Zhang, Xibin & King, Maxwell L. & Shang, Han Lin, 2014. "A sampling algorithm for bandwidth estimation in a nonparametric regression model with a flexible error density," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 218-234.
    3. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2011. "Bayesian estimation of bandwidths for a nonparametric regression model with a flexible error density," Monash Econometrics and Business Statistics Working Papers 10/11, Monash University, Department of Econometrics and Business Statistics.
    4. Han Shang, 2014. "Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density," Computational Statistics, Springer, vol. 29(3), pages 829-848, June.
    5. Michael S. Delgado & Daniel J. Henderson & Christopher F. Parmeter, 2014. "Does Education Matter for Economic Growth?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 76(3), pages 334-359, June.
    6. Song Li & Mervyn J. Silvapulle & Param Silvapulle & Xibin Zhang, 2015. "Bayesian Approaches to Nonparametric Estimation of Densities on the Unit Interval," Econometric Reviews, Taylor & Francis Journals, vol. 34(3), pages 394-412, March.
    7. Guohua Feng & Chuan Wang & Xibin Zhang, 2019. "Estimation of inefficiency in stochastic frontier models: a Bayesian kernel approach," Journal of Productivity Analysis, Springer, vol. 51(1), pages 1-19, February.
    8. Abhijit Sharma & Alastair Bailey & Iain Fraser, 2011. "Technology Adoption and Pest Control Strategies Among UK Cereal Farmers: Evidence from Parametric and Nonparametric Count Data Models," Journal of Agricultural Economics, Wiley Blackwell, vol. 62(1), pages 73-92, February.
    9. Zhang, Xibin & Brooks, Robert D. & King, Maxwell L., 2009. "A Bayesian approach to bandwidth selection for multivariate kernel regression with an application to state-price density estimation," Journal of Econometrics, Elsevier, vol. 153(1), pages 21-32, November.
    10. Jesús Peiró-Palomino, 2016. "Social Capital and Economic Growth in Europe: Nonlinear Trends and Heterogeneous Regional Effects," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(5), pages 717-751, October.
    11. Simar, Leopold & Zelenyuk, Valentin, 2011. "To Smooth or Not to Smooth? The Case of Discrete Variables in Nonparametric Regressions," LIDAM Discussion Papers ISBA 2011042, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    12. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    13. Arribas Ivan & Perez Francisco & Tortosa-Ausina Emili, 2010. "The Determinants of International Financial Integration Revisited: The Role of Networks and Geographic Neutrality," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 15(1), pages 1-55, December.
    14. James Bugden & Robert Waschik & Iain Fraser & Jeffrey S. Racine, 2016. "Parametric and non-parametric analysis of tax changes," Global Business and Economics Review, Inderscience Enterprises Ltd, vol. 18(5), pages 533-549.
    15. Zhang, Xibin & King, Maxwell L., 2008. "Box-Cox stochastic volatility models with heavy-tails and correlated errors," Journal of Empirical Finance, Elsevier, vol. 15(3), pages 549-566, June.
    16. Haupt, Harry & Schnurbus, Joachim & Semmler, Willi, 2018. "Estimation of grouped, time-varying convergence in economic growth," Econometrics and Statistics, Elsevier, vol. 8(C), pages 141-158.
    17. Marijn Verschelde & Marijke D’Haese & Glenn Rayp & Ellen Vandamme, 2013. "Challenging Small-Scale Farming: A Non-Parametric Analysis of the (Inverse) Relationship Between Farm Productivity and Farm Size in Burundi," Journal of Agricultural Economics, Wiley Blackwell, vol. 64(2), pages 319-342, June.
    18. Mariam Camarero & Jesús Peiró-Palomino & Cecilio Tamarit, 2017. "External imbalances and growth," Working Papers 2017/02, Economics Department, Universitat Jaume I, Castellón (Spain).
    19. Henderson, Daniel J. & Papageorgiou, Chris & Parmeter, Christopher F., 2013. "Who benefits from financial development? New methods, new evidence," European Economic Review, Elsevier, vol. 63(C), pages 47-67.
    20. Daniel J. Henderson, 2009. "A Non‐parametric Examination of Capital–Skill Complementarity," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(4), pages 519-538, August.

    More about this item

    Keywords

    cross-validation; Nadaraya-Watson estimator; posterior predictive density; random-walk Metropolis; unknown error density; value-at-risk;
    All these keywords.

    JEL classification:

    • B23 - Schools of Economic Thought and Methodology - - History of Economic Thought since 1925 - - - Econometrics; Quantitative and Mathematical Studies
    • C - Mathematical and Quantitative Methods
    • C00 - Mathematical and Quantitative Methods - - General - - - General
    • C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
    • C1 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General
    • C2 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables
    • C3 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables
    • C4 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jecnmx:v:4:y:2016:i:2:p:24-:d:68757. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.