IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v67y2013icp185-198.html
   My bibliography  Save this article

Bayesian bandwidth estimation for a nonparametric functional regression model with unknown error density

Author

Listed:
  • Shang, Han Lin

Abstract

Error density estimation in a nonparametric functional regression model with functional predictor and scalar response is considered. The unknown error density is approximated by a mixture of Gaussian densities with means being the individual residuals, and variance as a constant parameter. This proposed mixture error density has a form of a kernel density estimator of residuals, where the regression function is estimated by the functional Nadaraya–Watson estimator. A Bayesian bandwidth estimation procedure that can simultaneously estimate the bandwidths in the kernel-form error density and the functional Nadaraya–Watson estimator is proposed. A kernel likelihood and posterior for the bandwidth parameters are derived under the kernel-form error density. A series of simulation studies show that the proposed Bayesian estimation method performs on par with the functional cross validation for estimating the regression function, but it performs better than the likelihood cross validation for estimating the regression error density. The proposed Bayesian procedure is also applied to a nonparametric functional regression model, where the functional predictors are spectroscopy wavelengths and the scalar responses are fat/protein/moisture content, respectively.

Suggested Citation

  • Shang, Han Lin, 2013. "Bayesian bandwidth estimation for a nonparametric functional regression model with unknown error density," Computational Statistics & Data Analysis, Elsevier, vol. 67(C), pages 185-198.
  • Handle: RePEc:eee:csdana:v:67:y:2013:i:c:p:185-198
    DOI: 10.1016/j.csda.2013.05.006
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947313001679
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2013.05.006?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Müller, Hans-Georg & Yao, Fang, 2008. "Functional Additive Models," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1534-1544.
    2. Frédéric Ferraty & Ingrid Van Keilegom & Philippe Vieu, 2010. "On the Validity of the Bootstrap in Non‐Parametric Functional Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 37(2), pages 286-306, June.
    3. van der Laan Mark J. & Dudoit Sandrine & Keles Sunduz, 2004. "Asymptotic Optimality of Likelihood-Based Cross-Validation," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 3(1), pages 1-25, March.
    4. Y. K. Tse & Xibin Zhang & Jun Yu, 2004. "Estimation of hyperbolic diffusion using the Markov chain Monte Carlo method," Quantitative Finance, Taylor & Francis Journals, vol. 4(2), pages 158-169.
    5. Shang, Han Lin & Hyndman, Rob.J., 2011. "Nonparametric time series forecasting with dynamic updating," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 81(7), pages 1310-1324.
    6. Xibin Zhang & Maxwell L. King, 2011. "Bayesian semiparametric GARCH models," Monash Econometrics and Business Statistics Working Papers 24/11, Monash University, Department of Econometrics and Business Statistics.
    7. Chiou, Jeng-Min & Muller, Hans-Georg, 2007. "Diagnostics for functional regression via residual processes," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4849-4863, June.
    8. Harezlak, Jaroslaw & Coull, Brent A. & Laird, Nan M. & Magari, Shannon R. & Christiani, David C., 2007. "Penalized solutions to functional regression problems," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4911-4925, June.
    9. Philip Heidelberger & Peter D. Welch, 1983. "Simulation Run Length Control in the Presence of an Initial Transient," Operations Research, INFORMS, vol. 31(6), pages 1109-1144, December.
    10. Frédéric Ferraty & Philippe Vieu, 2002. "The Functional Nonparametric Model and Application to Spectrometric Data," Computational Statistics, Springer, vol. 17(4), pages 545-564, December.
    11. Philippe C. Besse & Herve Cardot & David B. Stephenson, 2000. "Autoregressive Forecasting of Some Functional Climatic Variations," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 27(4), pages 673-687, December.
    12. K. Benhenni & F. Ferraty & M. Rachdi & P. Vieu, 2007. "Local smoothing regression with functional data," Computational Statistics, Springer, vol. 22(3), pages 353-369, September.
    13. Escanciano, Juan Carlos & Jacho-Chávez, David T., 2012. "n-uniformly consistent density estimation in nonparametric regression models," Journal of Econometrics, Elsevier, vol. 167(2), pages 305-316.
    14. Fang Yao & Hans-Georg Müller, 2010. "Functional quadratic regression," Biometrika, Biometrika Trust, vol. 97(1), pages 49-64.
    15. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    16. Manuel Febrero-Bande & Wenceslao González-Manteiga, 2013. "Generalized additive models for functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(2), pages 278-292, June.
    17. Zhang, Xibin & Brooks, Robert D. & King, Maxwell L., 2009. "A Bayesian approach to bandwidth selection for multivariate kernel regression with an application to state-price density estimation," Journal of Econometrics, Elsevier, vol. 153(1), pages 21-32, November.
    18. John Geweke, 2010. "Complete and Incomplete Econometric Models," Economics Books, Princeton University Press, edition 1, number 9218.
    19. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    20. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    21. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2011. "Bayesian estimation of bandwidths for a nonparametric regression model with a flexible error density," Monash Econometrics and Business Statistics Working Papers 10/11, Monash University, Department of Econometrics and Business Statistics.
    22. Hyndman, Rob J. & Booth, Heather, 2008. "Stochastic population forecasts using functional data models for mortality, fertility and migration," International Journal of Forecasting, Elsevier, vol. 24(3), pages 323-342.
    23. Michael G. Akritas & Ingrid Van Keilegom, 2001. "Non‐parametric Estimation of the Residual Distribution," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 28(3), pages 549-567, September.
    24. J. Barrientos-Marin & F. Ferraty & P. Vieu, 2010. "Locally modelled regression and functional data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 22(5), pages 617-632.
    25. Boj, Eva & Delicado, Pedro & Fortiana, Josep, 2010. "Distance-based local linear regression for functional predictors," Computational Statistics & Data Analysis, Elsevier, vol. 54(2), pages 429-437, February.
    26. John A. D. Aston & Jeng‐Min Chiou & Jonathan P. Evans, 2010. "Linguistic pitch analysis using functional principal component mixed effect models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 59(2), pages 297-317, March.
    27. Ferraty, F. & Van Keilegom, I. & Vieu, P., 2012. "Regression when both response and predictor are functions," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 10-28.
    28. Christian Schellhase & Göran Kauermann, 2012. "Density estimation and comparison with a penalized mixture approach," Computational Statistics, Springer, vol. 27(4), pages 757-777, December.
    29. Manteiga, Wenceslao Gonzalez & Vieu, Philippe, 2007. "Statistics for Functional Data," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4788-4792, June.
    30. Dabo-Niang, Sophie & Guillas, Serge, 2010. "Functional semiparametric partially linear model with autoregressive errors," Journal of Multivariate Analysis, Elsevier, vol. 101(2), pages 307-315, February.
    31. Cheng, Fuxia, 2002. "Consistency of error density and distribution function estimators in nonparametric regression," Statistics & Probability Letters, Elsevier, vol. 59(3), pages 257-270, October.
    32. Florent Burba & Frédéric Ferraty & Philippe Vieu, 2009. "-Nearest Neighbour method in functional nonparametric regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(4), pages 453-469.
    33. Ferraty, F. & Van Keilegom, Ingrid & Vieu, P., 2012. "Regression when both response and predictor are functions," LIDAM Reprints ISBA 2012004, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    34. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    35. Renate Meyer & Jun Yu, 2000. "BUGS for a Bayesian analysis of stochastic volatility models," Econometrics Journal, Royal Economic Society, vol. 3(2), pages 198-215.
    36. Bircan Erbas & Rob J. Hyndman & Dorota M. Gertig, 2005. "Forecasting age-specific breast cancer mortality using functional data models," Monash Econometrics and Business Statistics Working Papers 3/05, Monash University, Department of Econometrics and Business Statistics.
    37. Chiou, Jeng-Min & Müller, Hans-Georg, 2009. "Modeling Hazard Rates as Functional Data for the Analysis of Cohort Lifetables and Mortality Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 572-585.
    38. Ferraty, Frederic & Van Keilegom, Ingrid & Vieu, Philippe, 2010. "On the Validity of the Bootstrap in Non-Parametric Functional Regression," LIDAM Reprints ISBA 2010018, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    39. Cheng, Fuxia & Sun, Shuxia, 2008. "A goodness-of-fit test of the errors in nonlinear autoregressive time series models," Statistics & Probability Letters, Elsevier, vol. 78(1), pages 50-59, January.
    40. Hyndman, Rob J. & Shahid Ullah, Md., 2007. "Robust forecasting of mortality and fertility rates: A functional data approach," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4942-4956, June.
    41. Hlubinka, Daniel & Prchal, Lubos, 2007. "Changes in atmospheric radiation from the statistical point of view," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4926-4941, June.
    42. Engle, Robert F & Gonzalez-Rivera, Gloria, 1991. "Semiparametric ARCH Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 9(4), pages 345-359, October.
    43. Aneiros-Pérez, Germán & Vieu, Philippe, 2006. "Semi-functional partial linear regression," Statistics & Probability Letters, Elsevier, vol. 76(11), pages 1102-1110, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chagny, Gaëlle & Roche, Angelina, 2016. "Adaptive estimation in the functional nonparametric regression model," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 105-118.
    2. Boente, Graciela & Vahnovan, Alejandra, 2017. "Robust estimators in semi-functional partial linear regression models," Journal of Multivariate Analysis, Elsevier, vol. 154(C), pages 59-84.
    3. Han Lin Shang, 2014. "Bayesian bandwidth estimation for a functional nonparametric regression model with mixed types of regressors and unknown error density," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(3), pages 599-615, September.
    4. Shang, Han Lin, 2016. "A Bayesian approach for determining the optimal semi-metric and bandwidth in scalar-on-function quantile regression with unknown error density and dependent functional data," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 95-104.
    5. Germán Aneiros & Nengxiang Ling & Philippe Vieu, 2015. "Error variance estimation in semi-functional partially linear regression models," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 27(3), pages 316-330, September.
    6. Philip T. Reiss & Jeff Goldsmith & Han Lin Shang & R. Todd Ogden, 2017. "Methods for Scalar-on-Function Regression," International Statistical Review, International Statistical Institute, vol. 85(2), pages 228-249, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Han Shang, 2014. "Bayesian bandwidth estimation for a semi-functional partial linear regression model with unknown error density," Computational Statistics, Springer, vol. 29(3), pages 829-848, June.
    2. Han Lin Shang, 2014. "Bayesian bandwidth estimation for a functional nonparametric regression model with mixed types of regressors and unknown error density," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(3), pages 599-615, September.
    3. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2016. "Bayesian Bandwidth Selection for a Nonparametric Regression Model with Mixed Types of Regressors," Econometrics, MDPI, vol. 4(2), pages 1-27, April.
    4. Han Shang, 2014. "A survey of functional principal component analysis," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 98(2), pages 121-142, April.
    5. Shang, Han Lin, 2016. "A Bayesian approach for determining the optimal semi-metric and bandwidth in scalar-on-function quantile regression with unknown error density and dependent functional data," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 95-104.
    6. Zhang, Xibin & King, Maxwell L. & Shang, Han Lin, 2014. "A sampling algorithm for bandwidth estimation in a nonparametric regression model with a flexible error density," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 218-234.
    7. Zhiyong Zhou & Zhengyan Lin, 2016. "Asymptotic normality of locally modelled regression estimator for functional data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(1), pages 116-131, March.
    8. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2011. "Bayesian estimation of bandwidths for a nonparametric regression model with a flexible error density," Monash Econometrics and Business Statistics Working Papers 10/11, Monash University, Department of Econometrics and Business Statistics.
    9. Philip T. Reiss & Jeff Goldsmith & Han Lin Shang & R. Todd Ogden, 2017. "Methods for Scalar-on-Function Regression," International Statistical Review, International Statistical Institute, vol. 85(2), pages 228-249, August.
    10. Song Li & Mervyn J. Silvapulle & Param Silvapulle & Xibin Zhang, 2015. "Bayesian Approaches to Nonparametric Estimation of Densities on the Unit Interval," Econometric Reviews, Taylor & Francis Journals, vol. 34(3), pages 394-412, March.
    11. Shuzhi Zhu & Peixin Zhao, 2019. "Tests for the linear hypothesis in semi-functional partial linear regression models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 82(2), pages 125-148, March.
    12. Han Lin Shang & Yang Yang, 2021. "Forecasting Australian subnational age-specific mortality rates," Journal of Population Research, Springer, vol. 38(1), pages 1-24, March.
    13. Kehui Chen & Xiaoke Zhang & Alexander Petersen & Hans-Georg Müller, 2017. "Quantifying Infinite-Dimensional Data: Functional Data Analysis in Action," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 9(2), pages 582-604, December.
    14. Germán Aneiros-Pérez & Philippe Vieu, 2013. "Testing linearity in semi-parametric functional data analysis," Computational Statistics, Springer, vol. 28(2), pages 413-434, April.
    15. Chagny, Gaëlle & Roche, Angelina, 2016. "Adaptive estimation in the functional nonparametric regression model," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 105-118.
    16. Yousri Slaoui, 2021. "Recursive non-parametric kernel classification rule estimation for independent functional data," Computational Statistics, Springer, vol. 36(1), pages 79-112, March.
    17. Han Lin Shang & Rob J Hyndman, 2016. "Grouped functional time series forecasting: An application to age-specific mortality rates," Monash Econometrics and Business Statistics Working Papers 4/16, Monash University, Department of Econometrics and Business Statistics.
    18. Chiou, Jeng-Min & Yang, Ya-Fang & Chen, Yu-Ting, 2016. "Multivariate functional linear regression and prediction," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 301-312.
    19. Y. K. Tse & Xibin Zhang & Jun Yu, 2004. "Estimation of hyperbolic diffusion using the Markov chain Monte Carlo method," Quantitative Finance, Taylor & Francis Journals, vol. 4(2), pages 158-169.
    20. Rachdi, Mustapha & Laksaci, Ali & Demongeot, Jacques & Abdali, Abdel & Madani, Fethi, 2014. "Theoretical and practical aspects of the quadratic error in the local linear estimation of the conditional density for functional data," Computational Statistics & Data Analysis, Elsevier, vol. 73(C), pages 53-68.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:67:y:2013:i:c:p:185-198. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.