IDEAS home Printed from https://ideas.repec.org/a/taf/quantf/v12y2012i3p437-449.html
   My bibliography  Save this article

A comparison of statistical tests for the adequacy of a neural network regression model

Author

Listed:
  • Nikos S. Thomaidis
  • Georgios D. Dounias

Abstract

An integral part of econometric practice is to test the adequacy of model specifications. If a model is adequately specified, it should not leave interesting features of the data-generating process in the errors. Despite the common tradition, the importance of diagnostic checking as a safeguard against mis-specification has only recently been recognized by neural network (NN) practitioners, possibly because this type of semi-parametric methodology was not originally designed for economic and financial applications. The purpose of this paper is to compare a number of analytical statistical testing procedures suitable to diagnostic checking on a neural network regression model. We present the standard Lagrange multiplier (LM) testing framework designed under the assumption of identically distributed disturbances and also examine two modifications that are robust to heteroskedasticity in errors. One modification also gives the researcher an opportunity to incorporate information concerning the volatility structure of the data-generating process in the testing procedure. By means of a Monte Carlo simulation, we investigate the performance of these tests under GARCH-type heteroskedasticity in errors and various distributional assumptions. The results show that although the primary concern of the researcher may be to design a regression model that accurately captures relations in the mean of the conditional distribution, developing a good approximation of the underlying volatility structure generally increases the efficiency of tests in detecting non-adequacy of a NN model. † http://fidelity.fme.ae gean.gr/decision

Suggested Citation

  • Nikos S. Thomaidis & Georgios D. Dounias, 2012. "A comparison of statistical tests for the adequacy of a neural network regression model," Quantitative Finance, Taylor & Francis Journals, vol. 12(3), pages 437-449, October.
    • Handle: RePEc:taf:quantf:v:12:y:2012:i:3:p:437-449
    DOI: 10.1080/14697680903426573
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/14697680903426573
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/14697680903426573?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    2. Engle, Robert F., 1982. "A general approach to lagrange multiplier model diagnostics," Journal of Econometrics, Elsevier, vol. 20(1), pages 83-104, October.
    3. Wooldridge, Jeffrey M., 1991. "On the application of robust, regression- based diagnostics to models of conditional means and conditional variances," Journal of Econometrics, Elsevier, vol. 47(1), pages 5-46, January.
    4. Eitrheim, Oyvind & Terasvirta, Timo, 1996. "Testing the adequacy of smooth transition autoregressive models," Journal of Econometrics, Elsevier, vol. 74(1), pages 59-75, September.
    5. T. S. Breusch & A. R. Pagan, 1980. "The Lagrange Multiplier Test and its Applications to Model Specification in Econometrics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(1), pages 239-253.
    6. Christian M. Hafner & Helmut Herwartz, 2000. "Testing for linear autoregressive dynamics under heteroskedasticity," Econometrics Journal, Royal Economic Society, vol. 3(2), pages 177-197.
    7. Marcelo C. Medeiros & Alvaro Veiga, 2003. "Diagnostic Checking in a Flexible Nonlinear Time Series Model," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(4), pages 461-482, July.
    8. French, Kenneth R. & Schwert, G. William & Stambaugh, Robert F., 1987. "Expected stock returns and volatility," Journal of Financial Economics, Elsevier, vol. 19(1), pages 3-29, September.
    9. Schwert, G William, 1990. "Stock Volatility and the Crash of '87," The Review of Financial Studies, Society for Financial Studies, vol. 3(1), pages 77-102.
    10. Teräsvirta, Timo, 1996. "Smooth Transition Models," SSE/EFI Working Paper Series in Economics and Finance 132, Stockholm School of Economics.
    11. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    12. Wooldridge, Jeffrey M., 1990. "A Unified Approach to Robust, Regression-Based Specification Tests," Econometric Theory, Cambridge University Press, vol. 6(1), pages 17-43, March.
    13. Bollerslev, Tim, 1987. "A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return," The Review of Economics and Statistics, MIT Press, vol. 69(3), pages 542-547, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sinan Deng & John Inekwe & Vladimir Smirnov & Andrew Wait & Chao Wang, 2023. "Machine Learning and Deep Learning Forecasts of Electricity Imbalance Prices," Working Papers 2023-03, University of Sydney, School of Economics.
    2. Golmohammadi, Davood, 2016. "Predicting hospital admissions to reduce emergency department boarding," International Journal of Production Economics, Elsevier, vol. 182(C), pages 535-544.
    3. Golmohammadi, Davood & Zhao, Lingyu & Dreyfus, David, 2023. "Using machine learning techniques to reduce uncertainty for outpatient appointment scheduling practices in outpatient clinics," Omega, Elsevier, vol. 120(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. McAleer, Michael & Medeiros, Marcelo C., 2008. "A multiple regime smooth transition Heterogeneous Autoregressive model for long memory and asymmetries," Journal of Econometrics, Elsevier, vol. 147(1), pages 104-119, November.
    2. Scharth, Marcel & Medeiros, Marcelo C., 2009. "Asymmetric effects and long memory in the volatility of Dow Jones stocks," International Journal of Forecasting, Elsevier, vol. 25(2), pages 304-327.
    3. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521779654, January.
    4. Demos, Antonis & Sentana, Enrique, 1998. "Testing for GARCH effects: a one-sided approach," Journal of Econometrics, Elsevier, vol. 86(1), pages 97-127, June.
    5. Yung-Shun Chen & Shiu-Tung Wang, 2004. "The empirical evidence of the leverage effect on volatility in international bulk shipping market," Maritime Policy & Management, Taylor & Francis Journals, vol. 31(2), pages 109-124, April.
    6. Kim, Dongcheol & Kon, Stanley J., 1999. "Structural change and time dependence in models of stock returns," Journal of Empirical Finance, Elsevier, vol. 6(3), pages 283-308, September.
    7. Geoffrey F. Loudon & Wing H. Watt & Pradeep K. Yadav, 2000. "An empirical analysis of alternative parametric ARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(2), pages 117-136.
    8. Degiannakis, Stavros & Xekalaki, Evdokia, 2004. "Autoregressive Conditional Heteroskedasticity (ARCH) Models: A Review," MPRA Paper 80487, University Library of Munich, Germany.
    9. BAUWENS, Luc & HAFNER, Christian & LAURENT, Sébastien, 2011. "Volatility models," LIDAM Discussion Papers CORE 2011058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
      • Bauwens, L. & Hafner, C. & Laurent, S., 2012. "Volatility Models," LIDAM Reprints ISBA 2012028, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
      • Bauwens, L. & Hafner C. & Laurent, S., 2011. "Volatility Models," LIDAM Discussion Papers ISBA 2011044, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    10. Eskandar A. Tooma, 2003. "Modeling and Forecasting Egyptian Stock Market Volatility Before and After Price Limits," Working Papers 0310, Economic Research Forum, revised Apr 2003.
    11. Bollerslev, Tim & Engle, Robert F. & Nelson, Daniel B., 1986. "Arch models," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 49, pages 2959-3038, Elsevier.
    12. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    13. Bollerslev, Tim & Chou, Ray Y. & Kroner, Kenneth F., 1992. "ARCH modeling in finance : A review of the theory and empirical evidence," Journal of Econometrics, Elsevier, vol. 52(1-2), pages 5-59.
    14. Pal, Debdatta, 2022. "Does hospitality industry stock volatility react asymmetrically to health and economic crises?," Economic Modelling, Elsevier, vol. 108(C).
    15. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    16. Alagidede, Paul & Panagiotidis, Theodore, 2009. "Modelling stock returns in Africa's emerging equity markets," International Review of Financial Analysis, Elsevier, vol. 18(1-2), pages 1-11, March.
    17. repec:wyi:journl:002087 is not listed on IDEAS
    18. Dongweí Su, 2003. "Risk, Return and Regulation in Chinese Stock Markets," World Scientific Book Chapters, in: Chinese Stock Markets A Research Handbook, chapter 3, pages 75-122, World Scientific Publishing Co. Pte. Ltd..
    19. Mehmet Sahiner, 2022. "Forecasting volatility in Asian financial markets: evidence from recursive and rolling window methods," SN Business & Economics, Springer, vol. 2(10), pages 1-74, October.
    20. Diongue, Abdou Kâ & Guégan, Dominique, 2007. "The stationary seasonal hyperbolic asymmetric power ARCH model," Statistics & Probability Letters, Elsevier, vol. 77(11), pages 1158-1164, June.
    21. Marcin Fałdziński & Piotr Fiszeder & Witold Orzeszko, 2020. "Forecasting Volatility of Energy Commodities: Comparison of GARCH Models with Support Vector Regression," Energies, MDPI, vol. 14(1), pages 1-18, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:quantf:v:12:y:2012:i:3:p:437-449. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/RQUF20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.