IDEAS home Printed from https://ideas.repec.org/p/ags/uwarer/269466.html
   My bibliography  Save this paper

The Properties of Some Goodness-of-Fit Tests

Author

Listed:
  • Boero, Gianna
  • Smith, Jeremy
  • Wallis, Kenneth F.

Abstract

The properties of Pearson’s goodness-of-fit test, as used in density forecast evaluation, income distribution analysis and elsewhere, are analysed. The components-of-chi-squared or “Pearson analog” tests of Anderson (1994) are shown to be less generally applicable than was originally claimed. For the case of equiprobable classes, where the general components tests remain valid, a Monte Carlo study shows that tests directed towards skewness and kurtosis may have low power, due to differences between the class boundaries and the intersection points of the distributions being compared. The power of individual component tests can be increased by the use of nonequiprobable classes.

Suggested Citation

  • Boero, Gianna & Smith, Jeremy & Wallis, Kenneth F., 2002. "The Properties of Some Goodness-of-Fit Tests," Economic Research Papers 269466, University of Warwick - Department of Economics.
    • Handle: RePEc:ags:uwarer:269466
    DOI: 10.22004/ag.econ.269466
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/269466/files/twerp653.pdf
    Download Restriction: no
    File URL: https://ageconsearch.umn.edu/record/269466/files/twerp653.pdf?subformat=pdfa
    Download Restriction: no
    File URL: https://libkey.io/10.22004/ag.econ.269466?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, "undated". "Evaluating Density Forecasts," CARESS Working Papres 97-18, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
    2. Francis X. Diebold & Anthony S. Tay & Kenneth F. Wallis, 1997. "Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters," NBER Working Papers 6228, National Bureau of Economic Research, Inc.
    3. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    4. Gordon Anderson, 2001. "The Power And Size Of Nonparametric Tests For Common Distributional Characteristics," Econometric Reviews, Taylor & Francis Journals, vol. 20(1), pages 1-30.
    5. Anderson, Gordon, 1994. "Simple tests of distributional form," Journal of Econometrics, Elsevier, vol. 62(2), pages 265-276, June.
    6. repec:sae:niesru:v:167:y::i:1:p:106-112 is not listed on IDEAS
    7. Engle, Robert F. & White (the late), Halbert (ed.), 1999. "Cointegration, Causality, and Forecasting: Festschrift in Honour of Clive W. J. Granger," OUP Catalogue, Oxford University Press, number 9780198296836, Decembrie.
    8. Boero, Gianna & Marrocu, Emanuela, 2002. "The Performance of Non-linear Exchange Rate Models: A Forecasting Comparison," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 21(7), pages 513-542, November.
    9. Arulampalam, W. & Robin A. Naylor & Jeremy P. Smith, 2002. "University of Warwick," Royal Economic Society Annual Conference 2002 9, Royal Economic Society.
    10. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-1193, September.
    11. Kenneth F. Wallis, 1999. "Asymmetric density forecasts of inflation and the Bank of England's fan chart," National Institute Economic Review, National Institute of Economic and Social Research, vol. 167(1), pages 106-112, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Boero, Gianna & Smith, Jeremy & Wallis, Kenneth F., 2004. "Decompositions of Pearson's chi-squared test," Journal of Econometrics, Elsevier, vol. 123(1), pages 189-193, November.
    2. Boero, Gianna & Marrocu, Emanuela, 2004. "The performance of SETAR models: a regime conditional evaluation of point, interval and density forecasts," International Journal of Forecasting, Elsevier, vol. 20(2), pages 305-320.
    3. G. Marletto, 2006. "La politica dei trasporti come politica per l'innovazione: spunti da un approccio evolutivo," Working Paper CRENoS 200605, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.
    4. OA Carboni & G. Medda, 2007. "Government Size and the Composition of Public Spending in a Neoclassical Growth Model," Working Paper CRENoS 200701, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gianna Boero & Jeremy Smith & Kenneth Wallis, 2005. "The Sensitivity of Chi-Squared Goodness-of-Fit Tests to the Partitioning of Data," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 341-370.
    2. Boero, Gianna & Smith, Jeremy & Wallis, Kenneth F., 2004. "Decompositions of Pearson's chi-squared test," Journal of Econometrics, Elsevier, vol. 123(1), pages 189-193, November.
    3. Terasvirta, Timo, 2006. "Forecasting economic variables with nonlinear models," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 8, pages 413-457, Elsevier.
    4. Boero, Gianna & Marrocu, Emanuela, 2004. "The performance of SETAR models: a regime conditional evaluation of point, interval and density forecasts," International Journal of Forecasting, Elsevier, vol. 20(2), pages 305-320.
    5. repec:lan:wpaper:470 is not listed on IDEAS
    6. Goodhart, C. A. E. & Pradhan, Manoj, 2023. "A snapshot of Central Bank (two year) forecasting: a mixed picture," LSE Research Online Documents on Economics 118680, London School of Economics and Political Science, LSE Library.
    7. Harvey, David I. & Newbold, Paul, 2003. "The non-normality of some macroeconomic forecast errors," International Journal of Forecasting, Elsevier, vol. 19(4), pages 635-653.
    8. Dowd, Kevin, 2007. "Too good to be true? The (In)credibility of the UK inflation fan charts," Journal of Macroeconomics, Elsevier, vol. 29(1), pages 91-102, March.
    9. Clements, Michael P., 2006. "Internal consistency of survey respondentsíforecasts: Evidence based on the Survey of Professional Forecasters," Economic Research Papers 269742, University of Warwick - Department of Economics.
    10. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1998. "Real-Time Multivariate Density Forecast Evaluation and Calibration: Monitoring the Risk of High-Frequency Returns on Foreign Exchange," New York University, Leonard N. Stern School Finance Department Working Paper Seires 98-079, New York University, Leonard N. Stern School of Business-.
    11. Goodhart Charles A.E., 2005. "The Monetary Policy Committee's Reaction Function: An Exercise in Estimation," The B.E. Journal of Macroeconomics, De Gruyter, vol. 5(1), pages 1-42, August.
    12. Ferrara, Laurent & Marcellino, Massimiliano & Mogliani, Matteo, 2015. "Macroeconomic forecasting during the Great Recession: The return of non-linearity?," International Journal of Forecasting, Elsevier, vol. 31(3), pages 664-679.
    13. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," The Journal of Financial Econometrics, Society for Financial Econometrics, vol. 2(1), pages 84-108.
    14. Guidolin, Massimo & Timmermann, Allan, 2006. "Term structure of risk under alternative econometric specifications," Journal of Econometrics, Elsevier, vol. 131(1-2), pages 285-308.
    15. Corradi, Valentina & Swanson, Norman R., 2006. "Bootstrap conditional distribution tests in the presence of dynamic misspecification," Journal of Econometrics, Elsevier, vol. 133(2), pages 779-806, August.
    16. Sean D. Campbell & Francis X. Diebold, 2005. "Weather Forecasting for Weather Derivatives," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 6-16, March.
    17. Neil R. Ericsson, 2000. "Predictable uncertainty in economic forecasting," International Finance Discussion Papers 695, Board of Governors of the Federal Reserve System (U.S.).
    18. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    19. Oller, Lars-Erik & Barot, Bharat, 2000. "The accuracy of European growth and inflation forecasts," International Journal of Forecasting, Elsevier, vol. 16(3), pages 293-315.
    20. Tara M. Sinclair & H. O. Stekler & Warren Carnow, 2012. "A new approach for evaluating economic forecasts," Economics Bulletin, AccessEcon, vol. 32(3), pages 2332-2342.
    21. Bharat Barot, 2004. "How accurate are the Swedish forecasters on GDB-Growth, CPI-inflation and unemployment? (1993 - 2001)," Brussels Economic Review, ULB -- Universite Libre de Bruxelles, vol. 47(2), pages 249-278.

    More about this item

    Keywords

    Agricultural and Food Policy; Research Methods/ Statistical Methods;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:uwarer:269466. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://warwick.ac.uk/fac/soc/economics/research/workingpapers/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.