IDEAS home Printed from https://ideas.repec.org/p/cns/cnscwp/200209.html
   My bibliography  Save this paper

The properties of some goodness-of-fit tests

Author

Listed:
  • G. Boero

  • J. Smith
  • KF. Wallis

Abstract

The properties of Pearson's goodness-of-fit test, as used in density forecast evaluation, income distribution analysis and elsewhere, are analysed. The components-of-chi-squared or "Pearson analog" tests of Anderson (1994) are shown to be less generally applicable than was originally claimed. For the case of equiprobable classes, where the general components tests remain valid, a Monte Carlo study shows that tests directed towards skewness and kurtosis may have low power, due to differences between the class boundaries and the intersection points of the distributions being compared. The power of individual component tests can be increased by the use of nonequiprobable classes.

Suggested Citation

  • G. Boero & J. Smith & KF. Wallis, 2002. "The properties of some goodness-of-fit tests," Working Paper CRENoS 200209, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.
    • Handle: RePEc:cns:cnscwp:200209
    as

    Download full text from publisher

    File URL: https://crenos.unica.it/crenos/node/183
    Download Restriction: no
    File URL: https://crenos.unica.it/crenos/sites/default/files/wp/02-09.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Francis X. Diebold & Anthony S. Tay & Kenneth F. Wallis, 1997. "Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters," NBER Working Papers 6228, National Bureau of Economic Research, Inc.
    2. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    3. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, "undated". "Evaluating Density Forecasts," CARESS Working Papres 97-18, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
    4. repec:sae:niesru:v:167:y::i:1:p:106-112 is not listed on IDEAS
    5. Engle, Robert F. & White (the late), Halbert (ed.), 1999. "Cointegration, Causality, and Forecasting: Festschrift in Honour of Clive W. J. Granger," OUP Catalogue, Oxford University Press, number 9780198296836.
    6. Arulampalam, W. & Robin A. Naylor & Jeremy P. Smith, 2002. "University of Warwick," Royal Economic Society Annual Conference 2002 9, Royal Economic Society.
    7. Kenneth F. Wallis, 1999. "Asymmetric density forecasts of inflation and the Bank of England's fan chart," National Institute Economic Review, National Institute of Economic and Social Research, vol. 167(1), pages 106-112, January.
    8. Wallis, Kenneth F., 1999. "Asymmetric density forecasts of inflation and the Bank of England's fan chart," National Institute Economic Review, National Institute of Economic and Social Research, vol. 167, pages 106-112, January.
    9. Gordon Anderson, 2001. "The Power And Size Of Nonparametric Tests For Common Distributional Characteristics," Econometric Reviews, Taylor & Francis Journals, vol. 20(1), pages 1-30.
    10. Anderson, Gordon, 1994. "Simple tests of distributional form," Journal of Econometrics, Elsevier, vol. 62(2), pages 265-276, June.
    11. Boero, Gianna & Marrocu, Emanuela, 2002. "The Performance of Non-linear Exchange Rate Models: A Forecasting Comparison," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 21(7), pages 513-542, November.
    12. Anderson, Gordon, 1996. "Nonparametric Tests of Stochastic Dominance in Income Distributions," Econometrica, Econometric Society, vol. 64(5), pages 1183-1193, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Boero, Gianna & Marrocu, Emanuela, 2004. "The performance of SETAR models: a regime conditional evaluation of point, interval and density forecasts," International Journal of Forecasting, Elsevier, vol. 20(2), pages 305-320.
    2. Boero, Gianna & Smith, Jeremy & Wallis, Kenneth F., 2004. "Decompositions of Pearson's chi-squared test," Journal of Econometrics, Elsevier, vol. 123(1), pages 189-193, November.
    3. G. Marletto, 2006. "La politica dei trasporti come politica per l'innovazione: spunti da un approccio evolutivo," Working Paper CRENoS 200605, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.
    4. OA Carboni & G Medda, 2007. "Government Size and the Composition of Public Spending in a Neoclassical Growth Model," Working Paper CRENoS 200701, Centre for North South Economic Research, University of Cagliari and Sassari, Sardinia.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gianna Boero & Jeremy Smith & Kenneth Wallis, 2005. "The Sensitivity of Chi-Squared Goodness-of-Fit Tests to the Partitioning of Data," Econometric Reviews, Taylor & Francis Journals, vol. 23(4), pages 341-370.
    2. Terasvirta, Timo, 2006. "Forecasting economic variables with nonlinear models," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 8, pages 413-457, Elsevier.
    3. Boero, Gianna & Smith, Jeremy & Wallis, Kenneth F., 2004. "Decompositions of Pearson's chi-squared test," Journal of Econometrics, Elsevier, vol. 123(1), pages 189-193, November.
    4. Goodhart, C. A. E. & Pradhan, Manoj, 2023. "A snapshot of Central Bank (two year) forecasting: a mixed picture," LSE Research Online Documents on Economics 118680, London School of Economics and Political Science, LSE Library.
    5. Harvey, David I. & Newbold, Paul, 2003. "The non-normality of some macroeconomic forecast errors," International Journal of Forecasting, Elsevier, vol. 19(4), pages 635-653.
    6. Goodhart Charles A.E., 2005. "The Monetary Policy Committee's Reaction Function: An Exercise in Estimation," The B.E. Journal of Macroeconomics, De Gruyter, vol. 5(1), pages 1-42, August.
    7. Boero, Gianna & Marrocu, Emanuela, 2004. "The performance of SETAR models: a regime conditional evaluation of point, interval and density forecasts," International Journal of Forecasting, Elsevier, vol. 20(2), pages 305-320.
    8. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    9. Dowd, Kevin, 2007. "Too good to be true? The (In)credibility of the UK inflation fan charts," Journal of Macroeconomics, Elsevier, vol. 29(1), pages 91-102, March.
    10. Neil R. Ericsson, 2000. "Predictable uncertainty in economic forecasting," International Finance Discussion Papers 695, Board of Governors of the Federal Reserve System (U.S.).
    11. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    12. Knüppel, Malte & Schultefrankenfeld, Guido, 2008. "How informative are macroeconomic risk forecasts? An examination of the Bank of England's inflation forecasts," Discussion Paper Series 1: Economic Studies 2008,14, Deutsche Bundesbank.
    13. Marco Vega, 2004. "Policy Makers Priors and Inflation Density Forecasts," Econometrics 0403005, University Library of Munich, Germany.
    14. Ali Al‐Nowaihi & Livio Stracca, 2003. "Behavioural Central Bank Loss Functions, Skewed Risks and Certainty Equivalence," Manchester School, University of Manchester, vol. 71(s1), pages 21-38, September.
    15. James Mitchell & Martin Weale, 2023. "Censored density forecasts: Production and evaluation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 714-734, August.
    16. Dong Jin Lee, 2009. "Testing Parameter Stability in Quantile Models: An Application to the U.S. Inflation Process," Working papers 2009-26, University of Connecticut, Department of Economics.
    17. Chao, Shih-Kang & Härdle, Wolfgang K. & Yuan, Ming, 2021. "Factorisable Multitask Quantile Regression," Econometric Theory, Cambridge University Press, vol. 37(4), pages 794-816, August.
    18. Clements, Michael P., "undated". "Internal consistency of survey respondentsíforecasts: Evidence based on the Survey of Professional Forecasters," Economic Research Papers 269742, University of Warwick - Department of Economics.
    19. Kenneth W. Clements & H. Y. Izan & Yihui Lan, 2009. "A Stochastic Measure of International Competitiveness," International Review of Finance, International Review of Finance Ltd., vol. 9(1‐2), pages 51-81, March.
    20. Lars E. O. Svensson, 2002. "Monetary policy and real stabilization," Proceedings - Economic Policy Symposium - Jackson Hole, Federal Reserve Bank of Kansas City, pages 261-312.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cns:cnscwp:200209. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CRENoS (email available below). General contact details of provider: https://edirc.repec.org/data/crenoit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.