Advanced Search
MyIDEAS: Login

Some Recent Developments in Predictive Accuracy Testing With Nested Models and (Generic) Nonlinear Alternatives

Contents:

Author Info

  • Valentina Corradi

    () (Queen Mary, University of London)

  • Norman Swanson

    () (Rutgers University)

Abstract

We provide analytical formulae for the asymptotic bias (ABIAS) and mean squared error (AMSE) of the IV estimator, and obtain approximations thereof based on an asymptotic scheme which essentially requires the expectation of the first stage F-statistic to converge to a finite (possibly small) positive limit as the number of instruments approaches infinity. The approximations so obtained are shown, via regression analysis, to yield good approximations for ABIAS and AMSE functions, and the AMSE approximation is shown to perform well relative to the approximation of Donald and Newey (2001). Additionally, the manner in which our framework generalizes that of Richardson and Wu (1971) is discussed. One consequence of the asymptotic framework adopted here is that consistent estimators for the ABIAS and AMSE can be obtained. As a result, we are able to construct a number of bias corrected OLS and IV estimators, which we show to be consistent under a sequential asymptotic scheme. These bias-corrected estimators are also robust, in the sense that they remain consistent in a conventional asymptotic setup, where the model is fully identified. A small Monte Carlo experiment documents the relative performance of our bias adjusted estimators versus standard IV, OLS, LIML estimators, and it is shown that our estimators have lower bias than LIML for various levels of endogeneity and instrument relevance.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: ftp://snde.rutgers.edu/Rutgers/wp/2003-16.pdf
Download Restriction: no

Bibliographic Info

Paper provided by Rutgers University, Department of Economics in its series Departmental Working Papers with number 200316.

as in new window
Length:
Date of creation: 21 Oct 2003
Date of revision:
Handle: RePEc:rut:rutres:200316

Contact details of provider:
Postal: New Jersey Hall - 75 Hamilton Street, New Brunswick, NJ 08901-1248
Phone: (732) 932-7482
Fax: (732) 932-7416
Web page: http://snde.rutgers.edu/Rutgers/wp/rutgers-wplist.html
More information through EDIRC

Related research

Keywords: Conditional p-value; bootstrap; forecasting; out-of-sample predictive accuracy; parameter estimation error;

Other versions of this item:

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Corradi, Valentina & Swanson, Norman R., 2002. "A consistent test for nonlinear out of sample predictive accuracy," Journal of Econometrics, Elsevier, vol. 110(2), pages 353-381, October.
  2. Peter F. Christoffersen & Francis X. Diebold, 1998. "How Relevant is Volatility Forecasting for Financial Risk Management?," New York University, Leonard N. Stern School Finance Department Working Paper Seires 98-080, New York University, Leonard N. Stern School of Business-.
  3. Granger, C. W. J., 1980. "Testing for causality : A personal viewpoint," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 329-352, May.
  4. Myles Callan & Eric Ghysels & Norman R. Swanson, 1998. "Monetary Policy Rules with Model and Data Uncertainty," CIRANO Working Papers 98s-40, CIRANO.
  5. Tom Stark and Dean Croushore, 2001. "Forecasting with a Real-Time Data Set for Macroeconomists," Computing in Economics and Finance 2001 258, Society for Computational Economics.
  6. Swanson, Norman R., 1998. "Money and output viewed through a rolling window," Journal of Monetary Economics, Elsevier, vol. 41(3), pages 455-474, May.
  7. Hansen, Bruce E, 1996. "Inference When a Nuisance Parameter Is Not Identified under the Null Hypothesis," Econometrica, Econometric Society, vol. 64(2), pages 413-30, March.
  8. Michael P. Clements & David F. Hendry, 1999. "On winning forecasting competitions in economics," Spanish Economic Review, Springer, vol. 1(2), pages 123-160.
  9. Lee, Tae-Hwy & White, Halbert & Granger, Clive W. J., 1993. "Testing for neglected nonlinearity in time series models : A comparison of neural network methods and alternative tests," Journal of Econometrics, Elsevier, vol. 56(3), pages 269-290, April.
  10. Granger, C W J, 1969. "Investigating Causal Relations by Econometric Models and Cross-Spectral Methods," Econometrica, Econometric Society, vol. 37(3), pages 424-38, July.
  11. Todd E. Clark & Michael McCracken, 1999. "Tests of Equal Forecast Accuracy and Encompassing for Nested Models," Computing in Economics and Finance 1999 1241, Society for Computational Economics.
  12. Bierens, Herman J, 1990. "A Consistent Conditional Moment Test of Functional Form," Econometrica, Econometric Society, vol. 58(6), pages 1443-58, November.
  13. Terasvirta, T & Anderson, H M, 1992. "Characterizing Nonlinearities in Business Cycles Using Smooth Transition Autoregressive Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(S), pages S119-36, Suppl. De.
  14. Kenneth D. West, 1994. "Asymptotic Inference About Predictive Ability," Macroeconomics 9410002, EconWPA.
  15. repec:att:wimass:9710 is not listed on IDEAS
  16. Clements, M.P. & Smith J., 1998. "Evaluating The Forecast of Densities of Linear and Non-Linear Models: Applications to Output Growth and Unemployment," The Warwick Economics Research Paper Series (TWERPS) 509, University of Warwick, Department of Economics.
  17. Jushan Bai, 2003. "Testing Parametric Conditional Distributions of Dynamic Models," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 531-549, August.
  18. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809.
  19. Dean Croushore & Tom Stark, 1999. "A real-time data set for macroeconomists," Working Papers 99-4, Federal Reserve Bank of Philadelphia.
  20. Corradi, Valentina & Swanson, Norman R. & Olivetti, Claudia, 2001. "Predictive ability with cointegrated variables," Journal of Econometrics, Elsevier, vol. 104(2), pages 315-358, September.
  21. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-62, November.
  22. Ashley, R & Granger, C W J & Schmalensee, R, 1980. "Advertising and Aggregate Consumption: An Analysis of Causality," Econometrica, Econometric Society, vol. 48(5), pages 1149-67, July.
  23. Stinchcombe, Maxwell B. & White, Halbert, 1998. "Consistent Specification Testing With Nuisance Parameters Present Only Under The Alternative," Econometric Theory, Cambridge University Press, vol. 14(03), pages 295-325, June.
  24. Valentina Corradi & Norman R. Swanson, 2003. "Bootstrap Conditional Distribution Tests In the Presence of Dynamic Misspecification," Departmental Working Papers 200311, Rutgers University, Department of Economics.
  25. Diebold, Francis X & Mariano, Roberto S, 1995. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 253-63, July.
  26. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
  27. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(06), pages 808-817, December.
  28. Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
  29. repec:cup:etheor:v:13:y:1997:i:6:p:808-17 is not listed on IDEAS
  30. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
  31. Norman R. Swanson & Jeffery D. Amato, 2000. "The real-time predictive content of money for output," BIS Working Papers 96, Bank for International Settlements.
  32. Inoue, Atsushi, 2001. "Testing For Distributional Change In Time Series," Econometric Theory, Cambridge University Press, vol. 17(01), pages 156-187, February.
  33. Herman J. Bierens & Werner Ploberger, 1997. "Asymptotic Theory of Integrated Conditional Moment Tests," Econometrica, Econometric Society, vol. 65(5), pages 1129-1152, September.
  34. Swanson, Norman R & White, Halbert, 1995. "A Model-Selection Approach to Assessing the Information in the Term Structure Using Linear Models and Artificial Neural Networks," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 265-75, July.
  35. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-40, November.
  36. Clements, Michael P. & Smith, Jeremy, 2002. "Evaluating multivariate forecast densities: a comparison of two approaches," International Journal of Forecasting, Elsevier, vol. 18(3), pages 397-407.
  37. Norman R. Swanson, 2000. "An Out of Sample Test for Granger Causality," Econometric Society World Congress 2000 Contributed Papers 0362, Econometric Society.
  38. Bierens, Herman J., 1982. "Consistent model specification tests," Journal of Econometrics, Elsevier, vol. 20(1), pages 105-134, October.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Norman R. Swanson & Nii Ayi Armah, 2011. "Predictive Inference Under Model Misspecification with an Application to Assessing the Marginal Predictive Content of Money for Output," Departmental Working Papers 201103, Rutgers University, Department of Economics.
  2. Michael P. Clements & Philip Hans Franses & Norman R. Swanson, 2003. "Forecasting economic and financial time-series with non-linear models," Departmental Working Papers 200309, Rutgers University, Department of Economics.
  3. Amendola, Alessandra & Storti, Giuseppe, 2008. "A GMM procedure for combining volatility forecasts," Computational Statistics & Data Analysis, Elsevier, vol. 52(6), pages 3047-3060, February.
  4. Wei Dong & Deokwoo Nam, 2011. "Exchange Rates and Individual Good’s Price Misalignment: Some Preliminary Evidence of Long-Horizon Predictability," Discussion Papers 11-8, Bank of Canada.
  5. Calhoun, Gray, 2012. "Out-Of-Sample Comparisons of Overfit Models," Staff General Research Papers 32462, Iowa State University, Department of Economics.
  6. Shiyi Chen & Wolfgang K. Härdle & Kiho Jeong, 2010. "Forecasting volatility with support vector machine-based GARCH model," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(4), pages 406-433.
  7. Teräsvirta, Timo, 2005. "Forecasting economic variables with nonlinear models," Working Paper Series in Economics and Finance 598, Stockholm School of Economics, revised 29 Dec 2005.
  8. Norman Swanson & Valentina Corradi, 2006. "Nonparametric Bootstrap Procedures for Predictive Inference Based on Recursive Estimation Schemes," Departmental Working Papers 200618, Rutgers University, Department of Economics.
  9. Valentina Corradi & Norman Swanson, 2004. "Bootstrap Procedures for Recursive Estimation Schemes With Applications to Forecast Model Selection," Departmental Working Papers 200418, Rutgers University, Department of Economics.
  10. Barbara Rossi, 2005. "Are Exchange Rates Really Random Walks? Some Evidence Robust to Parameter Instability," International Finance 0503006, EconWPA.
  11. Jeffrey S. Racine & Christopher F. Parmeter, 2012. "Data-Driven Model Evaluation: A Test for Revealed Performance," Department of Economics Working Papers 2012-13, McMaster University.
  12. Capistran, Carlos, 2006. "On comparing multi-horizon forecasts," Economics Letters, Elsevier, vol. 93(2), pages 176-181, November.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:rut:rutres:200316

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ().

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.