IDEAS home Printed from https://ideas.repec.org/p/fip/fedgif/317.html
   My bibliography  Save this paper

Monte Carlo methodology and the finite sample properties of statistics for testing nested and non-nested hypotheses

Author

Abstract

Using recently developed Monte Carlo methodology, this paper investigates the effect of dynamics and simultaneity on the finite sample properties of maximum likelihood and instrumental variables statistics for testing both nested and non-nested hypotheses. Numerical-analytical approximations (response surfaces) to the unknown finite sample size and power functions of those statistics are obtained for dynamic one-and two-equation models. The results illustrate the value of asymptotic theory in interpreting finite sample properties and certain limitations for doing so. Two practical finite sample results arise: the F form of the Wald statistic is strongly favored over its chi-squared form; and the effects of \"large-sigma\" and a small effective sample size are particularly pronounced for Sargan's (1958) instrumental variables statistic and Ericsson's (1983) Cox-type instrumental variables statistic. Re-examining Pesaran and Deaton's (1978) empirical example illustrates the additional information gained from the instrumental variables statistics.

Suggested Citation

  • Neil R. Ericsson, 1987. "Monte Carlo methodology and the finite sample properties of statistics for testing nested and non-nested hypotheses," International Finance Discussion Papers 317, Board of Governors of the Federal Reserve System (U.S.).
  • Handle: RePEc:fip:fedgif:317
    as

    Download full text from publisher

    File URL: http://www.federalreserve.gov/pubs/ifdp/1987/317/default.htm
    Download Restriction: no

    File URL: http://www.federalreserve.gov/pubs/ifdp/1987/317/ifdp317.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. MacKinnon, James G. & White, Halbert & Davidson, Russell, 1983. "Tests for model specification in the presence of alternative hypotheses : Some further results," Journal of Econometrics, Elsevier, vol. 21(1), pages 53-70, January.
    2. M. H. Pesaran, 1974. "On the General Problem of Model Selection," Review of Economic Studies, Oxford University Press, vol. 41(2), pages 153-171.
    3. Kiviet, Jan F., 1985. "Model selection test procedures in a single linear equation of a dynamic simultaneous system and their defects in small samples," Journal of Econometrics, Elsevier, vol. 28(3), pages 327-362, June.
    4. Phillips, Peter C B, 1977. "Approximations to Some Finite Sample Distributions Associated with a First-Order Stochastic Difference Equation," Econometrica, Econometric Society, vol. 45(2), pages 463-485, March.
    5. Maxwell L. King & Michael McAleer, 1987. "Further Results on Testing AR (1) Against MA (1) Disturbances in the Linear Regression Model," Review of Economic Studies, Oxford University Press, vol. 54(4), pages 649-663.
    6. Campos, Julia, 1986. "Finite-sample properties of the instrumental-variables estimator for dynamic simultaneous-equation subsystems with ARMA disturbances," Journal of Econometrics, Elsevier, vol. 32(3), pages 333-366, August.
    7. Maasoumi, Esfandiar & Phillips, Peter C. B., 1982. "On the behavior of inconsistent instrumental variable estimators," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 183-201, August.
    8. Davidson, James E. H. & Hendry, David F., 1981. "Interpreting econometric evidence : The behaviour of consumers' expenditure in the UK," European Economic Review, Elsevier, vol. 16(1), pages 177-192.
    9. Sargan, J D, 1976. "Econometric Estimators and the Edgeworth Approximation," Econometrica, Econometric Society, vol. 44(3), pages 421-448, May.
    10. Sargan, J D & Mikhail, W M, 1971. "A General Approximation to the Distribution of Instrumental Variables Estimates," Econometrica, Econometric Society, vol. 39(1), pages 131-169, January.
    11. Phillips, P C B, 1986. "The Exact Distribution of the Wald Statistic," Econometrica, Econometric Society, vol. 54(4), pages 881-895, July.
    12. Phillips, P.C.B., 1986. "Understanding spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 33(3), pages 311-340, December.
    13. Godfrey, Leslie G, 1983. "Testing Non-Nested Models after Estimation by Instrumental Variables or Least Squares," Econometrica, Econometric Society, vol. 51(2), pages 355-365, March.
    14. Neil R. Ericsson, 1986. "Post-simulation Analysis of Monte Carlo Experiments: Interpreting Pesaran's (1974) Study of Non-nested Hypothesis Test Statistics," Review of Economic Studies, Oxford University Press, vol. 53(4), pages 691-707.
    15. Granger, C. W. J. & Newbold, P., 1974. "Spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 2(2), pages 111-120, July.
    16. Neil R. Ericsson, 1983. "Asymptotic Properties of Instrumental Variables Statistics for Testing Non-Nested Hypotheses," Review of Economic Studies, Oxford University Press, vol. 50(2), pages 287-304.
    17. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    18. J. D. Sargan, 1980. "A Model of Wage-Price Inflation," Review of Economic Studies, Oxford University Press, vol. 47(1), pages 97-112.
    19. Godfrey, L. G. & Pesaran, M. H., 1983. "Tests of non-nested regression models: Small sample adjustments and Monte Carlo evidence," Journal of Econometrics, Elsevier, vol. 21(1), pages 133-154, January.
    20. Hendry, D F, 1973. "On Asymptotic Theory and Finite Sample Experiments," Economica, London School of Economics and Political Science, vol. 40(158), pages 210-217, May.
    21. Godfrey, Leslie G, 1978. "Testing against General Autoregressive and Moving Average Error Models When the Regressors Include Lagged Dependent Variables," Econometrica, Econometric Society, vol. 46(6), pages 1293-1301, November.
    22. B. Pereira, 1978. "Empirical comparisons of some tests of separate families of hypotheses," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 25(1), pages 219-234, December.
    23. Sargan, J D, 1980. "Some Approximations to the Distribution of Econometric Criteria Which are Asymptotically Distributed as Chi-Squared," Econometrica, Econometric Society, vol. 48(5), pages 1107-1138, July.
    24. Pesaran, M H, 1982. "Comparison of Local Power of Alternative Tests of Non-Nested Regression Models," Econometrica, Econometric Society, vol. 50(5), pages 1287-1305, September.
    25. Hendry, David F. & Pagan, Adrian R. & Sargan, J.Denis, 1984. "Dynamic specification," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 18, pages 1023-1100, Elsevier.
    26. Pesaran, M H & Deaton, Angus S, 1978. "Testing Non-Nested Nonlinear Regression Models," Econometrica, Econometric Society, vol. 46(3), pages 677-694, May.
    27. Nicholls, D F & Pagan, A R, 1983. "Heteroscedasticity in Models with Lagged Dependent Variables," Econometrica, Econometric Society, vol. 51(4), pages 1233-1242, July.
    28. D. S. Poskitt & A. R. Tremayne, 1981. "A Time Series Application Of The Use Of Monte Carlo Methods To Compare Statistical Tests," Journal of Time Series Analysis, Wiley Blackwell, vol. 2(4), pages 263-277, July.
    29. Hendry, David F & Mizon, Grayham E, 1978. "Serial Correlation as a Convenient Simplification, not a Nuisance: A Comment on a Study of the Demand for Money by the Bank of England," Economic Journal, Royal Economic Society, vol. 88(351), pages 549-563, September.
    30. P. C. B. Phillips, 1980. "Finite Sample Theory and the Distributions of Alternative Estimators of the Marginal Propensity to Consume," Review of Economic Studies, Oxford University Press, vol. 47(1), pages 183-224.
    31. J. Campos, 1986. "Instrumental Variables Estimation of Dynamic Simultaneous Systems with ARMA Errors," Review of Economic Studies, Oxford University Press, vol. 53(1), pages 125-138.
    32. Hendry, David F. & Srba, Frank, 1980. "Autoreg: a computer program library for dynamic econometric models with autoregressive errors," Journal of Econometrics, Elsevier, vol. 12(1), pages 85-102, January.
    33. Grayham E. Mizon & David F. Hendry, 1980. "An Empirical Application and Monte Carlo Analysis of Tests of Dynamic Specification," Review of Economic Studies, Oxford University Press, vol. 47(1), pages 21-45.
    34. Hendry, David F., 1982. "A reply to Professors Maasoumi and Phillips," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 203-213, August.
    35. Pesaran, M. Hashem, 1987. "Global and Partial Non-Nested Hypotheses and Asymptotic Local Power," Econometric Theory, Cambridge University Press, vol. 3(1), pages 69-97, February.
    36. Hendry, David F., 1984. "Monte carlo experimentation in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 16, pages 937-976, Elsevier.
    37. Robert Summers, 1959. "A Capital-Intensive Approach to the Small Sample Properties of Various Simultaneous Equation Estimators," Cowles Foundation Discussion Papers 64, Cowles Foundation for Research in Economics, Yale University.
    38. Phoebus J. Dhrymes & E. Philip Howrey & Saul H. Hymans & Jan Kmenta & Edward E. Leamer & Richard E. Quandt & James B. Ramsey & Harold T. Shapiro & Victor Zarnowitz, 1972. "Criteria for Evaluation of Econometric Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 1, number 3, pages 291-324, National Bureau of Economic Research, Inc.
    39. Davidson, James E H, et al, 1978. "Econometric Modelling of the Aggregate Time-Series Relationship between Consumers' Expenditure and Income in the United Kingdom," Economic Journal, Royal Economic Society, vol. 88(352), pages 661-692, December.
    40. Hendry, David F & Srba, Frank, 1977. "The Properties of Autoregressive Instrumental Variables Estimators in Dynamic Systems," Econometrica, Econometric Society, vol. 45(4), pages 969-990, May.
    41. Jan F. Kiviet, 1986. "On the Rigour of Some Misspecification Tests for Modelling Dynamic Relationships," Review of Economic Studies, Oxford University Press, vol. 53(2), pages 241-261.
    42. Jan Kmenta & James B. Ramsey, 1980. "Evaluation of Econometric Models," NBER Books, National Bureau of Economic Research, Inc, number kmen80-1, May.
    43. Klein, Lawrence R, 1969. "Estimation on Interdependent Systems in Macroeconometrics," Econometrica, Econometric Society, vol. 37(2), pages 171-192, April.
    44. Hausman, Jerry A, 1975. "An Instrumental Variable Approach to Full Information Estimators for Linear and Certain Nonlinear Econometric Models," Econometrica, Econometric Society, vol. 43(4), pages 727-738, July.
    45. Hendry, David F. & Harrison, Robin W., 1974. "Monte Carlo methodology and the small sample behaviour of ordinary and two-stage least squares," Journal of Econometrics, Elsevier, vol. 2(2), pages 151-174, July.
    46. James G. MacKinnon, 1983. "Model Specification Tests Against Non-Nested Alternatives," Working Paper 573, Economics Department, Queen's University.
    47. Anderson, T W, 1977. "Asymptotic Expansions of the Distributions of Estimates in Simultaneous Equations for Alternative Parameter Sequences," Econometrica, Econometric Society, vol. 45(2), pages 509-518, March.
    48. Hendry, David F., 1976. "The structure of simultaneous equations estimators," Journal of Econometrics, Elsevier, vol. 4(1), pages 51-88, February.
    49. Sowey, Eric R., 1973. "A classified bibliography of Monte Carlo studies in econometrics," Journal of Econometrics, Elsevier, vol. 1(4), pages 377-395, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David F. Hendry & Peter C.B. Phillips, 2017. "John Denis Sargan at the London School of Economics," Cowles Foundation Discussion Papers 2082, Cowles Foundation for Research in Economics, Yale University.
    2. Neil R. Ericsson, 1986. "Post-simulation Analysis of Monte Carlo Experiments: Interpreting Pesaran's (1974) Study of Non-nested Hypothesis Test Statistics," Review of Economic Studies, Oxford University Press, vol. 53(4), pages 691-707.
    3. MacKinnon, James G, 1992. "Model Specification Tests and Artificial Regressions," Journal of Economic Literature, American Economic Association, vol. 30(1), pages 102-146, March.
    4. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," Review of Economic Studies, Oxford University Press, vol. 53(4), pages 671-690.
    5. Neil R. Ericsson, 2021. "Dynamic Econometrics in Action: A Biography of David F. Hendry," International Finance Discussion Papers 1311, Board of Governors of the Federal Reserve System (U.S.).
    6. McAleer, Michael, 1995. "The significance of testing empirical non-nested models," Journal of Econometrics, Elsevier, vol. 67(1), pages 149-171, May.
    7. Julia Campos & Neil R. Ericsson & David F. Hendry, 2005. "General-to-specific modeling: an overview and selected bibliography," International Finance Discussion Papers 838, Board of Governors of the Federal Reserve System (U.S.).
    8. David F. Hendry, 2013. "Econometric Modelling: The ‘Consumption Function’ In Retrospect," Scottish Journal of Political Economy, Scottish Economic Society, vol. 60(5), pages 495-522, November.
    9. Charles G. Renfro, 2009. "The Practice of Econometric Theory," Advanced Studies in Theoretical and Applied Econometrics, Springer, number 978-3-540-75571-5, enero-jun.
    10. Hendry, David F., 1984. "Monte carlo experimentation in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 16, pages 937-976, Elsevier.
    11. Neil R. Ericsson & David F. Hendry, 1985. "Conditional econometric modelling : an application to new house prices in the United Kingdom," International Finance Discussion Papers 254, Board of Governors of the Federal Reserve System (U.S.).
    12. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118, September.
    13. Hendry, David F & Ericsson, Neil R, 1991. "An Econometric Analysis of U.K. Money Demand in 'Monetary Trends in the United States and the United Kingdom' by Milton Friedman and Anna Schwartz," American Economic Review, American Economic Association, vol. 81(1), pages 8-38, March.
    14. Hendry, David F. & Ericsson, Neil R., 1991. "Modeling the demand for narrow money in the United Kingdom and the United States," European Economic Review, Elsevier, vol. 35(4), pages 833-881, May.
    15. David F. Hendry & Grayham E. Mizon, 2016. "Improving the teaching of econometrics," Cogent Economics & Finance, Taylor & Francis Journals, vol. 4(1), pages 1170096-117, December.
    16. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
    17. Pons Novell, Jordi, 1997. "Selección de modelos no anidados. Un estudio de Monte Carlo," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 7, pages 131-139, Junio.
    18. McAleer, Michael, 1994. "Sherlock Holmes and the Search for Truth: A Diagnostic Tale," Journal of Economic Surveys, Wiley Blackwell, vol. 8(4), pages 317-370, December.
    19. Campos, Julia & Ericsson, Neil R. & Hendry, David F., 1996. "Cointegration tests in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 70(1), pages 187-220, January.
    20. Harry H. Kelejian & Gianfranco Piras, 2013. "A J-Test for Panel Models with Fixed Effects, Spatial and Time," Working Papers Working Paper 2013-03, Regional Research Institute, West Virginia University.

    More about this item

    Keywords

    Econometrics; Statistics;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgif:317. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.