IDEAS home Printed from https://ideas.repec.org/p/ags/monebs/267403.html

Comments on Testing Economic Theories and the Use of Model Selection Criteria

Author

Listed:
  • Granger, Clive
  • King, Maxwell L.
  • White, Halbert

Abstract

This paper outlines several difficulties with testing economic theories, particularly that the theories may be vague, may relate to a decision interval different from the observation period and may need construction of a metric to convert a complicated testing situation to an easier one. We argue that it is better to use model selection procedures rather than formal hypothesis testing when asking the data to decide on model specification. This is because testing favors the null hypothesis, typically uses an arbitrary choice of significance level and researchers working with the same data could easily end up with different final models, which would make policy recommendations difficult.

Suggested Citation

  • Granger, Clive & King, Maxwell L. & White, Halbert, "undated". "Comments on Testing Economic Theories and the Use of Model Selection Criteria," Papers 267403, Department of Econometrics and Business Statistics Working Papers.
  • Handle: RePEc:ags:monebs:267403
    DOI: 10.22004/ag.econ.267403
    as

    Download full text from publisher

    File URL: https://ageconsearch.umn.edu/record/267403/files/monash-147.pdf
    Download Restriction: no

    File URL: https://ageconsearch.umn.edu/record/267403/files/monash-147.pdf?subformat=pdfa
    Download Restriction: no

    File URL: https://libkey.io/10.22004/ag.econ.267403?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hall, Robert E, 1978. "Stochastic Implications of the Life Cycle-Permanent Income Hypothesis: Theory and Evidence," Journal of Political Economy, University of Chicago Press, vol. 86(6), pages 971-987, December.
    2. Nishii, R., 1988. "Maximum likelihood principle and model selection when the true model is unspecified," Journal of Multivariate Analysis, Elsevier, vol. 27(2), pages 392-403, November.
    3. King, Maxwell L., 1983. "Testing for autoregressive against moving average errors in the linear regression model," Journal of Econometrics, Elsevier, vol. 21(1), pages 35-51, January.
    4. Gilbert, Christopher L, 1986. "Professor Hendry's Econometric Methodology," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 48(3), pages 283-307, August.
    5. Pagan, Adrian, 1987. "Three Econometric Methodologies: A Critical Appraisal," Journal of Economic Surveys, Wiley Blackwell, vol. 1(1), pages 3-24.
    6. Ermini, Luigi, 1989. "Some New Evidence on the Timing of Consumption Decisions and on Their Generating Process," The Review of Economics and Statistics, MIT Press, vol. 71(4), pages 643-650, November.
    7. Bernt P. Stigum, 1990. "Toward a Formal Science of Economics," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262192845, December.
    8. Engle, R. F. & Granger, C. W. J. (ed.), 1991. "Long-Run Economic Relationships: Readings in Cointegration," OUP Catalogue, Oxford University Press, number 9780198283393.
    9. Lee, Tae-Hwy & White, Halbert & Granger, Clive W. J., 1993. "Testing for neglected nonlinearity in time series models : A comparison of neural network methods and alternative tests," Journal of Econometrics, Elsevier, vol. 56(3), pages 269-290, April.
    10. Fomby, Thomas B. & Guilkey, David K., 1978. "On choosing the optimal level of significance for the Durbin-Watson test and the Bayesian alternative," Journal of Econometrics, Elsevier, vol. 8(2), pages 203-213, October.
    11. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    12. Pötscher, B.M., 1991. "Effects of Model Selection on Inference," Econometric Theory, Cambridge University Press, vol. 7(2), pages 163-185, June.
    13. Sawa, Takamitsu, 1978. "Information Criteria for Discriminating among Alternative Regression Models," Econometrica, Econometric Society, vol. 46(6), pages 1273-1291, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Julia Campos & Neil R. Ericsson & David F. Hendry, 2005. "General-to-specific modeling: an overview and selected bibliography," International Finance Discussion Papers 838, Board of Governors of the Federal Reserve System (U.S.).
    2. Kevin D. Hoover & Stephen J. Perez, 1999. "Data mining reconsidered: encompassing and the general-to-specific approach to specification search," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 167-191.
    3. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118, March.
    4. David F. Hendry, 2024. "A Brief History of General‐to‐specific Modelling," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 86(1), pages 1-20, February.
    5. Rajendra Prasad Shrestha Ph. D., 2008. "Private Savings Behaviour in Nepal: Long-term Determinants and Short-run Dynamics," NRB Economic Review, Nepal Rastra Bank, Research Department, vol. 20, pages 16-31, April.
    6. Charles G. Renfro, 2009. "The Practice of Econometric Theory," Advanced Studies in Theoretical and Applied Econometrics, Springer, number 978-3-540-75571-5.
    7. Janine Aron & John Muellbauer, 2006. "Housing Wealth, Credit Conditions and Consumption," CSAE Working Paper Series 2006-08, Centre for the Study of African Economies, University of Oxford.
    8. Neil R. Ericsson, 2021. "Dynamic Econometrics in Action: A Biography of David F. Hendry," International Finance Discussion Papers 1311, Board of Governors of the Federal Reserve System (U.S.).
    9. David F. Hendry, 2013. "Econometric Modelling: The ‘Consumption Function’ In Retrospect," Scottish Journal of Political Economy, Scottish Economic Society, vol. 60(5), pages 495-522, November.
    10. Mur, Jesús & Angulo, Ana, 2009. "Model selection strategies in a spatial setting: Some additional results," Regional Science and Urban Economics, Elsevier, vol. 39(2), pages 200-213, March.
    11. Kremers, Jeroen J M & Ericsson, Neil R & Dolado, Juan J, 1992. "The Power of Cointegration Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 54(3), pages 325-348, August.
    12. Susanne M. Schennach & Daniel Wilhelm, 2017. "A Simple Parametric Model Selection Test," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1663-1674, October.
    13. Spanos, Aris, 1989. "On Rereading Haavelmo: A Retrospective View of Econometric Modeling," Econometric Theory, Cambridge University Press, vol. 5(3), pages 405-429, December.
    14. Joseph DeJuan & Tony S. Wirjanto & Xinpeng Xu, 2016. "The Adjustment of Consumption to Income Changes Across Chinese Provinces," Annals of Economics and Finance, Society for AEF, vol. 17(2), pages 235-253, November.
    15. Janine Aron & John Muellbauer, 2000. "Personal and Corporate Saving in South Africa," The World Bank Economic Review, World Bank, vol. 14(3), pages 509-544, September.
    16. Singh, Tarlok, 2004. "On the optimizing model of the balance of trade in India," Journal of Policy Modeling, Elsevier, vol. 26(5), pages 605-625, July.
    17. Bardsen, Gunnar & Eitrheim, Oyvind & Jansen, Eilev S. & Nymoen, Ragnar, 2005. "The Econometrics of Macroeconomic Modelling," OUP Catalogue, Oxford University Press, number 9780199246502.
    18. Granger, Clive W. J. & Swanson, Norman R., 1997. "An introduction to stochastic unit-root processes," Journal of Econometrics, Elsevier, vol. 80(1), pages 35-62, September.
    19. Faust, Jon & Whiteman, Charles H., 1997. "General-to-specific procedures for fitting a data-admissible, theory-inspired, congruent, parsimonious, encompassing, weakly-exogenous, identified, structural model to the DGP: A translation and criti," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 47(1), pages 121-161, December.
    20. Andrews, Donald W. K. & Lu, Biao, 2001. "Consistent model and moment selection procedures for GMM estimation with application to dynamic panel data models," Journal of Econometrics, Elsevier, vol. 101(1), pages 123-164, March.

    More about this item

    Keywords

    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ags:monebs:267403. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: AgEcon Search (email available below). General contact details of provider: https://edirc.repec.org/data/dxmonau.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.