IDEAS home Printed from https://ideas.repec.org/a/eee/jpolmo/v14y1992i4p465-495.html
   My bibliography  Save this article

Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration

Author

Listed:
  • Ericsson, Neil R.

Abstract

Parameter constancy and a model's mean square forecast error are two commonly used measures of forecast performance. By explicit consideration of the information sets involved, this paper clarifies the roles that each plays in analyzing a model's forecast accuracy. Both criteria are necessary for \"good\" forecast performance, but neither (nor both) is sufficient. Further, these criteria fit into a general taxonomy of model evaluation statistics, and the information set corresponding to a model's mean square forecast error leads to a new test statistic, forecast-model encompassing. Two models of U.K. money demand illustrate the various measures of forecast accuracy.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
  • Handle: RePEc:eee:jpolmo:v:14:y:1992:i:4:p:465-495
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/0161-8938(92)90017-7
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Schinasi, Garry J. & Swamy, P. A. V. B., 1989. "The out-of-sample forecasting performance of exchange rate models when coefficients are allowed to change," Journal of International Money and Finance, Elsevier, vol. 8(3), pages 375-390, September.
    2. Nicholls, D F & Pagan, A R, 1983. "Heteroscedasticity in Models with Lagged Dependent Variables," Econometrica, Econometric Society, vol. 51(4), pages 1233-1242, July.
    3. Davidson, Russell & MacKinnon, James G, 1981. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Econometrica, Econometric Society, vol. 49(3), pages 781-793, May.
    4. M. H. Pesaran, 1974. "On the General Problem of Model Selection," Review of Economic Studies, Oxford University Press, vol. 41(2), pages 153-171.
    5. Neil R. Ericsson & David F. Hendry, 1985. "Conditional econometric modelling : an application to new house prices in the United Kingdom," International Finance Discussion Papers 254, Board of Governors of the Federal Reserve System (U.S.).
    6. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    7. Granger, Clive W. J. & Deutsch, Melinda, 1992. "Comments on the evaluation of policy models," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 497-516, August.
    8. Stephen M. Goldfeld, 1973. "The Demand for Money Revisited," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 4(3), pages 577-646.
    9. Hali J. Edison, 1983. "The rise and fall of sterling: testing alternative models of exchange rate determination," International Finance Discussion Papers 224, Board of Governors of the Federal Reserve System (U.S.).
    10. Hendry, David F, 1988. "The Encompassing Implications of Feedback versus Feedforward Mechanisms in Econometrics," Oxford Economic Papers, Oxford University Press, vol. 40(1), pages 132-149, March.
    11. Hendry, David F. & Ericsson, Neil R., 1991. "Modeling the demand for narrow money in the United Kingdom and the United States," European Economic Review, Elsevier, vol. 35(4), pages 833-881, May.
    12. Diebold, Francis X., 1989. "Forecast combination and encompassing: Reconciling two divergent literatures," International Journal of Forecasting, Elsevier, vol. 5(4), pages 589-592.
    13. Chow, Gregory C., 1984. "Random and changing coefficient models," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 21, pages 1213-1245, Elsevier.
    14. Fair, Ray C., 1986. "Evaluating the predictive accuracy of models," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 3, chapter 33, pages 1979-1995, Elsevier.
    15. Pagan, Adrian, 1989. "On the role of simulation in the statistical evaluation of econometric models," Journal of Econometrics, Elsevier, vol. 40(1), pages 125-139, January.
    16. Edison, Hali J & Klovland, Jan Tore, 1987. "A Quantitative Reassessment of the Purchasing Power Parity Hypothesis: Evidence from Norway and the United Kingdom," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 2(4), pages 309-333, October.
    17. Julia Campos & Neil R. Ericsson, 1988. "Econometric modeling of consumers' expenditure in Venezuela," International Finance Discussion Papers 325, Board of Governors of the Federal Reserve System (U.S.).
    18. Swamy, P. A. V. B. & Tinsley, P. A., 1980. "Linear prediction and estimation methods for regression models with stationary stochastic coefficients," Journal of Econometrics, Elsevier, vol. 12(2), pages 103-142, February.
    19. Fisher, Franklin M, 1970. "Tests of Equality Between Sets of Coefficients in Two Linear Regressions: An Expository Note," Econometrica, Econometric Society, vol. 38(2), pages 361-366, March.
    20. Goldfeld, Stephen M. & Sichel, Daniel E., 1990. "The demand for money," Handbook of Monetary Economics, in: B. M. Friedman & F. H. Hahn (ed.), Handbook of Monetary Economics, edition 1, volume 1, chapter 8, pages 299-356, Elsevier.
    21. Dufour, Jean-Marie, 1980. "Dummy variables and predictive tests for structural change," Economics Letters, Elsevier, vol. 6(3), pages 241-247.
    22. Granger, Clive W J, 1986. "Developments in the Study of Cointegrated Economic Variables," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 48(3), pages 213-228, August.
    23. Ericsson, Neil R. & Campos, Julia & Tran, Hong-Anh, 1990. "Pc-Give and David Hendry'S Econometric Methodology," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 10(1), April.
    24. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    25. Garry J. Schinasi & P. A. V. B. Swamy, 1986. "Should fixed coefficients be reestimated every period for extrapolation?," International Finance Discussion Papers 287, Board of Governors of the Federal Reserve System (U.S.).
    26. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    27. Meese, Richard A. & Rogoff, Kenneth, 1983. "Empirical exchange rate models of the seventies : Do they fit out of sample?," Journal of International Economics, Elsevier, vol. 14(1-2), pages 3-24, February.
    28. Jan F. Kiviet, 1986. "On the Rigour of Some Misspecification Tests for Modelling Dynamic Relationships," Review of Economic Studies, Oxford University Press, vol. 53(2), pages 241-261.
    29. Dufour, Jean-Marie, 1982. "Recursive stability analysis of linear regression relationships: An exploratory methodology," Journal of Econometrics, Elsevier, vol. 19(1), pages 31-76, May.
    30. Spanos,Aris, 1986. "Statistical Foundations of Econometric Modelling," Cambridge Books, Cambridge University Press, number 9780521269124, July.
    31. Godfrey, Leslie G, 1978. "Testing against General Autoregressive and Moving Average Error Models When the Regressors Include Lagged Dependent Variables," Econometrica, Econometric Society, vol. 46(6), pages 1293-1301, November.
    32. Sargan, J D, 1980. "Some Approximations to the Distribution of Econometric Criteria Which are Asymptotically Distributed as Chi-Squared," Econometrica, Econometric Society, vol. 48(5), pages 1107-1138, July.
    33. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hendry, David F. & Ericsson, Neil R., 1991. "Modeling the demand for narrow money in the United Kingdom and the United States," European Economic Review, Elsevier, vol. 35(4), pages 833-881, May.
    2. Sunil Sharma & Neil R. Ericsson, 1998. "Broad money demand and financial liberalization in Greece," Empirical Economics, Springer, vol. 23(3), pages 417-436.
    3. Hendry, David F & Ericsson, Neil R, 1991. "An Econometric Analysis of U.K. Money Demand in 'Monetary Trends in the United States and the United Kingdom' by Milton Friedman and Anna Schwartz," American Economic Review, American Economic Association, vol. 81(1), pages 8-38, March.
    4. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," Review of Economic Studies, Oxford University Press, vol. 53(4), pages 671-690.
    5. Bierens, H.J. & Broersma, L., 1991. "The relation between unemployment and interest rate : some international evidence," Serie Research Memoranda 0112, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    6. Ericsson, Neil R & Hendry, David F & Mizon, Grayham E, 1998. "Exogeneity, Cointegration, and Economic Policy Analysis," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(4), pages 370-387, October.
    7. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    8. Ericsson, Neil R., 1992. "Cointegration, exogeneity, and policy analysis: An overview," Journal of Policy Modeling, Elsevier, vol. 14(3), pages 251-280, June.
    9. Neil R. Ericsson & David F. Hendry & Hong-Anh Tran, 1993. "Cointegration, seasonality, encompassing, and the demand for money in the United Kingdom," International Finance Discussion Papers 457, Board of Governors of the Federal Reserve System (U.S.).
    10. Charles G. Renfro, 2009. "The Practice of Econometric Theory," Advanced Studies in Theoretical and Applied Econometrics, Springer, number 978-3-540-75571-5, enero-jun.
    11. Julia Campos & Neil R. Ericsson & David F. Hendry, 2005. "General-to-specific modeling: an overview and selected bibliography," International Finance Discussion Papers 838, Board of Governors of the Federal Reserve System (U.S.).
    12. Broersma, L., 1991. "The relation between unemployment and interest rate : application of an ARX approach," Serie Research Memoranda 0057, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    13. Neil R. Ericsson & David F. Hendry, 1985. "Conditional econometric modelling : an application to new house prices in the United Kingdom," International Finance Discussion Papers 254, Board of Governors of the Federal Reserve System (U.S.).
    14. Neil R. Ericsson, 1987. "Monte Carlo methodology and the finite sample properties of statistics for testing nested and non-nested hypotheses," International Finance Discussion Papers 317, Board of Governors of the Federal Reserve System (U.S.).
    15. Neil R. Ericsson & Steven B. Kamin, 1993. "Dollarization in Argentina," International Finance Discussion Papers 460, Board of Governors of the Federal Reserve System (U.S.).
    16. Jim Granato & William West, 1994. "Words And Deeds: Symbolic Politics And Decision Making At The Federal Reserve," Economics and Politics, Wiley Blackwell, vol. 6(3), pages 233-255, November.
    17. Ericsson, Neil R. & Campos, Julia & Tran, Hong-Anh, 1990. "Pc-Give and David Hendry'S Econometric Methodology," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 10(1), April.
    18. Neil R. Ericsson & David F. Hendry & Kevin M. Prestwich, 1998. "The Demand for Broad Money in the United Kingdom, 1878–1993," Scandinavian Journal of Economics, Wiley Blackwell, vol. 100(1), pages 289-324, March.
    19. Neil R. Ericsson, 1986. "Post-simulation Analysis of Monte Carlo Experiments: Interpreting Pesaran's (1974) Study of Non-nested Hypothesis Test Statistics," Review of Economic Studies, Oxford University Press, vol. 53(4), pages 691-707.
    20. MacKinnon, James G, 1992. "Model Specification Tests and Artificial Regressions," Journal of Economic Literature, American Economic Association, vol. 30(1), pages 102-146, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jpolmo:v:14:y:1992:i:4:p:465-495. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.elsevier.com/locate/inca/505735 .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505735 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.