IDEAS home Printed from https://ideas.repec.org/p/cpr/ceprdp/3821.html
   My bibliography  Save this paper

Estimating Loss Function Parameters

Author

Listed:
  • Timmermann, Allan
  • Elliott, Graham
  • Komunjer, Ivana

Abstract

In situations where a sequence of forecasts is observed, a common strategy is to examine ?rationality? conditional on a given loss function. We examine this from a different perspective - supposing that we have a family of loss functions indexed by unknown shape parameters, then given the forecasts can we back out the loss function parameters consistent with the forecasts being rational even when we do not observe the underlying forecasting model? We establish identification of the parameters of a general class of loss functions that nest popular loss functions as special cases and provide estimation methods and asymptotic distributional results for these parameters. The methods are applied in an empirical analysis of IMF and OECD forecasts of budget deficits for the G7 countries. We find that allowing for asymmetric loss can significantly change the outcome of empirical tests of forecast rationality.

Suggested Citation

  • Timmermann, Allan & Elliott, Graham & Komunjer, Ivana, 2003. "Estimating Loss Function Parameters," CEPR Discussion Papers 3821, C.E.P.R. Discussion Papers.
  • Handle: RePEc:cpr:ceprdp:3821
    as

    Download full text from publisher

    File URL: https://cepr.org/publications/DP3821
    Download Restriction: CEPR Discussion Papers are free to download for our researchers, subscribers and members. If you fall into one of these categories but have trouble downloading our papers, please contact us at subscribers@cepr.org
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    2. Timmermann, Allan & Patton, Andrew, 2003. "Properties of Optimal Forecasts," CEPR Discussion Papers 4037, C.E.P.R. Discussion Papers.
    3. Hansen, Lars Peter & Hodrick, Robert J, 1980. "Forward Exchange Rates as Optimal Predictors of Future Spot Rates: An Econometric Analysis," Journal of Political Economy, University of Chicago Press, vol. 88(5), pages 829-853, October.
    4. Frederic S. Mishkin, 1983. "Are Market Forecasts Rational?," NBER Chapters, in: A Rational Expectations Approach to Macroeconometrics: Testing Policy Ineffectiveness and Efficient-Markets Models, pages 59-75, National Bureau of Economic Research, Inc.
    5. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    6. Frankel, Jeffrey A & Froot, Kenneth A, 1987. "Using Survey Data to Test Standard Propositions Regarding Exchange Rate Expectations," American Economic Review, American Economic Association, vol. 77(1), pages 133-153, March.
    7. Cargill, Thomas F & Meyer, Robert A, 1980. "The Term Structure of Inflationary Expectations and Market Efficiency," Journal of Finance, American Finance Association, vol. 35(1), pages 57-70, March.
    8. Hafer, R W & Hein, Scott E, 1985. "On the Accuracy of Time-Series, Interest Rate, and Survey Forecasts of Inflation," The Journal of Business, University of Chicago Press, vol. 58(4), pages 377-398, October.
    9. West, Kenneth D. & Edison, Hali J. & Cho, Dongchul, 1993. "A utility-based comparison of some models of exchange rate volatility," Journal of International Economics, Elsevier, vol. 35(1-2), pages 23-45, August.
    10. repec:cup:etheor:v:13:y:1997:i:6:p:808-17 is not listed on IDEAS
    11. Zarnowitz, Victor, 1979. "An Analysis of Annual and Multiperiod Qtrly Forecasts of Aggregate Income, Output, and the Price Level," The Journal of Business, University of Chicago Press, vol. 52(1), pages 1-33, January.
    12. Clive W.J. Granger, 1999. "Outline of forecast theory using generalized cost functions," Spanish Economic Review, Springer;Spanish Economic Association, vol. 1(2), pages 161-173.
    13. Michael Artis & Massimiliano Marcellino, 2001. "Fiscal forecasting: The track record of the IMF, OECD and EC," Econometrics Journal, Royal Economic Society, vol. 4(1), pages 20-36.
    14. Newey, Whitney K. & McFadden, Daniel, 1986. "Large sample estimation and hypothesis testing," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 36, pages 2111-2245, Elsevier.
    15. Fama, Eugene F, 1975. "Short-Term Interest Rates as Predictors of Inflation," American Economic Review, American Economic Association, vol. 65(3), pages 269-282, June.
    16. Christoffersen, Peter F. & Diebold, Francis X., 1997. "Optimal Prediction Under Asymmetric Loss," Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
    17. Campbell, Bryan & Ghysels, Eric, 1995. "Federal Budget Projections: A Nonparametric Assessment of Bias and Efficiency," The Review of Economics and Statistics, MIT Press, vol. 77(1), pages 17-31, February.
    18. Nobay, A. Robert & Peel, David, 1998. "Optimal monetary policy in a model of asymmetric central bank preferences," LSE Research Online Documents on Economics 119138, London School of Economics and Political Science, LSE Library.
    19. Pesando, James E, 1975. "A Note on the Rationality of the Livingston Price Expectations," Journal of Political Economy, University of Chicago Press, vol. 83(4), pages 849-858, August.
    20. West, Kenneth D & McCracken, Michael W, 1998. "Regression-Based Tests of Predictive Ability," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 817-840, November.
    21. Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-735, September.
    22. Batchelor, Roy & Peel, David A., 1998. "Rationality testing under asymmetric loss," Economics Letters, Elsevier, vol. 61(1), pages 49-54, October.
    23. Corradi, Valentina & Swanson, Norman R., 2002. "A consistent test for nonlinear out of sample predictive accuracy," Journal of Econometrics, Elsevier, vol. 110(2), pages 353-381, October.
    24. Brown, Bryan W & Maital, Shlomo, 1981. "What Do Economists Know? An Empirical Study of Experts' Expectations," Econometrica, Econometric Society, vol. 49(2), pages 491-504, March.
    25. Figlewski, Stephen & Wachtel, Paul, 1981. "The Formation of Inflationary Expectations," The Review of Economics and Statistics, MIT Press, vol. 63(1), pages 1-10, February.
    26. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    27. Lakonishok, Josef, 1980. "Stock Market Return Expectations: Some General Properties," Journal of Finance, American Finance Association, vol. 35(4), pages 921-931, September.
    28. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    29. Granger, C. W. J. & Newbold, Paul, 1986. "Forecasting Economic Time Series," Elsevier Monographs, Elsevier, edition 2, number 9780122951831 edited by Shell, Karl.
    30. Dokko, Yoon & Edelstein, Robert H, 1989. "How Well Do Economists Forecast Stock Market Prices? A Study of the Livingston Surveys," American Economic Review, American Economic Association, vol. 79(4), pages 865-871, September.
    31. Zarnowitz, Victor, 1985. "Rational Expectations and Macroeconomic Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 3(4), pages 293-311, October.
    32. Bonham, Carl & Cohen, Richard, 1995. "Testing the Rationality of Price Forecasts: Comment," American Economic Review, American Economic Association, vol. 85(1), pages 284-289, March.
    33. Gultekin, N Bulent, 1983. "Stock Market Returns and Inflation Forecasts," Journal of Finance, American Finance Association, vol. 38(3), pages 663-673, June.
    34. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    35. De Bondt, Werner F. M. & Bange, Mary M., 1992. "Inflation Forecast Errors and Time Variation in Term Premia," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 27(4), pages 479-496, December.
    36. Granger, C.W.J. & Pesaran, M. H., 1999. "Economic and Statistical Measures of Forecast Accuracy," Cambridge Working Papers in Economics 9910, Faculty of Economics, University of Cambridge.
    37. Jeffrey A. Frankel & Kenneth A. Froot, 1985. "Using Survey Data to Test Some Standard Propositions Regarding Exchange Rate Expectations," NBER Working Papers 1672, National Bureau of Economic Research, Inc.
    38. Hansen, Lars Peter & Singleton, Kenneth J, 1982. "Generalized Instrumental Variables Estimation of Nonlinear Rational Expectations Models," Econometrica, Econometric Society, vol. 50(5), pages 1269-1286, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Martin Skitmore & Franco K. T. Cheung, 2007. "Explorations in specifying construction price forecast loss functions," Construction Management and Economics, Taylor & Francis Journals, vol. 25(5), pages 449-465.
    2. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    3. Stan Hurn & Ralf Becker, 2009. "Testing for Nonlinearity in Mean in the Presence of Heteroskedasticity," Economic Analysis and Policy, Elsevier, vol. 39(2), pages 311-326, September.
    4. Tom Engsted & Niels Haldrup & Boriss Siliverstovs, 2004. "Long-run forecasting in multicointegrated systems," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(5), pages 315-335.
    5. Basu, Sudipta & Markov, Stanimir, 2004. "Loss function assumptions in rational expectations tests on financial analysts' earnings forecasts," Journal of Accounting and Economics, Elsevier, vol. 38(1), pages 171-203, December.
    6. Yang Yang & Tae-Hwy Lee, 2004. "Bagging Binary Predictors for Time Series," Econometric Society 2004 Far Eastern Meetings 512, Econometric Society.
    7. Lee, Tae-Hwy & Yang, Yang, 2006. "Bagging binary and quantile predictors for time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 465-497.
    8. Timmermann, Allan & Patton, Andrew, 2003. "Properties of Optimal Forecasts," CEPR Discussion Papers 4037, C.E.P.R. Discussion Papers.
    9. Adrian Pagan & Hashem Pesaran, 2007. "Econometric Analysis of Structural Systems with Permanent and Transitory Shocks. Working paper #7," NCER Working Paper Series 7, National Centre for Econometric Research.
    10. Pedro Henrique Melo Albuquerque & Yaohao Peng & João Pedro Fontoura da Silva, 2022. "Making the whole greater than the sum of its parts: A literature review of ensemble methods for financial time series forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(8), pages 1701-1724, December.
    11. Alexander, Marcus & Christakis, Nicholas A., 2008. "Bias and asymmetric loss in expert forecasts: A study of physician prognostic behavior with respect to patient survival," Journal of Health Economics, Elsevier, vol. 27(4), pages 1095-1108, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
    2. Timmermann, Allan & Patton, Andrew, 2003. "Properties of Optimal Forecasts," CEPR Discussion Papers 4037, C.E.P.R. Discussion Papers.
    3. Capistrán, Carlos, 2008. "Bias in Federal Reserve inflation forecasts: Is the Federal Reserve irrational or just cautious?," Journal of Monetary Economics, Elsevier, vol. 55(8), pages 1415-1427, November.
    4. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    5. Ivana Komunjer & Michael T. Owyang, 2012. "Multivariate Forecast Evaluation and Rationality Testing," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1066-1080, November.
    6. Carl Bonham & Richard Cohen & Shigeyuki Abe, 2006. "The Rationality and Heterogeneity of Survey Forecasts of the Yen-Dollar Exchange Rate: A Reexamination," Working Papers 200611, University of Hawaii at Manoa, Department of Economics.
    7. Patton, Andrew J. & Timmermann, Allan, 2005. "Testable implications of forecast optimality," LSE Research Online Documents on Economics 6834, London School of Economics and Political Science, LSE Library.
    8. Silva Lopes, Artur, 1994. "A "hipótese das expectativas racionais": teoria e realidade (uma visita guiada à literatura até 1992) [The "rational expectations hypothesis": theory and reality (a guided tour ," MPRA Paper 9699, University Library of Munich, Germany, revised 23 Jul 2008.
    9. Croushore Dean, 2010. "An Evaluation of Inflation Forecasts from Surveys Using Real-Time Data," The B.E. Journal of Macroeconomics, De Gruyter, vol. 10(1), pages 1-32, May.
    10. Alexander, Marcus & Christakis, Nicholas A., 2008. "Bias and asymmetric loss in expert forecasts: A study of physician prognostic behavior with respect to patient survival," Journal of Health Economics, Elsevier, vol. 27(4), pages 1095-1108, July.
    11. Patton, Andrew J., 2011. "Volatility forecast comparison using imperfect volatility proxies," Journal of Econometrics, Elsevier, vol. 160(1), pages 246-256, January.
    12. Capistrán Carlos & López Moctezuma Gabriel, 2008. "Experts' Macroeconomics Expectations: An Evaluation of Mexican Short-Run Forecasts," Working Papers 2008-11, Banco de México.
    13. Giovannelli, Alessandro & Pericoli, Filippo Maria, 2020. "Are GDP forecasts optimal? Evidence on European countries," International Journal of Forecasting, Elsevier, vol. 36(3), pages 963-973.
    14. Corradi, Valentina & Swanson, Norman R., 2004. "Some recent developments in predictive accuracy testing with nested models and (generic) nonlinear alternatives," International Journal of Forecasting, Elsevier, vol. 20(2), pages 185-199.
    15. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    16. Ang, Andrew & Bekaert, Geert & Wei, Min, 2007. "Do macro variables, asset markets, or surveys forecast inflation better?," Journal of Monetary Economics, Elsevier, vol. 54(4), pages 1163-1212, May.
    17. Rossi, Barbara, 2013. "Advances in Forecasting under Instability," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324, Elsevier.
    18. repec:lan:wpaper:470 is not listed on IDEAS
    19. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    20. Aretz, Kevin & Bartram, Söhnke M. & Pope, Peter F., 2011. "Asymmetric loss functions and the rationality of expected stock returns," International Journal of Forecasting, Elsevier, vol. 27(2), pages 413-437.
    21. McCracken, Michael W., 2007. "Asymptotics for out of sample tests of Granger causality," Journal of Econometrics, Elsevier, vol. 140(2), pages 719-752, October.

    More about this item

    Keywords

    IMF; Oecd; Asymmetric loss; Macroeconomic forecasting;
    All these keywords.

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • E00 - Macroeconomics and Monetary Economics - - General - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cpr:ceprdp:3821. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://www.cepr.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.