The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys
Qualitative expectational data from business surveys are widely used to construct forecasts. However, based typically on evaluation at the macroeconomic level, doubts persist about the utility of these data. This paper evaluates the ability of the underlying firm-level expectations to anticipate subsequent outcomes. Importantly, this evaluation is not hampered by only having access to qualitative outcome data obtained from subsequent business surveys. Quantitative outcome data are also exploited. This required access to a unique panel dataset which matches firms' responses from the qualitative business survey with the same firms' quantitative replies to a different survey carried out by the national statistical office. Nonparametric tests then reveal an apparent paradox. Despite evidence that the qualitative and quantitative outcome data are related, we find that the expectational data offer rational forecasts of the qualitative but not the quantitative outcomes. We discuss the role of "discretisation" errors and the loss function in explaining this paradox.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Lee, Kevin C, 1994. "Formation of Price and Cost Inflation Expectations in British Manufacturing Industries: A Multi-Sectoral Analysis," Economic Journal, Royal Economic Society, vol. 104(423), pages 372-85, March.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521634809, December.
- McIntosh, James & Schiantarelli, Fabio & Low, William, 1989. "A Qualitative Response Analysis of UK Firms' Employment and Output Decisions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 4(3), pages 251-64, July-Sept.
- Brown, Bryan W & Maital, Shlomo, 1981. "What Do Economists Know? An Empirical Study of Experts' Expectations," Econometrica, Econometric Society, vol. 49(2), pages 491-504, March.
- Hansson, Jesper & Jansson, Per & Lof, Marten, 2005. "Business survey data: Do they help in forecasting GDP growth?," International Journal of Forecasting, Elsevier, vol. 21(2), pages 377-389.
- Wallis, Kenneth F, 1980. "Econometric Implications of the Rational Expectations Hypothesis," Econometrica, Econometric Society, vol. 48(1), pages 49-73, January.
- Abberger, Klaus, 2007.
"Qualitative business surveys and the assessment of employment -- A case study for Germany,"
International Journal of Forecasting,
Elsevier, vol. 23(2), pages 249-258.
- Klaus Abberger, 2005. "Qualitative Business Surveys and theAssessment of Employment A Case Study for Germany," Ifo Working Paper Series Ifo Working Paper No. 11, Ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
- Ivaldi, Marc, 1992. "Survey Evidence on the Rationality of Expectations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(3), pages 225-41, July-Sept.
- Pesaran, M.H. & Weale, M., 2005.
Cambridge Working Papers in Economics
0536, Faculty of Economics, University of Cambridge.
- Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-35, September.
- Kauppi, Eija & Lassila, Jukka & Teräsvirta, Timo, 1996. "Short-Term Forecasting of Industrial Production with Business Survey Data: Experience from Finland's Great Depression," Discussion Papers 546, The Research Institute of the Finnish Economy.
- William A. Branch, 2004. "The Theory of Rationally Heterogeneous Expectations: Evidence from Survey Data on Inflation Expectations," Economic Journal, Royal Economic Society, vol. 114(497), pages 592-621, 07.
- Nerlove, Marc, 1983.
"Expectations, Plans, and Realizations in Theory and Practice,"
Econometric Society, vol. 51(5), pages 1251-79, September.
- Marc Nerlove, 1981. "Expectations, Plans and Realizations: In Theory and Practice," Discussion Papers 511, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Carroll, Christopher D & Fuhrer, Jeffrey C & Wilcox, David W, 1994.
"Does Consumer Sentiment Forecast Household Spending? If So, Why?,"
American Economic Review,
American Economic Association, vol. 84(5), pages 1397-1408, December.
- Christopher D. Carroll & Jeffery C. Fuhrer & David W. Wilcox, 1994. "RATS code for Does Consumer Sentiment Forecast Household Spending? If So, Why?," QM&RBC Codes 49, Quantitative Macroeconomics & Real Business Cycles.
- Lucrezia Reichlin & Mario Forni & Marc Hallin & Marco Lippi, 2001.
"Coincident and leading indicators for the Euro area,"
ULB Institutional Repository
2013/10137, ULB -- Universite Libre de Bruxelles.
- Forni, Mario, et al, 2001. "Coincident and Leading Indicators for the Euro Area," Economic Journal, Royal Economic Society, vol. 111(471), pages C62-85, May.
- Gourieroux, Christian & Monfort, Alain & Renault, Eric & Trognon, Alain, 1987. "Generalised residuals," Journal of Econometrics, Elsevier, vol. 34(1-2), pages 5-32.
- Carlson, John A & Parkin, J Michael, 1975. "Inflation Expectations," Economica, London School of Economics and Political Science, vol. 42(166), pages 123-38, May.
- Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-83, November.
- Gourieroux, Christian & Pradel, Jacqueline, 1986. "Direct test of the rational expectation hypothesis," European Economic Review, Elsevier, vol. 30(2), pages 265-284, April.
- Zellner, Arnold, 1986. "Biased predictors, rationality and the evaluation of forecasts," Economics Letters, Elsevier, vol. 21(1), pages 45-48.
- Troy D. Matheson & James Mitchell & Brian Silverstone, 2010. "Nowcasting and predicting data revisions using panel survey data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 313-330.
- Carl S Bonham & Richard H Cohen, 2000. "Testing the Rational Expectations Hypothesis using Survey Data," Working Papers 200007, University of Hawaii at Manoa, Department of Economics.
- Easaw, Joshy Z. & Heravi, Saeed M., 2004. "Evaluating consumer sentiments as predictors of UK household consumption behavior: Are they accurate and useful?," International Journal of Forecasting, Elsevier, vol. 20(4), pages 671-681.
- Kauppi, Eija & Lassila, Jukka & Terasvirta, Timo, 1996. "Short-term forecasting of industrial production with business survey data: experience from Finland's great depression 1990-1993," International Journal of Forecasting, Elsevier, vol. 12(3), pages 373-381, September.
- Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-62, April.
- Carl S Bonham & Richard H Cohen, 2000.
"To Aggregate, Pool, or Neither: Testing the Rational Expectations Hypothesis Using Survey Data,"
200003, University of Hawaii at Manoa, Department of Economics.
- Bonham, Carl S & Cohen, Richard H, 2001. "To Aggregate, Pool, or Neither: Testing the Rational-Expectations Hypothesis Using Survey Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(3), pages 278-91, July.
- Clements, Michael P., 2010.
"Explanations of the inconsistencies in survey respondents' forecasts,"
European Economic Review,
Elsevier, vol. 54(4), pages 536-549, May.
- Clements, Michael P., 2008. "Explanations of the inconsistencies in survey respondents'forecasts," The Warwick Economics Research Paper Series (TWERPS) 870, University of Warwick, Department of Economics.
- James Mitchell & Richard J. Smith & Martin R. Weale, 2005. "Forecasting Manufacturing Output Growth Using Firm-Level Survey Data," Manchester School, University of Manchester, vol. 73(4), pages 479-499, 07.
- Souleles, Nicholas S, 2004. "Expectations, Heterogeneous Forecast Errors, and Consumption: Micro Evidence from the Michigan Consumer Sentiment Surveys," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 36(1), pages 39-72, February.
- Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009.
"Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 27, pages 30-41.
- Joseph Engelberg & Charles F. Manski & Jared Williams, 2006. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," NBER Working Papers 11978, National Bureau of Economic Research, Inc.
- Ciaran Driver & Giovanni Urga, 2004. "Transforming Qualitative Survey Data: Performance Comparisons for the UK," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(1), pages 71-89, 02.
- Allan Timmermann & Andrew Patton, 2004.
"Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity,"
wp04-05, Warwick Business School, Finance Group.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
- Claveria, Oscar & Pons, Ernest & Ramos, Raul, 2007. "Business and consumer expectations and macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 47-69.
- Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
- Wheeler, Tracy, 2010. "What can we learn from surveys of business expectations?," Bank of England Quarterly Bulletin, Bank of England, vol. 50(3), pages 190-198.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:27:y:2011:i:4:p:1128-1146. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Shamier, Wendy)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.