The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys
Qualitative expectational data from business surveys are widely used to construct forecasts. However, based typically on evaluation at the macroeconomic level, doubts persist about the utility of these data. This paper evaluates the ability of the underlying firm-level expectations to anticipate subsequent outcomes. Importantly, this evaluation is not hampered by only having access to qualitative outcome data obtained from subsequent business surveys. Quantitative outcome data are also exploited. This required access to a unique panel dataset which matches firms' responses from the qualitative business survey with the same firms' quantitative replies to a different survey carried out by the national statistical office. Nonparametric tests then reveal an apparent paradox. Despite evidence that the qualitative and quantitative outcome data are related, we find that the expectational data offer rational forecasts of the qualitative but not the quantitative outcomes. We discuss the role of "discretisation" errors and the loss function in explaining this paradox.
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Kauppi, Eija & Lassila, Jukka & Teräsvirta, Timo, 1996. "Short-Term Forecasting of Industrial Production with Business Survey Data: Experience from Finland's Great Depression," Discussion Papers 546, The Research Institute of the Finnish Economy.
- Wheeler, Tracy, 2010. "What can we learn from surveys of business expectations?," Bank of England Quarterly Bulletin, Bank of England, vol. 50(3), pages 190-198.
- McIntosh, James & Schiantarelli, Fabio & Low, William, 1989. "A Qualitative Response Analysis of UK Firms' Employment and Output Decisions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 4(3), pages 251-64, July-Sept.
- Clements, Michael P., 2008.
"Explanations of the inconsistencies in survey respondents'forecasts,"
The Warwick Economics Research Paper Series (TWERPS)
870, University of Warwick, Department of Economics.
- Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
- Easaw, Joshy Z. & Heravi, Saeed M., 2004. "Evaluating consumer sentiments as predictors of UK household consumption behavior: Are they accurate and useful?," International Journal of Forecasting, Elsevier, vol. 20(4), pages 671-681.
- William A. Branch, 2004. "The Theory of Rationally Heterogeneous Expectations: Evidence from Survey Data on Inflation Expectations," Economic Journal, Royal Economic Society, vol. 114(497), pages 592-621, 07.
- Nerlove, Marc, 1983.
"Expectations, Plans, and Realizations in Theory and Practice,"
Econometric Society, vol. 51(5), pages 1251-79, September.
- Marc Nerlove, 1981. "Expectations, Plans and Realizations: In Theory and Practice," Discussion Papers 511, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Ivaldi, Marc, 1992. "Survey Evidence on the Rationality of Expectations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(3), pages 225-41, July-Sept.
- Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-83, November.
- Troy D. Matheson & James Mitchell & Brian Silverstone, 2010. "Nowcasting and predicting data revisions using panel survey data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 313-330.
- Gourieroux, Christian & Pradel, Jacqueline, 1986. "Direct test of the rational expectation hypothesis," European Economic Review, Elsevier, vol. 30(2), pages 265-284, April.
- Claveria, Oscar & Pons, Ernest & Ramos, Raul, 2007. "Business and consumer expectations and macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 47-69.
- Gourieroux, Christian & Monfort, Alain & Renault, Eric & Trognon, Alain, 1987. "Generalised residuals," Journal of Econometrics, Elsevier, vol. 34(1-2), pages 5-32.
- Carl S Bonham & Richard H Cohen, 2000. "Testing the Rational Expectations Hypothesis using Survey Data," Working Papers 200007, University of Hawaii at Manoa, Department of Economics.
- Forni, Mario, et al, 2001.
"Coincident and Leading Indicators for the Euro Area,"
Royal Economic Society, vol. 111(471), pages C62-85, May.
- Lucrezia Reichlin & Mario Forni & Marc Hallin & Marco Lippi, 2001. "Coincident and leading indicators for the Euro area," ULB Institutional Repository 2013/10137, ULB -- Universite Libre de Bruxelles.
- Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-62, April.
- Zellner, Arnold, 1986. "Biased predictors, rationality and the evaluation of forecasts," Economics Letters, Elsevier, vol. 21(1), pages 45-48.
- Klaus Abberger, 2005.
"Qualitative Business Surveys and theAssessment of Employment A Case Study for Germany,"
Ifo Working Paper Series
Ifo Working Paper No. 11, Ifo Institute for Economic Research at the University of Munich.
- Abberger, Klaus, 2007. "Qualitative business surveys and the assessment of employment -- A case study for Germany," International Journal of Forecasting, Elsevier, vol. 23(2), pages 249-258.
- M. Hashem Pesaran & Martin Weale, 2005.
IEPR Working Papers
05.30, Institute of Economic Policy Research (IEPR).
- Lee, Kevin C, 1994. "Formation of Price and Cost Inflation Expectations in British Manufacturing Industries: A Multi-Sectoral Analysis," Economic Journal, Royal Economic Society, vol. 104(423), pages 372-85, March.
- Joseph Engelberg & Charles F. Manski & Jared Williams, 2006.
"Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters,"
NBER Working Papers
11978, National Bureau of Economic Research, Inc.
- Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521632423.
- Carlson, John A & Parkin, J Michael, 1975. "Inflation Expectations," Economica, London School of Economics and Political Science, vol. 42(166), pages 123-38, May.
- Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-35, September.
- Bonham, Carl S & Cohen, Richard H, 2001.
"To Aggregate, Pool, or Neither: Testing the Rational-Expectations Hypothesis Using Survey Data,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 19(3), pages 278-91, July.
- Carl S Bonham & Richard H Cohen, 2000. "To Aggregate, Pool, or Neither: Testing the Rational Expectations Hypothesis Using Survey Data," Working Papers 200003, University of Hawaii at Manoa, Department of Economics.
- Ciaran Driver & Giovanni Urga, 2004. "Transforming Qualitative Survey Data: Performance Comparisons for the UK," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(1), pages 71-89, 02.
- Souleles, Nicholas S, 2004. "Expectations, Heterogeneous Forecast Errors, and Consumption: Micro Evidence from the Michigan Consumer Sentiment Surveys," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 36(1), pages 39-72, February.
- James Mitchell & Richard J. Smith & Martin R. Weale, 2005. "Forecasting Manufacturing Output Growth Using Firm-Level Survey Data," Manchester School, University of Manchester, vol. 73(4), pages 479-499, 07.
- Carroll, Christopher D & Fuhrer, Jeffrey C & Wilcox, David W, 1994.
"Does Consumer Sentiment Forecast Household Spending? If So, Why?,"
American Economic Review,
American Economic Association, vol. 84(5), pages 1397-1408, December.
- Christopher D. Carroll & Jeffery C. Fuhrer & David W. Wilcox, 1994. "RATS code for Does Consumer Sentiment Forecast Household Spending? If So, Why?," QM&RBC Codes 49, Quantitative Macroeconomics & Real Business Cycles.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
- Allan Timmermann & Andrew Patton, 2004.
"Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity,"
wp04-05, Warwick Business School, Finance Group.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
- Brown, Bryan W & Maital, Shlomo, 1981. "What Do Economists Know? An Empirical Study of Experts' Expectations," Econometrica, Econometric Society, vol. 49(2), pages 491-504, March.
- Hansson, Jesper & Jansson, Per & Lof, Marten, 2005. "Business survey data: Do they help in forecasting GDP growth?," International Journal of Forecasting, Elsevier, vol. 21(2), pages 377-389.
- Wallis, Kenneth F, 1980. "Econometric Implications of the Rational Expectations Hypothesis," Econometrica, Econometric Society, vol. 48(1), pages 49-73, January.
- Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:27:y:2011:i:4:p:1128-1146. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei)
If references are entirely missing, you can add them using this form.