The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys
Qualitative expectational data from business surveys are widely used to construct forecasts. However, based typically on evaluation at the macroeconomic level, doubts persist about the utility of these data. This paper evaluates the ability of the underlying firm-level expectations to anticipate subsequent outcomes. Importantly, this evaluation is not hampered by only having access to qualitative outcome data obtained from subsequent business surveys. Quantitative outcome data are also exploited. This required access to a unique panel dataset which matches firms' responses from the qualitative business survey with the same firms' quantitative replies to a different survey carried out by the national statistical office. Nonparametric tests then reveal an apparent paradox. Despite evidence that the qualitative and quantitative outcome data are related, we find that the expectational data offer rational forecasts of the qualitative but not the quantitative outcomes. We discuss the role of "discretisation" errors and the loss function in explaining this paradox.
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Lee, Kevin C, 1994. "Formation of Price and Cost Inflation Expectations in British Manufacturing Industries: A Multi-Sectoral Analysis," Economic Journal, Royal Economic Society, vol. 104(423), pages 372-85, March.
- Ciaran Driver & Giovanni Urga, 2004. "Transforming Qualitative Survey Data: Performance Comparisons for the UK," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(1), pages 71-89, 02.
- Patton, Andrew J. & Timmermann, Allan, 2007.
"Properties of optimal forecasts under asymmetric loss and nonlinearity,"
Journal of Econometrics,
Elsevier, vol. 140(2), pages 884-918, October.
- Allan Timmermann & Andrew Patton, 2004. "Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity," Working Papers wp04-05, Warwick Business School, Finance Group.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521632423, June.
- Forni, Mario, et al, 2001.
"Coincident and Leading Indicators for the Euro Area,"
Royal Economic Society, vol. 111(471), pages C62-85, May.
- Lucrezia Reichlin & Mario Forni & Marc Hallin & Marco Lippi, 2001. "Coincident and leading indicators for the Euro area," ULB Institutional Repository 2013/10137, ULB -- Universite Libre de Bruxelles.
- M. Hashem Pesaran & Martin Weale, 2005.
IEPR Working Papers
05.30, Institute of Economic Policy Research (IEPR).
- Kauppi, Eija & Lassila, Jukka & Teräsvirta, Timo, 1996. "Short-Term Forecasting of Industrial Production with Business Survey Data: Experience from Finland's Great Depression," Discussion Papers 546, The Research Institute of the Finnish Economy.
- Wheeler, Tracy, 2010. "What can we learn from surveys of business expectations?," Bank of England Quarterly Bulletin, Bank of England, vol. 50(3), pages 190-198.
- Carl S Bonham & Richard H Cohen, 2000.
"To Aggregate, Pool, or Neither: Testing the Rational Expectations Hypothesis Using Survey Data,"
200003, University of Hawaii at Manoa, Department of Economics.
- Bonham, Carl S & Cohen, Richard H, 2001. "To Aggregate, Pool, or Neither: Testing the Rational-Expectations Hypothesis Using Survey Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(3), pages 278-91, July.
- Joseph Engelberg & Charles F. Manski & Jared Williams, 2006.
"Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters,"
NBER Working Papers
11978, National Bureau of Economic Research, Inc.
- Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
- Carl S Bonham & Richard H Cohen, 2000. "Testing the Rational Expectations Hypothesis using Survey Data," Working Papers 200007, University of Hawaii at Manoa, Department of Economics.
- Ivaldi, Marc, 1992. "Survey Evidence on the Rationality of Expectations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(3), pages 225-41, July-Sept.
- William A. Branch, 2004. "The Theory of Rationally Heterogeneous Expectations: Evidence from Survey Data on Inflation Expectations," Economic Journal, Royal Economic Society, vol. 114(497), pages 592-621, 07.
- Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-62, April.
- Hansson, Jesper & Jansson, Per & Lof, Marten, 2005. "Business survey data: Do they help in forecasting GDP growth?," International Journal of Forecasting, Elsevier, vol. 21(2), pages 377-389.
- Carroll, Christopher D & Fuhrer, Jeffrey C & Wilcox, David W, 1994.
"Does Consumer Sentiment Forecast Household Spending? If So, Why?,"
American Economic Review,
American Economic Association, vol. 84(5), pages 1397-1408, December.
- Christopher D. Carroll & Jeffery C. Fuhrer & David W. Wilcox, 1994. "RATS code for Does Consumer Sentiment Forecast Household Spending? If So, Why?," QM&RBC Codes 49, Quantitative Macroeconomics & Real Business Cycles.
- Souleles, Nicholas S, 2004. "Expectations, Heterogeneous Forecast Errors, and Consumption: Micro Evidence from the Michigan Consumer Sentiment Surveys," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 36(1), pages 39-72, February.
- Abberger, Klaus, 2007.
"Qualitative business surveys and the assessment of employment -- A case study for Germany,"
International Journal of Forecasting,
Elsevier, vol. 23(2), pages 249-258.
- Klaus Abberger, 2005. "Qualitative Business Surveys and theAssessment of Employment A Case Study for Germany," Ifo Working Paper Series Ifo Working Paper No. 11, Ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
- Nerlove, Marc, 1983.
"Expectations, Plans, and Realizations in Theory and Practice,"
Econometric Society, vol. 51(5), pages 1251-79, September.
- Marc Nerlove, 1981. "Expectations, Plans and Realizations: In Theory and Practice," Discussion Papers 511, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Wallis, Kenneth F, 1980. "Econometric Implications of the Rational Expectations Hypothesis," Econometrica, Econometric Society, vol. 48(1), pages 49-73, January.
- Easaw, Joshy Z. & Heravi, Saeed M., 2004. "Evaluating consumer sentiments as predictors of UK household consumption behavior: Are they accurate and useful?," International Journal of Forecasting, Elsevier, vol. 20(4), pages 671-681.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
- Clements, Michael P., 2008.
"Explanations of the inconsistencies in survey respondents'forecasts,"
The Warwick Economics Research Paper Series (TWERPS)
870, University of Warwick, Department of Economics.
- Clements, Michael P., 2010. "Explanations of the inconsistencies in survey respondents' forecasts," European Economic Review, Elsevier, vol. 54(4), pages 536-549, May.
- Claveria, Oscar & Pons, Ernest & Ramos, Raul, 2007. "Business and consumer expectations and macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 47-69.
- Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-35, September.
- Gourieroux, Christian & Monfort, Alain & Renault, Eric & Trognon, Alain, 1987. "Generalised residuals," Journal of Econometrics, Elsevier, vol. 34(1-2), pages 5-32.
- Kauppi, Eija & Lassila, Jukka & Terasvirta, Timo, 1996. "Short-term forecasting of industrial production with business survey data: experience from Finland's great depression 1990-1993," International Journal of Forecasting, Elsevier, vol. 12(3), pages 373-381, September.
- Troy D. Matheson & James Mitchell & Brian Silverstone, 2010. "Nowcasting and predicting data revisions using panel survey data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 313-330.
- Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-83, November.
- Gourieroux, Christian & Pradel, Jacqueline, 1986. "Direct test of the rational expectation hypothesis," European Economic Review, Elsevier, vol. 30(2), pages 265-284, April.
- McIntosh, James & Schiantarelli, Fabio & Low, William, 1989. "A Qualitative Response Analysis of UK Firms' Employment and Output Decisions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 4(3), pages 251-64, July-Sept.
- James Mitchell & Richard J. Smith & Martin R. Weale, 2005. "Forecasting Manufacturing Output Growth Using Firm-Level Survey Data," Manchester School, University of Manchester, vol. 73(4), pages 479-499, 07.
- Brown, Bryan W & Maital, Shlomo, 1981. "What Do Economists Know? An Empirical Study of Experts' Expectations," Econometrica, Econometric Society, vol. 49(2), pages 491-504, March.
- Carlson, John A & Parkin, J Michael, 1975. "Inflation Expectations," Economica, London School of Economics and Political Science, vol. 42(166), pages 123-38, May.
- Zellner, Arnold, 1986. "Biased predictors, rationality and the evaluation of forecasts," Economics Letters, Elsevier, vol. 21(1), pages 45-48.
- Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:27:y:2011:i:4:p:1128-1146. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei)
If references are entirely missing, you can add them using this form.