The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys
AbstractQualitative expectational data from business surveys are widely used to construct forecasts. However, based typically on evaluation at the macroeconomic level, doubts persist about the utility of these data. This paper evaluates the ability of the underlying firm-level expectations to anticipate subsequent outcomes. Importantly, this evaluation is not hampered by only having access to qualitative outcome data obtained from subsequent business surveys. Quantitative outcome data are also exploited. This required access to a unique panel dataset which matches firms' responses from the qualitative business survey with the same firms' quantitative replies to a different survey carried out by the national statistical office. Nonparametric tests then reveal an apparent paradox. Despite evidence that the qualitative and quantitative outcome data are related, we find that the expectational data offer rational forecasts of the qualitative but not the quantitative outcomes. We discuss the role of "discretisation" errors and the loss function in explaining this paradox.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal International Journal of Forecasting.
Volume (Year): 27 (2011)
Issue (Month): 4 (October)
Contact details of provider:
Web page: http://www.elsevier.com/locate/ijforecast
Expectational data Qualitative business survey data Firm-level comparison Early indicators Matched data set;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Gourieroux, Christian & Pradel, Jacqueline, 1986. "Direct test of the rational expectation hypothesis," European Economic Review, Elsevier, vol. 30(2), pages 265-284, April.
- Zellner, Arnold, 1986. "Biased predictors, rationality and the evaluation of forecasts," Economics Letters, Elsevier, vol. 21(1), pages 45-48.
- Gourieroux, Christian & Monfort, Alain & Renault, Eric & Trognon, Alain, 1987. "Generalised residuals," Journal of Econometrics, Elsevier, vol. 34(1-2), pages 5-32.
- Pesaran, M.H. & Weale, M., 2005.
Cambridge Working Papers in Economics
0536, Faculty of Economics, University of Cambridge.
- M. Hashem Pesaran & Martin Weale, 2005. "Survey Expectations," IEPR Working Papers 05.30, Institute of Economic Policy Research (IEPR).
- Martin Weale, 2005. "Survey Expectations," NIESR Discussion Papers 260, National Institute of Economic and Social Research.
- M. Hashem Pesaran & Martin Weale, 2005. "Survey Expectations," CESifo Working Paper Series 1599, CESifo Group Munich.
- Lucrezia Reichlin & Mario Forni & Marc Hallin & Marco Lippi, 2001.
"Coincident and leading indicators for the Euro area,"
ULB Institutional Repository
2013/10137, ULB -- Universite Libre de Bruxelles.
- Forni, Mario, et al, 2001. "Coincident and Leading Indicators for the Euro Area," Economic Journal, Royal Economic Society, vol. 111(471), pages C62-85, May.
- Claveria, Oscar & Pons, Ernest & Ramos, Raul, 2007. "Business and consumer expectations and macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 47-69.
- Patton, Andrew J. & Timmermann, Allan, 2007.
"Properties of optimal forecasts under asymmetric loss and nonlinearity,"
Journal of Econometrics,
Elsevier, vol. 140(2), pages 884-918, October.
- Allan Timmermann & Andrew Patton, 2004. "Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity," Working Papers wp04-05, Warwick Business School, Finance Group.
- Troy D. Matheson & James Mitchell & Brian Silverstone, 2010. "Nowcasting and predicting data revisions using panel survey data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 313-330.
- Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-35, September.
- Nerlove, Marc, 1983.
"Expectations, Plans, and Realizations in Theory and Practice,"
Econometric Society, vol. 51(5), pages 1251-79, September.
- Marc Nerlove, 1981. "Expectations, Plans and Realizations: In Theory and Practice," Discussion Papers 511, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Ivaldi, Marc, 1992. "Survey Evidence on the Rationality of Expectations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(3), pages 225-41, July-Sept.
- Ciaran Driver & Giovanni Urga, 2004. "Transforming Qualitative Survey Data: Performance Comparisons for the UK," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(1), pages 71-89, 02.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521632423, December.
- Das, J.W.M. & Dominitz, J. & Soest, A.H.O. van, 1997.
"Comparing Predictions and Outcomes: Theory and Application to Income Changes,"
1997-45, Tilburg University, Center for Economic Research.
- Das, J.W.M. & Dominitz, J. & Soest, A.H.O. van, 1998. "Comparing predictions and outcomes: theory and application to income changes," Open Access publications from Tilburg University urn:nbn:nl:ui:12-121742, Tilburg University.
- Brown, Bryan W & Maital, Shlomo, 1981. "What Do Economists Know? An Empirical Study of Experts' Expectations," Econometrica, Econometric Society, vol. 49(2), pages 491-504, March.
- Wheeler, Tracy, 2010. "What can we learn from surveys of business expectations?," Bank of England Quarterly Bulletin, Bank of England, vol. 50(3), pages 190-198.
- Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-83, November.
- Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-62, April.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
- Joseph Engelberg & Charles F. Manski & Jared Williams, 2006.
"Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters,"
NBER Working Papers
11978, National Bureau of Economic Research, Inc.
- Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
- Souleles, Nicholas S, 2004. "Expectations, Heterogeneous Forecast Errors, and Consumption: Micro Evidence from the Michigan Consumer Sentiment Surveys," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 36(1), pages 39-72, February.
- Hansson, Jesper & Jansson, Per & Lof, Marten, 2005. "Business survey data: Do they help in forecasting GDP growth?," International Journal of Forecasting, Elsevier, vol. 21(2), pages 377-389.
- Easaw, Joshy Z. & Heravi, Saeed M., 2004. "Evaluating consumer sentiments as predictors of UK household consumption behavior: Are they accurate and useful?," International Journal of Forecasting, Elsevier, vol. 20(4), pages 671-681.
- Klaus Abberger, 2005.
"Qualitative Business Surveys and theAssessment of Employment A Case Study for Germany,"
Ifo Working Paper Series
Ifo Working Paper No. 11, Ifo Institute for Economic Research at the University of Munich.
- Abberger, Klaus, 2007. "Qualitative business surveys and the assessment of employment -- A case study for Germany," International Journal of Forecasting, Elsevier, vol. 23(2), pages 249-258.
- William A. Branch, 2004. "The Theory of Rationally Heterogeneous Expectations: Evidence from Survey Data on Inflation Expectations," Economic Journal, Royal Economic Society, vol. 114(497), pages 592-621, 07.
- Carlson, John A & Parkin, J Michael, 1975. "Inflation Expectations," Economica, London School of Economics and Political Science, vol. 42(166), pages 123-38, May.
- McIntosh, James & Schiantarelli, Fabio & Low, William, 1989. "A Qualitative Response Analysis of UK Firms' Employment and Output Decisions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 4(3), pages 251-64, July-Sept.
- Lee, Kevin C, 1994. "Formation of Price and Cost Inflation Expectations in British Manufacturing Industries: A Multi-Sectoral Analysis," Economic Journal, Royal Economic Society, vol. 104(423), pages 372-85, March.
- Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
- James Mitchell & Richard J. Smith & Martin R. Weale, 2005. "Forecasting Manufacturing Output Growth Using Firm-Level Survey Data," Manchester School, University of Manchester, vol. 73(4), pages 479-499, 07.
- Carroll, Christopher D & Fuhrer, Jeffrey C & Wilcox, David W, 1994.
"Does Consumer Sentiment Forecast Household Spending? If So, Why?,"
American Economic Review,
American Economic Association, vol. 84(5), pages 1397-1408, December.
- Christopher D. Carroll & Jeffery C. Fuhrer & David W. Wilcox, 1994. "RATS code for Does Consumer Sentiment Forecast Household Spending? If So, Why?," QM&RBC Codes 49, Quantitative Macroeconomics & Real Business Cycles.
- Wallis, Kenneth F, 1980. "Econometric Implications of the Rational Expectations Hypothesis," Econometrica, Econometric Society, vol. 48(1), pages 49-73, January.
- Puah, Chin-Hong & Wong, Shirly Siew-Ling & Habibullah, Muzafar Shah, 2012. "Rationality of business operational forecasts: evidence from Malaysian distributive trade sector," MPRA Paper 37599, University Library of Munich, Germany.
- Breitung, Jörg & Schmeling, Maik, 2013.
"Quantifying survey expectations: What’s wrong with the probability approach?,"
International Journal of Forecasting,
Elsevier, vol. 29(1), pages 142-154.
- Breitung, Jörg & Schmeling, Maik, 2011. "Quantifying survey expectations: What's wrong with the probability approach?," Diskussionspapiere der Wirtschaftswissenschaftlichen FakultÃ¤t der Leibniz UniversitÃ¤t Hannover dp-485, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
- Kajal Lahiri & Yongchen Zhao, 2013. "Quantifying Heterogeneous Survey Expectations: The Carlson-Parkin Method Revisited," Discussion Papers 13-08, University at Albany, SUNY, Department of Economics.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If references are entirely missing, you can add them using this form.