The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys
AbstractQualitative expectational data from business surveys are widely used to construct forecasts. However, based typically on evaluation at the macroeconomic level, doubts persist about the utility of these data. This paper evaluates the ability of the underlying firm-level expectations to anticipate subsequent outcomes. Importantly, this evaluation is not hampered by only having access to qualitative outcome data obtained from subsequent business surveys. Quantitative outcome data are also exploited. This required access to a unique panel dataset which matches firms' responses from the qualitative business survey with the same firms' quantitative replies to a different survey carried out by the national statistical office. Nonparametric tests then reveal an apparent paradox. Despite evidence that the qualitative and quantitative outcome data are related, we find that the expectational data offer rational forecasts of the qualitative but not the quantitative outcomes. We discuss the role of "discretisation" errors and the loss function in explaining this paradox.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal International Journal of Forecasting.
Volume (Year): 27 (2011)
Issue (Month): 4 (October)
Contact details of provider:
Web page: http://www.elsevier.com/locate/ijforecast
Expectational data Qualitative business survey data Firm-level comparison Early indicators Matched data set;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Wheeler, Tracy, 2010. "What can we learn from surveys of business expectations?," Bank of England Quarterly Bulletin, Bank of England, vol. 50(3), pages 190-198.
- Allan Timmermann & Andrew Patton, 2004.
"Properties of Optimal Forecasts under Asymmetric Loss and Nonlinearity,"
wp04-05, Warwick Business School, Finance Group.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
- Wallis, Kenneth F, 1980. "Econometric Implications of the Rational Expectations Hypothesis," Econometrica, Econometric Society, vol. 48(1), pages 49-73, January.
- Forni, Mario, et al, 2001.
"Coincident and Leading Indicators for the Euro Area,"
Royal Economic Society, vol. 111(471), pages C62-85, May.
- Lucrezia Reichlin & Mario Forni & Marc Hallin & Marco Lippi, 2001. "Coincident and leading indicators for the Euro area," ULB Institutional Repository 2013/10137, ULB -- Universite Libre de Bruxelles.
- Klaus Abberger, 2005.
"Qualitative Business Surveys and theAssessment of Employment A Case Study for Germany,"
Ifo Working Paper Series
Ifo Working Paper No. 11, Ifo Institute for Economic Research at the University of Munich.
- Abberger, Klaus, 2007. "Qualitative business surveys and the assessment of employment -- A case study for Germany," International Journal of Forecasting, Elsevier, vol. 23(2), pages 249-258.
- Pesaran, M. Hashem & Weale, Martin, 2006.
Handbook of Economic Forecasting,
- Martin Weale, 2005. "Survey Expectations," NIESR Discussion Papers 260, National Institute of Economic and Social Research.
- Pesaran, M.H. & Weale, M., 2005. "Survey Expectations," Cambridge Working Papers in Economics 0536, Faculty of Economics, University of Cambridge.
- M. Hashem Pesaran & Martin Weale, 2005. "Survey Expectations," IEPR Working Papers 05.30, Institute of Economic Policy Research (IEPR).
- M. Hashem Pesaran & Martin Weale, 2005. "Survey Expectations," CESifo Working Paper Series 1599, CESifo Group Munich.
- Ivaldi, Marc, 1992. "Survey Evidence on the Rationality of Expectations," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 7(3), pages 225-41, July-Sept.
- Ciaran Driver & Giovanni Urga, 2004. "Transforming Qualitative Survey Data: Performance Comparisons for the UK," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(1), pages 71-89, 02.
- Das, J.W.M. & Dominitz, J. & Soest, A.H.O. van, 1997.
"Comparing Predictions and Outcomes: Theory and Application to Income Changes,"
1997-45, Tilburg University, Center for Economic Research.
- Das, J.W.M. & Dominitz, J. & Soest, A.H.O. van, 1998. "Comparing predictions and outcomes: theory and application to income changes," Open Access publications from Tilburg University urn:nbn:nl:ui:12-121742, Tilburg University.
- Clements,Michael & Hendry,David, 1998.
"Forecasting Economic Time Series,"
Cambridge University Press, number 9780521634809, December.
- Nerlove, Marc, 1983.
"Expectations, Plans, and Realizations in Theory and Practice,"
Econometric Society, vol. 51(5), pages 1251-79, September.
- Marc Nerlove, 1981. "Expectations, Plans and Realizations: In Theory and Practice," Discussion Papers 511, Northwestern University, Center for Mathematical Studies in Economics and Management Science.
- Brown, Bryan W & Maital, Shlomo, 1981. "What Do Economists Know? An Empirical Study of Experts' Expectations," Econometrica, Econometric Society, vol. 49(2), pages 491-504, March.
- Lee, Kevin C, 1994. "Formation of Price and Cost Inflation Expectations in British Manufacturing Industries: A Multi-Sectoral Analysis," Economic Journal, Royal Economic Society, vol. 104(423), pages 372-85, March.
- McIntosh, James & Schiantarelli, Fabio & Low, William, 1989. "A Qualitative Response Analysis of UK Firms' Employment and Output Decisions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 4(3), pages 251-64, July-Sept.
- Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009.
"Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 27, pages 30-41.
- Joseph Engelberg & Charles F. Manski & Jared Williams, 2006. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," NBER Working Papers 11978, National Bureau of Economic Research, Inc.
- Keane, Michael P & Runkle, David E, 1990. "Testing the Rationality of Price Forecasts: New Evidence from Panel Data," American Economic Review, American Economic Association, vol. 80(4), pages 714-35, September.
- Zellner, Arnold, 1986. "Biased predictors, rationality and the evaluation of forecasts," Economics Letters, Elsevier, vol. 21(1), pages 45-48.
- William A. Branch, 2004. "The Theory of Rationally Heterogeneous Expectations: Evidence from Survey Data on Inflation Expectations," Economic Journal, Royal Economic Society, vol. 114(497), pages 592-621, 07.
- Souleles, Nicholas S, 2004. "Expectations, Heterogeneous Forecast Errors, and Consumption: Micro Evidence from the Michigan Consumer Sentiment Surveys," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 36(1), pages 39-72, February.
- Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
- Easaw, Joshy Z. & Heravi, Saeed M., 2004. "Evaluating consumer sentiments as predictors of UK household consumption behavior: Are they accurate and useful?," International Journal of Forecasting, Elsevier, vol. 20(4), pages 671-681.
- Carroll, Christopher D & Fuhrer, Jeffrey C & Wilcox, David W, 1994.
"Does Consumer Sentiment Forecast Household Spending? If So, Why?,"
American Economic Review,
American Economic Association, vol. 84(5), pages 1397-1408, December.
- Christopher D. Carroll & Jeffery C. Fuhrer & David W. Wilcox, 1994. "RATS code for Does Consumer Sentiment Forecast Household Spending? If So, Why?," QM&RBC Codes 49, Quantitative Macroeconomics & Real Business Cycles.
- Gourieroux, Christian & Pradel, Jacqueline, 1986. "Direct test of the rational expectation hypothesis," European Economic Review, Elsevier, vol. 30(2), pages 265-284, April.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
- Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-83, November.
- Troy D. Matheson & James Mitchell & Brian Silverstone, 2010. "Nowcasting and predicting data revisions using panel survey data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 313-330.
- Gourieroux, Christian & Monfort, Alain & Renault, Eric & Trognon, Alain, 1987. "Generalised residuals," Journal of Econometrics, Elsevier, vol. 34(1-2), pages 5-32.
- Hansson, Jesper & Jansson, Per & Lof, Marten, 2005. "Business survey data: Do they help in forecasting GDP growth?," International Journal of Forecasting, Elsevier, vol. 21(2), pages 377-389.
- Carlson, John A & Parkin, J Michael, 1975. "Inflation Expectations," Economica, London School of Economics and Political Science, vol. 42(166), pages 123-38, May.
- James Mitchell & Richard J. Smith & Martin R. Weale, 2005. "Forecasting Manufacturing Output Growth Using Firm-Level Survey Data," Manchester School, University of Manchester, vol. 73(4), pages 479-499, 07.
- Claveria, Oscar & Pons, Ernest & Ramos, Raul, 2007. "Business and consumer expectations and macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 47-69.
- Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-62, April.
- Breitung, Jörg & Schmeling, Maik, 2013.
"Quantifying survey expectations: What’s wrong with the probability approach?,"
International Journal of Forecasting,
Elsevier, vol. 29(1), pages 142-154.
- Breitung, Jörg & Schmeling, Maik, 2011. "Quantifying survey expectations: What's wrong with the probability approach?," Diskussionspapiere der Wirtschaftswissenschaftlichen FakultÃ¤t der Leibniz UniversitÃ¤t Hannover dp-485, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
- Kajal Lahiri & Yongchen Zhao, 2013. "Quantifying Heterogeneous Survey Expectations: The Carlson-Parkin Method Revisited," Discussion Papers 13-08, University at Albany, SUNY, Department of Economics.
- Martinsen, Kjetil & Ravazzolo, Francesco & Wulfsberg, Fredrik, 2014.
"Forecasting macroeconomic variables using disaggregate survey data,"
International Journal of Forecasting,
Elsevier, vol. 30(1), pages 65-77.
- Kjetil Martinsen & Francesco Ravazzolo & Fredrik Wulfsberg, 2011. "Forecasting macroeconomic variables using disaggregate survey data," Working Paper 2011/04, Norges Bank.
- Puah, Chin-Hong & Wong, Shirly Siew-Ling & Habibullah, Muzafar Shah, 2012. "Rationality of business operational forecasts: evidence from Malaysian distributive trade sector," MPRA Paper 37599, University Library of Munich, Germany.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.