IDEAS home Printed from https://ideas.repec.org/p/nzb/nzbdps/2007-02.html
   My bibliography  Save this paper

Nowcasting and predicting data revisions in real time using qualitative panel survey data

Author

Listed:

Abstract

The qualitative responses that firms give to business survey questions regarding changes in their own output provide a real-time signal of official output changes. The most commonly-used method to produce an aggregate quantitative indicator from business survey responses - the net balance, or diffusion index - has changed little in 40 years. It focuses on the proportion of survey respondents replying "up", "the same" or "down". This paper investigates whether an improved real-time signal of official output data changes can be derived from a recently advanced method on the aggregation of survey data from panel responses. It also considers the ability of survey data to anticipate revisions to official output data. We find, in a New Zealand application, that exploiting the panel dimension to qualitative survey data gives a better in-sample signal about official data than traditional methods. This is achieved by giving a higher weight to firms whose answers have a close link to official data than to those whose experiences correspond only weakly or not at all. Out-of-sample, it is less clear it matters how survey data are quantified with simpler and more parsimonious methods hard to improve. It is clear, nevertheless, that survey data, exploited in some form, help to explain revisions to official data.

Suggested Citation

  • Troy Matheson & James Mitchell & Brian Silverstone, 2007. "Nowcasting and predicting data revisions in real time using qualitative panel survey data," Reserve Bank of New Zealand Discussion Paper Series DP2007/02, Reserve Bank of New Zealand.
  • Handle: RePEc:nzb:nzbdps:2007/02
    as

    Download full text from publisher

    File URL: http://www.rbnz.govt.nz/-/media/ReserveBank/Files/Publications/Discussion%20papers/2007/dp07-02.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Smith, Jeremy & McAleer, Michael, 1995. "Alternative Procedures for Converting Qualitative Response Data to Quantitative Expectations: An Application to Australian Manufacturing," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(2), pages 165-185, April-Jun.
    2. Pesaran, M. Hashem & Weale, Martin, 2006. "Survey Expectations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 14, pages 715-776, Elsevier.
    3. Clements,Michael & Hendry,David, 1998. "Forecasting Economic Time Series," Cambridge Books, Cambridge University Press, number 9780521634809.
    4. Dr Martin Weale & Dr. James Mitchell, 2002. "Aggregate versus Disaggregate Survey-Based Indicators of Economic Activity (revised January 2005)," National Institute of Economic and Social Research (NIESR) Discussion Papers 194, National Institute of Economic and Social Research.
    5. Ciaran Driver & Giovanni Urga, 2004. "Transforming Qualitative Survey Data: Performance Comparisons for the UK," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 66(1), pages 71-89, February.
    6. Faust, Jon & Rogers, John H & Wright, Jonathan H, 2005. "News and Noise in G-7 GDP Announcements," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 403-419, June.
    7. Graham Elliott & Allan Timmermann, 2016. "Economic Forecasting," Economics Books, Princeton University Press, edition 1, number 10740.
    8. Carlson, John A & Parkin, J Michael, 1975. "Inflation Expectations," Economica, London School of Economics and Political Science, vol. 42(166), pages 123-138, May.
    9. James Mitchell & Richard J. Smith & Martin R. Weale, 2005. "Forecasting Manufacturing Output Growth Using Firm‐Level Survey Data," Manchester School, University of Manchester, vol. 73(4), pages 479-499, July.
    10. Michela Nardo, 2003. "The Quantification of Qualitative Survey Data: A Critical Assessment," Journal of Economic Surveys, Wiley Blackwell, vol. 17(5), pages 645-668, December.
    11. Begg,Iain & Henry,Brian, 1998. "Applied Economics and Public Policy," Cambridge Books, Cambridge University Press, number 9780521624145.
    12. Cath Sleeman, 2006. "Analysis of revisions to quarterly GDP - a real-time database," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 69, pages 1-44., March.
    13. Tom Stark, 2002. "A summary of the conference on real-time data analysis," Business Review, Federal Reserve Bank of Philadelphia, issue Q 1, pages 5-11.
    14. Dr Martin Weale & Dr. James Mitchell, 2006. "A Bayesian Indicator of Manufacturing Output from Qualitative Business Panel Survey Data," National Institute of Economic and Social Research (NIESR) Discussion Papers 261, National Institute of Economic and Social Research.
    15. Michel De Vroey & Pierre Malgrange, 2016. "Macroeconomics," Chapters, in: Gilbert Faccarello & Heinz D. Kurz (ed.), Handbook on the History of Economic Analysis Volume III, chapter 27, pages 372-390, Edward Elgar Publishing.
    16. Dr Martin Weale & Dr. James Mitchell, 2006. "A Bayesian Indicator of Manufacturing Output from Qualitative Business Panel Survey Data," National Institute of Economic and Social Research (NIESR) Discussion Papers 261, National Institute of Economic and Social Research.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kirdan Lees, 2009. "Overview of a recent Reserve Bank workshop: nowcasting with model combination," Reserve Bank of New Zealand Bulletin, Reserve Bank of New Zealand, vol. 72, pages 31-33, March.
    2. Bhattacharya, Rudrani & Pandey, Radhika & Veronese, Giovanni, 2011. "Tracking India Growth in Real Time," Working Papers 11/90, National Institute of Public Finance and Policy.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Troy D. Matheson & James Mitchell & Brian Silverstone, 2010. "Nowcasting and predicting data revisions using panel survey data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 313-330.
    2. Olivier Biau & Hélène Erkel-Rousse & Nicolas Ferrari, 2006. "Réponses individuelles aux enquêtes de conjoncture et prévision de la production manufacturière," Économie et Statistique, Programme National Persée, vol. 395(1), pages 91-116.
    3. Silvia Lui & James Mitchell & Martin Weale, 2011. "Qualitative business surveys: signal or noise?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 327-348, April.
    4. Oscar Claveria & Enric Monte & Salvador Torra, 2018. "Tracking economic growth by evolving expectations via genetic programming: A two-step approach," Working Papers XREAP2018-4, Xarxa de Referència en Economia Aplicada (XREAP), revised Oct 2018.
    5. Oscar Claveria & Enric Monte & Salvador Torra, 2018. "A Data-Driven Approach to Construct Survey-Based Indicators by Means of Evolutionary Algorithms," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(1), pages 1-14, January.
    6. Oscar Claveria & Enric Monte & Salvador Torra, 2019. "Evolutionary Computation for Macroeconomic Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 833-849, February.
    7. Oscar Claveria & Enric Monte & Salvador Torra, 2017. "A new approach for the quantification of qualitative measures of economic expectations," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(6), pages 2685-2706, November.
    8. Lui, Silvia & Mitchell, James & Weale, Martin, 2011. "The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1128-1146, October.
    9. Lahiri, Kajal & Zhao, Yongchen, 2015. "Quantifying survey expectations: A critical review and generalization of the Carlson–Parkin method," International Journal of Forecasting, Elsevier, vol. 31(1), pages 51-62.
    10. Kajal Lahiri & Yongchen Zhao, 2013. "Quantifying Heterogeneous Survey Expectations: The Carlson-Parkin Method Revisited," Discussion Papers 13-08, University at Albany, SUNY, Department of Economics.
    11. James Mitchell & Richard J. Smith & Martin R. Weale, 2013. "Efficient Aggregation Of Panel Qualitative Survey Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(4), pages 580-603, June.
    12. Breitung, Jörg & Schmeling, Maik, 2013. "Quantifying survey expectations: What’s wrong with the probability approach?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 142-154.
    13. David Bywaters & Gareth Thomas, 2008. "Output Expectations and Forecasting of UK Manufacturing," Atlantic Economic Journal, Springer;International Atlantic Economic Society, vol. 36(2), pages 125-137, June.
    14. François Hild, 2006. "Un nouvel indicateur synthétique prenant en compte la dynamique des réponses individuelles à l'enquête Industrie," Économie et Statistique, Programme National Persée, vol. 395(1), pages 65-89.
    15. Francisco Dias & Cláudia Duarte & António Rua, 2010. "Inflation expectations in the euro area: are consumers rational?," Review of World Economics (Weltwirtschaftliches Archiv), Springer;Institut für Weltwirtschaft (Kiel Institute for the World Economy), vol. 146(3), pages 591-607, September.
    16. Maurizio Bovi, 2016. "The tale of two expectations," Quality & Quantity: International Journal of Methodology, Springer, vol. 50(6), pages 2677-2705, November.
    17. Dr Martin Weale & Dr. James Mitchell, 2006. "A Bayesian Indicator of Manufacturing Output from Qualitative Business Panel Survey Data," National Institute of Economic and Social Research (NIESR) Discussion Papers 261, National Institute of Economic and Social Research.
    18. Oscar Claveria & Enric Monte & Salvador Torra, 2017. "Let the data do the talking: Empirical modelling of survey-based expectations by means of genetic programming," IREA Working Papers 201711, University of Barcelona, Research Institute of Applied Economics, revised May 2017.
    19. James Mitchell & Richard J. Smith & Martin R. Weale, 2002. "Quantification of Qualitative Firm-Level Survey Data," Economic Journal, Royal Economic Society, vol. 112(478), pages 117-135, March.
    20. James Mitchell & Richard J. Smith & Martin R. Weale, 2005. "Forecasting Manufacturing Output Growth Using Firm‐Level Survey Data," Manchester School, University of Manchester, vol. 73(4), pages 479-499, July.

    More about this item

    JEL classification:

    • C35 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions
    • C42 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Survey Methods
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nzb:nzbdps:2007/02. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Reserve Bank of New Zealand Knowledge Centre (email available below). General contact details of provider: https://edirc.repec.org/data/rbngvnz.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.