IDEAS home Printed from https://ideas.repec.org/p/nya/albaec/13-08.html
   My bibliography  Save this paper

Quantifying Heterogeneous Survey Expectations: The Carlson-Parkin Method Revisited

Author

Listed:
  • Kajal Lahiri
  • Yongchen Zhao

Abstract

We propose a generalized ordered response model that nests the popular Carlson-Parkin (CP) method to quantify household in flation expectations while explicitly control for cross-sectional heterogeneity in the threshold parameters and the variance. By matching qualitative and quantitative data from 1979 to 2012 from the University of Michigan's Survey of Consumers, we find evidence against the threshold constancy, symmetry, and homogeneity assumptions of the CP method. We show that the quantified expectations produced by the generalized model outperform those produced by the CP method, most notably during the 2008 recession period. We also show that when an rolling-window identification scheme is employed instead of the unbiasedness assumption over the entire sample, quantified expectations are significantly better in terms of predictive accuracy when compared with the quantitative expect ations reported in the survey.

Suggested Citation

  • Kajal Lahiri & Yongchen Zhao, 2013. "Quantifying Heterogeneous Survey Expectations: The Carlson-Parkin Method Revisited," Discussion Papers 13-08, University at Albany, SUNY, Department of Economics.
    • Handle: RePEc:nya:albaec:13-08
    as

    Download full text from publisher

    File URL: http://www.albany.edu/economics/research/workingp/2013/lz_quantification.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dasgupta, Susmita & Lahiri, Kajal, 1992. "A Comparative Study of Alternative Methods of Quantifying Qualitative Survey Responses Using NAPM Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 10(4), pages 391-400, October.
    2. Silvia Lui & James Mitchell & Martin Weale, 2011. "Qualitative business surveys: signal or noise?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 174(2), pages 327-348, April.
    3. Lui, Silvia & Mitchell, James & Weale, Martin, 2011. "The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1128-1146, October.
    4. Smith, Jeremy & McAleer, Michael, 1995. "Alternative Procedures for Converting Qualitative Response Data to Quantitative Expectations: An Application to Australian Manufacturing," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 10(2), pages 165-185, April-Jun.
    5. Pesaran, M. Hashem & Weale, Martin, 2006. "Survey Expectations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 14, pages 715-776, Elsevier.
    6. James Mitchell & Richard J. Smith & Martin R. Weale, 2002. "Quantification of Qualitative Firm-Level Survey Data," Economic Journal, Royal Economic Society, vol. 112(478), pages 117-135, March.
    7. N. Gregory Mankiw & Ricardo Reis, 2002. "Sticky Information versus Sticky Prices: A Proposal to Replace the New Keynesian Phillips Curve," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1295-1328.
    8. Rolf Scheufele, 2011. "Are Qualitative Inflation Expectations Useful to Predict Inflation?," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2011(1), pages 29-53.
    9. repec:cup:apsrev:v:98:y:2004:i:01:p:191-207_00 is not listed on IDEAS
    10. Loffler, Gunter, 1999. "Refining the Carlson-Parkin method," Economics Letters, Elsevier, vol. 64(2), pages 167-171, August.
    11. Christian M. Dahl & Lin Xia, 2004. "Quantification of Qualitative Survey Data and Test of Consistent Expectations: A New Likelihood Approach," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2004(1), pages 71-92.
    12. William H. Greene & David A. Hensher, 2010. "Ordered Choices and Heterogeneity in Attribute Processing," Journal of Transport Economics and Policy, University of Bath, vol. 44(3), pages 331-364, September.
    13. Kanoh, Satoru & Li, Zhi Dong, 1990. "A Method of Exploring the Mechanism of Inflationary Expectations Based on Qualitative Survey Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 8(4), pages 395-403, October.
    14. Akira Terai, 2010. "Measurement error in estimating inflation expectations from survey data: An evaluation by Monte Carlo simulations," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2009(2), pages 133-156.
    15. Claveria, Oscar & Pons, Ernest & Ramos, Raul, 2007. "Business and consumer expectations and macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 23(1), pages 47-69.
    16. Ang, Andrew & Bekaert, Geert & Wei, Min, 2007. "Do macro variables, asset markets, or surveys forecast inflation better?," Journal of Monetary Economics, Elsevier, vol. 54(4), pages 1163-1212, May.
    17. Breitung, Jörg & Schmeling, Maik, 2013. "Quantifying survey expectations: What’s wrong with the probability approach?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 142-154.
    18. Steffen Henzel & Timo Wollmershäuser, 2006. "Quantifying Inflation Expectations with the Carlson-Parkin Method: A Survey-based Determination of the Just Noticeable Difference," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2005(3), pages 321-352.
    19. Greene,William H. & Hensher,David A., 2010. "Modeling Ordered Choices," Cambridge Books, Cambridge University Press, number 9780521194204, September.
    20. Magnus Forsells & Geoff Kenny, 2004. "Survey Expectations, Rationality and the Dynamics of Euro Area Inflation," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2004(1), pages 13-41.
    21. Balcombe, Kelvin, 1996. "The Carlson-Parkin method applied to NZ price expectations using QSBO survey data," Economics Letters, Elsevier, vol. 51(1), pages 51-57, April.
    22. Souleles, Nicholas S, 2004. "Expectations, Heterogeneous Forecast Errors, and Consumption: Micro Evidence from the Michigan Consumer Sentiment Surveys," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 36(1), pages 39-72, February.
    23. Thomas Maag, 2009. "On the accuracy of the probability method for quantifying beliefs about inflation," KOF Working papers 09-230, KOF Swiss Economic Institute, ETH Zurich.
    24. James Mitchell & Richard J. Smith & Martin R. Weale, 2005. "Forecasting Manufacturing Output Growth Using Firm‐Level Survey Data," Manchester School, University of Manchester, vol. 73(4), pages 479-499, July.
    25. Christian Müller, 2009. "The information content of qualitative survey data," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2009(1), pages 1-12.
    26. James Mitchell & Richard J. Smith & Martin R. Weale, 2005. "Forecasting Manufacturing Output Growth Using Firm‐Level Survey Data," Manchester School, University of Manchester, vol. 73(4), pages 479-499, July.
    27. Michela Nardo, 2003. "The Quantification of Qualitative Survey Data: A Critical Assessment," Journal of Economic Surveys, Wiley Blackwell, vol. 17(5), pages 645-668, December.
    28. repec:bla:econom:v:55:y:1988:i:219:p:317-31 is not listed on IDEAS
    29. Richard Curtin, 2007. "Consumer Sentiment Surveys: Worldwide Review and Assessment," Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2007(1), pages 7-42.
    30. repec:bla:econom:v:42:y:1975:i:166:p:123-38 is not listed on IDEAS
    31. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    32. Mitchell, James, 2002. "The use of non-normal distributions in quantifying qualitative survey data on expectations," Economics Letters, Elsevier, vol. 76(1), pages 101-107, June.
    33. Fishe, Raymond P. H. & Lahiri, Kajal, 1981. "On the estimation of inflationary expectations from qualitative responses," Journal of Econometrics, Elsevier, vol. 16(1), pages 89-102, May.
    34. Fishe, Raymond P H & Idson, Todd L, 1990. "Information-Induced Heteroscedasticity in Price Expectations Data," The Review of Economics and Statistics, MIT Press, vol. 72(2), pages 304-312, May.
    35. Dr Martin Weale & Dr. James Mitchell, 2005. "Forecasting manufacturing output growth using firm-level survey data," National Institute of Economic and Social Research (NIESR) Discussion Papers 251, National Institute of Economic and Social Research.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Binder, Carola Conces, 2016. "Estimation of historical inflation expectations," Explorations in Economic History, Elsevier, vol. 61(C), pages 1-31.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lahiri, Kajal & Zhao, Yongchen, 2015. "Quantifying survey expectations: A critical review and generalization of the Carlson–Parkin method," International Journal of Forecasting, Elsevier, vol. 31(1), pages 51-62.
    2. Breitung, Jörg & Schmeling, Maik, 2013. "Quantifying survey expectations: What’s wrong with the probability approach?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 142-154.
    3. Oscar Claveria & Enric Monte & Salvador Torra, 2017. "A new approach for the quantification of qualitative measures of economic expectations," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(6), pages 2685-2706, November.
    4. Oscar Claveria & Enric Monte & Salvador Torra, 2018. "A Data-Driven Approach to Construct Survey-Based Indicators by Means of Evolutionary Algorithms," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(1), pages 1-14, January.
    5. Oscar Claveria & Enric Monte & Salvador Torra, 2017. "Let the data do the talking: Empirical modelling of survey-based expectations by means of genetic programming," IREA Working Papers 201711, University of Barcelona, Research Institute of Applied Economics, revised May 2017.
    6. Oscar Claveria & Enric Monte & Salvador Torra, 2018. "“Tracking economic growth by evolving expectations via genetic programming: A two-step approach”," AQR Working Papers 201801, University of Barcelona, Regional Quantitative Analysis Group, revised Jan 2018.
    7. Oscar Claveria & Enric Monte & Salvador Torra, 2019. "Evolutionary Computation for Macroeconomic Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 53(2), pages 833-849, February.
    8. Oscar Claveria & Enric Monte & Salvador Torra, 2015. "“Self-organizing map analysis of agents’ expectations. Different patterns of anticipation of the 2008 financial crisis”," AQR Working Papers 201508, University of Barcelona, Regional Quantitative Analysis Group, revised Mar 2015.
    9. Oscar Claveria, 2021. "Forecasting with Business and Consumer Survey Data," Forecasting, MDPI, vol. 3(1), pages 1-22, February.
    10. Olivier Biau & Hélène Erkel-Rousse & Nicolas Ferrari, 2006. "Réponses individuelles aux enquêtes de conjoncture et prévision de la production manufacturière," Économie et Statistique, Programme National Persée, vol. 395(1), pages 91-116.
    11. Oscar Claveria & Enric Monte & Salvador Torra, 2019. "Empirical modelling of survey-based expectations for the design of economic indicators in five European regions," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 46(2), pages 205-227, May.
    12. Bovi, Maurizio, 2013. "Are the representative agent’s beliefs based on efficient econometric models?," Journal of Economic Dynamics and Control, Elsevier, vol. 37(3), pages 633-648.
    13. Lui, Silvia & Mitchell, James & Weale, Martin, 2011. "The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1128-1146, October.
    14. Das, Abhiman & Lahiri, Kajal & Zhao, Yongchen, 2019. "Inflation expectations in India: Learning from household tendency surveys," International Journal of Forecasting, Elsevier, vol. 35(3), pages 980-993.
    15. Dr Martin Weale & Dr. James Mitchell, 2006. "A Bayesian Indicator of Manufacturing Output from Qualitative Business Panel Survey Data," National Institute of Economic and Social Research (NIESR) Discussion Papers 261, National Institute of Economic and Social Research.
    16. Martinsen, Kjetil & Ravazzolo, Francesco & Wulfsberg, Fredrik, 2014. "Forecasting macroeconomic variables using disaggregate survey data," International Journal of Forecasting, Elsevier, vol. 30(1), pages 65-77.
    17. Lui, Silvia & Mitchell, James & Weale, Martin, 2011. "The utility of expectational data: Firm-level evidence using matched qualitative-quantitative UK surveys," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1128-1146, October.
    18. James Mitchell & Richard J. Smith & Martin R. Weale, 2013. "Efficient Aggregation Of Panel Qualitative Survey Data," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(4), pages 580-603, June.
    19. Maurizio Bovi, 2014. "Shocks and the Expectations Formation Process. A Tale of Two Expectations," Natural Field Experiments 00390, The Field Experiments Website.
    20. Nolte, Ingmar & Pohlmeier, Winfried, 2007. "Using forecasts of forecasters to forecast," International Journal of Forecasting, Elsevier, vol. 23(1), pages 15-28.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nya:albaec:13-08. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Byoung Park (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.