IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/18308.html
   My bibliography  Save this paper

The Validity of Consumption Data: Are the Consumer Expenditure Interview and Diary Surveys Informative?

Author

Listed:
  • Adam Bee
  • Bruce D. Meyer
  • James X. Sullivan

Abstract

This paper examines the quality of data collected in the Consumer Expenditure (CE) Survey, which is the source for the Consumer Price Index weights and is the main source of U.S. consumption microdata. We compare reported spending on a large number of categories of goods and services to comparable national income account data. We do this separately for the two components of the CE--the Interview Survey and the Diary Survey--rather than a combination that has been used in past comparisons. We find that most of the largest categories of consumption are measured well in the Interview Survey as the ratio to the national account data is close to one and has not declined appreciably over time. Several other large categories are reported at a low rate or have seen the ratio to the national accounts decline over time. The results are less encouraging for the Diary Survey. There is no large Diary category that is both measured well and reported at a higher rate than in the Interview Survey. We also compare the ownership of and the value of durables, such as homes and cars, in the CE to other sources. This evidence suggests the CE performs fairly well. Based on observable characteristics, the CE Survey appears to be fairly representative, although there is strong evidence of under-representation at the top of the income distribution and under-reporting of income and expenditures at the top. We then examine the precision of the two surveys and the frequency of no spending overall or for a given spending category. In the Diary Survey, we find much greater dispersion in spending and the dispersion relative to the Interview Survey varies across goods and over time. Diary respondents are much more likely to report zero spending for a consumption category, and a high and increasing fraction of respondents reporting zero for all categories. These results suggest that using Diary data to assess inequality trends and other distributional outcomes is likely to lead to biased and misleading results. Our results have important implications for interpreting and properly using CE data and how best to redesign the CE.

Suggested Citation

  • Adam Bee & Bruce D. Meyer & James X. Sullivan, 2012. "The Validity of Consumption Data: Are the Consumer Expenditure Interview and Diary Surveys Informative?," NBER Working Papers 18308, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:18308
    Note: AG DAE EFG LS PE TWP
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w18308.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Martin Browning & Thomas F. Crossley & Guglielmo Weber, 2003. "Asking consumption questions in general purpose surveys," Economic Journal, Royal Economic Society, vol. 113(491), pages 540-567, November.
    2. James M. Poterba, 1991. "Is the Gasoline Tax Regressive?," NBER Chapters, in: Tax Policy and the Economy, Volume 5, pages 145-164, National Bureau of Economic Research, Inc.
    3. Nicholas S. Souleles & Jonathan A. Parker & David S. Johnson, 2006. "Household Expenditure and the Income Tax Rebates of 2001," American Economic Review, American Economic Association, vol. 96(5), pages 1589-1610, December.
    4. Robert K. Triest, 1998. "Has Poverty Gotten Worse?," Journal of Economic Perspectives, American Economic Association, vol. 12(1), pages 97-114, Winter.
    5. Adam Bee & Bruce D. Meyer & James X. Sullivan, 2013. "The Validity of Consumption Data: Are the Consumer Expenditure Interview and Diary Surveys Informative?," NBER Chapters, in: Improving the Measurement of Consumer Expenditures, pages 204-240, National Bureau of Economic Research, Inc.
    6. Melvin Stephens Jr., 2003. ""3rd of tha Month": Do Social Security Recipients Smooth Consumption Between Checks?," American Economic Review, American Economic Association, vol. 93(1), pages 406-422, March.
    7. Jonathan A. Parker & Nicholas S. Souleles & David S. Johnson & Robert McClelland, 2013. "Consumer Spending and the Economic Stimulus Payments of 2008," American Economic Review, American Economic Association, vol. 103(6), pages 2530-2553, October.
    8. Michael D. Hurd & Susann Rohwedder, 2013. "Measuring Total Household Spending in a Monthly Internet Survey: Evidence from the American Life Panel," NBER Chapters, in: Improving the Measurement of Consumer Expenditures, pages 365-387, National Bureau of Economic Research, Inc.
    9. Orazio P. Attanasio & Erich Battistin & Mario Padula, 2010. "Inequality in Living Standards Since 1980," Books, American Enterprise Institute, number 25159, September.
    10. Slesnick,Daniel T., 2001. "Consumption and Social Welfare," Cambridge Books, Cambridge University Press, number 9780521497206, October.
    11. Thomas F. Crossley & Joachim K. Winter, 2014. "Asking Households about Expenditures: What Have We Learned?," NBER Chapters, in: Improving the Measurement of Consumer Expenditures, pages 23-50, National Bureau of Economic Research, Inc.
    12. Bruce D. Meyer & James X. Sullivan, 2011. "Viewpoint: Further results on measuring the well-being of the poor using income and consumption," Canadian Journal of Economics, Canadian Economics Association, vol. 44(1), pages 52-87, February.
    13. Bertelli, Anthony M. & John, Peter C., 2012. "From the editors," Journal of Public Policy, Cambridge University Press, vol. 32(03), pages 169-170, December.
    14. Bruce D. Meyer & James X. Sullivan, 2008. "Changes in the Consumption, Income, and Well-Being of Single Mother Headed Families," American Economic Review, American Economic Association, vol. 98(5), pages 2221-2241, December.
    15. Bruce D. Meyer & Wallace K. C. Mok & James X. Sullivan, 2009. "The Under-Reporting of Transfers in Household Surveys: Its Nature and Consequences," NBER Working Papers 15181, National Bureau of Economic Research, Inc.
    16. Bruce D. Meyer & James X. Sullivan, 2009. "Five Decades of Consumption and Income Poverty," Working Papers 0907, Harris School of Public Policy Studies, University of Chicago.
    17. Slesnick, Daniel T, 1992. "Aggregate Consumption and Saving in the Postwar United States," The Review of Economics and Statistics, MIT Press, vol. 74(4), pages 585-597, November.
    18. Barry Bosworth, 2010. "Price Deflators, the Trust Fund Forecast, and Social Security Solvency," Working Papers, Center for Retirement Research at Boston College wp2010-11, Center for Retirement Research, revised Oct 2010.
    19. David A. Wise, 2004. "Perspectives on the Economics of Aging," NBER Books, National Bureau of Economic Research, Inc, number wise04-1, August.
    20. Angus Deaton & Valerie Kozel, 2005. "Data and Dogma: The Great Indian Poverty Debate," The World Bank Research Observer, World Bank Group, vol. 20(2), pages 177-199.
    21. Naeem Ahmed & Matthew Brzozowski & Thomas Crossley, 2006. "Measurement errors in recall food consumption data," IFS Working Papers W06/21, Institute for Fiscal Studies.
    22. Slesnick, Daniel T, 1993. "Gaining Ground: Poverty in the Postwar United States," Journal of Political Economy, University of Chicago Press, vol. 101(1), pages 1-38, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bruce D. Meyer & James X. Sullivan, 2009. "Five Decades of Consumption and Income Poverty," Working Papers 0907, Harris School of Public Policy Studies, University of Chicago.
    2. Bruce D. Meyer & James X. Sullivan, 2012. "Identifying the Disadvantaged: Official Poverty, Consumption Poverty, and the New Supplemental Poverty Measure," Journal of Economic Perspectives, American Economic Association, vol. 26(3), pages 111-136, Summer.
    3. Bruce D. Meyer & James X. Sullivan, 2011. "Viewpoint: Further results on measuring the well‐being of the poor using income and consumption," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 44(1), pages 52-87, February.
    4. Han, Jeehoon & Meyer, Bruce D. & Sullivan, James X., 2020. "Inequality in the joint distribution of consumption and time use," Journal of Public Economics, Elsevier, vol. 191(C).
    5. Bruce D. Meyer & James X. Sullivan, 2017. "Consumption and Income Inequality in the U.S. Since the 1960s," NBER Working Papers 23655, National Bureau of Economic Research, Inc.
    6. Bruce D. Meyer & James X. Sullivan, 2009. "Five Decades of Consumption and Income Poverty," NBER Working Papers 14827, National Bureau of Economic Research, Inc.
    7. Thomas F. Crossley & Joachim K. Winter, 2014. "Asking Households about Expenditures: What Have We Learned?," NBER Chapters, in: Improving the Measurement of Consumer Expenditures, pages 23-50, National Bureau of Economic Research, Inc.
    8. Bruce D. Meyer & James X. Sullivan, 2011. "Consumption and Income Poverty Over the Business Cycle," Research in Labor Economics, in: Who Loses in the Downturn? Economic Crisis, Employment and Income Distribution, pages 51-82, Emerald Group Publishing Limited.
    9. Martin Browning & Thomas F. Crossley & Joachim Winter, 2014. "The Measurement of Household Consumption Expenditures," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 475-501, August.
    10. Jonathan A. Parker & Nicholas S. Souleles & Christopher D. Carroll, 2014. "The Benefits of Panel Data in Consumer Expenditure Surveys," NBER Chapters, in: Improving the Measurement of Consumer Expenditures, pages 75-99, National Bureau of Economic Research, Inc.
    11. Bruce Meyer & Wallace K. C. Mok, 2016. "Disability, Earnings, Income and Consumption," NBER Chapters, in: Social Insurance Programs (Trans-Atlantic Public Economics Seminar, TAPES), National Bureau of Economic Research, Inc.
    12. Marta Moratti, 2010. "Consumption Poverty and Pro-Poor Growth in Bolivia," Working Paper Series 1310, Department of Economics, University of Sussex Business School.
    13. Tal Gross & Timothy J. Layton & Daniel Prinz, 2022. "The Liquidity Sensitivity of Healthcare Consumption: Evidence from Social Security Payments," American Economic Review: Insights, American Economic Association, vol. 4(2), pages 175-190, June.
    14. Jonathan A. Parker & Nicholas S. Souleles & David S. Johnson & Robert McClelland, 2013. "Consumer Spending and the Economic Stimulus Payments of 2008," American Economic Review, American Economic Association, vol. 103(6), pages 2530-2553, October.
    15. Andrew Bibler & Mouhcine Guettabi & Matthew N. Reimer, 2023. "Universal Cash Transfers and Labor Market Outcomes," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 42(1), pages 198-224, January.
    16. Agarwal, Sumit & Koo, Kang Mo & Qian, Wenlan, 2022. "Consumption response to temporary price shock: Evidence from Singapore's annual sale event," Journal of Financial Intermediation, Elsevier, vol. 51(C).
    17. Guney, Ibrahim Ethem & Hacihasanoglu, Yavuz Selim & Tumen, Semih, 2017. "Consumer Loan Response to Permanent Labor Income Shocks: Evidence from a Major Minimum Wage Increase," GLO Discussion Paper Series 58, Global Labor Organization (GLO).
    18. Ingvild Almås & Timothy K.M. Beatty & Thomas F. Crossley, 2018. "Lost in Translation: What do Engel Curves Tell us about the Cost of Living?," CESifo Working Paper Series 6886, CESifo.
    19. John Bagnall & David Bounie & Kim P. Huynh & Anneke Kosse & Tobias Schmidt & Scott Schuh, 2016. "Consumer Cash Usage: A Cross-Country Comparison with Payment Diary Survey Data," International Journal of Central Banking, International Journal of Central Banking, vol. 12(4), pages 1-61, December.
    20. Orazio Attanasio & Erik Hurst & Luigi Pistaferri, 2012. "The Evolution of Income, Consumption, and Leisure Inequality in The US, 1980-2010," NBER Working Papers 17982, National Bureau of Economic Research, Inc.

    More about this item

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C82 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Macroeconomic Data; Data Access
    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis
    • D31 - Microeconomics - - Distribution - - - Personal Income and Wealth Distribution
    • I32 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Measurement and Analysis of Poverty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:18308. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.