IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/6009.html
   My bibliography  Save this paper

How accurate are recall data ? evidence from coastal India

Author

Listed:
  • de Nicola, Francesca
  • Gine, Xavier

Abstract

This paper investigates the accuracy of recall data by comparing administrative records with retrospective, self-reported survey responses to income and asset questions for a sample of self-employed households from coastal India. It finds that the magnitude of the recall error increases over time, in part because respondents rely less on memory and instead infer earnings based on past earnings. Individuals tend to recall monthly earnings more accurately when they are higher than the median. These results imply that the variance estimated from the self-reported earnings distribution will be lower than the real one. The paper also finds that data reported by income earners are more accurate than those by their wives. In addition, the use of time cues can worsen accuracy if they are not relevant to the respondent. Where the recall questions are placed in the two-hour long survey, however, does not affect accuracy.

Suggested Citation

  • de Nicola, Francesca & Gine, Xavier, 2012. "How accurate are recall data ? evidence from coastal India," Policy Research Working Paper Series 6009, The World Bank.
  • Handle: RePEc:wbk:wbrwps:6009
    as

    Download full text from publisher

    File URL: http://www-wds.worldbank.org/external/default/WDSContentServer/WDSP/IB/2012/03/22/000158349_20120322160235/Rendered/PDF/WPS6009.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. John Bound & Charles Brown & Greg J. Duncan & Willard L. Rodgers, 1989. "Measurement Error In Cross-Sectional and Longitudinal Labor Market Surveys: Results From Two Validation Studies," NBER Working Papers 2884, National Bureau of Economic Research, Inc.
    2. Bound, John & Krueger, Alan B, 1991. "The Extent of Measurement Error in Longitudinal Earnings Data: Do Two Wrongs Make a Right?," Journal of Labor Economics, University of Chicago Press, vol. 9(1), pages 1-24, January.
    3. Amos Tversky & Daniel Kahneman, 1991. "Loss Aversion in Riskless Choice: A Reference-Dependent Model," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 1039-1061.
    4. Siwan Anderson & Jean-Marie Baland, 2002. "The Economics of Roscas and Intrahousehold Resource Allocation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 963-995.
    5. Beegle, Kathleen & Carletto, Calogero & Himelein, Kristen, 2012. "Reliability of recall in agricultural data," Journal of Development Economics, Elsevier, vol. 98(1), pages 34-41.
    6. Pischke, Jorn-Steffen, 1995. "Measurement Error and Earnings Dynamics: Some Estimates from the PSID Validation Study," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 305-314, July.
    7. Das, Jishnu & Hammer, Jeffrey & Sánchez-Paramo, Carolina, 2012. "The impact of recall periods on reported morbidity and health seeking behavior," Journal of Development Economics, Elsevier, vol. 98(1), pages 76-88.
    8. Costas Meghir & Luigi Pistaferri, 2004. "Income Variance Dynamics and Heterogeneity," Econometrica, Econometric Society, vol. 72(1), pages 1-32, January.
    9. Duncan, Greg J & Hill, Daniel H, 1985. "An Investigation of the Extent and Consequences of Measurement Error in Labor-Economic Survey Data," Journal of Labor Economics, University of Chicago Press, vol. 3(4), pages 508-532, October.
    10. Delavande, Adeline & Giné, Xavier & McKenzie, David, 2011. "Measuring subjective expectations in developing countries: A critical review and new evidence," Journal of Development Economics, Elsevier, vol. 94(2), pages 151-163, March.
    11. Megan Beckett & Julie Da Vanzo & Narayan Sastry & Constantijn Panis & Christine Peterson, 2001. "The Quality of Retrospective Data: An Examination of Long-Term Recall in a Developing Country," Journal of Human Resources, University of Wisconsin Press, vol. 36(3), pages 593-625.
    12. de Mel, Suresh & McKenzie, David J. & Woodruff, Christopher, 2009. "Measuring microenterprise profits: Must we ask how the sausage is made?," Journal of Development Economics, Elsevier, vol. 88(1), pages 19-31, January.
    13. Angrist, Joshua D. & Krueger, Alan B., 1999. "Empirical strategies in labor economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 23, pages 1277-1366, Elsevier.
    14. Beegle, Kathleen & De Weerdt, Joachim & Friedman, Jed & Gibson, John, 2012. "Methods of household consumption measurement through surveys: Experimental results from Tanzania," Journal of Development Economics, Elsevier, vol. 98(1), pages 3-18.
    15. Mathiowetz, Nancy A & Duncan, Greg J, 1988. "Out of Work, Out of Mind: Response Errors in Retrospective Reports of Unemployment," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(2), pages 221-229, April.
    16. Nava Ashraf, 2009. "Spousal Control and Intra-household Decision Making: An Experimental Study in the Philippines," American Economic Review, American Economic Association, vol. 99(4), pages 1245-1277, September.
    17. Udry, Christopher, 1996. "Gender, Agricultural Production, and the Theory of the Household," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 1010-1046, October.
    18. Bound, John & Brown, Charles & Mathiowetz, Nancy, 2001. "Measurement error in survey data," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 5, chapter 59, pages 3705-3843, Elsevier.
    19. Akee, Randall, 2011. "Errors in self-reported earnings: The role of previous earnings volatility and individual characteristics," Journal of Development Economics, Elsevier, vol. 96(2), pages 409-421, November.
    20. Siwan Anderson & Jean-Marie Baland, 2002. "The Economics of Roscas and Intrahousehold Resource Allocation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 963-995.
    21. Poterba, James M & Summers, Lawrence H, 1986. "Reporting Errors and Labor Market Dynamics," Econometrica, Econometric Society, vol. 54(6), pages 1319-1338, November.
    22. Bound, John & Brown, Charles & Duncan, Greg J & Rodgers, Willard L, 1994. "Evidence on the Validity of Cross-Sectional and Longitudinal Labor Market Data," Journal of Labor Economics, University of Chicago Press, vol. 12(3), pages 345-368, July.
    23. Kennickell, Arthur B & Starr-McCluer, Martha, 1997. "Retrospective Reporting of Household Wealth: Evidence from the 1983-1989 Survey of Consumer Finances," Journal of Business & Economic Statistics, American Statistical Association, vol. 15(4), pages 452-463, October.
    24. Daniel McFadden & Albert Bemmaor & Francis Caro & Jeff Dominitz & Byung-Hill Jun & Arthur Lewbel & Rosa Matzkin & Francesca Molinari & Norbert Schwarz & Robert Willis & Joachim Winter, 2005. "Statistical Analysis of Choice Experiments and Surveys," Marketing Letters, Springer, vol. 16(3), pages 183-196, December.
    25. Akee, Randall K. Q., 2007. "Errors in Self-Reported Earnings: The Role of Previous Earnings Volatility," IZA Discussion Papers 3263, Institute of Labor Economics (IZA).
    26. Sendhil Mullainathan, 2002. "A Memory-Based Model of Bounded Rationality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 735-774.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Akee, Randall, 2011. "Errors in self-reported earnings: The role of previous earnings volatility and individual characteristics," Journal of Development Economics, Elsevier, vol. 96(2), pages 409-421, November.
    2. Randall Akee, Devesh Kapur, 2012. "Remittances and Rashomon- Working Paper 285," Working Papers 285, Center for Global Development.
    3. ChangHwan Kim & Christopher R. Tamborini, 2014. "Response Error in Earnings," Sociological Methods & Research, , vol. 43(1), pages 39-72, February.
    4. Yingyao Hu & Geert Ridder, 2012. "Estimation of nonlinear models with mismeasured regressors using marginal information," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(3), pages 347-385, April.
    5. Brownstone, David & Valletta, Robert G, 1996. "Modeling Earnings Measurement Error: A Multiple Imputation Approach," The Review of Economics and Statistics, MIT Press, vol. 78(4), pages 705-717, November.
    6. Bollinger, Christopher R. & Hirsch, Barry & Hokayem, Charles M. & Ziliak, James P., 2018. "Trouble in the Tails? What We Know about Earnings Nonresponse Thirty Years after Lillard, Smith, and Welch," IZA Discussion Papers 11710, Institute of Labor Economics (IZA).
    7. Geert Ridder & Yingyao Hu, 2004. "Estimation of Nonlinear Models with Measurement Error Using Marginal Information," Econometric Society 2004 North American Summer Meetings 21, Econometric Society.
    8. John Abowd & Martha Stinson, 2011. "Estimating Measurement Error in SIPP Annual Job Earnings: A Comparison of Census Bureau Survey and SSA Administrative Data," Working Papers 11-20, Center for Economic Studies, U.S. Census Bureau.
    9. Wollburg, Philip & Tiberti, Marco & Zezza, Alberto, 2021. "Recall length and measurement error in agricultural surveys," Food Policy, Elsevier, vol. 100(C).
    10. Akee, Randall K. Q., 2007. "Errors in Self-Reported Earnings: The Role of Previous Earnings Volatility," IZA Discussion Papers 3263, Institute of Labor Economics (IZA).
    11. Whalley, Alexander, 2011. "Education and labor market risk: Understanding the role of data cleaning," Economics of Education Review, Elsevier, vol. 30(3), pages 528-545, June.
    12. Arie Kapteyn & Jelmer Y. Ypma, 2007. "Measurement Error and Misclassification: A Comparison of Survey and Administrative Data," Journal of Labor Economics, University of Chicago Press, vol. 25(3), pages 513-551.
    13. Ragui Assaad & Caroline Krafft & Shaimaa Yassin, 2018. "Comparing retrospective and panel data collection methods to assess labor market dynamics," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 8(1), pages 1-34, December.
    14. Abay, Kibrom A. & Abate, Gashaw T. & Barrett, Christopher B. & Bernard, Tanguy, 2019. "Correlated non-classical measurement errors, ‘Second best’ policy inference, and the inverse size-productivity relationship in agriculture," Journal of Development Economics, Elsevier, vol. 139(C), pages 171-184.
    15. Lynn, Peter & Jäckle, Annette & Sala, Emanuela & P. Jenkins, Stephen, 2004. "Validation of survey data on income and employment: the ISMIE experience," ISER Working Paper Series 2004-14, Institute for Social and Economic Research.
    16. Arthi, Vellore & Beegle, Kathleen & De Weerdt, Joachim & Palacios-López, Amparo, 2018. "Not your average job: Measuring farm labor in Tanzania," Journal of Development Economics, Elsevier, vol. 130(C), pages 160-172.
    17. Jungmin Lee & Sokbae Lee, 2012. "Does it Matter WHO Responded to the Survey? Trends in the U.S. Gender Earnings Gap Revisited," ILR Review, Cornell University, ILR School, vol. 65(1), pages 148-160, January.
    18. Joachim De Weerdt & John Gibson & Kathleen Beegle, 2020. "What Can We Learn from Experimenting with Survey Methods?," Annual Review of Resource Economics, Annual Reviews, vol. 12(1), pages 431-447, October.
    19. Dean R. Hyslop & Wilbur Townsend, 2020. "Earnings Dynamics and Measurement Error in Matched Survey and Administrative Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 38(2), pages 457-469, April.
    20. Peter Gottschalk & Minh Huynh, 2010. "Are Earnings Inequality and Mobility Overstated? The Impact of Nonclassical Measurement Error," The Review of Economics and Statistics, MIT Press, vol. 92(2), pages 302-315, May.

    More about this item

    Keywords

    Access to Finance; Statistical&Mathematical Sciences; Educational Sciences; Fiscal&Monetary Policy; Economic Theory&Research;
    All these keywords.

    JEL classification:

    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • Q12 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - Agriculture - - - Micro Analysis of Farm Firms, Farm Households, and Farm Input Markets

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:6009. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.