Tracking, Attrition and Data Quality in the Kenyan Life Panel Survey Round 1 (KLPS-1)
Understanding the possible pitfalls of survey data is critical for empirical research. Among other things, poor data quality can lead to biased regression estimates, potentially resulting in incorrect interpretations that mislead researchers and policymakers alike. Common data problems include difficulties in tracking respondents and high survey attrition, enumerator error and bias, and respondent reporting error. This paper describes and analyzes these issues in Round 1 of the Kenyan Life Panel Survey (KLPS-1), collected in 2003-2005. The KLPS-1 is an innovative longitudinal dataset documenting a wide range of outcomes for Kenyan youths who had originally attended schools participating in a deworming treatment program starting in 1998. The careful design of this survey allows for examination of an array of data quality issues. First, we explore the existence and implications of sample attrition bias. Basic residential, educational, and mortality information was obtained for 88% of target respondents, and personal contact was made with 84%, an exceptionally high follow-up rate for a young adult population in a less developed country. Moreover, rates of sample attrition are nearly identical for respondents who were randomly assigned deworming treatment and for those who were not, a key factor in the validity of subsequent statistical analysis. One vital component of this success is the tracking of respondents both nationally and across international borders (in our case, into Uganda), thus we discuss in detail the costs and benefits of tracking movers. Finally, we study KLPS-1 data quality more broadly by examining enumerator error and bias, as well as survey response consistency. We conclude that the extent of enumerator error is low, with an average of less than one recording error per survey. Errors decrease over time as enumerator experience with the survey instrument increases, but increase over the course of multiple interviews within a single day, presumably due to fatigue. We do find some evidence that the enumerator-respondent match in terms of gender, ethnicity, and religion correlates with responses regarding trust of others and religious activities, suggesting some field officer bias on sensitive questions. Reporting reliability is analyzed using respondent re-surveys. These checks show high levels of consistency across survey/re-survey rounds for the respondentâ€™s own characteristics and personal history,with lower reliability rates on questions asked about othersâ€™ characteristics. The steps taken in the design of KLPS-1 to avoid common errors in survey data collection greatly improved the quality of this panel dataset, and provide some valuable lessons for future field data collection projects.
|Date of creation:||01 Aug 2008|
|Date of revision:|
|Contact details of provider:|| Postal: |
Phone: (510) 642-1922
Fax: (510) 642-5018
Web page: http://www.escholarship.org/repec/iber_cider/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998.
"An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of income Dynamics,"
Economics Working Paper Archive
379, The Johns Hopkins University,Department of Economics.
- John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Journal of Human Resources, University of Wisconsin Press, vol. 33(2), pages 251-299.
- John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," NBER Technical Working Papers 0220, National Bureau of Economic Research, Inc.
- John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1997. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Boston College Working Papers in Economics 394, Boston College Department of Economics.
- J. Fitzgerald & P. Gottschalk & R. Moffitt, . "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Institute for Research on Poverty Discussion Papers 1156-98, University of Wisconsin Institute for Research on Poverty.
- Duncan Thomas & Elizabeth Frankenberg & James P. Smith, 2000.
"Lost But Not Forgotten: Attrition and Follow-up in the Indonesian Family Life Survey,"
00-03, RAND Corporation Publications Department.
- Duncan Thomas & Elizabeth Frankenberg & James P. Smith, 2001. "Lost but Not Forgotten: Attrition and Follow-up in the Indonesia Family Life Survey," Journal of Human Resources, University of Wisconsin Press, vol. 36(3), pages 556-592.
- Duncan Thomas & Elizabeth Frankenberg & James P. Smith, 2004. "Lost but Not Forgotten: Attrition and Follow-up in the Indonesia Family Life Survey," Labor and Demography 0408007, EconWPA.
- Thomas, D. & Frankenberg, E. & Smith, J.P., 2000. "Lost But Not Forgotten Attribution and Follow-up in the Indonesian Family Life Survey," Papers 00-03, RAND - Labor and Population Program.
- FFF1Simona NNN1Bignami-Van Assche & FFF2Georges NNN2Reniers & FFF2Alexander A. NNN2Weinreb, 2003. "An Assessment of the KDICP and MDICP Data Quality," Demographic Research Special Collections, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 1(2), pages 31-76, September.
- Mathiowetz, Nancy A & Duncan, Greg J, 1988. "Out of Work, Out of Mind: Response Errors in Retrospective Reports of Unemployment," Journal of Business & Economic Statistics, American Statistical Association, vol. 6(2), pages 221-29, April.
- Edward Miguel & Michael Kremer, 2004. "Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities," Econometrica, Econometric Society, vol. 72(1), pages 159-217, 01.
- Sean Becketti & William Gould & Lee Lillard & Finis Welch, 1985. "The Panel Study of Income Dynamics After Fourteen Years: An Evaluation," UCLA Economics Working Papers 361, UCLA Department of Economics.
- James P. Smith & Duncan Thomas, 2004.
"Remembrances of Things Past: Test-Retest Reliability of Retrospective Migration Histories,"
Labor and Demography
- James P. Smith & Duncan Thomas, 2003. "Remembrances of things past: test-retest reliability of retrospective migration histories," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 166(1), pages 23-49.
- Jeffrey R. Kling & B. Jeffrey Liebman, 2004. "Experimental Analysis of Neighborhood Effects on Youth," Working Papers 862, Princeton University, Department of Economics, Industrial Relations Section..
- Jeffrey R. Kling & Jeffrey B. Liebman, 2005.
"Experimental Analysis Of Neighborhood Effects On Youth,"
249, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
- Kling, Jeffrey & Liebman, Jeffrey, 2004. "Experimental Analysis of Neighborhood Effects on Youth," Working Paper Series rwp04-034, Harvard University, John F. Kennedy School of Government.
- Falaris, Evangelos M., 2003. "The effect of survey attrition in longitudinal surveys: evidence from Peru, Cote d'Ivoire and Vietnam," Journal of Development Economics, Elsevier, vol. 70(1), pages 133-157, February.
When requesting a correction, please mention this item's handle: RePEc:cdl:ciders:qt3cw7p1hx. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Lisa Schiff)
If references are entirely missing, you can add them using this form.