IDEAS home Printed from https://ideas.repec.org/p/ldr/wpaper/103.html
   My bibliography  Save this paper

An evaluation of the determinants and implications of panel attrition in the National Income Dynamics Survey (2008 – 2010)

Author

Listed:
  • Nic Baigrie

    (School of Economics, University of Cape Town)

  • Katherine Eyal

    (SALDRU, School of Economics, University of Cape Town)

Abstract

Panel surveys offer a valuable tool for researchers to explore the dynamics underlying individual and household behaviours. The Achilles heel of panel data is attrition. This paper examines the determinants and implications of attrition in the first two waves of South Africa's National Income Dynamics Survey (NIDS). Multivariate tests in labour market and health specifications show that there is some moderate evidence of attrition bias in estimated coefficients based on the non-attriting sample. This bias can be seen in labour market specifications, in particular for men, and for Africans, and to a much lesser degree in health specifications, in particular for small samples of Whites. Researchers should take care when using the panel data set to generalise to the overall population.

Suggested Citation

  • Nic Baigrie & Katherine Eyal, 2013. "An evaluation of the determinants and implications of panel attrition in the National Income Dynamics Survey (2008 – 2010)," SALDRU Working Papers 103, Southern Africa Labour and Development Research Unit, University of Cape Town.
    • Handle: RePEc:ldr:wpaper:103
    as

    Download full text from publisher

    File URL: https://www.opensaldru.uct.ac.za/bitstream/handle/11090/619/2013_103.pdf?sequence=1
    File Function: Full text
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Duncan Thomas & Elizabeth Frankenberg & James P. Smith, 2001. "Lost but Not Forgotten: Attrition and Follow-up in the Indonesia Family Life Survey," Journal of Human Resources, University of Wisconsin Press, vol. 36(3), pages 556-592.
    2. Robert Moffitt & John Fitzgerald & Peter Gottschalk, 1999. "Sample Attrition in Panel Data: The Role of Selection on Observables," Annals of Economics and Statistics, GENES, issue 55-56, pages 129-152.
    3. Jere R. Behrman & John Hoddinott, 2005. "Programme Evaluation with Unobserved Heterogeneity and Selective Implementation: The Mexican PROGRESA Impact on Child Nutrition," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(4), pages 547-569, August.
    4. Marcel Das & Vera Toepoel & Arthur van Soest, 2011. "Nonparametric Tests of Panel Conditioning and Attrition Bias in Panel Surveys," Sociological Methods & Research, , vol. 40(1), pages 32-56, February.
    5. John Fitzgerald & Peter Gottschalk & Robert Moffitt, 1998. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics," Journal of Human Resources, University of Wisconsin Press, vol. 33(2), pages 251-299.
    6. Nicoletti, Cheti & Peracchi, Franco & Foliano, Francesca, 2011. "Estimating Income Poverty in the Presence of Missing Data and Measurement Error," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 61-72.
    7. Maluccio, John A., 2000. "Attrition in the Kwazulu Natal income dynamics study, 1993-1998," FCND briefs 95, International Food Policy Research Institute (IFPRI).
    8. Jacob A. Mincer, 1974. "Introduction to "Schooling, Experience, and Earnings"," NBER Chapters, in: Schooling, Experience, and Earnings, pages 1-4, National Bureau of Economic Research, Inc.
    9. Jeremy Magruder & Nicoli Nattrass, 2006. "Exploring Attrition Bias: The Case Of The Khayelitsha Panel Study (2000‐2004)," South African Journal of Economics, Economic Society of South Africa, vol. 74(4), pages 769-781, December.
    10. Julie Berry Cullen & Brian A Jacob & Steven Levitt, 2006. "The Effect of School Choice on Participants: Evidence from Randomized Lotteries," Econometrica, Econometric Society, vol. 74(5), pages 1191-1230, September.
    11. Dhaval M. Dave & Jennifer Tennant & Gregory J. Colman, 2011. "Isolating the Effect of Major Depression on Obesity: Role of Selection Bias," NBER Working Papers 17068, National Bureau of Economic Research, Inc.
    12. Thomas, Duncan & Witoelar, Firman & Frankenberg, Elizabeth & Sikoki, Bondan & Strauss, John & Sumantri, Cecep & Suriastini, Wayan, 2012. "Cutting the costs of attrition: Results from the Indonesia Family Life Survey," Journal of Development Economics, Elsevier, vol. 98(1), pages 108-123.
    13. Wittenberg, Martin, 2011. "Estimating expenditure impacts without expenditure data using asset proxies," Economics Letters, Elsevier, vol. 110(2), pages 122-125, February.
    14. Becketti, Sean & Gould, William & Lillard, Lee & Welch, Finis, 1988. "The Panel Study of Income Dynamics after Fourteen Years: An Evaluatio n," Journal of Labor Economics, University of Chicago Press, vol. 6(4), pages 472-492, October.
    15. Falaris, Evangelos M., 2003. "The effect of survey attrition in longitudinal surveys: evidence from Peru, Cote d'Ivoire and Vietnam," Journal of Development Economics, Elsevier, vol. 70(1), pages 133-157, February.
    16. Nic Baigrie & Katherine Eyal, 2014. "An Evaluation of the Determinants and Implications of Panel Attrition in the National Income Dynamics Survey (2008-2010)," South African Journal of Economics, Economic Society of South Africa, vol. 82(1), pages 39-65, March.
    17. Jacob A. Mincer, 1974. "Schooling, Experience, and Earnings," NBER Books, National Bureau of Economic Research, Inc, number minc74-1.
    18. Miguel Lacerda & Cally Ardington & Murray Leibbrandt, 2007. "Sequential Regression Multiple Imputation for Incomplete Multivariate Data using Markov Chain Monte Carlo," SALDRU Working Papers 13, Southern Africa Labour and Development Research Unit, University of Cape Town.
    19. Lynn, Peter & Laurie, Heather, 2008. "The use of respondent incentives on longitudinal surveys," ISER Working Paper Series 2008-42, Institute for Social and Economic Research.
    20. Samuel H. Preston, 1980. "Causes and Consequences of Mortality Declines in Less Developed Countries during the Twentieth Century," NBER Chapters, in: Population and Economic Change in Developing Countries, pages 289-360, National Bureau of Economic Research, Inc.
    21. Nicola Branson & Martin Wittenberg, 2007. "The Measurement Of Employment Status In South Africa Using Cohort Analysis, 1994‐20041," South African Journal of Economics, Economic Society of South Africa, vol. 75(2), pages 313-326, June.
    22. Susan Watkins & Ina Warriner, 2003. "How do we know we need to control for selectivity?," Demographic Research Special Collections, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 1(4), pages 109-142.
    23. Baird, Sarah & Hamory, Joan & Miguel, Edward, 2008. "Tracking, Attrition and Data Quality in the Kenyan Life Panel Survey Round 1 (KLPS-1)," Center for International and Development Economics Research, Working Paper Series qt3cw7p1hx, Center for International and Development Economics Research, Institute for Business and Economic Research, UC Berkeley.
    24. Martin Wittenberg & Mark Collinson, 2007. "Restructuring of Households in Rural South Africa: Reflections on Average Household Size in the Agincourt Sub-district 1992-2003," SALDRU Working Papers 12, Southern Africa Labour and Development Research Unit, University of Cape Town.
    25. Patrick Puhani, 2000. "The Heckman Correction for Sample Selection and Its Critique," Journal of Economic Surveys, Wiley Blackwell, vol. 14(1), pages 53-68, February.
    26. Harold Alderman & Jere Behrman & Hans-Peter Kohler & John A. Maluccio & Susan Watkins, 2001. "Attrition in Longitudinal Household Survey Data," Demographic Research, Max Planck Institute for Demographic Research, Rostock, Germany, vol. 5(4), pages 79-124.
    27. Jan Pickery & Geert Loosveldt & Ann Carton, 2001. "The Effects of Interviewer and Respondent Characteristics on Response Behavior in Panel Surveys," Sociological Methods & Research, , vol. 29(4), pages 509-523, May.
    28. Thomas MaCurdy & Thomas Mroz & R. Mark Gritz, 1998. "An Evaluation of the National Longitudinal Survey on Youth," Journal of Human Resources, University of Wisconsin Press, vol. 33(2), pages 345-436.
    29. Kasirye, Ibrahim & Ssewanyana, Sarah N., 2010. "Impacts and determinants of panel survey attrition: The case of Northern Uganda survey 2004-2008," Research Series 127536, Economic Policy Research Centre (EPRC).
    30. Shane A. Norris & Linda M. Richter & Stella A. Fleetwood, 2007. "Panel studies in developing countries: case analysis of sample attrition over the past 16 years within the birth to twenty cohort in Johannesburg, South Africa," Journal of International Development, John Wiley & Sons, Ltd., vol. 19(8), pages 1143-1150.
    31. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    32. repec:adr:anecst:y:1999:i:55-56:p:05 is not listed on IDEAS
    33. Nicoletti, Cheti & Peracchi, Franco & Foliano, Francesca, 2007. "Estimating income poverty in the presence of measurement error and missing data problems," ISER Working Paper Series 2007-15, Institute for Social and Economic Research.
    34. Oliver Lipps, 2009. "Attrition of Households and Individuals in Panel Surveys," SOEPpapers on Multidisciplinary Panel Data Research 164, DIW Berlin, The German Socio-Economic Panel (SOEP).
    35. Jacob A. Mincer, 1974. "Schooling and Earnings," NBER Chapters, in: Schooling, Experience, and Earnings, pages 41-63, National Bureau of Economic Research, Inc.
    36. John A. Maluccio, 2004. "Using Quality of Interview Information to Assess Nonrandom Attrition Bias in Developing‐Country Panel Data," Review of Development Economics, Wiley Blackwell, vol. 8(1), pages 91-109, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nic Baigrie & Katherine Eyal, 2014. "An Evaluation of the Determinants and Implications of Panel Attrition in the National Income Dynamics Survey (2008-2010)," South African Journal of Economics, Economic Society of South Africa, vol. 82(1), pages 39-65, March.
    2. Annah Vimbai Bengesai & Nompumelelo Nzimande, 2020. "The Association between Family Structure Changes and High School Completion in South Africa," Social Sciences, MDPI, vol. 9(8), pages 1-15, July.
    3. Dorrit Posel & Daniela Casale & Claire Vermaak, 2014. "Job Search and the Measurement of Unemployment in South Africa," South African Journal of Economics, Economic Society of South Africa, vol. 82(1), pages 66-80, March.
    4. Amina Ebrahim & Kezia Lilenstein, 2019. "Gender and the South African labour market: Policy relevant research possibilities using South African tax data," WIDER Working Paper Series wp-2019-31, World Institute for Development Economic Research (UNU-WIDER).
    5. Alfred K. Mukong & Ernest N. Tingum, 2018. "The Demand for Cigarettes: New Evidence from South Africa," Working Papers 745, Economic Research Southern Africa.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Teresa Molina Millán & Karen Macours, 2017. "Attrition in randomized control trials: Using tracking information to correct bias," FEUNL Working Paper Series novaf:wp1702, Universidade Nova de Lisboa, Faculdade de Economia.
    2. Thomas, Duncan & Witoelar, Firman & Frankenberg, Elizabeth & Sikoki, Bondan & Strauss, John & Sumantri, Cecep & Suriastini, Wayan, 2012. "Cutting the costs of attrition: Results from the Indonesia Family Life Survey," Journal of Development Economics, Elsevier, vol. 98(1), pages 108-123.
    3. Molina Millán, Teresa & Macours, Karen, 2017. "Attrition in Randomized Control Trials: Using Tracking Information to Correct Bias," IZA Discussion Papers 10711, Institute of Labor Economics (IZA).
    4. Nobuhiko Fuwa, 2010. "Should We Track Migrant Households When Collecting Household Panel Data? Household Relocation, Economic Mobility, and Attrition Biases in the Rural Philippines," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 93(1), pages 56-82.
    5. Alan Sánchez & Javier Escobal, 2020. "Survey attrition after 15 years of tracking children in four developing countries: The Young Lives study," Review of Development Economics, Wiley Blackwell, vol. 24(4), pages 1196-1216, November.
    6. Arslan, Aslihan & Taylor, J. Edward, 2011. "Whole-household migration, inequality and poverty in rural Mexico," Kiel Working Papers 1742, Kiel Institute for the World Economy (IfW Kiel).
    7. Sarah Xue Dong, 2016. "Consistency between Sakernas and the IFLS for Analyses of Indonesia’s Labour Market: A Cross-Validation Exercise," Bulletin of Indonesian Economic Studies, Taylor & Francis Journals, vol. 52(3), pages 343-378, September.
    8. repec:dau:papers:123456789/5443 is not listed on IDEAS
    9. Günalp, Burak & Cilasun, Seyit Mümin & Acar, Elif Öznur, 2013. "Male-Female Labor Market Participation and the Extent of Gender-Based Wage Discrimination in Turkey," MPRA Paper 51503, University Library of Munich, Germany.
    10. Marjan Petreski & Nikica Blazevski & Blagica Petreski, 2014. "Gender Wage Gap when Women are Highly Inactive: Evidence from Repeated Imputations with Macedonian Data," Journal of Labor Research, Springer, vol. 35(4), pages 393-411, December.
    11. Kossova, Elena & Potanin, Bogdan, 2018. "Heckman method and switching regression model multivariate generalization," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 50, pages 114-143.
    12. Serge Atherwood & Corey S Sparks, 2019. "Early-career trajectories of young workers in the U.S. in the context of the 2008–09 recession: The effect of labor market entry timing," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-30, March.
    13. Meghir, Costas & Rivkin, Steven, 2011. "Econometric Methods for Research in Education," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 1, pages 1-87, Elsevier.
    14. Jacqueline Mosomi, 2019. "Distributional changes in the gender wage gap in the post-apartheid South African labour market," WIDER Working Paper Series wp-2019-17, World Institute for Development Economic Research (UNU-WIDER).
    15. Farshid Vahid & Pushkar Maitra, 2005. "The Effect of Household Characteristics on Living Standards in South Africa 1993 - 98: A Quantile Regression Analysis with Sample Attrition," ANU Working Papers in Economics and Econometrics 2005-452, Australian National University, College of Business and Economics, School of Economics.
    16. Gabin Langevin & David Masclet & Fabien Moizeau & Emmanuel Peterle, 2017. "Ethnic gaps in educational attainment and labor-market outcomes: evidence from France," Education Economics, Taylor & Francis Journals, vol. 25(1), pages 84-111, January.
    17. Johnes, Geraint & Tanaka, Yasuhide, 2008. "Changes in gender wage discrimination in the 1990s: A tale of three very different economies," Japan and the World Economy, Elsevier, vol. 20(1), pages 97-113, January.
    18. Günalp, Burak & Cilasun, Seyit Mümin & Acar, Elif Öznur, 2013. "Male-Female Labor Market Participation and the Extent of Gender-Based Wage Discrimination in Turkey," MPRA Paper 51503, University Library of Munich, Germany.
    19. Paul W. Miller & Barry R. Chiswick, 2002. "Immigrant earnings: Language skills, linguistic concentrations and the business cycle," Journal of Population Economics, Springer;European Society for Population Economics, vol. 15(1), pages 31-57.
    20. Sandra Nieto & Raúl Ramos, 2013. "Non-Formal Education, Overeducation And Wages," Revista de Economia Aplicada, Universidad de Zaragoza, Departamento de Estructura Economica y Economia Publica, vol. 21(1), pages 5-28, Spring.
    21. Chloé Duvivier Duvivier & Mary-Françoise Renard & Shi Li, 2012. "Are workers close to cities paid higher non-agricultural wages in rural China?," CERDI Working papers halshs-00673698, HAL.

    More about this item

    Keywords

    attrition bias; panel surveys; South Africa; selection on observables; selection on unobservable.;
    All these keywords.

    JEL classification:

    • J10 - Labor and Demographic Economics - - Demographic Economics - - - General
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C24 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Truncated and Censored Models; Switching Regression Models; Threshold Regression Models
    • D00 - Microeconomics - - General - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ldr:wpaper:103. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alison Siljeur (email available below). General contact details of provider: https://edirc.repec.org/data/sauctza.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.