A Framework for Investigating Micro Data Quality, with Application to South African Labour Market Household Surveys
AbstractIn this paper the Total Survey Error (TSE) paradigm is combined with detailed data quality indicators to develop a framework for investigating micro data quality. The TSE framework is widely used in the survey methodology literature to identify different components of error that arise in the survey process. Consequently, it provides a very useful typology for researchers to understand which data quality issues are relevant in applied work based on these surveys. In order to demonstrate how the framework sheds light on micro data quality, two labour market household surveys conducted by Statistics South Africa are reviewed, spanning a time-frame from 1995-2007. It is argued that efforts to improve data quality should involve a virtuous interaction between producers and consumers of micro data and should be considered an evolving process. For producers of data, the preparation and publication of detailed data quality frameworks is recommended, and two examples of these frameworks are reviewed. For consumers of data, judicious analyses of the univariate, bivariate and multivariate relationships in public-use versions of the datasets can help shed light on different components of survey error, and should be communicated back to survey organisations. Ultimately, improving data quality is about being more explicit about the limitations of data production at each stage of the process, which does not stop at initial public release.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Southern Africa Labour and Development Research Unit, University of Cape Town in its series SALDRU Working Papers with number 90.
Date of creation: 2012
Date of revision:
Contact details of provider:
Postal: Leslie Social Science Building, Private Bag, Rondebosch, 7701
Phone: +27 21 650 5696
Fax: +27 21 650 5697
Web page: http://www.saldru.uct.ac.za/
More information through EDIRC
Data Quality Evaluation and Assessment; Total Survey Error;
Find related papers by JEL classification:
- C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data
- C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
This paper has been announced in the following NEP Reports:
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Servaas van der Berg & Megan Louw, 2003.
"Changing Patterns of South African income distribution: Towards time series estimates of distribution and poverty,"
02/2003, Stellenbosch University, Department of Economics.
- Servaas Van Der Berg & Megan Louw, 2004. "Changing Patterns Of South African Income Distribution: Towards Time Series Estimates Of Distribution And Poverty," South African Journal of Economics, Economic Society of South Africa, vol. 72(3), pages 546-572, 09.
- Reza Daniels & Sandrine Rospabé, 2005. "Estimating an Earnings Function from Coarsened Data by an Interval Censored Regression Procedure," Working Papers 05091, University of Cape Town, Development Policy Research Unit.
- Nicola Branson & Martin Wittenberg, 2007. "The Measurement Of Employment Status In South Africa Using Cohort Analysis, 1994-2004," South African Journal of Economics, Economic Society of South Africa, vol. 75(2), pages 313-326, 06.
- Nicola Branson & Martin Wittenberg, 2011. "Re-weighting South African National Household Survey Data to create a consistent series over time: A cross entropy estimation approach," SALDRU Working Papers 54, Southern Africa Labour and Development Research Unit, University of Cape Town.
- Nicola Branson, 2009. "Re-weighting the OHS and LFS National household Survey Data to create a consistent series over time: A Cross Entropy Estimation Approach," SALDRU Working Papers 38, Southern Africa Labour and Development Research Unit, University of Cape Town.
- Martin Wittenberg, 2006. "Research Note: Errors In The October Household Survey 1994 Available From The South African Data Archive," South African Journal of Economics, Economic Society of South Africa, vol. 74(4), pages 766-768, December.
- Rosalia Vazquez-Alvarez, 2003. "Anchoring Bias and Covariate Nonresponse," University of St. Gallen Department of Economics working paper series 2003 2003-19, Department of Economics, University of St. Gallen.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Alison Siljeur).
If references are entirely missing, you can add them using this form.