A Framework for Investigating Micro Data Quality, with Application to South African Labour Market Household Surveys
In this paper the Total Survey Error (TSE) paradigm is combined with detailed data quality indicators to develop a framework for investigating micro data quality. The TSE framework is widely used in the survey methodology literature to identify different components of error that arise in the survey process. Consequently, it provides a very useful typology for researchers to understand which data quality issues are relevant in applied work based on these surveys. In order to demonstrate how the framework sheds light on micro data quality, two labour market household surveys conducted by Statistics South Africa are reviewed, spanning a time-frame from 1995-2007. It is argued that efforts to improve data quality should involve a virtuous interaction between producers and consumers of micro data and should be considered an evolving process. For producers of data, the preparation and publication of detailed data quality frameworks is recommended, and two examples of these frameworks are reviewed. For consumers of data, judicious analyses of the univariate, bivariate and multivariate relationships in public-use versions of the datasets can help shed light on different components of survey error, and should be communicated back to survey organisations. Ultimately, improving data quality is about being more explicit about the limitations of data production at each stage of the process, which does not stop at initial public release.
|Date of creation:||2012|
|Date of revision:|
|Contact details of provider:|| Postal: |
Phone: +27 21 650 5696
Fax: +27 21 650 5697
Web page: http://www.saldru.uct.ac.za/
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Rosalia Vazquez-Alvarez, 2003. "Anchoring Bias and Covariate Nonresponse," University of St. Gallen Department of Economics working paper series 2003 2003-19, Department of Economics, University of St. Gallen.
- Nicola Branson, 2009. "Re-weighting the OHS and LFS National household Survey Data to create a consistent series over time: A Cross Entropy Estimation Approach," SALDRU Working Papers 38, Southern Africa Labour and Development Research Unit, University of Cape Town.
- Reza Daniels & Sandrine Rospabé, 2005. "Estimating an Earnings Function from Coarsened Data by an Interval Censored Regression Procedure," Working Papers 05091, University of Cape Town, Development Policy Research Unit.
- Servaas van der Berg & Megan Louw, 2003.
"Changing Patterns of South African income distribution: Towards time series estimates of distribution and poverty,"
02/2003, Stellenbosch University, Department of Economics.
- Servaas Van Der Berg & Megan Louw, 2004. "Changing Patterns Of South African Income Distribution: Towards Time Series Estimates Of Distribution And Poverty," South African Journal of Economics, Economic Society of South Africa, vol. 72(3), pages 546-572, 09.
- Martin Wittenberg, 2006. "Research Note: Errors In The October Household Survey 1994 Available From The South African Data Archive," South African Journal of Economics, Economic Society of South Africa, vol. 74(4), pages 766-768, December.
- Nicola Branson & Martin Wittenberg, 2007. "The Measurement Of Employment Status In South Africa Using Cohort Analysis, 1994-2004," South African Journal of Economics, Economic Society of South Africa, vol. 75(2), pages 313-326, 06.
- Nicola Branson & Martin Wittenberg, 2014.
"Reweighting South African National Household Survey Data to Create a Consistent Series Over Time: A Cross-Entropy Estimation Approach,"
South African Journal of Economics,
Economic Society of South Africa, vol. 82(1), pages 19-38, 03.
- Nicola Branson & Martin Wittenberg, 2011. "Re-weighting South African National Household Survey Data to create a consistent series over time: A cross entropy estimation approach," SALDRU Working Papers 54, Southern Africa Labour and Development Research Unit, University of Cape Town.
When requesting a correction, please mention this item's handle: RePEc:ldr:wpaper:90. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Alison Siljeur)
If references are entirely missing, you can add them using this form.