A Framework for Investigating Micro Data Quality, with Application to South African Labour Market Household Surveys
In this paper the Total Survey Error (TSE) paradigm is combined with detailed data quality indicators to develop a framework for investigating micro data quality. The TSE framework is widely used in the survey methodology literature to identify different components of error that arise in the survey process. Consequently, it provides a very useful typology for researchers to understand which data quality issues are relevant in applied work based on these surveys. In order to demonstrate how the framework sheds light on micro data quality, two labour market household surveys conducted by Statistics South Africa are reviewed, spanning a time-frame from 1995-2007. It is argued that efforts to improve data quality should involve a virtuous interaction between producers and consumers of micro data and should be considered an evolving process. For producers of data, the preparation and publication of detailed data quality frameworks is recommended, and two examples of these frameworks are reviewed. For consumers of data, judicious analyses of the univariate, bivariate and multivariate relationships in public-use versions of the datasets can help shed light on different components of survey error, and should be communicated back to survey organisations. Ultimately, improving data quality is about being more explicit about the limitations of data production at each stage of the process, which does not stop at initial public release.
|Date of creation:||2012|
|Contact details of provider:|| Postal: Private BagX3, Rondebosch, 7701, Cape Town|
Phone: +27 21 650 5696
Fax: +27 21 650 5697
Web page: http://www.saldru.uct.ac.za/
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Nicola Branson & Martin Wittenberg, 2014.
"Reweighting South African National Household Survey Data to Create a Consistent Series Over Time: A Cross-Entropy Estimation Approach,"
South African Journal of Economics,
Economic Society of South Africa, vol. 82(1), pages 19-38, 03.
- Nicola Branson & Martin Wittenberg, 2011. "Re-weighting South African National Household Survey Data to create a consistent series over time: A cross entropy estimation approach," SALDRU Working Papers 54, Southern Africa Labour and Development Research Unit, University of Cape Town.
- Nicola Branson & Martin Wittenberg, 2007. "The Measurement Of Employment Status In South Africa Using Cohort Analysis, 1994-2004," South African Journal of Economics, Economic Society of South Africa, vol. 75(2), pages 313-326, 06.
- Nicola Branson, 2009. "Re-weighting the OHS and LFS National household Survey Data to create a consistent series over time: A Cross Entropy Estimation Approach," SALDRU Working Papers 38, Southern Africa Labour and Development Research Unit, University of Cape Town.
- Servaas Van Der Berg & Megan Louw, 2004. "Changing Patterns Of South African Income Distribution: Towards Time Series Estimates Of Distribution And Poverty," South African Journal of Economics, Economic Society of South Africa, vol. 72(3), pages 546-572, 09.
- Servaas van der Berg & Megan Louw, 2003. "Changing Patterns of South African income distribution: Towards time series estimates of distribution and poverty," Working Papers 02/2003, Stellenbosch University, Department of Economics.
- Martin Wittenberg, 2006. "Research Note: Errors In The October Household Survey 1994 Available From The South African Data Archive," South African Journal of Economics, Economic Society of South Africa, vol. 74(4), pages 766-768, December.
- Rosalia Vazquez-Alvarez, 2003. "Anchoring Bias and Covariate Nonresponse," University of St. Gallen Department of Economics working paper series 2003 2003-19, Department of Economics, University of St. Gallen.
- Reza Daniels & Sandrine Rospabé, 2005. "Estimating an Earnings Function from Coarsened Data by an Interval Censored Regression Procedure," Working Papers 05091, University of Cape Town, Development Policy Research Unit. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:ldr:wpaper:90. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Alison Siljeur)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.