Who Responds to Voluntary Cognitive Tests in Household Surveys? The Role of Labour Market Status, Respondent Confidence, Motivation and a Culture of Learning in South Africa
AbstractBoth South Africa’s labour market and education system were directly influenced by the separate development policies of the apartheid regime. To this day, great inequalities persist in both domains. South Africa’s performance in standardized international test scores (such as TIMMS) is poor even relative to most developing countries. Furthermore, the better quality of outcomes in former white schools still leaves learners from former black schools at a disadvantage that feeds through to severe labour market inequalities. This study is the first in a series of papers that attempts to understand the role of school quality on labour market outcomes. Here we scrutinize the measurement of numeracy test scores in the National Income Dynamics Survey (NIDS) of 2008, particularly in light of potential sample selection issues. While this survey measures standard welfare and labour market indicators, it is one of the first in South Africa to also ask respondents to complete a concurrent numeracy test. Response rates on this module were particularly low, given that the test was taken on a voluntary basis. We develop a basic empirical model to understand who is likely to take the test. We postulate that discouraged workers’ low propensity to take the test is correlated with their reduced motivation to undertake job search, that the searching unemployed are highly motivated to take the test (as they wish to gauge their ability or practice assessments while embarking on the job search process), the poorest among the self-employed face severe time opportunity costs (as their low incomes are less secure than those of salaried workers) and the richest amongst the employed exhibit an income effect (in that the time opportunity costs of their high incomes reduce their willingness to respond to the numeracy test). Furthermore, locational effects suggest that those residing in geographical “points of entry” into the labour market are also more likely to take the test. The young (who are still in education) and the most educated (in the whole population) also tend to answer the test more readily. The latter observations indicate that some form of confidence in respondents’ own abilities drives their response patterns. To explain these observed features, we construct composite indices of motivation/emotional well-being and individuals’ confidence in their writing abilities using multiple correspondence analysis. While each of these psychological and behavioural factors is a strong predictor of test response, they do not entirely eliminate the independent contributions of each of the observed influences mentioned above. Coefficient magnitudes of each of the sociodemographic variables are, however, reduced, indicating that the particular behavioural influences introduced in later models tell some of the story. Additional uncaptured behavioural and motivational factors are therefore investigated. Firstly, we investigate the role of survey fatigue (by controlling for the time it took to complete the survey before the test was administered), which plays an important role in the black and coloured subpopulations. It furthermore explains why the wealthiest amongst the formally employed are less likely to complete the numeracy test. However, surprisingly, “pseudoaltruistic” effects appear amongst the (wealthier) white population, in that the longer the duration of the preceding questions, the more likely they are to care about answering the test. However, this result cannot be generalized to the whole white population, as response rates were very low among this group. Secondly, (household) peer effects are strong throughout the population, suggesting that a culture of learning is pivotal in understanding response patterns. The results of this paper suggest that broad sociodemographic and labour market features remain important determinants of test response, even after controlling for behavioural features. This suggests that subsequent labour market work must take these drivers into account to avoid the risk of sample selection bias.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Stellenbosch University, Department of Economics in its series Working Papers with number 27/2010.
Date of creation: 2010
Date of revision:
education; behavioural economics; survey design; voluntary assessment; numeracy; survey non-response; sample selection bias; respondent confidence; motivation; culture of learning; South Africa;
Find related papers by JEL classification:
- C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data
- C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
- D03 - Microeconomics - - General - - - Behavioral Economics; Underlying Principles
- I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
This paper has been announced in the following NEP Reports:
- NEP-AFR-2011-01-03 (Africa)
- NEP-ALL-2011-01-03 (All new papers)
- NEP-CBE-2011-01-03 (Cognitive & Behavioural Economics)
- NEP-LAB-2011-01-03 (Labour Economics)
- NEP-NEU-2011-01-03 (Neuroeconomics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Chevalier, Arnaud & Gibbons, Steve & Thorpe, Andy & Snell, Martin & Hoskins, Sherria, 2007.
"Students' Academic Self-Perception,"
IZA Discussion Papers
3031, Institute for the Study of Labor (IZA).
- Arnaud Chevalier & Steve Gibbons & Andy Thorpe & Sherria Hoskins, 2007. "Students' Academic Self Perception," Working Papers 200729, Geary Institute, University College Dublin.
- Arnaud Chevalier & Steve Gibbons & Sherria Hoskins & Martin Snell & Andy Thorpe, 2008. "Students academic self-perception," CEE Discussion Papers 0090, Centre for the Economics of Education, LSE.
- Allen, Chris T & Machleit, Karen A & Kleine, Susan Schultz, 1992. " A Comparison of Attitudes and Emotions as Predictors of Behavior at Diverse Levels of Behavioral Experience," Journal of Consumer Research, University of Chicago Press, vol. 18(4), pages 493-504, March.
- Eric A. Hanushek & Ludger Woessmann, 2010.
"Sample Selectivity and the Validity of International Student Achievement Tests in Economic Research,"
NBER Working Papers
15867, National Bureau of Economic Research, Inc.
- Hanushek, Eric A. & Woessmann, Ludger, 2011. "Sample selectivity and the validity of international student achievement tests in economic research," Economics Letters, Elsevier, vol. 110(2), pages 79-82, February.
- Eric A. Hanushek & Ludger Woessmann, 2010. "Sample Selectivity and the Validity of International Student Achievement Tests in Economic Research," CESifo Working Paper Series 3007, CESifo Group Munich.
- Hanushek, Eric A. & Woessmann, Ludger, 2010. "Sample Selectivity and the Validity of International Student Achievement Tests in Economic Research," IZA Discussion Papers 4926, Institute for the Study of Labor (IZA).
- Childers, Terry L & Rao, Akshay R, 1992. " The Influence of Familial and Peer-Based Reference Groups on Consumer Decisions," Journal of Consumer Research, University of Chicago Press, vol. 19(2), pages 198-211, September.
- Eric A. Hanushek & Ludger Woessmann, 2008.
"The Role of Cognitive Skills in Economic Development,"
Journal of Economic Literature,
American Economic Association, vol. 46(3), pages 607-68, September.
- Eric Hanushek & Ludger Wobmann, 2008. "The Role of Cognitive Skills in Economic Development," Discussion Papers 07-034, Stanford Institute for Economic Policy Research.
- Geeta Kingdon & John Knight, 2000.
"Are Searching and Non-searching Unemployment Distinct States when Unemployment is High? The Case of South Africa,"
Economics Series Working Papers
WPS/2000-02, University of Oxford, Department of Economics.
- Geeta G. Kingdon & John B. Knight, 2000. "Are searching and non-searching unemployment distinct states when unemployment is high? The case of South Africa," CSAE Working Paper Series 2000-02, Centre for the Study of African Economies, University of Oxford.
- Blair, Edward & Burton, Scot, 1987. " Cognitive Processes Used by Survey Respondents to Answer Behavioral Frequency Questions," Journal of Consumer Research, University of Chicago Press, vol. 14(2), pages 280-88, September.
- Lindbeck, Assar, 1997.
"Incentives and Social Norms in Household Behavior,"
American Economic Review,
American Economic Association, vol. 87(2), pages 370-77, May.
- Megan Louw & Servaas Van der berg & Derek Yu, 2007. "Convergence Of A Kind: Educational Attainment And Intergenerational Social Mobility In South Africa," South African Journal of Economics, Economic Society of South Africa, vol. 75(3), pages 548-571, 09.
- Booysen, Frikkie & van der Berg, Servaas & Burger, Ronelle & Maltitz, Michael von & Rand, Gideon du, 2008. "Using an Asset Index to Assess Trends in Poverty in Seven Sub-Saharan African Countries," World Development, Elsevier, vol. 36(6), pages 1113-1130, June.
- Burks, Stephen V. & Carpenter, Jeffrey P. & Götte, Lorenz & Rustichini, Aldo, 2010. "Overconfidence is a Social Signaling Bias," IZA Discussion Papers 4840, Institute for the Study of Labor (IZA).
- Ardington, Cally & Lam, David & Leibbrandt, Murray & Welch, Matthew, 2006. "The sensitivity to key data imputations of recent estimates of income poverty and inequality in South Africa," Economic Modelling, Elsevier, vol. 23(5), pages 822-835, September.
- Gilley, Otis W. & Leone, Robert P., 1991. "A two-stage imputation procedure for item nonresponse in surveys," Journal of Business Research, Elsevier, vol. 22(4), pages 281-291, June.
- Mia de Vos, 2011. "Quantitative and qualitative aspects of education in South Africa: An analysis using the National Income Dynamic Study," Working Papers 06/2011, Stellenbosch University, Department of Economics.
- Gideon du Rand & Hendrik van Broekhuizen & Dieter von Fintel, 2011. "Numeric competence, confidence and school quality in the South African wage function: towards understanding pre-labour market discrimination," Working Papers 12/2011, Stellenbosch University, Department of Economics.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Melt van Schoor).
If references are entirely missing, you can add them using this form.