IDEAS home Printed from https://ideas.repec.org/a/uwp/jhriss/v56y2021i4p1254-1295.html
   My bibliography  Save this article

Measuring Skills in Developing Countries

Author

Listed:
  • Rachid Laaja
  • Karen Macours

Abstract

Measures of cognitive, noncognitive, and technical skills are increasingly used in surveys in developing countries, but have mostly been validated in high-income countries. We use a survey experiment in Western Kenya to test the reliability and validity of commonly used skills measures. Cognitive skills measures are found to be reliable and internally consistent, technical skills are very noisy, and measurement error in noncognitive skills is found to be nonclassical. Addressing both random and systematic measurement error using common psychometric practices and repeated measures leads to some improvements and clearer predictions, though concerns remain. These findings hold for a replication in Colombia.

Suggested Citation

  • Rachid Laaja & Karen Macours, 2021. "Measuring Skills in Developing Countries," Journal of Human Resources, University of Wisconsin Press, vol. 56(4), pages 1254-1295.
    • Handle: RePEc:uwp:jhriss:v:56:y:2021:i:4:p:1254-1295
    Note: DOI: 10.3368/jhr.56.4.1018-9805R1
    as

    Download full text from publisher

    File URL: http://jhr.uwpress.org/cgi/reprint/56/4/1254
    Download Restriction: A subscripton is required to access pdf files. Pay per article is available.
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), 2011. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 4, number 4, June.
    2. Orazio Attanasio & Sarah Cattan & Emla Fitzsimons & Costas Meghir & Marta Rubio-Codina, 2015. "Estimating the Production Function for Human Capital: Results from a Randomized Control Trial in Colombia," Cowles Foundation Discussion Papers 1987, Cowles Foundation for Research in Economics, Yale University.
    3. Lori Beaman & Jeremy Magruder, 2012. "Who Gets the Job Referral? Evidence from a Social Networks Experiment," American Economic Review, American Economic Association, vol. 102(7), pages 3574-3593, December.
    4. Florence Kondylis & Valerie Mueller & S. Zhu, 2015. "Measuring agricultural knowledge and adoption," Agricultural Economics, International Association of Agricultural Economists, vol. 46(3), pages 449-462, May.
    5. Ernesto Dal Bó & Frederico Finan & Martín A. Rossi, 2013. "Strengthening State Capabilities: The Role of Financial Incentives in the Call to Public Service," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(3), pages 1169-1218.
    6. de Mel, Suresh & McKenzie, David & Woodruff, Christopher, 2009. "Innovative Firms or Innovative Owners? Determinants of Innovation in Micro, Small, and Medium Enterprises," IZA Discussion Papers 3962, Institute of Labor Economics (IZA).
    7. Matthew Groh & David McKenzie & Tara Vishwanath, 2015. "Reducing Information Asymmetries in the Youth Labor Market of Jordan with Psychometrics and Skill Based Tests," The World Bank Economic Review, World Bank, vol. 29(suppl_1), pages 106-117.
    8. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    9. Timothy N. Bond & Kevin Lang, 2018. "The Sad Truth About Happiness Scales: Empirical Results," NBER Working Papers 24853, National Bureau of Economic Research, Inc.
    10. John Horn, 1965. "A rationale and test for the number of factors in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 30(2), pages 179-185, June.
    11. Orazio Attanasio & Sarah Cattan & Emla Fitzsimons & Costas Meghir & Marta Rubio-Codina, 2020. "Estimating the Production Function for Human Capital: Results from a Randomized Controlled Trial in Colombia," American Economic Review, American Economic Association, vol. 110(1), pages 48-85, January.
    12. Blattman, Christopher & Dercon, Stefan, 2016. "Occupational choice in early industrializing societies: Experimental evidence on the income and health effects of industrial an," CEPR Discussion Papers 11556, C.E.P.R. Discussion Papers.
    13. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    14. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    15. David McKenzie & Christopher Woodruff, 2014. "What Are We Learning from Business Training and Entrepreneurship Evaluations around the Developing World?," The World Bank Research Observer, World Bank, vol. 29(1), pages 48-82.
    16. Pascaline Dupas & Jonathan Robinson, 2013. "Savings Constraints and Microenterprise Development: Evidence from a Field Experiment in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 5(1), pages 163-192, January.
    17. repec:oup:qjecon:v:129:y:2014:i:2:p:939-993. is not listed on IDEAS
    18. Ali Hasanain & Saad Gulzar & Arman Rezaee & Yasir Khan, 2015. "Personalities and Public Sector Performance: Evidence from a Health Experiment in Pakistan," Working Papers id:6690, eSocialSciences.
    19. Macours, Karen & Barham, Tania & Maluccio, John, 2017. "Are Conditional Cash Transfers Fulfilling Their Promise? Schooling, Learning, and Earnings After 10 Years," CEPR Discussion Papers 11937, C.E.P.R. Discussion Papers.
    20. Flavio Cunha & James J. HECKMAN, 2009. "Investing in our Young People," Rivista Internazionale di Scienze Sociali, Vita e Pensiero, Pubblicazioni dell'Universita' Cattolica del Sacro Cuore, vol. 117(3), pages 387-418.
    21. Almlund, Mathilde & Duckworth, Angela Lee & Heckman, James & Kautz, Tim, 2011. "Personality Psychology and Economics," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 4, chapter 0, pages 1-181, Elsevier.
    22. Melissa Osborne & Herbert Gintis & Samuel Bowles, 2001. "The Determinants of Earnings: A Behavioral Approach," Journal of Economic Literature, American Economic Association, vol. 39(4), pages 1137-1176, December.
    23. Blattman,Christopher & Jamison,Julian C & Sheridan,Margaret, 2016. "Reducing crime and violence : experimental evidence on adult noncognitive investments in Liberia," Policy Research Working Paper Series 7648, The World Bank.
    24. Suresh de Mel & David McKenzie & Christopher Woodruff, 2010. "Who are the Microenterprise Owners? Evidence from Sri Lanka on Tokman versus De Soto," NBER Chapters, in: International Differences in Entrepreneurship, pages 63-87, National Bureau of Economic Research, Inc.
    25. Sayantan Ghosal & Smarajit Jana & Anandi Mani & Sandip Mitra & Sanchari Roy, 2022. "Sex Workers, Stigma, and Self-Image: Evidence from Kolkata Brothels," The Review of Economics and Statistics, MIT Press, vol. 104(3), pages 431-448, May.
    26. Delavande, Adeline & Giné, Xavier & McKenzie, David, 2011. "Measuring subjective expectations in developing countries: A critical review and new evidence," Journal of Development Economics, Elsevier, vol. 94(2), pages 151-163, March.
    27. Susan Athey & Guido Imbens, 2016. "The Econometrics of Randomized Experiments," Papers 1607.00698, arXiv.org.
    28. David Lagakos & Michael E. Waugh, 2013. "Selection, Agriculture, and Cross-Country Productivity Differences," American Economic Review, American Economic Association, vol. 103(2), pages 948-980, April.
    29. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    30. Murnane, Richard J & Willett, John B & Levy, Frank, 1995. "The Growing Importance of Cognitive Skills in Wage Determination," The Review of Economics and Statistics, MIT Press, vol. 77(2), pages 251-266, May.
    31. Tanguy Bernard & Alemayehu Seyoum Taffesse, 2014. "Aspirations: An approach to measurement with validation using ethiopian data," Post-Print hal-03022496, HAL.
    32. Suresh de Mel & David McKenzie & Christopher Woodruff, 2009. "Are Women More Credit Constrained? Experimental Evidence on Gender and Microenterprise Returns," American Economic Journal: Applied Economics, American Economic Association, vol. 1(3), pages 1-32, July.
    33. Henry Kaiser, 1958. "The varimax criterion for analytic rotation in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 23(3), pages 187-200, September.
    34. Lee Cronbach, 1951. "Coefficient alpha and the internal structure of tests," Psychometrika, Springer;The Psychometric Society, vol. 16(3), pages 297-334, September.
    35. Godtland, Erin M & Sadoulet, Elisabeth & De Janvry, Alain & Murgai, Rinku & Ortiz, Oscar, 2004. "The Impact of Farmer Field Schools on Knowledge and Productivity: A Study of Potato Farmers in the Peruvian Andes," Economic Development and Cultural Change, University of Chicago Press, vol. 53(1), pages 63-92, October.
    36. Heckman, James J., 2011. "Integrating Personality Psychology into Economics," IZA Discussion Papers 5950, Institute of Labor Economics (IZA).
    37. Steven Buck & Jeffrey Alwang, 2011. "Agricultural extension, trust, and learning: results from economic experiments in Ecuador," Agricultural Economics, International Association of Agricultural Economists, vol. 42(6), pages 685-699, November.
    38. Jessica Leight & Paul Glewwe & Albert Park, 2015. "The Impact of Early Childhood Rainfall Shocks on the Evolution of Cognitive and Non-cognitive Skills," Department of Economics Working Papers 2016-14, Department of Economics, Williams College, revised Oct 2016.
    39. Mauceri, Maria & Alwang, Jeffrey Roger & Norton, George W. & Barrera, Victor, 2007. "Effectiveness of Integrated Pest Management Dissemination Techniques: A Case Study of Potato Farmers in Carchi, Ecuador," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 39(3), pages 1-16, December.
    40. George Judge & Laura Schechter, 2009. "Detecting Problems in Survey Data Using Benford’s Law," Journal of Human Resources, University of Wisconsin Press, vol. 44(1).
    41. Douglas Gollin & David Lagakos & Michael E. Waugh, 2014. "The Agricultural Productivity Gap," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(2), pages 939-993.
    42. Rema Hanna & Sendhil Mullainathan & Joshua Schwartzstein, 2014. "Learning Through Noticing: Theory and Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1311-1353.
    43. Dercon, Stefan & Orkin, Kate & Bernard, Tanguy & Taffesse, Alemayehu, 2014. "The Future in Mind: Aspirations and Forward-Looking Behaviour in Rural Ethiopia," CEPR Discussion Papers 10224, C.E.P.R. Discussion Papers.
    44. Heckman, James J, 1995. "Lessons from the Bell Curve," Journal of Political Economy, University of Chicago Press, vol. 103(5), pages 1091-1120, October.
    45. Phillips, Joseph M, 1994. "Farmer Education and Farmer Efficiency: A Meta-Analysis," Economic Development and Cultural Change, University of Chicago Press, vol. 43(1), pages 149-165, October.
    46. Jones, Maria & Kondylis, Florence, 2018. "Does feedback matter? Evidence from agricultural services," Journal of Development Economics, Elsevier, vol. 131(C), pages 28-41.
    47. Jamison, Dean T. & Moock, Peter R., 1984. "Farmer education and farm efficiency in Nepal: The role of schooling, extension services, and cognitive skills," World Development, Elsevier, vol. 12(1), pages 67-86, January.
    48. Gershon Feder & Rinku Murgai & Jaime B. Quizon, 2004. "The Acquisition and Diffusion of Knowledge: The Case of Pest Management Training in Farmer Field Schools, Indonesia," Journal of Agricultural Economics, Wiley Blackwell, vol. 55(2), pages 221-243, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Attanasio, Orazio & Blundell, Richard & Conti, Gabriella & Mason, Giacomo, 2020. "Inequality in socio-emotional skills: A cross-cohort comparison," Journal of Public Economics, Elsevier, vol. 191(C).
    2. Achyuta Adhvaryu & Anant Nyshadham & Jorge A. Tamayo, 2019. "Managerial Quality and Productivity Dynamics," NBER Working Papers 25852, National Bureau of Economic Research, Inc.
    3. Bühler, Dorothee & Sharma, Rasadhika & Stein, Wiebke, 2020. "Occupational Attainment and Earnings in Southeast Asia: The Role of Non-cognitive Skills," Labour Economics, Elsevier, vol. 67(C).
    4. James J. Heckman, 2008. "Schools, Skills, And Synapses," Economic Inquiry, Western Economic Association International, vol. 46(3), pages 289-324, July.
    5. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    6. Glewwe, Paul & Huang, Qiuqiong & Park, Albert, 2017. "Cognitive skills, noncognitive skills, and school-to-work transitions in rural China," Journal of Economic Behavior & Organization, Elsevier, vol. 134(C), pages 141-164.
    7. Thiel, Hendrik & Thomsen, Stephan L., 2013. "Noncognitive skills in economics: Models, measurement, and empirical evidence," Research in Economics, Elsevier, vol. 67(2), pages 189-214.
    8. Heckman, James J. & Kautz, Tim, 2012. "Hard evidence on soft skills," Labour Economics, Elsevier, vol. 19(4), pages 451-464.
    9. Trivitt, Julie & Cheng, Albert, 2016. "When you say nothing at all: The predictive power of student effort on surveysAuthor-Name: Hitt, Collin," Economics of Education Review, Elsevier, vol. 52(C), pages 105-119.
    10. Nicoletti, Cheti & Tonei, Valentina, 2020. "Do parental time investments react to changes in child’s skills and health?," European Economic Review, Elsevier, vol. 127(C).
    11. Schurer, Stefanie, 2017. "Bouncing back from health shocks: Locus of control and labor supply," Journal of Economic Behavior & Organization, Elsevier, vol. 133(C), pages 1-20.
    12. Orazio Attanasio & Sarah Cattan & Emla Fitzsimons & Costas Meghir & Marta Rubio-Codina, 2020. "Estimating the Production Function for Human Capital: Results from a Randomized Controlled Trial in Colombia," American Economic Review, American Economic Association, vol. 110(1), pages 48-85, January.
    13. Calero, Carla & Gonzalez Diez, Veronica & Soares, Yuri S.D. & Kluve, Jochen & Corseuil, Carlos Henrique, 2017. "Can arts-based interventions enhance labor market outcomes among youth? Evidence from a randomized trial in Rio de Janeiro," Labour Economics, Elsevier, vol. 45(C), pages 131-142.
    14. José Manuel Cordero Ferrera & Manuel Muñiz Pérez & Rosa Simancas Rodríguez, 2015. "The influence of socioeconomic factors on cognitive and non-cognitive educational outcomes," Investigaciones de Economía de la Educación volume 10, in: Marta Rahona López & Jennifer Graves (ed.), Investigaciones de Economía de la Educación 10, edition 1, volume 10, chapter 21, pages 413-438, Asociación de Economía de la Educación.
    15. Engelhardt, Carina, 2017. "Unemployment and personality: Are conscientiousness and agreeableness related to employability?," Hannover Economic Papers (HEP) dp-621, Leibniz Universität Hannover, Wirtschaftswissenschaftliche Fakultät.
    16. Humphries, John Eric & Kosse, Fabian, 2017. "On the interpretation of non-cognitive skills – What is being measured and why it matters," Journal of Economic Behavior & Organization, Elsevier, vol. 136(C), pages 174-185.
    17. James J. Heckman & Chase O. Corbin, 2016. "Capabilities and Skills," Journal of Human Development and Capabilities, Taylor & Francis Journals, vol. 17(3), pages 342-359, July.
    18. Gensowski, Miriam, 2018. "Personality, IQ, and lifetime earnings," Labour Economics, Elsevier, vol. 51(C), pages 170-183.
    19. James Heckman & Flavio Cunha, 2007. "The Technology of Skill Formation," American Economic Review, American Economic Association, vol. 97(2), pages 31-47, May.
    20. Kautz, Tim & Heckman, James J. & Diris, Ron & ter Weel, Bas & Borghans, Lex, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," IZA Discussion Papers 8696, Institute of Labor Economics (IZA).

    More about this item

    JEL classification:

    • O12 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Microeconomic Analyses of Economic Development
    • O13 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Agriculture; Natural Resources; Environment; Other Primary Products
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:uwp:jhriss:v:56:y:2021:i:4:p:1254-1295. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://jhr.uwpress.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.