IDEAS home Printed from https://ideas.repec.org/a/eee/ecoedu/v52y2016icp105-119.html
   My bibliography  Save this article

When you say nothing at all: The predictive power of student effort on surveysAuthor-Name: Hitt, Collin

Author

Listed:
  • Trivitt, Julie
  • Cheng, Albert

Abstract

Character traits and noncognitive skills are important for human capital development and long-run life outcomes. Research in economics and psychology now shows this convincingly. But research into the exact determinants of noncognitive skills has been slowed by a common data limitation: most large-scale datasets do not contain adequate measures of noncognitive skills. This is particularly problematic in education policy evaluation. We demonstrate that within any survey dataset, there is important latent information that can be used as a proxy measure of noncognitive skills. Specifically, we examine the amount of conscientious effort that students exhibit on surveys, as measured by their item response rates. We use six nationally-representative, longitudinal surveys of American youth. We find that the percentage of questions skipped during the baseline year when respondents were adolescents is a significant predictor of later-life educational attainment, net of cognitive ability. Insofar as item response rates affect employment and income, they do so through their effect on educational attainment. The pattern of findings gives compelling reasons to view item response rates as a promising behavioral measure of noncognitive skills for use in future research. We posit that response rates are a measure of conscientiousness, though additional research is required to determine what exact noncognitive skills are being captured by item response rates.

Suggested Citation

  • Trivitt, Julie & Cheng, Albert, 2016. "When you say nothing at all: The predictive power of student effort on surveysAuthor-Name: Hitt, Collin," Economics of Education Review, Elsevier, vol. 52(C), pages 105-119.
  • Handle: RePEc:eee:ecoedu:v:52:y:2016:i:c:p:105-119
    DOI: 10.1016/j.econedurev.2016.02.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0272775716300541
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.econedurev.2016.02.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), 2011. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 4, number 4, June.
    2. repec:mpr:mprres:5086 is not listed on IDEAS
    3. Coughlin, Conor & Castilla, Carolina, 2014. "The effect of private high school education on the college trajectory," Economics Letters, Elsevier, vol. 125(2), pages 200-203.
    4. James Heckman, 2011. "Policies to foster human capital," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 73-137.
    5. Lex Borghans & Angela Lee Duckworth & James J. Heckman & Bas ter Weel, 2008. "The Economics and Psychology of Personality Traits," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    6. Heckman, James J. & Kautz, Tim, 2012. "Hard evidence on soft skills," Labour Economics, Elsevier, vol. 19(4), pages 451-464.
    7. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    8. Robert Kaestner & Kevin Callison, 2011. "Adolescent Cognitive and Noncognitive Correlates of Adult Health," Journal of Human Capital, University of Chicago Press, vol. 5(1), pages 29-69.
    9. Carmit Segal, 2013. "Misbehavior, Education, And Labor Market Outcomes," Journal of the European Economic Association, European Economic Association, vol. 11(4), pages 743-779, August.
    10. James J. Heckman & Jora Stixrud & Sergio Urzua, 2006. "The Effects of Cognitive and Noncognitive Abilities on Labor Market Outcomes and Social Behavior," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 411-482, July.
    11. Carmit Segal, 2012. "Working When No One Is Watching: Motivation, Test Scores, and Economic Success," Management Science, INFORMS, vol. 58(8), pages 1438-1457, August.
    12. Lex Borghans & Bas ter Weel & Bruce A. Weinberg, 2008. "Interpersonal Styles and Labor Market Outcomes," Journal of Human Resources, University of Wisconsin Press, vol. 43(4).
    13. Ali Hasanain & Saad Gulzar & Arman Rezaee & Yasir Khan, 2015. "Personalities and Public Sector Performance: Evidence from a Health Experiment in Pakistan," Working Papers id:6690, eSocialSciences.
    14. Almlund, Mathilde & Duckworth, Angela Lee & Heckman, James & Kautz, Tim, 2011. "Personality Psychology and Economics," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 4, chapter 0, pages 1-181, Elsevier.
    15. Melissa Osborne & Herbert Gintis & Samuel Bowles, 2001. "The Determinants of Earnings: A Behavioral Approach," Journal of Economic Literature, American Economic Association, vol. 39(4), pages 1137-1176, December.
    16. McGee, Andrew & McGee, Peter, 2016. "Search, effort, and locus of control," Journal of Economic Behavior & Organization, Elsevier, vol. 126(PA), pages 89-101.
    17. Greg J. Duncan & Katherine Magnuson, 2013. "Investing in Preschool Programs," Journal of Economic Perspectives, American Economic Association, vol. 27(2), pages 109-132, Spring.
    18. Chingos, Matthew M. & Peterson, Paul E., 2015. "Experimentally estimated impacts of school vouchers on college enrollment and degree attainment," Journal of Public Economics, Elsevier, vol. 122(C), pages 1-12.
    19. John Deke & Joshua Haimson, "undated". "Valuing Student Competencies: Which Ones Predict Postsecondary Educational Attainment and Earnings, and for Whom?," Mathematica Policy Research Reports be1c67f2201f4640b7381c0fa, Mathematica Policy Research.
    20. Petter Lundborg & Paul Nystedt & Dan-Olof Rooth, 2014. "Height and Earnings: The Role of Cognitive and Noncognitive Skills," Journal of Human Resources, University of Wisconsin Press, vol. 49(1), pages 141-166.
    21. Heckman, James J., 2011. "Integrating Personality Psychology into Economics," IZA Discussion Papers 5950, Institute of Labor Economics (IZA).
    22. Will Dobbie & Roland G. Fryer Jr., 2015. "The Medium-Term Impacts of High-Achieving Charter Schools," Journal of Political Economy, University of Chicago Press, vol. 123(5), pages 985-1037.
    23. Erik Lindqvist & Roine Vestman, 2011. "The Labor Market Returns to Cognitive and Noncognitive Ability: Evidence from the Swedish Enlistment," American Economic Journal: Applied Economics, American Economic Association, vol. 3(1), pages 101-128, January.
    24. Cawley, John & Heckman, James & Vytlacil, Edward, 2001. "Three observations on wages and measured cognitive ability," Labour Economics, Elsevier, vol. 8(4), pages 419-442, September.
    25. Gerrit Mueller & Erik Plug, 2006. "Estimating the Effect of Personality on Male and Female Earnings," ILR Review, Cornell University, ILR School, vol. 60(1), pages 3-22, October.
    26. Yona Rubinstein & James J. Heckman, 2001. "The Importance of Noncognitive Skills: Lessons from the GED Testing Program," American Economic Review, American Economic Association, vol. 91(2), pages 145-149, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cheng, Albert & Zamarro, Gema, 2018. "Measuring teacher non-cognitive skills and its impact on students: Insight from the Measures of Effective Teaching Longitudinal Database," Economics of Education Review, Elsevier, vol. 64(C), pages 251-260.
    2. Marianna Battaglia & Marisa Hidalgo-Hidalgo, 2020. "Non-Cognitive Skills and Remedial Education: Good News for Girls," Working Papers 20.10, Universidad Pablo de Olavide, Department of Economics.
    3. Francesca Borgonovi & Alessandro Ferrara & Mario Piacentini, 2020. "From asking to observing. Behavioural measures of socio-emotional and motivational skills in large-scale assessments," DoQSS Working Papers 20-19, Quantitative Social Science - UCL Social Research Institute, University College London.
    4. Sonja C. Kassenboehmer & Stefanie Schurer, 2018. "Survey item-response behavior as an imperfect proxy for unobserved ability: Theory and application," Working Papers 2018-035, Human Capital and Economic Opportunity Working Group.
    5. Mariagrazia Cavallo & Giuseppe Russo, 2020. "Reading Performance and Math Performance of Second-Generation Children in Italy," CSEF Working Papers 554, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    6. Esther Ulitzsch & Qiwei He & Vincent Ulitzsch & Hendrik Molter & André Nichterlein & Rolf Niedermeier & Steffi Pohl, 2021. "Combining Clickstream Analyses and Graph-Modeled Data Clustering for Identifying Common Response Processes," Psychometrika, Springer;The Psychometric Society, vol. 86(1), pages 190-214, March.
    7. Zhang, Yi & He, Jia, 2023. "Measuring non-cognitive skills exploiting log-files on online behaviour," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    8. Dimitrios Nikolaou, 2022. "Bullying, cyberbullying, and youth health behaviors," Kyklos, Wiley Blackwell, vol. 75(1), pages 75-105, February.
    9. Dorner, Zack & Lancsar, Emily, 2023. "Don’t pay the highly motivated too much," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    10. Gema Zamarro & Malachi Nichols & Angela L Duckworth & Sidney K D’Mello, 2020. "Validation of survey effort measures of grit and self-control in a sample of high school students," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-16, July.
    11. Zamarro, Gema & Cheng, Albert & Shakeel, M. Danish & Hitt, Collin, 2018. "Comparing and validating measures of non-cognitive traits: Performance task measures and self-reports from a nationally representative internet panel," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 72(C), pages 51-60.
    12. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2018. "Test scores, noncognitive skills and economic growth," Economics of Education Review, Elsevier, vol. 63(C), pages 134-153.
    13. Rodríguez-Planas, Núria & Nollenberger, Natalia, 2018. "Let the girls learn! It is not only about math … it's about gender social norms," Economics of Education Review, Elsevier, vol. 62(C), pages 230-253.
    14. Nollenberger, Natalia & Rodríguez-Planas, Núria, 2017. "Let the Girls Learn! I It is not Only about Math... It’s about Gender Social Norm," IZA Discussion Papers 10625, Institute of Labor Economics (IZA).
    15. Gregor Gonza & Anže Burger, 2017. "Subjective Well-Being During the 2008 Economic Crisis: Identification of Mediating and Moderating Factors," Journal of Happiness Studies, Springer, vol. 18(6), pages 1763-1797, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Sun Youn & Ohtake, Fumio, 2018. "Is being agreeable a key to success or failure in the labor market?," Journal of the Japanese and International Economies, Elsevier, vol. 49(C), pages 8-27.
    2. Shelly Lundberg, 2017. "Noncognitive Skills as Human Capital," NBER Chapters, in: Education, Skills, and Technical Change: Implications for Future US GDP Growth, pages 219-243, National Bureau of Economic Research, Inc.
    3. Thiel, Hendrik & Thomsen, Stephan L., 2013. "Noncognitive skills in economics: Models, measurement, and empirical evidence," Research in Economics, Elsevier, vol. 67(2), pages 189-214.
    4. Dohmen, Thomas, 2014. "Behavioral labor economics: Advances and future directions," Labour Economics, Elsevier, vol. 30(C), pages 71-85.
    5. Gensowski, Miriam & Gørtz, Mette & Schurer, Stefanie, 2021. "Inequality in personality over the life cycle," Journal of Economic Behavior & Organization, Elsevier, vol. 184(C), pages 46-77.
    6. Maria Cubel & Ana Nuevo‐Chiquero & Santiago Sanchez‐Pages & Marian Vidal‐Fernandez, 2016. "Do Personality Traits Affect Productivity? Evidence from the Laboratory," Economic Journal, Royal Economic Society, vol. 0(592), pages 654-681, May.
    7. Eckhardt Bode & Lucia Perez Villar, 2017. "Creativity, education or what? On the measurement of regional human capital," Papers in Regional Science, Wiley Blackwell, vol. 96, pages 51-67, March.
    8. Bonacini, Luca & Gallo, Giovanni & Scicchitano, Sergio, 2021. "Sometimes you cannot make it on your own. How household background influences chances of success in Italy," GLO Discussion Paper Series 832, Global Labor Organization (GLO).
    9. Humphries, John Eric & Kosse, Fabian, 2017. "On the interpretation of non-cognitive skills – What is being measured and why it matters," Journal of Economic Behavior & Organization, Elsevier, vol. 136(C), pages 174-185.
    10. Elke Lüdemann, 2011. "Schooling and the Formation of Cognitive and Non-cognitive Outcomes," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 39.
    11. Glewwe, Paul & Song, Yang & Zou, Xianqiang, 2022. "Labor market outcomes, cognitive skills, and noncognitive skills in rural China," Journal of Economic Behavior & Organization, Elsevier, vol. 193(C), pages 294-311.
    12. Chen, Weiwei & Grove, Wayne A. & Hussey, Andrew, 2017. "The role of confidence and noncognitive skills for post-baccalaureate academic and labor market outcomes," Journal of Economic Behavior & Organization, Elsevier, vol. 138(C), pages 10-29.
    13. Leonora Risse & Lisa Farrell & Tim R L Fry, 2018. "Personality and pay: do gender gaps in confidence explain gender gaps in wages?," Oxford Economic Papers, Oxford University Press, vol. 70(4), pages 919-949.
    14. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2018. "Test scores, noncognitive skills and economic growth," Economics of Education Review, Elsevier, vol. 63(C), pages 134-153.
    15. Shelly Lundberg, 2013. "The College Type: Personality and Educational Inequality," Journal of Labor Economics, University of Chicago Press, vol. 31(3), pages 421-441.
    16. Attanasio, Orazio & Blundell, Richard & Conti, Gabriella & Mason, Giacomo, 2020. "Inequality in socio-emotional skills: A cross-cohort comparison," Journal of Public Economics, Elsevier, vol. 191(C).
    17. Kautz, Tim & Heckman, James J. & Diris, Ron & ter Weel, Bas & Borghans, Lex, 2014. "Fostering and Measuring Skills: Improving Cognitive and Non-Cognitive Skills to Promote Lifetime Success," IZA Discussion Papers 8696, Institute of Labor Economics (IZA).
    18. Melinda Petre, 2018. "Are Employers Omniscient? Employer Learning About Cognitive and Noncognitive Skills," Industrial Relations: A Journal of Economy and Society, Wiley Blackwell, vol. 57(3), pages 323-360, July.
    19. Deborah Cobb-Clark, 2015. "Locus of control and the labor market," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-19, December.
    20. Cuesta, Maite Blázquez & Budría, Santiago, 2017. "Unemployment persistence: How important are non-cognitive skills?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 69(C), pages 29-37.

    More about this item

    Keywords

    Noncognitive skills; Educational attainment; Labor-market outcomes; Human capital;
    All these keywords.

    JEL classification:

    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecoedu:v:52:y:2016:i:c:p:105-119. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/econedurev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.