IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp17332.html

Noncognitive Human Capital and Misreporting Behavior in Online Surveys

Author

Listed:
  • Li, Haizheng

    (Georgia Institute of Technology)

  • Liu, Qinyi

    (University of Nottingham Ningbo China)

  • Xu, Yiting

    (Central University of Finance and Economics Beijing)

Abstract

In this study, we investigate misreporting behavior in online surveys based on the field experiments in a large-scale online training program for rural teachers. We link the digitally recorded data with survey responses and integrate randomized controlled trials (RCTs) in the survey design. Noncognitive human capital is measured using both self-reported personality traits and proxies based on observed behaviors. Our results show that the impact of observed individual characteristics varies depending on the nature of the question and survey specifics. Unobserved heterogeneity affects both survey participation and response accuracy, resulting in sample selectivity. Noncognitive human capital inferred from observed behaviors consistently shows important influence on misreporting, while that measured by self-reported personality traits suffers from the same misreporting problem. However, behavior proxy may also capture factors external to survey respondents, and it is important to separate the effect of noncognitive human capital from the external impacts. Additionally, survey design affects misreporting. Therefore, improving the efficiency of survey such as by changing the saliency and optimizing the sequence of questions, can improve survey quality. These findings carry important implications for using survey data and for improving survey data quality.

Suggested Citation

  • Li, Haizheng & Liu, Qinyi & Xu, Yiting, 2024. "Noncognitive Human Capital and Misreporting Behavior in Online Surveys," IZA Discussion Papers 17332, IZA Network @ LISER.
  • Handle: RePEc:iza:izadps:dp17332
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp17332.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mara Ewers & Florian Zimmermann, 2015. "Image And Misreporting," Journal of the European Economic Association, European Economic Association, vol. 13(2), pages 363-380, April.
    2. Celhay, Pablo & Meyer, Bruce D. & Mittag, Nikolas, 2024. "What leads to measurement errors? Evidence from reports of program participation in three surveys," Journal of Econometrics, Elsevier, vol. 238(2).
    3. Leonardo Bursztyn & Robert Jensen, 2017. "Social Image and Economic Behavior in the Field: Identifying, Understanding, and Shaping Social Pressure," Annual Review of Economics, Annual Reviews, vol. 9(1), pages 131-153, September.
    4. Abay, Kibrom A. & Barrett, Christopher B. & Kilic, Talip & Moylan, Heather & Ilukor, John & Vundru, Wilbert Drazi, 2023. "Nonclassical measurement error and farmers’ response to information treatment," Journal of Development Economics, Elsevier, vol. 164(C).
    5. Alain Cohn & Ernst Fehr & Michel André Maréchal, 2014. "Business culture and dishonesty in the banking industry," Nature, Nature, vol. 516(7529), pages 86-89, December.
    6. Anke Becker & Thomas Deckers & Thomas Dohmen & Armin Falk & Fabian Kosse, 2012. "The Relationship Between Economic Preferences and Psychological Personality Measures," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 453-478, July.
    7. Bašić, Zvonimir & Quercia, Simone, 2022. "The influence of self and social image concerns on lying," Games and Economic Behavior, Elsevier, vol. 133(C), pages 162-169.
    8. John M. Abowd & Martha H. Stinson, 2013. "Estimating Measurement Error in Annual Job Earnings: A Comparison of Survey and Administrative Data," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1451-1467, December.
    9. Anke Becker & Thomas Deckers & Thomas Dohmen & Armin Falk & Fabian Kosse, 2012. "The Relationship Between Economic Preferences and Psychological Personality Measures," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 453-478, July.
    10. Abraham, Katharine G. & Filiz-Ozbay, Emel & Ozbay, Erkut Y. & Turner, Lesley J., 2020. "Framing effects, earnings expectations, and the design of student loan repayment schemes," Journal of Public Economics, Elsevier, vol. 183(C).
    11. Dench, Daniel & Joyce, Theodore, 2022. "Information and credible sanctions in curbing online cheating among undergraduates: A field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 195(C), pages 408-427.
    12. Thomas Dohmen & Tomáš Jagelka, 2024. "Accounting for Individual-Specific Reliability of Self-Assessed Measures of Economic Preferences and Personality Traits," Journal of Political Economy Microeconomics, University of Chicago Press, vol. 2(3), pages 399-462.
    13. Black, Dan & Sanders, Seth & Taylor, Lowell, 2003. "Measurement of Higher Education in the Census and Current Population Survey," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 545-554, January.
    14. Sendhil Mullainathan & Marianne Bertrand, 2001. "Do People Mean What They Say? Implications for Subjective Survey Data," American Economic Review, American Economic Association, vol. 91(2), pages 67-72, May.
    15. Burke, Mary A. & Carman, Katherine G., 2017. "You can be too thin (but not too tall): Social desirability bias in self-reports of weight and height," Economics & Human Biology, Elsevier, vol. 27(PA), pages 198-222.
    16. Shuaizhang Feng & Yingyao Hu, 2013. "Misclassification Errors and the Underestimation of the US Unemployment Rate," American Economic Review, American Economic Association, vol. 103(2), pages 1054-1070, April.
    17. Katharine G. Abraham & John Haltiwanger & Kristin Sandusky & James R. Spletzer, 2013. "Exploring Differences in Employment between Household and Establishment Data," Journal of Labor Economics, University of Chicago Press, vol. 31(S1), pages 129-172.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sofianos, Andis, 2022. "Self-reported & revealed trust: Experimental evidence," Journal of Economic Psychology, Elsevier, vol. 88(C).
    2. Ola Andersson & Topi Miettinen & Kaisa Hytönen & Magnus Johannesson & Ute Stephan, 2017. "Subliminal influence on generosity," Experimental Economics, Springer;Economic Science Association, vol. 20(3), pages 531-555, September.
    3. Murray, Neil & Neyse, Levent & Schröder, Carsten, 2023. "Changes in risk attitudes vary across domains throughout the life course," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 534-563.
    4. repec:ces:ceswps:_9253 is not listed on IDEAS
    5. Ayato Kitadai & Yusuke Fukasawa & Nariaki Nishino, 2025. "Bias-Adjusted LLM Agents for Human-Like Decision-Making via Behavioral Economics," Papers 2508.18600, arXiv.org.
    6. Ha Trong Nguyen & Huong Thu Le & Luke Connelly & Francis Mitrou, 2023. "Accuracy of self‐reported private health insurance coverage," Health Economics, John Wiley & Sons, Ltd., vol. 32(12), pages 2709-2729, December.
    7. Giuseppe Albanese & Guido de Blasio & Paolo Sestito, 2017. "Trust, risk and time preferences: evidence from survey data," International Review of Economics, Springer;Happiness Economics and Interpersonal Relations (HEIRS), vol. 64(4), pages 367-388, December.
    8. François Desmoulins-Lebeault & Jean-François Gajewski & Luc Meunier, 2018. "Personality and Risk Aversion," Economics Bulletin, AccessEcon, vol. 38(1), pages 472-489.
    9. Breaban, Adriana & van de Kuilen, Gijs & Noussair, Charles, 2016. "Prudence, Personality, Cognitive Ability and Emotional State," Other publications TiSEM 9a01a5ab-e03d-49eb-9cd7-4, Tilburg University, School of Economics and Management.
    10. Fabian Kosse & Thomas Deckers & Pia Pinger & Hannah Schildberg-Hörisch & Armin Falk, 2020. "The Formation of Prosociality: Causal Evidence on the Role of Social Environment," Journal of Political Economy, University of Chicago Press, vol. 128(2), pages 434-467.
    11. Mittag, Nikolas, 2016. "Correcting for Misreporting of Government Benefits," IZA Discussion Papers 10266, IZA Network @ LISER.
    12. Guzmán, Ricardo & Harrison, Rodrigo & Abarca, Nureya & Villena, Mauricio G., 2020. "A game-theoretic model of reciprocity and trust that incorporates personality traits," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 84(C).
    13. Vaaramo, Mikko & Huikari, Sanna & Ala-Mursula, Leena & Miettunen, Jouko & Korhonen, Marko, 2024. "Temperament traits and economic preferences predict occupational choice beyond human capital variables," Labour Economics, Elsevier, vol. 90(C).
    14. Stephen A Gallo & Karen B Schmaling, 2022. "Peer review: Risk and risk tolerance," PLOS ONE, Public Library of Science, vol. 17(8), pages 1-20, August.
    15. McGee, Andrew & McGee, Peter, 2016. "Search, effort, and locus of control," Journal of Economic Behavior & Organization, Elsevier, vol. 126(PA), pages 89-101.
    16. Volland, Benjamin, 2017. "The role of risk and trust attitudes in explaining residential energy demand: Evidence from the United Kingdom," Ecological Economics, Elsevier, vol. 132(C), pages 14-30.
    17. Firth, Chris & Stewart, Neil & Antoniou, Constantinos & Leake, David, 2023. "The effects of personality and IQ on portfolio outcomes," Finance Research Letters, Elsevier, vol. 51(C).
    18. Mequanint B. Melesse & Amos Nyangira Tirra & Yabibal M. Walle & Michael Hauser, 2023. "Understanding the Determinants of Aspirations in Rural Tanzania: Does Financial Literacy Matter?," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 35(6), pages 1294-1321, December.
    19. Alain Cohn & Michel André Maréchal & Frédéric Schneider & Roberto A Weber, 2021. "Frequent Job Changes can Signal Poor Work Attitude and Reduce Employability," Journal of the European Economic Association, European Economic Association, vol. 19(1), pages 475-508.
    20. John, Katrin & Thomsen, Stephan L., 2015. "School-track environment or endowment: What determines different other-regarding behavior across peer groups?," Games and Economic Behavior, Elsevier, vol. 94(C), pages 122-141.
    21. Breitkopf, Laura & Chowdhury, Shyamal K. & Priyam, Shambhavi & Schildberg-Hörisch, Hannah & Sutter, Matthias, 2020. "Do economic preferences of children predict behavior?," DICE Discussion Papers 342, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp17332. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Fallak (email available below). General contact details of provider: https://edirc.repec.org/data/izaaalu.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.