IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2022-13.html
   My bibliography  Save this paper

Should we trust measures of trust?

Author

Listed:
  • Héloise Cloléry

    (CREST-Ecole polytechnique, IP Paris)

  • Guillaume Hollard

    (CREST-Ecole polytechnique, IP Paris and CNRS)

  • Fabien Perez

    (CREST-Ensae, IP Paris)

  • Inès Picard

    (CREST-Genes, IP Paris)

Abstract

Trust is an important economic variable that may however be subject to measurement error, leading to econometric issues such as attenuation bias or spurious correlations. We use a test/retest protocol to assess the measurement error in the two main tasks that are used to elicit trust, namely survey questions and experimental games. We find that trust measures based on the trust game entail substantial measurement error (with up to 15% of noise), while there is virtually no noise in stated trust measures. Given the specificity of our subject pool (students in a top Engineering school) and the short period of time between the test and the retest, we consider these percentages of noise as lower bounds. We also provide a sub-group analysis based on measures of cognitive ability and effort. We find substantial heterogeneity across sub-groups in trust-game behavior, but none for the survey questions. We finally discuss which measure of trust should be used, and the estimation strategies that can be applied to limit the effect of measurement error.

Suggested Citation

  • Héloise Cloléry & Guillaume Hollard & Fabien Perez & Inès Picard, 2022. "Should we trust measures of trust?," Working Papers 2022-13, Center for Research in Economics and Statistics.
    • Handle: RePEc:crs:wpaper:2022-13
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2022-13.pdf
    File Function: CREST working paper version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zak, Paul J & Knack, Stephen, 2001. "Trust and Growth," Economic Journal, Royal Economic Society, vol. 111(470), pages 295-321, April.
    2. Thöni, Christian & Tyran, Jean-Robert & Wengström, Erik, 2012. "Microfoundations of social capital," Journal of Public Economics, Elsevier, vol. 96(7-8), pages 635-643.
    3. Stephen Knack & Philip Keefer, 1997. "Does Social Capital Have an Economic Payoff? A Cross-Country Investigation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(4), pages 1251-1288.
    4. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    5. Fabien Perez & Guillaume Hollard & Radu Vranceanu, 2021. "How serious is the measurement-error problem in risk-aversion tasks?," Journal of Risk and Uncertainty, Springer, vol. 63(3), pages 319-342, December.
    6. Algan, Yann & Cahuc, Pierre & Sangnier, Marc, 2011. "Efficient and Inefficient Welfare States," IZA Discussion Papers 5445, Institute of Labor Economics (IZA).
    7. Lisa Anderson & Jennifer Mellor, 2009. "Are risk preferences stable? Comparing an experimental measure with a validated survey-based measure," Journal of Risk and Uncertainty, Springer, vol. 39(2), pages 137-160, October.
    8. Ben Gillen & Erik Snowberg & Leeat Yariv, 2019. "Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1826-1863.
    9. Sangnier, Marc, 2013. "Does trust favor macroeconomic stability?," Journal of Comparative Economics, Elsevier, vol. 41(3), pages 653-668.
    10. Yann Algan & Pierre Cahuc, 2010. "Inherited Trust and Growth," American Economic Review, American Economic Association, vol. 100(5), pages 2060-2092, December.
    11. Brañas-Garza, Pablo & Kujal, Praveen & Lenkei, Balint, 2019. "Cognitive reflection test: Whom, how, when," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 82(C).
    12. Ashraf, Nava & Bohnet, Iris & Piankov, Nikita, 2003. "Is Trust a Bad Investment?," Working Paper Series rwp03-047, Harvard University, John F. Kennedy School of Government.
    13. La Porta, Rafael, et al, 1997. "Trust in Large Organizations," American Economic Review, American Economic Association, vol. 87(2), pages 333-338, May.
    14. Ernst Fehr & Urs Fischbacher & Bernhard von Rosenbladt & J�rgen Schupp & Gert G. Wagner, "undated". "A Nation-Wide Laboratory: Examining trust and trustworthiness by integrating behavioral experiments into representative surveys," IEW - Working Papers 141, Institute for Empirical Research in Economics - University of Zurich.
    15. Johnson, Noel D. & Mislin, Alexandra A., 2011. "Trust games: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 865-889.
    16. Yann Algan & Pierre Cahuc & Marc Sangnier, 2016. "Trust and the Welfare State: the Twin Peaks Curve," Economic Journal, Royal Economic Society, vol. 126(593), pages 861-883, June.
    17. Amador-Hidalgo, Luis & Brañas-Garza, Pablo & Espín, Antonio M. & García-Muñoz, Teresa & Hernández-Román, Ana, 2021. "Cognitive abilities and risk-taking: Errors, not preferences," European Economic Review, Elsevier, vol. 134(C).
    18. Nicholas J. Cox, 2008. "Speaking Stata: Correlation with confidence, or Fisher's z revisited," Stata Journal, StataCorp LP, vol. 8(3), pages 413-439, September.
    19. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    20. Banerjee, Ritwik, 2018. "On the interpretation of World Values Survey trust question - Global expectations vs. local beliefs," European Journal of Political Economy, Elsevier, vol. 55(C), pages 491-510.
    21. Armin Falk & Anke Becker & Thomas Dohmen & David Huffman & Uwe Sunde, 2023. "The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences," Management Science, INFORMS, vol. 69(4), pages 1935-1950, April.
    22. repec:hal:spmain:info:hdl:2441/432sbils8u9t7qa99cii5psht1 is not listed on IDEAS
    23. Chen, Daniel L. & Schonger, Martin & Wickens, Chris, 2016. "oTree—An open-source platform for laboratory, online, and field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 9(C), pages 88-97.
    24. Yu, Shu & Beugelsdijk, Sjoerd & de Haan, Jakob, 2015. "Trade, trust and the rule of law," European Journal of Political Economy, Elsevier, vol. 37(C), pages 102-115.
    25. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    26. J. R. Lockwood & Daniel F. McCaffrey, 2020. "Recommendations about estimating errors-in-variables regression in Stata," Stata Journal, StataCorp LP, vol. 20(1), pages 116-130, March.
    27. Billur Aksoy & Haley Harwell & Ada Kovaliukaite & Catherine Eckel, 2018. "Measuring trust: A reinvestigation," Southern Economic Journal, John Wiley & Sons, vol. 84(4), pages 992-1000, April.
    28. Greiner, Ben, 2004. "An Online Recruitment System for Economic Experiments," MPRA Paper 13513, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin G. Kocher, 2015. "How Trust in Social Dilemmas Evolves with Age," CESifo Working Paper Series 5447, CESifo.
    2. Kim, Jeongbin & Putterman, Louis & Zhang, Xinyi, 2022. "Trust, Beliefs and Cooperation: Excavating a Foundation of Strong Economies," European Economic Review, Elsevier, vol. 147(C).
    3. Kocher, Martin G. & Martinsson, Peter & Matzat, Dominik & Wollbrant, Conny, 2015. "The role of beliefs, trust, and risk in contributions to a public good," Journal of Economic Psychology, Elsevier, vol. 51(C), pages 236-244.
    4. Thöni, Christian & Tyran, Jean-Robert & Wengström, Erik, 2012. "Microfoundations of social capital," Journal of Public Economics, Elsevier, vol. 96(7-8), pages 635-643.
    5. Sofianos, Andis, 2022. "Self-reported & revealed trust: Experimental evidence," Journal of Economic Psychology, Elsevier, vol. 88(C).
    6. Sangnier, Marc, 2013. "Does trust favor macroeconomic stability?," Journal of Comparative Economics, Elsevier, vol. 41(3), pages 653-668.
    7. Banerjee, Ritwik, 2018. "On the interpretation of World Values Survey trust question - Global expectations vs. local beliefs," European Journal of Political Economy, Elsevier, vol. 55(C), pages 491-510.
    8. Algan, Yann & Cahuc, Pierre, 2014. "Trust, Growth, and Well-Being: New Evidence and Policy Implications," Handbook of Economic Growth, in: Philippe Aghion & Steven Durlauf (ed.), Handbook of Economic Growth, edition 1, volume 2, chapter 2, pages 49-120, Elsevier.
    9. Weber, Martin & Germann, Maximilian & Loos, Benjamin, 2018. "Trust and Delegated Investing: A Money Doctors Experiment," CEPR Discussion Papers 12984, C.E.P.R. Discussion Papers.
    10. Avtonomov, Y. & Elizarova, E., 2016. "Trust, Expectations and Optimism Bias: an Experimental Study," Journal of the New Economic Association, New Economic Association, vol. 29(1), pages 27-53.
    11. Bohdan Kukharskyy & Michael Pflüger, 2011. "Relational Contracts and the Economic Well-Being of Nations," Working Papers 095, Bavarian Graduate Program in Economics (BGPE).
    12. Joseph Stiglitz & Jean-Paul Fitoussi & Martine Durand, 2018. "For Good Measure: Advancing Research on Well-Being Metrics Beyond GDP," Sciences Po publications info:hdl:2441/3gpul0a2209, Sciences Po.
    13. Goeschl, Timo & Jarke, Johannes, 2014. "Trust, but verify? When trustworthiness is observable only through (costly) monitoring," WiSo-HH Working Paper Series 20, University of Hamburg, Faculty of Business, Economics and Social Sciences, WISO Research Laboratory.
    14. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David Huffman & Uwe Sunde, 2018. "Global Evidence on Economic Preferences," The Quarterly Journal of Economics, Oxford University Press, vol. 133(4), pages 1645-1692.
    15. Fijnanda van Klingeren, 2020. "Playing nice in the sandbox: On the role of heterogeneity, trust and cooperation in common-pool resources," PLOS ONE, Public Library of Science, vol. 15(8), pages 1-36, August.
    16. Houser, Daniel & Schunk, Daniel & Winter, Joachim, 2010. "Distinguishing trust from risk: An anatomy of the investment game," Journal of Economic Behavior & Organization, Elsevier, vol. 74(1-2), pages 72-81, May.
    17. Alves, Guillermo & Blanchard, Pablo & Burdin, Gabriel & Chávez, Mariana & Dean, Andrés, 2022. "Like principal, like agent? Managerial preferences in employee-owned firms," Journal of Institutional Economics, Cambridge University Press, vol. 18(6), pages 877-899, December.
    18. Yann Algan & Pierre Cahuc, 2014. "Trust, Well-Being and Growth: New Evidence and Policy Implications," Post-Print hal-01169659, HAL.
    19. Jalan, Akanksha & Matkovskyy, Roman & Urquhart, Andrew & Yarovaya, Larisa, 2023. "The role of interpersonal trust in cryptocurrency adoption," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 83(C).
    20. Armin Falk & Anke Becker & Thomas Dohmen & David Huffman & Uwe Sunde, 2023. "The Preference Survey Module: A Validated Instrument for Measuring Risk, Time, and Social Preferences," Management Science, INFORMS, vol. 69(4), pages 1935-1950, April.

    More about this item

    Keywords

    Trust; Trust Game; Measurement Error; ORIV.;
    All these keywords.

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2022-13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.