IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp4087.html
   My bibliography  Save this paper

Measuring Trust: Experiments and Surveys in Contrast and Combination

Author

Listed:
  • Naef, Michael

    (University of London)

  • Schupp, Jürgen

    (DIW Berlin)

Abstract

Trust is a concept that has attracted significant attention in economic theory and research within the last two decades: it has been applied in a number of contexts and has been investigated both as an explanatory and as a dependent variable. In this paper, we explore the questions of what exactly is measured by the diverse survey-derived scales and experiments claiming to measure trust, and how these different measures are related. Using nationally representative data, we test a commonly used experimental measure of trust for robustness to a number of interferences, finding it to be mostly unsusceptible to stake size, the extent of strategy space, the use of the strategy method, and the characteristics of the experimenters. Inspired by criticism of the widespread trust question used in many surveys, we created a new, improved survey trust scale consisting of three short statements. We show that the dimension of this scale is distinct from trust in institutions and trust in known others. Our new scale is a valid and reliable measure of trust in strangers. The scale is valid in the sense that it correlates with trusting behaviour in the experiment. Both survey and experimental measure correlate with related factors such as risk aversion, being an entrepreneur or a shareholder. Furthermore, we demonstrate that the survey measure's test-retest reliability (six weeks) is high. The experimental measure of trust is, on the other hand, not significantly correlated with trust in institutions nor with trust in known others. We conclude that the experimental measure of trust refers not to trust in a general sense, but specifically to trust in strangers.

Suggested Citation

  • Naef, Michael & Schupp, Jürgen, 2009. "Measuring Trust: Experiments and Surveys in Contrast and Combination," IZA Discussion Papers 4087, Institute of Labor Economics (IZA).
  • Handle: RePEc:iza:izadps:dp4087
    as

    Download full text from publisher

    File URL: http://ftp.iza.org/dp4087.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hoffman, Elizabeth & McCabe, Kevin A & Smith, Vernon L, 1998. "Behavioral Foundations of Reciprocity: Experimental Economics and Evolutionary Psychology," Economic Inquiry, Western Economic Association International, vol. 36(3), pages 335-352, July.
    2. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, Oxford University Press, vol. 114(3), pages 817-868.
    3. Ernst Fehr & Michael Naef & Klaus M. Schmidt, 2006. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments: Comment," American Economic Review, American Economic Association, vol. 96(5), pages 1912-1917, December.
    4. Falk, Armin & Fischbacher, Urs, 2006. "A theory of reciprocity," Games and Economic Behavior, Elsevier, vol. 54(2), pages 293-315, February.
    5. Sutter, Matthias & Kocher, Martin G., 2007. "Trust and trustworthiness across different age groups," Games and Economic Behavior, Elsevier, vol. 59(2), pages 364-382, May.
    6. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2008. "Trusting the Stock Market," Journal of Finance, American Finance Association, vol. 63(6), pages 2557-2600, December.
    7. Holm, Håkan & Nystedt, Paul, 2008. "Trust in surveys and games - A methodological contribution on the influence of money and location," Journal of Economic Psychology, Elsevier, vol. 29(4), pages 522-542, August.
    8. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    9. Todd L. Cherry & Peter Frykblom & Jason F. Shogren, 2002. "Hardnose the Dictator," American Economic Review, American Economic Association, vol. 92(4), pages 1218-1221, September.
    10. Guth, Werner & Huck, Steffen & Muller, Wieland, 2001. "The Relevance of Equal Splits in Ultimatum Games," Games and Economic Behavior, Elsevier, vol. 37(1), pages 161-169, October.
    11. Schotter Andrew & Weigelt Keith & Wilson Charles, 1994. "A Laboratory Investigation of Multiperson Rationality and Presentation Effects," Games and Economic Behavior, Elsevier, vol. 6(3), pages 445-468, May.
    12. Rainer, Helmut & Siedler, Thomas, 2009. "Does democracy foster trust?," Journal of Comparative Economics, Elsevier, vol. 37(2), pages 251-269, June.
    13. James J. Heckman & Jeffrey A. Smith, 1995. "Assessing the Case for Social Experiments," Journal of Economic Perspectives, American Economic Association, vol. 9(2), pages 85-110, Spring.
    14. Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2007. "Estimating Risk Attitudes in Denmark: A Field Experiment," Scandinavian Journal of Economics, Wiley Blackwell, vol. 109(2), pages 341-368, June.
    15. Johansson-Stenman, Olof & Mahmud, Minhaj & Martinsson, Peter, 2013. "Trust, trust games and stated trust: Evidence from rural Bangladesh," Journal of Economic Behavior & Organization, Elsevier, vol. 95(C), pages 286-298.
    16. Alesina, Alberto & La Ferrara, Eliana, 2002. "Who trusts others?," Journal of Public Economics, Elsevier, vol. 85(2), pages 207-234, August.
    17. John Ermisch & Diego Gambetta & Heather Laurie & Thomas Siedler & S. C. Noah Uhrig, 2009. "Measuring people's trust," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 172(4), pages 749-769, October.
    18. Ashraf, Nava & Bohnet, Iris & Piankov, Nikita, 2003. "Is Trust a Bad Investment?," Working Paper Series rwp03-047, Harvard University, John F. Kennedy School of Government.
    19. Jeffrey Carpenter & Cristina Connolly & Caitlin Myers, 2008. "Altruistic behavior in a representative dictator experiment," Experimental Economics, Springer;Economic Science Association, vol. 11(3), pages 282-298, September.
    20. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Juergen Schupp & Gert Wagner, 2005. "Individual Risk Attitudes: New Evidence from a Large, Representative, Experimentally-Validated Survey," Working Papers 2096, The Field Experiments Website.
    21. Dirk Engelmann & Martin Strobel, 2006. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments: Reply," American Economic Review, American Economic Association, vol. 96(5), pages 1918-1923, December.
    22. Johansson-Stenman, Olof & Mahmud, Minhaj & Martinsson, Peter, 2005. "Does stake size matter in trust games?," Economics Letters, Elsevier, vol. 88(3), pages 365-369, September.
    23. Ernst Fehr & Urs Fischbacher & Bernhard von Rosenbladt & J�rgen Schupp & Gert G. Wagner, "undated". "A Nation-Wide Laboratory: Examining trust and trustworthiness by integrating behavioral experiments into representative surveys," IEW - Working Papers 141, Institute for Empirical Research in Economics - University of Zurich.
    24. Luigi Guiso & Paola Sapienza & Luigi Zingales, 2006. "Does Culture Affect Economic Outcomes?," Journal of Economic Perspectives, American Economic Association, vol. 20(2), pages 23-48, Spring.
    25. Glenn W. Harrison & Morten I. Lau & Melonie B. Williams, 2002. "Estimating Individual Discount Rates in Denmark: A Field Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1606-1617, December.
    26. Guiso, Luigi & Sapienza, Paola & Zingales, Luigi, 2003. "People's opium? Religion and economic attitudes," Journal of Monetary Economics, Elsevier, vol. 50(1), pages 225-282, January.
    27. Hoffman, Elizabeth & McCabe, Kevin A & Smith, Vernon L, 1996. "On Expectations and the Monetary Stakes in Ultimatum Games," International Journal of Game Theory, Springer;Game Theory Society, vol. 25(3), pages 289-301.
    28. Jordi Brandts & Gary Charness, 2000. "Hot vs. Cold: Sequential Responses and Preference Stability in Experimental Games," Experimental Economics, Springer;Economic Science Association, vol. 2(3), pages 227-238, March.
    29. Daniel Haile & Abdolkarim Sadrieh & Harrie A. A. Verbon, 2008. "Cross-racial envy and underinvestment in South African partnerships," Cambridge Journal of Economics, Oxford University Press, vol. 32(5), pages 703-724, September.
    30. Carpenter, Jeffrey & Verhoogen, Eric & Burks, Stephen, 2005. "The effect of stakes in distribution experiments," Economics Letters, Elsevier, vol. 86(3), pages 393-398, March.
    31. Daniel Haile & Abdolkarim Sadrieh & Harrie A. A Verbon, 2006. "Cross-Racial Envy and Underinvestment in South Africa," CESifo Working Paper Series 1657, CESifo.
    32. Forsythe Robert & Horowitz Joel L. & Savin N. E. & Sefton Martin, 1994. "Fairness in Simple Bargaining Experiments," Games and Economic Behavior, Elsevier, vol. 6(3), pages 347-369, May.
    33. List, John A. & Cherry, Todd L., 2008. "Examining the role of fairness in high stakes allocation decisions," Journal of Economic Behavior & Organization, Elsevier, vol. 65(1), pages 1-8, January.
    34. Edward L. Glaeser & David I. Laibson & José A. Scheinkman & Christine L. Soutter, 2000. "Measuring Trust," The Quarterly Journal of Economics, Oxford University Press, vol. 115(3), pages 811-846.
      • Glaeser, Edward Ludwig & Laibson, David I. & Scheinkman, Jose A. & Soutter, Christine L., 2000. "Measuring Trust," Scholarly Articles 4481497, Harvard University Department of Economics.
    35. Jana Vyrastekova & Supriya Garikipati, 2005. "Beliefs and Trust: An Experiment," Working Papers 200511, University of Liverpool, Department of Economics.
    36. Robert Slonim & Alvin E. Roth, 1998. "Learning in High Stakes Ultimatum Games: An Experiment in the Slovak Republic," Econometrica, Econometric Society, vol. 66(3), pages 569-596, May.
    37. Gachter, Simon & Herrmann, Benedikt & Thoni, Christian, 2004. "Trust, voluntary cooperation, and socio-economic background: survey and experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 55(4), pages 505-531, December.
    38. Cameron, Lisa A, 1999. "Raising the Stakes in the Ultimatum Game: Experimental Evidence from Indonesia," Economic Inquiry, Western Economic Association International, vol. 37(1), pages 47-59, January.
    39. Martin Spieß & Martin Kroh, 2008. "Documentation of Sample Sizes and Panel Attrition in the German Socio Economic Panel (SOEP) (1984 until 2006)," Data Documentation 27, DIW Berlin, German Institute for Economic Research.
    40. Niels Winkler & Martin Kroh & Martin Spieß, 2006. "Entwicklung einer deutschen Kurzskala zur zweidimensionalen Messung von sozialer Erwünschtheit," Discussion Papers of DIW Berlin 579, DIW Berlin, German Institute for Economic Research.
    41. Gert G. Wagner & Joachim R. Frick & Jürgen Schupp, 2007. "The German Socio-Economic Panel Study (SOEP) – Scope, Evolution and Enhancements," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 127(1), pages 139-169.
    42. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    43. Tim Reeskens & Marc Hooghe, 2008. "Cross-cultural measurement equivalence of generalized trust. Evidence from the European Social Survey (2002 and 2004)," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 85(3), pages 515-532, February.
    44. Berg Joyce & Dickhaut John & McCabe Kevin, 1995. "Trust, Reciprocity, and Social History," Games and Economic Behavior, Elsevier, vol. 10(1), pages 122-142, July.
    45. Jeannette Brosig & Joachim Weimann & Chun-Lei Yang, 2003. "The Hot Versus Cold Effect in a Simple Bargaining Experiment," Experimental Economics, Springer;Economic Science Association, vol. 6(1), pages 75-90, June.
    46. Martin Kroh & Martin Spieß, 2008. "Documentation of Sample Sizes and Panel Attrition in the German Socio Economic Panel (SOEP) (1984 until 2007)," Data Documentation 39, DIW Berlin, German Institute for Economic Research.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Matteo M. Galizzi & Daniel Navarro Martinez, 2015. "On the external validity of social-preference games: A systematic lab-field study," Economics Working Papers 1462, Department of Economics and Business, Universitat Pompeu Fabra.
    2. Emin Karagözoğlu & Ümit Barış Urhan, 2017. "The Effect of Stake Size in Experimental Bargaining and Distribution Games: A Survey," Group Decision and Negotiation, Springer, vol. 26(2), pages 285-325, March.
    3. Martijn J. van den Assem & Dennie van Dolder & Richard H. Thaler, 2012. "Split or Steal? Cooperative Behavior When the Stakes Are Large," Management Science, INFORMS, vol. 58(1), pages 2-20, January.
    4. Matteo M. Galizzi & Daniel Navarro-Martinez, 2019. "On the External Validity of Social Preference Games: A Systematic Lab-Field Study," Management Science, INFORMS, vol. 65(3), pages 976-1002, March.
    5. Barmettler, Franziska & Fehr, Ernst & Zehnder, Christian, 2012. "Big experimenter is watching you! Anonymity and prosocial behavior in the laboratory," Games and Economic Behavior, Elsevier, vol. 75(1), pages 17-34.
    6. Murnighan, J. Keith & Wang, Long, 2016. "The social world as an experimental game," Organizational Behavior and Human Decision Processes, Elsevier, vol. 136(C), pages 80-94.
    7. Fehr, Ernst & Schmidt, Klaus M., 2005. "The Economics of Fairness, Reciprocity and Altruism – Experimental Evidence and New Theories," Discussion Paper Series of SFB/TR 15 Governance and the Efficiency of Economic Systems 66, Free University of Berlin, Humboldt University of Berlin, University of Bonn, University of Mannheim, University of Munich.
    8. Martin G. Kocher, 2015. "How Trust in Social Dilemmas Evolves with Age," CESifo Working Paper Series 5447, CESifo.
    9. Tamás Kovács & Marc Willinger, 2010. "Is there a relation between trust and trustworthiness?," Working Papers 10-03, LAMETA, Universtiy of Montpellier, revised Mar 2010.
    10. Johnson, Noel D. & Mislin, Alexandra A., 2011. "Trust games: A meta-analysis," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 865-889.
    11. Bellemare, Charles & Kroger, Sabine, 2007. "On representative social capital," European Economic Review, Elsevier, vol. 51(1), pages 183-202, January.
    12. Larney, Andrea & Rotella, Amanda & Barclay, Pat, 2019. "Stake size effects in ultimatum game and dictator game offers: A meta-analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 61-72.
    13. Kocher, Martin G. & Martinsson, Peter & Matzat, Dominik & Wollbrant, Conny, 2015. "The role of beliefs, trust, and risk in contributions to a public good," Journal of Economic Psychology, Elsevier, vol. 51(C), pages 236-244.
    14. Becchetti, Leonardo & Conzo, Pierluigi, 2011. "Enhancing capabilities through credit access: Creditworthiness as a signal of trustworthiness under asymmetric information," Journal of Public Economics, Elsevier, vol. 95(3), pages 265-278.
    15. Sutter, Matthias & Kocher, Martin G., 2007. "Trust and trustworthiness across different age groups," Games and Economic Behavior, Elsevier, vol. 59(2), pages 364-382, May.
    16. Greiner, Ben & Ockenfels, Axel & Werner, Peter, 2012. "The dynamic interplay of inequality and trust—An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 81(2), pages 355-365.
    17. Grund Christian & Harbring Christine, 2013. "Trust and Control at the Workplace: Evidence from Representative Samples of Employees in Europe," Journal of Economics and Statistics (Jahrbuecher fuer Nationaloekonomie und Statistik), De Gruyter, vol. 233(5-6), pages 619-637, October.
    18. Johansson-Stenman, Olof & Mahmud, Minhaj & Martinsson, Peter, 2005. "Does stake size matter in trust games?," Economics Letters, Elsevier, vol. 88(3), pages 365-369, September.
    19. Sun-Ki Chai & Dolgorsuren Dorj & Katerina Sherstyuk, 2018. "Cultural Values and Behavior in Dictator, Ultimatum, and Trust Games: An Experimental Study," Research in Experimental Economics, in: Anna Gunnthorsdottir & Douglas A. Norton (ed.), Experimental Economics and Culture, volume 20, pages 89-166, Emerald Publishing Ltd.
    20. repec:tiu:tiucen:200457 is not listed on IDEAS
    21. Cochard, François & Le Gallo, Julie & Georgantzis, Nikolaos & Tisserand, Jean-Christian, 2021. "Social preferences across different populations: Meta-analyses on the ultimatum game and dictator game," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 90(C).

    More about this item

    Keywords

    representativity; survey; experiment; trust; SOEP;
    All these keywords.

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement
    • Z13 - Other Special Topics - - Cultural Economics - - - Economic Sociology; Economic Anthropology; Language; Social and Economic Stratification

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp4087. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.iza.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: http://www.iza.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.