IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2507.15568.html
   My bibliography  Save this paper

Explaining Apparently Inaccurate Self-assessments of Relative Performance: A Replication and Adaptation of 'Overconfident: Do you put your money on it?' by Hoelzl and Rustichini (2005)

Author

Listed:
  • Marius Protte

Abstract

This study replicates and adapts the experiment of Hoelzl and Rustichini (2005), which examined overplacement, i.e., overconfidence in relative self-assessments, by analyzing individuals' voting preferences between a performance-based and a lottery-based bonus payment mechanism. The original study found underplacement - the majority of their sample apparently expected to perform worse than others - in difficult tasks with monetary incentives, contradicting the widely held assumption of a general human tendency toward overconfidence. This paper challenges the comparability of the two payment schemes, arguing that differences in outcome structures and non-monetary motives may have influenced participants' choices beyond misconfidence. In an online replication, a fixed-outcome distribution lottery mechanism with interdependent success probabilities and no variance in the number of winners - designed to better align with the performance-based payment scheme - is compared against the probabilistic-outcome distribution lottery used in the original study, which features an independent success probability and a variable number of winners. The results align more closely with traditional overplacement patterns than underplacement, as nearly three-fourths of participants prefer the performance-based option regardless of lottery design. Key predictors of voting behavior include expected performance, group performance estimations, and sample question outcomes, while factors such as social comparison tendencies and risk attitudes play no significant role. Self-reported voting rationales highlight the influence of normative beliefs, control preferences, and feedback signals beyond confidence. These results contribute to methodological discussions in overconfidence research by reassessing choice-based overconfidence measures and exploring alternative explanations for observed misplacement effects.

Suggested Citation

  • Marius Protte, 2025. "Explaining Apparently Inaccurate Self-assessments of Relative Performance: A Replication and Adaptation of 'Overconfident: Do you put your money on it?' by Hoelzl and Rustichini (2005)," Papers 2507.15568, arXiv.org.
    • Handle: RePEc:arx:papers:2507.15568
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2507.15568
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dirk Engelmann & Martin Strobel, 2004. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments," American Economic Review, American Economic Association, vol. 94(4), pages 857-869, September.
    2. Charness, Gary B & Rabin, Matthew, 2001. "Understanding Social Preferences With Simple Tests," University of California at Santa Barbara, Economics Working Paper Series qt0dc3k4m5, Department of Economics, UC Santa Barbara.
    3. Jean‐Pierre Benoît & Juan Dubra, 2011. "Apparent Overconfidence," Econometrica, Econometric Society, vol. 79(5), pages 1591-1625, September.
    4. Charness, Gary & Rabin, Matthew, 2001. "Understanding Social Preferences with Simple Tests," Department of Economics, Working Paper Series qt4qz9k8vg, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    5. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    6. Antonio A. Arechar & Simon Gächter & Lucas Molleman, 2018. "Conducting interactive experiments online," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 99-131, March.
    7. Wilde, Christian & Krahnen, Jan Pieter & Ockenfels, Peter, 2014. "Measuring Ambiguity Aversion: A Systematic Experimental Approach," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100557, Verein für Socialpolitik / German Economic Association.
    8. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    9. Jose A. Scheinkman & Wei Xiong, 2003. "Overconfidence and Speculative Bubbles," Journal of Political Economy, University of Chicago Press, vol. 111(6), pages 1183-1219, December.
    10. David Owens Jr. & Zachary Grossman Jr. & Ryan Fackler Jr., 2014. "The Control Premium: A Preference for Payoff Autonomy," American Economic Journal: Microeconomics, American Economic Association, vol. 6(4), pages 138-161, November.
    11. Ernst Fehr & Michael Naef & Klaus M. Schmidt, 2006. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments: Comment," American Economic Review, American Economic Association, vol. 96(5), pages 1912-1917, December.
    12. Bruno Biais & Denis Hilton & Karine Mazurier & Sébastien Pouget, 2005. "Judgemental Overconfidence, Self-Monitoring, and Trading Performance in an Experimental Financial Market," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(2), pages 287-312.
    13. Malmendier, Ulrike & Tate, Geoffrey, 2008. "Who makes acquisitions? CEO overconfidence and the market's reaction," Journal of Financial Economics, Elsevier, vol. 89(1), pages 20-43, July.
    14. Daniel Kahneman & Dan Lovallo, 1993. "Timid Choices and Bold Forecasts: A Cognitive Perspective on Risk Taking," Management Science, INFORMS, vol. 39(1), pages 17-31, January.
    15. Thesmar, David & Landier, Augustin, 2003. "Financial Contracting with Optimistic Entrepreneurs: Theory and Evidence," CEPR Discussion Papers 3971, C.E.P.R. Discussion Papers.
    16. Anderson, Cameron & Brion, Sebastien & Moore, Don A. & Kennedy, Jessica A., 2012. "A status-enhancement account of overconfidence," Institute for Research on Labor and Employment, Working Paper Series qt6s5812wf, Institute of Industrial Relations, UC Berkeley.
    17. Terrance Odean., 1996. "Volume, Volatility, Price and Profit When All Trader Are Above Average," Research Program in Finance Working Papers RPF-266, University of California at Berkeley.
    18. Kent D. Daniel & David Hirshleifer & Avanidhar Subrahmanyam, 2001. "Overconfidence, Arbitrage, and Equilibrium Asset Pricing," Journal of Finance, American Finance Association, vol. 56(3), pages 921-965, June.
    19. Krawczyk, Michał, 2012. "Incentives and timing in relative performance judgments: A field experiment," Journal of Economic Psychology, Elsevier, vol. 33(6), pages 1240-1246.
    20. Uri Gneezy & Alex Imas & John List, 2015. "Estimating Individual Ambiguity Aversion: A Simple Approach," Artefactual Field Experiments 00588, The Field Experiments Website.
    21. Ulrike Malmendier & Geoffrey Tate, 2005. "CEO Overconfidence and Corporate Investment," Journal of Finance, American Finance Association, vol. 60(6), pages 2661-2700, December.
    22. Antonio E. Bernardo & Ivo Welch, 2001. "On the Evolution of Overconfidence and Entrepreneurs," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 10(3), pages 301-330, September.
    23. Charness, Gary & Rabin, Matthew, 2002. "Understanding Social Preferences with Simple Tests," Department of Economics, Working Paper Series qt3d04q5sm, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    24. Alexander W. Cappelen & Astri Drange Hole & Erik Ø Sørensen & Bertil Tungodden, 2007. "The Pluralism of Fairness Ideals: An Experimental Approach," American Economic Review, American Economic Association, vol. 97(3), pages 818-827, June.
    25. repec:cup:judgdm:v:2:y:2007:i::p:189-203 is not listed on IDEAS
    26. Grossman, Zachary & Owens, David, 2012. "An unlucky feeling: Overconfidence and noisy feedback," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 510-524.
    27. Jean-Pierre Benoît & Juan Dubra & Giorgia Romagnoli, 2022. "Belief Elicitation When More than Money Matters: Controlling for "Control"," American Economic Journal: Microeconomics, American Economic Association, vol. 14(3), pages 837-888, August.
    28. Jeremy Clark & Lana Friesen, 2009. "Overconfidence in Forecasts of Own Performance: An Experimental Study," Economic Journal, Royal Economic Society, vol. 119(534), pages 229-251, January.
    29. Johannes Abeler & Steffen Altmann & Sebastian Kube & Matthias Wibral, 2010. "Gift Exchange and Workers' Fairness Concerns: When Equality is Unfair," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1299-1324, December.
    30. Laura K. Gee & Marco Migueis & Sahar Parsa, 2017. "Redistributive choices and increasing income inequality: experimental evidence for income as a signal of deservingness," Experimental Economics, Springer;Economic Science Association, vol. 20(4), pages 894-923, December.
    31. Roland Bénabou & Jean Tirole, 2005. "Self-Confidence and Personal Motivation," International Economic Association Series, in: Bina Agarwal & Alessandro Vercelli (ed.), Psychology, Rationality and Economic Behaviour, chapter 2, pages 19-57, Palgrave Macmillan.
    32. Mollerstrom, Johanna & Reme, Bjørn-Atle & Sørensen, Erik Ø., 2015. "Luck, choice and responsibility — An experimental study of fairness views," Journal of Public Economics, Elsevier, vol. 131(C), pages 33-40.
    33. Gary Charness & Matthew Rabin, 2002. "Understanding Social Preferences with Simple Tests," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 817-869.
    34. Adam S. Goodie & Diana L. Young, 2007. "The skill element in decision making under uncertainty: Control or competence?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 2, pages 189-203, June.
    35. Craig R. Fox & Amos Tversky, 1995. "Ambiguity Aversion and Comparative Ignorance," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(3), pages 585-603.
    36. Townsend, David M. & Busenitz, Lowell W. & Arthurs, Jonathan D., 2010. "To start or not to start: Outcome and ability expectations in the decision to start a new venture," Journal of Business Venturing, Elsevier, vol. 25(2), pages 192-202, March.
    37. Guillaume Hollard & Sébastien Massoni & Jean-Christophe Vergnaud, 2016. "In search of good probability assessors: an experimental comparison of elicitation rules for confidence judgments," Theory and Decision, Springer, vol. 80(3), pages 363-387, March.
    38. Grossman, Zachary & Owens, David, 2010. "An Unlucky Feeling: Overconfidence and Noisy Feedback," University of California at Santa Barbara, Economics Working Paper Series qt13r2f3gt, Department of Economics, UC Santa Barbara.
    39. Prissé, Benjamin & Jorrat, Diego, 2022. "Lab vs online experiments: No differences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    40. Chuang, Wen-I & Lee, Bong-Soo, 2006. "An empirical evaluation of the overconfidence hypothesis," Journal of Banking & Finance, Elsevier, vol. 30(9), pages 2489-2515, September.
    41. Robert Libby & Kristina Rennekamp, 2012. "Self‐Serving Attribution Bias, Overconfidence, and the Issuance of Management Forecasts," Journal of Accounting Research, John Wiley & Sons, Ltd., vol. 50(1), pages 197-231, March.
    42. H. Young Baek & Florence Neymotin, 2019. "Overconfident entrepreneurs: Innovating more and paying the piper," Economics Bulletin, AccessEcon, vol. 39(2), pages 1144-1153.
    43. Alvaro Sandroni & Francesco Squintani, 2007. "Overconfidence, Insurance, and Paternalism," American Economic Review, American Economic Association, vol. 97(5), pages 1994-2004, December.
    44. Hogarth, Robin M & Kunreuther, Howard, 1989. "Risk, Ambiguity, and Insurance," Journal of Risk and Uncertainty, Springer, vol. 2(1), pages 5-35, April.
    45. Daylian M. Cain & Don A. Moore & Uriel Haran, 2015. "Making sense of overconfidence in market entry," Strategic Management Journal, Wiley Blackwell, vol. 36(1), pages 1-18, January.
    46. Guillaume Hollard & Sébastien Massoni & Jean-Christophe Vergnaud, 2016. "In search of good probability assessors: an experimental comparison of elicitation rules for confidence judgments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-01306258, HAL.
    47. D. Urbig & J. Stauf & U. Weitzel, 2009. "What is your level of overconfidence? A strictly incentive compatible measurement of absolute and relative overconfidence," Working Papers 09-20, Utrecht School of Economics.
    48. Erik Hoelzl & Aldo Rustichini, 2005. "Overconfident: Do You Put Your Money On It?," Economic Journal, Royal Economic Society, vol. 115(503), pages 305-318, April.
    49. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    50. Owens, David & Grossman , Zachary & Fackler , Ryan, 2012. "The Control Premium: A Preference for Payoff Autonomy," University of California at Santa Barbara, Economics Working Paper Series qt5bg845s1, Department of Economics, UC Santa Barbara.
    51. Urs Fischbacher & Nadja Kairies-Schwarz & Ulrike Stefani, 2017. "Non-additivity and the Salience of Marginal Productivities: Experimental Evidence on Distributive Fairness," Economica, London School of Economics and Political Science, vol. 84(336), pages 587-610, October.
    52. Philipp Koellinger & Theresa Treffers, 2015. "Joy Leads to Overconfidence, and a Simple Countermeasure," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-22, December.
    53. Proeger, Till & Meub, Lukas, 2014. "Overconfidence as a social bias: Experimental evidence," Economics Letters, Elsevier, vol. 122(2), pages 203-207.
    54. Steffen Andersen & Glenn Harrison & Morten Lau & E. Rutström, 2009. "Elicitation using multiple price list formats," Experimental Economics, Springer;Economic Science Association, vol. 12(3), pages 365-366, September.
    55. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    56. Heath, Chip & Tversky, Amos, 1991. "Preference and Belief: Ambiguity and Competence in Choice under Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 4(1), pages 5-28, January.
    57. repec:bla:jfinan:v:53:y:1998:i:6:p:1887-1934 is not listed on IDEAS
    58. Daniel L. Chen & Martin Schonger & Chris Wickens, 2016. "oTree - An open-source platform for laboratory, online, and field experiments," Post-Print hal-04315125, HAL.
    59. Keith M. Marzilli Ericson, 2011. "Forgetting We Forget: Overconfidence And Memory," Journal of the European Economic Association, European Economic Association, vol. 9(1), pages 43-60, February.
    60. Bernardo, Antonio & Welch, Ivo, 1997. "On the Evolution of Overconfidence and Entrepreneurs," University of California at Los Angeles, Anderson Graduate School of Management qt6668s4pz, Anderson Graduate School of Management, UCLA.
    61. Young Park & Luís Santos-Pinto, 2010. "Overconfidence in tournaments: evidence from the field," Theory and Decision, Springer, vol. 69(1), pages 143-166, July.
    62. Wang, F. Albert, 2001. "Overconfidence, Investor Sentiment, and Evolution," Journal of Financial Intermediation, Elsevier, vol. 10(2), pages 138-170, April.
    63. Pavlo Blavatskyy, 2009. "Betting on own knowledge: Experimental test of overconfidence," Journal of Risk and Uncertainty, Springer, vol. 38(1), pages 39-49, February.
    64. Dan Lovallo & Colin Camerer, 1999. "Overconfidence and Excess Entry: An Experimental Approach," American Economic Review, American Economic Association, vol. 89(1), pages 306-318, March.
    65. Kraft, Priscilla S. & Günther, Christina & Kammerlander, Nadine H. & Lampe, Jan, 2022. "Overconfidence and entrepreneurship: A meta-analysis of different types of overconfidence in the entrepreneurial process," Journal of Business Venturing, Elsevier, vol. 37(4).
    66. Grieco, Daniela & Hogarth, Robin M., 2009. "Overconfidence in absolute and relative performance: The regression hypothesis and Bayesian updating," Journal of Economic Psychology, Elsevier, vol. 30(5), pages 756-771, October.
    67. Goodie, Adam S. & Young, Diana L., 2007. "The skill element in decision making under uncertainty: Control or competence?," Judgment and Decision Making, Cambridge University Press, vol. 2(3), pages 189-203, June.
    68. Chen, Daniel L. & Schonger, Martin & Wickens, Chris, 2016. "oTree—An open-source platform for laboratory, online, and field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 9(C), pages 88-97.
    69. Joseph R. Radzevick & Don A. Moore, 2011. "Competing to Be Certain (But Wrong): Market Dynamics and Excessive Confidence in Judgment," Management Science, INFORMS, vol. 57(1), pages 93-106, January.
    70. James Andreoni & John Miller, 2002. "Giving According to GARP: An Experimental Test of the Consistency of Preferences for Altruism," Econometrica, Econometric Society, vol. 70(2), pages 737-753, March.
    71. Daniel Ellsberg, 1961. "Risk, Ambiguity, and the Savage Axioms," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 75(4), pages 643-669.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benoît, Jean-Pierre & Dubra, Juan, 2007. "Overconfidence?," MPRA Paper 6017, University Library of Munich, Germany, revised Nov 2007.
    2. Alexia Gaudeul, 2013. "Social preferences under uncertainty," Jena Economics Research Papers 2013-024, Friedrich-Schiller-University Jena.
    3. Jean‐Pierre Benoît & Juan Dubra, 2011. "Apparent Overconfidence," Econometrica, Econometric Society, vol. 79(5), pages 1591-1625, September.
    4. Strang, Louis & Schaube, Sebastian, 2025. "(Not) Everyone can be a winner — The role of payoff interdependence for redistribution," Journal of Public Economics, Elsevier, vol. 243(C).
    5. Kerschbamer, Rudolf & Müller, Daniel, 2020. "Social preferences and political attitudes: An online experiment on a large heterogeneous sample," Journal of Public Economics, Elsevier, vol. 182(C).
    6. Juan Dubra & Jean-Pierre Beno t & Giorgia Romagnoli, 2019. "Belief elicitation when more than money matters," Documentos de Trabajo/Working Papers 1901, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
    7. Jean-Pierre Benoît & Juan Dubra & Don A. Moore, 2015. "Does The Better-Than-Average Effect Show That People Are Overconfident?: Two Experiments," Journal of the European Economic Association, European Economic Association, vol. 13(2), pages 293-329, April.
    8. Fischer, Mira & Wagner, Valentin, 2018. "Effects of Timing and Reference Frame of Feedback: Evidence from a Field Experiment," IZA Discussion Papers 11970, Institute of Labor Economics (IZA).
    9. Haisley, Emily C. & Weber, Roberto A., 2010. "Self-serving interpretations of ambiguity in other-regarding behavior," Games and Economic Behavior, Elsevier, vol. 68(2), pages 614-625, March.
    10. Kerschbamer, Rudolf, 2015. "The geometry of distributional preferences and a non-parametric identification approach: The Equality Equivalence Test," European Economic Review, Elsevier, vol. 76(C), pages 85-103.
    11. Daniel Müller & Sander Renes, 2017. "Fairness views and political preferences - Evidence from a large online experiment," Working Papers 2017-10, Faculty of Economics and Statistics, Universität Innsbruck.
    12. Hyndman, Kyle & Walker, Matthew J., 2022. "Fairness and risk in ultimatum bargaining," Games and Economic Behavior, Elsevier, vol. 132(C), pages 90-105.
    13. Rudolf Kerschbamer, 2013. "The Geometry of Distributional Preferences and a Non-Parametric Identification Approach," Working Papers 2013-25, Faculty of Economics and Statistics, Universität Innsbruck.
    14. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    15. Björn Bartling & Alexander W. Cappelen & Henning Hermes & Marit Skivenes & Bertil Tungodden, 2023. "Free to fail? Paternalistic preferences in the United States," ECON - Working Papers 436, Department of Economics - University of Zurich, revised May 2025.
    16. Antonio Filippin & Manuela Raimondi, 2016. "The Patron Game with Heterogeneous Endowments: A Case Against Inequality Aversion," De Economist, Springer, vol. 164(1), pages 69-81, March.
    17. Zahra Murad & Martin Sefton & Chris Starmer, 2016. "How do risk attitudes affect measured confidence?," Journal of Risk and Uncertainty, Springer, vol. 52(1), pages 21-46, February.
    18. Ingvild Almås & Alexander W. Cappelen & Bertil Tungodden, 2020. "Cutthroat Capitalism versus Cuddly Socialism: Are Americans More Meritocratic and Efficiency-Seeking than Scandinavians?," Journal of Political Economy, University of Chicago Press, vol. 128(5), pages 1753-1788.
    19. Fischer, Mira & Wagner, Valentin, 2019. "Effects of Timing and Reference Frame of Feedback," Rationality and Competition Discussion Paper Series 150, CRC TRR 190 Rationality and Competition.
    20. Krawczyk, Michal & Le Lec, Fabrice, 2021. "How to elicit distributional preferences: A stress-test of the equality equivalence test," Journal of Economic Behavior & Organization, Elsevier, vol. 182(C), pages 13-28.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2507.15568. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.