IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2507.15568.html
   My bibliography  Save this paper

Explaining Apparently Inaccurate Self-assessments of Relative Performance: A Replication and Adaptation of 'Overconfident: Do you put your money on it?' by Hoelzl and Rustichini (2005)

Author

Listed:
  • Marius Protte

Abstract

This study replicates and adapts the experiment of Hoelzl and Rustichini (2005), which examined overplacement, i.e., overconfidence in relative self-assessments, by analyzing individuals' voting preferences between a performance-based and a lottery-based bonus payment mechanism. The original study found underplacement - the majority of their sample apparently expected to perform worse than others - in difficult tasks with monetary incentives, contradicting the widely held assumption of a general human tendency toward overconfidence. This paper challenges the comparability of the two payment schemes, arguing that differences in outcome structures and non-monetary motives may have influenced participants' choices beyond misconfidence. In an online replication, a fixed-outcome distribution lottery mechanism with interdependent success probabilities and no variance in the number of winners - designed to better align with the performance-based payment scheme - is compared against the probabilistic-outcome distribution lottery used in the original study, which features an independent success probability and a variable number of winners. The results align more closely with traditional overplacement patterns than underplacement, as nearly three-fourths of participants prefer the performance-based option regardless of lottery design. Key predictors of voting behavior include expected performance, group performance estimations, and sample question outcomes, while factors such as social comparison tendencies and risk attitudes play no significant role. Self-reported voting rationales highlight the influence of normative beliefs, control preferences, and feedback signals beyond confidence. These results contribute to methodological discussions in overconfidence research by reassessing choice-based overconfidence measures and exploring alternative explanations for observed misplacement effects.

Suggested Citation

  • Marius Protte, 2025. "Explaining Apparently Inaccurate Self-assessments of Relative Performance: A Replication and Adaptation of 'Overconfident: Do you put your money on it?' by Hoelzl and Rustichini (2005)," Papers 2507.15568, arXiv.org.
    • Handle: RePEc:arx:papers:2507.15568
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2507.15568
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gary Charness & Matthew Rabin, 2002. "Understanding Social Preferences with Simple Tests," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(3), pages 817-869.
    2. Ernst Fehr & Klaus M. Schmidt, 1999. "A Theory of Fairness, Competition, and Cooperation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(3), pages 817-868.
    3. Ernst Fehr & Michael Naef & Klaus M. Schmidt, 2006. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments: Comment," American Economic Review, American Economic Association, vol. 96(5), pages 1912-1917, December.
    4. Antonio A. Arechar & Simon Gächter & Lucas Molleman, 2018. "Conducting interactive experiments online," Experimental Economics, Springer;Economic Science Association, vol. 21(1), pages 99-131, March.
    5. Malmendier, Ulrike & Tate, Geoffrey, 2008. "Who makes acquisitions? CEO overconfidence and the market's reaction," Journal of Financial Economics, Elsevier, vol. 89(1), pages 20-43, July.
    6. Daniel Kahneman & Dan Lovallo, 1993. "Timid Choices and Bold Forecasts: A Cognitive Perspective on Risk Taking," Management Science, INFORMS, vol. 39(1), pages 17-31, January.
    7. Terrance Odean., 1996. "Volume, Volatility, Price and Profit When All Trader Are Above Average," Research Program in Finance Working Papers RPF-266, University of California at Berkeley.
    8. Krawczyk, Michał, 2012. "Incentives and timing in relative performance judgments: A field experiment," Journal of Economic Psychology, Elsevier, vol. 33(6), pages 1240-1246.
    9. Uri Gneezy & Alex Imas & John List, 2015. "Estimating Individual Ambiguity Aversion: A Simple Approach," Artefactual Field Experiments 00588, The Field Experiments Website.
    10. Ulrike Malmendier & Geoffrey Tate, 2005. "CEO Overconfidence and Corporate Investment," Journal of Finance, American Finance Association, vol. 60(6), pages 2661-2700, December.
    11. repec:cup:judgdm:v:2:y:2007:i::p:189-203 is not listed on IDEAS
    12. Grossman, Zachary & Owens, David, 2012. "An unlucky feeling: Overconfidence and noisy feedback," Journal of Economic Behavior & Organization, Elsevier, vol. 84(2), pages 510-524.
    13. Jean-Pierre Benoît & Juan Dubra & Giorgia Romagnoli, 2022. "Belief Elicitation When More than Money Matters: Controlling for "Control"," American Economic Journal: Microeconomics, American Economic Association, vol. 14(3), pages 837-888, August.
    14. Alexander W. Cappelen & Astri Drange Hole & Erik Ø Sørensen & Bertil Tungodden, 2007. "The Pluralism of Fairness Ideals: An Experimental Approach," American Economic Review, American Economic Association, vol. 97(3), pages 818-827, June.
    15. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    16. Johannes Abeler & Steffen Altmann & Sebastian Kube & Matthias Wibral, 2010. "Gift Exchange and Workers' Fairness Concerns: When Equality is Unfair," Journal of the European Economic Association, MIT Press, vol. 8(6), pages 1299-1324, December.
    17. Jeremy Clark & Lana Friesen, 2009. "Overconfidence in Forecasts of Own Performance: An Experimental Study," Economic Journal, Royal Economic Society, vol. 119(534), pages 229-251, January.
    18. Roland Bénabou & Jean Tirole, 2005. "Self-Confidence and Personal Motivation," International Economic Association Series, in: Bina Agarwal & Alessandro Vercelli (ed.), Psychology, Rationality and Economic Behaviour, chapter 2, pages 19-57, Palgrave Macmillan.
    19. Mollerstrom, Johanna & Reme, Bjørn-Atle & Sørensen, Erik Ø., 2015. "Luck, choice and responsibility — An experimental study of fairness views," Journal of Public Economics, Elsevier, vol. 131(C), pages 33-40.
    20. Craig R. Fox & Amos Tversky, 1995. "Ambiguity Aversion and Comparative Ignorance," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 110(3), pages 585-603.
    21. Guillaume Hollard & Sébastien Massoni & Jean-Christophe Vergnaud, 2016. "In search of good probability assessors: an experimental comparison of elicitation rules for confidence judgments," Theory and Decision, Springer, vol. 80(3), pages 363-387, March.
    22. Prissé, Benjamin & Jorrat, Diego, 2022. "Lab vs online experiments: No differences," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 100(C).
    23. Chuang, Wen-I & Lee, Bong-Soo, 2006. "An empirical evaluation of the overconfidence hypothesis," Journal of Banking & Finance, Elsevier, vol. 30(9), pages 2489-2515, September.
    24. H. Young Baek & Florence Neymotin, 2019. "Overconfident entrepreneurs: Innovating more and paying the piper," Economics Bulletin, AccessEcon, vol. 39(2), pages 1144-1153.
    25. Daylian M. Cain & Don A. Moore & Uriel Haran, 2015. "Making sense of overconfidence in market entry," Strategic Management Journal, Wiley Blackwell, vol. 36(1), pages 1-18, January.
    26. Guillaume Hollard & Sébastien Massoni & Jean-Christophe Vergnaud, 2016. "In search of good probability assessors: an experimental comparison of elicitation rules for confidence judgments," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-01306258, HAL.
    27. Bruno Biais & Denis Hilton & Karine Mazurier & Sébastien Pouget, 2005. "Judgemental Overconfidence, Self-Monitoring, and Trading Performance in an Experimental Financial Market," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(2), pages 287-312.
    28. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    29. Proeger, Till & Meub, Lukas, 2014. "Overconfidence as a social bias: Experimental evidence," Economics Letters, Elsevier, vol. 122(2), pages 203-207.
    30. Antonio E. Bernardo & Ivo Welch, 2001. "On the Evolution of Overconfidence and Entrepreneurs," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 10(3), pages 301-330, September.
    31. Steffen Andersen & Glenn Harrison & Morten Lau & E. Rutström, 2009. "Elicitation using multiple price list formats," Experimental Economics, Springer;Economic Science Association, vol. 12(3), pages 365-366, September.
    32. Axel Ockenfels & Gary E. Bolton, 2000. "ERC: A Theory of Equity, Reciprocity, and Competition," American Economic Review, American Economic Association, vol. 90(1), pages 166-193, March.
    33. Keith M. Marzilli Ericson, 2011. "Forgetting We Forget: Overconfidence And Memory," Journal of the European Economic Association, European Economic Association, vol. 9(1), pages 43-60, February.
    34. Wang, F. Albert, 2001. "Overconfidence, Investor Sentiment, and Evolution," Journal of Financial Intermediation, Elsevier, vol. 10(2), pages 138-170, April.
    35. Chen, Daniel L. & Schonger, Martin & Wickens, Chris, 2016. "oTree—An open-source platform for laboratory, online, and field experiments," Journal of Behavioral and Experimental Finance, Elsevier, vol. 9(C), pages 88-97.
    36. Daniel Ellsberg, 1961. "Risk, Ambiguity, and the Savage Axioms," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 75(4), pages 643-669.
    37. Dirk Engelmann & Martin Strobel, 2004. "Inequality Aversion, Efficiency, and Maximin Preferences in Simple Distribution Experiments," American Economic Review, American Economic Association, vol. 94(4), pages 857-869, September.
    38. Jean‐Pierre Benoît & Juan Dubra, 2011. "Apparent Overconfidence," Econometrica, Econometric Society, vol. 79(5), pages 1591-1625, September.
    39. Wilde, Christian & Krahnen, Jan Pieter & Ockenfels, Peter, 2014. "Measuring Ambiguity Aversion: A Systematic Experimental Approach," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100557, Verein für Socialpolitik / German Economic Association.
    40. Jose A. Scheinkman & Wei Xiong, 2003. "Overconfidence and Speculative Bubbles," Journal of Political Economy, University of Chicago Press, vol. 111(6), pages 1183-1219, December.
    41. David Owens Jr. & Zachary Grossman Jr. & Ryan Fackler Jr., 2014. "The Control Premium: A Preference for Payoff Autonomy," American Economic Journal: Microeconomics, American Economic Association, vol. 6(4), pages 138-161, November.
    42. Thesmar, David & Landier, Augustin, 2003. "Financial Contracting with Optimistic Entrepreneurs: Theory and Evidence," CEPR Discussion Papers 3971, C.E.P.R. Discussion Papers.
    43. Anderson, Cameron & Brion, Sebastien & Moore, Don A. & Kennedy, Jessica A., 2012. "A status-enhancement account of overconfidence," Institute for Research on Labor and Employment, Working Paper Series qt6s5812wf, Institute of Industrial Relations, UC Berkeley.
    44. Kent D. Daniel & David Hirshleifer & Avanidhar Subrahmanyam, 2001. "Overconfidence, Arbitrage, and Equilibrium Asset Pricing," Journal of Finance, American Finance Association, vol. 56(3), pages 921-965, June.
    45. Laura K. Gee & Marco Migueis & Sahar Parsa, 2017. "Redistributive choices and increasing income inequality: experimental evidence for income as a signal of deservingness," Experimental Economics, Springer;Economic Science Association, vol. 20(4), pages 894-923, December.
    46. Adam S. Goodie & Diana L. Young, 2007. "The skill element in decision making under uncertainty: Control or competence?," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 2, pages 189-203, June.
    47. Townsend, David M. & Busenitz, Lowell W. & Arthurs, Jonathan D., 2010. "To start or not to start: Outcome and ability expectations in the decision to start a new venture," Journal of Business Venturing, Elsevier, vol. 25(2), pages 192-202, March.
    48. Robert Libby & Kristina Rennekamp, 2012. "Self‐Serving Attribution Bias, Overconfidence, and the Issuance of Management Forecasts," Journal of Accounting Research, John Wiley & Sons, Ltd., vol. 50(1), pages 197-231, March.
    49. Alvaro Sandroni & Francesco Squintani, 2007. "Overconfidence, Insurance, and Paternalism," American Economic Review, American Economic Association, vol. 97(5), pages 1994-2004, December.
    50. Hogarth, Robin M & Kunreuther, Howard, 1989. "Risk, Ambiguity, and Insurance," Journal of Risk and Uncertainty, Springer, vol. 2(1), pages 5-35, April.
    51. D. Urbig & J. Stauf & U. Weitzel, 2009. "What is your level of overconfidence? A strictly incentive compatible measurement of absolute and relative overconfidence," Working Papers 09-20, Utrecht School of Economics.
    52. Erik Hoelzl & Aldo Rustichini, 2005. "Overconfident: Do You Put Your Money On It?," Economic Journal, Royal Economic Society, vol. 115(503), pages 305-318, April.
    53. Urs Fischbacher & Nadja Kairies-Schwarz & Ulrike Stefani, 2017. "Non-additivity and the Salience of Marginal Productivities: Experimental Evidence on Distributive Fairness," Economica, London School of Economics and Political Science, vol. 84(336), pages 587-610, October.
    54. Philipp Koellinger & Theresa Treffers, 2015. "Joy Leads to Overconfidence, and a Simple Countermeasure," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-22, December.
    55. Heath, Chip & Tversky, Amos, 1991. "Preference and Belief: Ambiguity and Competence in Choice under Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 4(1), pages 5-28, January.
    56. repec:bla:jfinan:v:53:y:1998:i:6:p:1887-1934 is not listed on IDEAS
    57. Daniel L. Chen & Martin Schonger & Chris Wickens, 2016. "oTree - An open-source platform for laboratory, online, and field experiments," Post-Print hal-04315125, HAL.
    58. Young Park & Luís Santos-Pinto, 2010. "Overconfidence in tournaments: evidence from the field," Theory and Decision, Springer, vol. 69(1), pages 143-166, July.
    59. Pavlo Blavatskyy, 2009. "Betting on own knowledge: Experimental test of overconfidence," Journal of Risk and Uncertainty, Springer, vol. 38(1), pages 39-49, February.
    60. Dan Lovallo & Colin Camerer, 1999. "Overconfidence and Excess Entry: An Experimental Approach," American Economic Review, American Economic Association, vol. 89(1), pages 306-318, March.
    61. Kraft, Priscilla S. & Günther, Christina & Kammerlander, Nadine H. & Lampe, Jan, 2022. "Overconfidence and entrepreneurship: A meta-analysis of different types of overconfidence in the entrepreneurial process," Journal of Business Venturing, Elsevier, vol. 37(4).
    62. Grieco, Daniela & Hogarth, Robin M., 2009. "Overconfidence in absolute and relative performance: The regression hypothesis and Bayesian updating," Journal of Economic Psychology, Elsevier, vol. 30(5), pages 756-771, October.
    63. Goodie, Adam S. & Young, Diana L., 2007. "The skill element in decision making under uncertainty: Control or competence?," Judgment and Decision Making, Cambridge University Press, vol. 2(3), pages 189-203, June.
    64. Joseph R. Radzevick & Don A. Moore, 2011. "Competing to Be Certain (But Wrong): Market Dynamics and Excessive Confidence in Judgment," Management Science, INFORMS, vol. 57(1), pages 93-106, January.
    65. James Andreoni & John Miller, 2002. "Giving According to GARP: An Experimental Test of the Consistency of Preferences for Altruism," Econometrica, Econometric Society, vol. 70(2), pages 737-753, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benoît, Jean-Pierre & Dubra, Juan, 2007. "Overconfidence?," MPRA Paper 6017, University Library of Munich, Germany, revised Nov 2007.
    2. Jean‐Pierre Benoît & Juan Dubra, 2011. "Apparent Overconfidence," Econometrica, Econometric Society, vol. 79(5), pages 1591-1625, September.
    3. Juan Dubra & Jean-Pierre Beno t & Giorgia Romagnoli, 2019. "Belief elicitation when more than money matters," Documentos de Trabajo/Working Papers 1901, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
    4. Zahra Murad & Martin Sefton & Chris Starmer, 2016. "How do risk attitudes affect measured confidence?," Journal of Risk and Uncertainty, Springer, vol. 52(1), pages 21-46, February.
    5. Jean-Pierre Benoît & Juan Dubra & Don A. Moore, 2015. "Does The Better-Than-Average Effect Show That People Are Overconfident?: Two Experiments," Journal of the European Economic Association, European Economic Association, vol. 13(2), pages 293-329, April.
    6. Mohammed Abdellaoui & Han Bleichrodt & Cédric Gutierrez, 2023. "Unpacking Overconfident Behavior When Betting on Oneself," Post-Print hal-04383402, HAL.
    7. Stephen L. Cheung & Lachlan Johnstone, 2025. "True overconfidence, revealed through actions: An experiment," Journal of Risk and Uncertainty, Springer, vol. 70(2), pages 171-199, April.
    8. Alexia Gaudeul, 2013. "Social preferences under uncertainty," Jena Economics Research Papers 2013-024, Friedrich-Schiller-University Jena.
    9. Philipp Koellinger & Theresa Treffers, 2015. "Joy Leads to Overconfidence, and a Simple Countermeasure," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-22, December.
    10. David Hirshleife, 2015. "Behavioral Finance," Annual Review of Financial Economics, Annual Reviews, vol. 7(1), pages 133-159, December.
    11. Strang, Louis & Schaube, Sebastian, 2025. "(Not) Everyone can be a winner — The role of payoff interdependence for redistribution," Journal of Public Economics, Elsevier, vol. 243(C).
    12. Bucciol, Alessandro & Quercia, Simone & Sconti, Alessia, 2021. "Promoting financial literacy among the elderly: Consequences on confidence," Journal of Economic Psychology, Elsevier, vol. 87(C).
    13. Chen, Si & Schildberg-Hörisch, Hannah, 2019. "Looking at the bright side: The motivational value of confidence," European Economic Review, Elsevier, vol. 120(C).
    14. Kerschbamer, Rudolf & Müller, Daniel, 2020. "Social preferences and political attitudes: An online experiment on a large heterogeneous sample," Journal of Public Economics, Elsevier, vol. 182(C).
    15. Bhatt, Vipul & Smith, Angela M., 2025. "Overconfidence and performance: Evidence from a simple real-effort task," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 114(C).
    16. Jean-Pierre Benoît & Juan Dubra & Giorgia Romagnoli, 2022. "Belief Elicitation When More than Money Matters: Controlling for "Control"," American Economic Journal: Microeconomics, American Economic Association, vol. 14(3), pages 837-888, August.
    17. Helen X. H. Bao & Steven Haotong Li, 2016. "Overconfidence And Real Estate Research: A Survey Of The Literature," The Singapore Economic Review (SER), World Scientific Publishing Co. Pte. Ltd., vol. 61(04), pages 1-24, September.
    18. Louis Lévy-Garboua & Muniza Askari & Marco Gazel, 2018. "Confidence biases and learning among intuitive Bayesians," Theory and Decision, Springer, vol. 84(3), pages 453-482, May.
    19. Bruhin, Adrian & Santos-Pinto, Luís & Staubli, David, 2018. "How do beliefs about skill affect risky decisions?," Journal of Economic Behavior & Organization, Elsevier, vol. 150(C), pages 350-371.
    20. Cédric Gutierrez & Thomas Åstebro & Tomasz Obloj, 2020. "The Impact of Overconfidence and Ambiguity Attitude on Market Entry," Organization Science, INFORMS, vol. 31(2), pages 308-329, March.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2507.15568. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.