IDEAS home Printed from https://ideas.repec.org/a/aea/aecrev/v108y2018i11p3266-3302.html
   My bibliography  Save this article

Measuring and Bounding Experimenter Demand

Author

Listed:
  • Jonathan de Quidt
  • Johannes Haushofer
  • Christopher Roth

Abstract

We propose a technique for assessing robustness to demand effects of findings from experiments and surveys. The core idea is that by deliberately inducing demand in a structured way we can bound its influence. We present a model in which participants respond to their beliefs about the researcher's objectives. Bounds are obtained by manipulating those beliefs with "demand treatments." We apply the method to 11 classic tasks, and estimate bounds averaging 0.13 standard deviations, suggesting that typical demand effects are probably modest. We also show how to compute demand-robust treatment effects and how to structurally estimate the model.

Suggested Citation

  • Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
  • Handle: RePEc:aea:aecrev:v:108:y:2018:i:11:p:3266-3302
    Note: DOI: 10.1257/aer.20171330
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/aer.20171330
    Download Restriction: no

    File URL: https://www.aeaweb.org/articles/attachments?retrieve=UcqoUDxaB4iMQIrGoMSU_VdMcKuG3Wko
    Download Restriction: no

    File URL: https://www.aeaweb.org/articles/attachments?retrieve=zHeZK0cQO5i4Mfk-5j3ynET3rfSjwCMU
    Download Restriction: no

    File URL: https://www.aeaweb.org/articles/attachments?retrieve=9_DoZMSSjmAXhFBu6ohVK9gEJFOGGm0_
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Barmettler, Franziska & Fehr, Ernst & Zehnder, Christian, 2012. "Big experimenter is watching you! Anonymity and prosocial behavior in the laboratory," Games and Economic Behavior, Elsevier, vol. 75(1), pages 17-34.
    2. James Andreoni & Charles Sprenger, 2012. "Estimating Time Preferences from Convex Budgets," American Economic Review, American Economic Association, vol. 102(7), pages 3333-3356, December.
    3. Guido W. Imbens & Charles F. Manski, 2004. "Confidence Intervals for Partially Identified Parameters," Econometrica, Econometric Society, vol. 72(6), pages 1845-1857, November.
    4. Aurelio Bruzzo, 2018. "Recenti iniziative europee ed italiane per la valorizzazione del patrimonio culturale," Working Papers 2018127, University of Ferrara, Department of Economics.
    5. Stefano DellaVigna & John A. List & Ulrike Malmendier, 2012. "Testing for Altruism and Social Pressure in Charitable Giving," The Quarterly Journal of Economics, Oxford University Press, vol. 127(1), pages 1-56.
    6. Uri Gneezy & Jan Potters, 1997. "An Experiment on Risk Taking and Evaluation Periods," The Quarterly Journal of Economics, Oxford University Press, vol. 112(2), pages 631-645.
    7. Urs Fischbacher & Franziska Föllmi-Heusi, 2013. "Lies In Disguise—An Experimental Study On Cheating," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 525-547, June.
    8. Stefano Dellavigna & John A. List & Ulrike Malmendier & Gautam Rao, 2017. "Voting to Tell Others," Review of Economic Studies, Oxford University Press, vol. 84(1), pages 143-181.
    9. Nicholas Bardsley, 2008. "Dictator game giving: altruism or artefact?," Experimental Economics, Springer;Economic Science Association, vol. 11(2), pages 122-133, June.
    10. Binmore, K & Shaked, A & Sutton, J, 1985. "Testing Noncooperative Bargaining Theory: A Preliminary Study," American Economic Review, American Economic Association, vol. 75(5), pages 1178-1180, December.
    11. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    12. Kahneman, Daniel & Knetsch, Jack L & Thaler, Richard H, 1986. "Fairness and the Assumptions of Economics," The Journal of Business, University of Chicago Press, vol. 59(4), pages 285-300, October.
    13. Gerber, Alan S. & Green, Donald P. & Larimer, Christopher W., 2008. "Social Pressure and Voter Turnout: Evidence from a Large-Scale Field Experiment," American Political Science Review, Cambridge University Press, vol. 102(1), pages 33-48, February.
    14. John A. List & Robert P. Berrens & Alok K. Bohara & Joe Kerkvliet, 2004. "Examining the Role of Social Isolation on Stated Preferences," American Economic Review, American Economic Association, vol. 94(3), pages 741-752, June.
    15. repec:feb:framed:0087 is not listed on IDEAS
    16. Guth, Werner & Schmittberger, Rolf & Schwarze, Bernd, 1982. "An experimental analysis of ultimatum bargaining," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 367-388, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Burks, Stephen V. & Carpenter, Jeffrey P. & Verhoogen, Eric, 2003. "Playing both roles in the trust game," Journal of Economic Behavior & Organization, Elsevier, vol. 51(2), pages 195-216, June.
    2. Bartoš, Vojtěch, 2021. "Seasonal scarcity and sharing norms," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 303-316.
    3. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    4. Cristina Bicchieri & Eugen Dimant & Simon Gächter & Daniele Nosenzo, 2020. "Observability, Social Proximity, and the Erosion of Norm Compliance," ECONtribute Discussion Papers Series 009, University of Bonn and University of Cologne, Germany.
    5. Andreas Bergh & Philipp Christoph Wichardt, 2018. "Mine, Ours or Yours? Unintended Framing Effects in Dictator Games," CESifo Working Paper Series 7049, CESifo.
    6. He, Haoran & Wu, Keyu, 2016. "Choice set, relative income, and inequity aversion: An experimental investigation," Journal of Economic Psychology, Elsevier, vol. 54(C), pages 177-193.
    7. Weimann Joachim, 2015. "Die Rolle von Verhaltensökonomik und experimenteller Forschung in Wirtschaftswissenschaft und Politikberatung," Perspektiven der Wirtschaftspolitik, De Gruyter, vol. 16(3), pages 231-252, October.
    8. Thorsten Chmura & Christoph Engel & Markus Englerth, 2013. "Selfishness As a Potential Cause of Crime. A Prison Experiment," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2013_05, Max Planck Institute for Research on Collective Goods.
    9. Müller, Stephan & Rau, Holger A., 2020. "Economic preferences and compliance in the social stress test of the Corona crisis," Center for European, Governance and Economic Development Research Discussion Papers 391, University of Goettingen, Department of Economics.
    10. Larney, Andrea & Rotella, Amanda & Barclay, Pat, 2019. "Stake size effects in ultimatum game and dictator game offers: A meta-analysis," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 61-72.
    11. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    12. van der Heijden, Eline C. M. & Nelissen, Jan H. M. & Verbon, Harrie A. A., 1997. "Altruism and fairness in a public pension system," Journal of Economic Behavior & Organization, Elsevier, vol. 32(4), pages 505-518, April.
    13. Jacek Miękisz & Michał Ramsza, 2012. "Replicator Dynamics of Symmetric Ultimatum Game," Dynamic Games and Applications, Springer, vol. 2(2), pages 258-268, June.
    14. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
    15. Blanco, Mariana & Engelmann, Dirk & Normann, Hans Theo, 2011. "A within-subject analysis of other-regarding preferences," Games and Economic Behavior, Elsevier, vol. 72(2), pages 321-338, June.
    16. te Velde, Vera L., 2018. "Beliefs-based altruism as an alternative explanation for social signaling behaviors," Journal of Economic Behavior & Organization, Elsevier, vol. 152(C), pages 177-191.
    17. Christoph Engel, 2011. "Dictator games: a meta study," Experimental Economics, Springer;Economic Science Association, vol. 14(4), pages 583-610, November.
    18. Müller, Stephan & Rau, Holger A., 2021. "Economic preferences and compliance in the social stress test of the COVID-19 crisis," Journal of Public Economics, Elsevier, vol. 194(C).
    19. Ananish Chaudhuri & Vegard Iversen & Francesca R. Jensenius & Pushkar Maitra, 2020. "Time in Office and the Changing Gender Gap in Dishonesty: Evidence from Local Politics in India," CESifo Working Paper Series 8217, CESifo.
    20. Bao, Te & Tian, Xu & Yu, Xiaohua, 2015. "Dictator game with indivisibility of money," Research Report 15001-EEF, University of Groningen, Research Institute SOM (Systems, Organisations and Management).

    More about this item

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:aecrev:v:108:y:2018:i:11:p:3266-3302. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.