IDEAS home Printed from https://ideas.repec.org/a/aea/aejmic/v16y2024i4p371-405.html
   My bibliography  Save this article

Secure Survey Design in Organizations: Theory and Experiments

Author

Listed:
  • Sylvain Chassang
  • Christian Zehnder

Abstract

We study secure survey designs in organizational settings where fear of retaliation makes it hard to elicit truth. Theory predicts that (i) randomized-response techniques offer no improvement because they are strategically equivalent to direct elicitation, (ii) exogenously distorting survey responses (hard garbling) can improve information transmission, and (iii) the impact of survey design on reporting can be estimated in equilibrium. Laboratory experiments confirm that hard garbling outperforms direct elicitation but randomized response works better than expected. False accusations slightly but persistently bias treatment effect estimates. Additional experiments reveal that play converges to equilibrium if learning from others' experience is possible.

Suggested Citation

  • Sylvain Chassang & Christian Zehnder, 2024. "Secure Survey Design in Organizations: Theory and Experiments," American Economic Journal: Microeconomics, American Economic Association, vol. 16(4), pages 371-405, November.
    • Handle: RePEc:aea:aejmic:v:16:y:2024:i:4:p:371-405
    DOI: 10.1257/mic.20220187
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/mic.20220187
    Download Restriction: no
    File URL: https://doi.org/10.3886/E196081V1
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/mic.20220187.appx
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/mic.20220187.ds
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    File URL: https://libkey.io/10.1257/mic.20220187?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mechtenberg, Lydia & Muehlheusser, Gerd & Roider, Andreas, 2020. "Whistleblower protection: Theory and experimental evidence," European Economic Review, Elsevier, vol. 126(C).
    2. Juan Ortner & Sylvain Chassang, 2018. "Making Corruption Harder: Asymmetric Information, Collusion, and Crime," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2108-2133.
    3. Vincent P. Crawford & Nagore Iriberri, 2007. "Level-k Auctions: Can a Nonequilibrium Model of Strategic Thinking Explain the Winner's Curse and Overbidding in Private-Value Auctions?," Econometrica, Econometric Society, vol. 75(6), pages 1721-1770, November.
    4. Philip A. Haile & Ali Hortaçsu & Grigory Kosenok, 2008. "On the Empirical Content of Quantal Response Equilibrium," American Economic Review, American Economic Association, vol. 98(1), pages 180-200, March.
    5. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    6. Camerer, Colin & Nunnari, Salvatore & Palfrey, Thomas R., 2016. "Quantal response and nonequilibrium beliefs explain overbidding in maximum-value auctions," Games and Economic Behavior, Elsevier, vol. 98(C), pages 243-263.
    7. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    8. Fudenberg, Drew & Levine, David K, 1993. "Self-Confirming Equilibrium," Econometrica, Econometric Society, vol. 61(3), pages 523-545, May.
    9. Steven Kaplan & Joseph Schultz, 2007. "Intentions to Report Questionable Acts: An Examination of the Influence of Anonymous Reporting Channel, Internal Audit Quality, and Setting," Journal of Business Ethics, Springer, vol. 71(2), pages 109-124, March.
    10. Stahl Dale O., 1993. "Evolution of Smartn Players," Games and Economic Behavior, Elsevier, vol. 5(4), pages 604-617, October.
    11. Ernst Fehr & Michael Powell & Tom Wilkening, 2021. "Behavioral Constraints on the Design of Subgame-Perfect Implementation Mechanisms," American Economic Review, American Economic Association, vol. 111(4), pages 1055-1091, April.
    12. Bryn Rosenfeld & Kosuke Imai & Jacob N. Shapiro, 2016. "An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions," American Journal of Political Science, John Wiley & Sons, vol. 60(3), pages 783-802, July.
    13. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    14. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    15. Chassang, Sylvain & Zehnder, Christian, 2016. "Rewards and punishments: informal contracting through social preferences," Theoretical Economics, Econometric Society, vol. 11(3), September.
    16. Graeme Blair & Kosuke Imai & Yang-Yang Zhou, 2015. "Design and Analysis of the Randomized Response Technique," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 1304-1319, September.
    17. Teck-Hua Ho & Xuanming Su, 2013. "A Dynamic Level-k Model in Sequential Games," Management Science, INFORMS, vol. 59(2), pages 452-469, March.
    18. John, Leslie K. & Loewenstein, George & Acquisti, Alessandro & Vosgerau, Joachim, 2018. "When and why randomized response techniques (fail to) elicit the truth," Organizational Behavior and Human Decision Processes, Elsevier, vol. 148(C), pages 101-123.
    19. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    20. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Blume, Andreas & Lai, Ernest K. & Lim, Wooyoung, 2023. "Mediated talk: An experiment," Journal of Economic Theory, Elsevier, vol. 208(C).
    2. Pikulina, Elena S. & Tergiman, Chloe, 2020. "Preferences for power," Journal of Public Economics, Elsevier, vol. 185(C).
    3. Ashwin Kambhampati & Carlos Segura-Rodriguez, 2020. "The Optimal Assortativity of Teams Inside the Firm," PIER Working Paper Archive 20-018, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    4. Laura Boudreau & Sylvain Chassang & Ada González-Torre & Rachel Heath, 2023. "Monitoring Harassment in Organizations," Working Papers 2022-19, Princeton University. Economics Department..

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benndorf, Volker & Kübler, Dorothea & Normann, Hans-Theo, 2015. "Privacy concerns, voluntary disclosure of information, and unraveling: An experiment," European Economic Review, Elsevier, vol. 75(C), pages 43-59.
    2. García-Pola, Bernardo & Iriberri, Nagore & Kovářík, Jaromír, 2020. "Non-equilibrium play in centipede games," Games and Economic Behavior, Elsevier, vol. 120(C), pages 391-433.
    3. Lin, Po-Hsuan & Palfrey, Thomas R., 2024. "Cognitive hierarchies for games in extensive form," Journal of Economic Theory, Elsevier, vol. 220(C).
    4. repec:hum:wpaper:sfb649dp2013-040 is not listed on IDEAS
    5. Külpmann, Philipp & Kuzmics, Christoph, 2022. "Comparing theories of one-shot play out of treatment," Journal of Economic Theory, Elsevier, vol. 205(C).
    6. Benjamin Patrick Evans & Mikhail Prokopenko, 2021. "Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-making," Papers 2106.15844, arXiv.org, revised Mar 2023.
    7. Penczynski, Stefan P., 2017. "The nature of social learning: Experimental evidence," European Economic Review, Elsevier, vol. 94(C), pages 148-165.
    8. Wright, James R. & Leyton-Brown, Kevin, 2017. "Predicting human behavior in unrepeated, simultaneous-move games," Games and Economic Behavior, Elsevier, vol. 106(C), pages 16-37.
    9. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    10. Georganas, Sotiris, 2011. "English auctions with resale: An experimental study," Games and Economic Behavior, Elsevier, vol. 73(1), pages 147-166, September.
    11. Nichole Szembrot, 2018. "Experimental study of cursed equilibrium in a signaling game," Experimental Economics, Springer;Economic Science Association, vol. 21(2), pages 257-291, June.
    12. Bosch-Domènech, Antoni & Vriend, Nicolaas J., 2013. "On the role of non-equilibrium focal points as coordination devices," Journal of Economic Behavior & Organization, Elsevier, vol. 94(C), pages 52-67.
    13. Philippe Jehiel, 2022. "Analogy-Based Expectation Equilibrium and Related Concepts:Theory, Applications, and Beyond," Working Papers halshs-03735680, HAL.
    14. Allain, Marie-Laure & Chambolle, Claire & Rey, Patrick & Teyssier, Sabrina, 2021. "Vertical integration as a source of hold-up: An experiment," European Economic Review, Elsevier, vol. 137(C).
    15. Breitmoser, Yves, 2019. "Knowing me, imagining you: Projection and overbidding in auctions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 423-447.
    16. Miguel A Costa-Gomes & Vincent P Crawford & Nagore Iriberri, 2008. "Comparing Models of Strategic Thinking in Van Huyck, Battalio, and Beil’s Coordination Games," Levine's Working Paper Archive 122247000000002346, David K. Levine.
    17. Llorente-Saguer, Aniol & Sheremeta, Roman M. & Szech, Nora, 2023. "Designing contests between heterogeneous contestants: An experimental study of tie-breaks and bid-caps in all-pay auctions," European Economic Review, Elsevier, vol. 154(C).
    18. Dan Levin & James Peck & Asen Ivanov, 2016. "Separating Bayesian Updating from Non-Probabilistic Reasoning: An Experimental Investigation," American Economic Journal: Microeconomics, American Economic Association, vol. 8(2), pages 39-60, May.
    19. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    20. David Danz & Dietmar Fehr & Dorothea Kübler, 2012. "Information and beliefs in a repeated normal-form game," Experimental Economics, Springer;Economic Science Association, vol. 15(4), pages 622-640, December.
    21. Despoina Alempaki & Andrew M. Colman & Felix Kölle & Graham Loomes & Briony D. Pulford, 2022. "Investigating the failure to best respond in experimental games," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 656-679, April.

    More about this item

    JEL classification:

    • C83 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Survey Methods; Sampling Methods
    • C90 - Mathematical and Quantitative Methods - - Design of Experiments - - - General
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:aejmic:v:16:y:2024:i:4:p:371-405. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.