IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/25918.html
   My bibliography  Save this paper

Secure Survey Design in Organizations: Theory and Experiments

Author

Listed:
  • Sylvain Chassang
  • Christian Zehnder

Abstract

We study the impact of secure survey designs ensuring plausible deniability on information transmission in organizations. We are interested in settings in which fear of retaliation makes potential informants reluctant to reveal the truth. Theory predicts that: (i) popular randomized-response designs fail to induce informative reports, because they are strategically equivalent to non-secure direct-elicitation designs; (ii) hard-garbling designs that exogenously distort survey responses improve information transmission; and (iii) unbiased estimates of the impact of survey design on information transmission can be obtained in equilibrium. Laboratory experiments qualify these predictions. While hard-garbling does improve information transmission over direct-elicitation, other predictions fail: randomized response performs much better than expected; and false accusations lead to a small but persistent bias in treatment effect estimates. We show that these deviations from equilibrium can be accounted for in an off-the-shelf model of boundedly rational play, and that this model of play makes specific predictions over the bias of treatment effect estimators. Additional experiments reveal that play converges to equilibrium if players can (socially) learn from cross-sectional data. These results suggest that randomized response cannot be used systematically in organizational settings, whereas hard garbling improves survey quality even under long-run equilibrium conditions.

Suggested Citation

  • Sylvain Chassang & Christian Zehnder, 2019. "Secure Survey Design in Organizations: Theory and Experiments," NBER Working Papers 25918, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:25918
    Note: DEV LE LS POL
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w25918.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Juan Ortner & Sylvain Chassang, 2018. "Making Corruption Harder: Asymmetric Information, Collusion, and Crime," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2108-2133.
    2. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    3. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    4. Philip A. Haile & Ali Hortaçsu & Grigory Kosenok, 2008. "On the Empirical Content of Quantal Response Equilibrium," American Economic Review, American Economic Association, vol. 98(1), pages 180-200, March.
    5. Steven Kaplan & Joseph Schultz, 2007. "Intentions to Report Questionable Acts: An Examination of the Influence of Anonymous Reporting Channel, Internal Audit Quality, and Setting," Journal of Business Ethics, Springer, vol. 71(2), pages 109-124, March.
    6. Bryn Rosenfeld & Kosuke Imai & Jacob N. Shapiro, 2016. "An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions," American Journal of Political Science, John Wiley & Sons, vol. 60(3), pages 783-802, July.
    7. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    8. Mechtenberg, Lydia & Muehlheusser, Gerd & Roider, Andreas, 2020. "Whistleblower protection: Theory and experimental evidence," European Economic Review, Elsevier, vol. 126(C).
    9. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    10. Fehr, Ernst & Powell, Michael & Wilkening, Tom, 2021. "Behavioral Constraints on the Design of Subgame-Perfect Implementation Mechanisms," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 111(4), pages 1055-1091.
    11. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    12. Vincent P. Crawford & Nagore Iriberri, 2007. "Level-k Auctions: Can a Nonequilibrium Model of Strategic Thinking Explain the Winner's Curse and Overbidding in Private-Value Auctions?," Econometrica, Econometric Society, vol. 75(6), pages 1721-1770, November.
    13. Camerer, Colin & Nunnari, Salvatore & Palfrey, Thomas R., 2016. "Quantal response and nonequilibrium beliefs explain overbidding in maximum-value auctions," Games and Economic Behavior, Elsevier, vol. 98(C), pages 243-263.
    14. Graeme Blair & Kosuke Imai & Yang-Yang Zhou, 2015. "Design and Analysis of the Randomized Response Technique," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 1304-1319, September.
    15. Teck-Hua Ho & Xuanming Su, 2013. "A Dynamic Level-k Model in Sequential Games," Management Science, INFORMS, vol. 59(2), pages 452-469, March.
    16. John, Leslie K. & Loewenstein, George & Acquisti, Alessandro & Vosgerau, Joachim, 2018. "When and why randomized response techniques (fail to) elicit the truth," Organizational Behavior and Human Decision Processes, Elsevier, vol. 148(C), pages 101-123.
    17. Chassang, Sylvain & Zehnder, Christian, 2016. "Rewards and punishments: informal contracting through social preferences," Theoretical Economics, Econometric Society, vol. 11(3), September.
    18. Stahl Dale O., 1993. "Evolution of Smartn Players," Games and Economic Behavior, Elsevier, vol. 5(4), pages 604-617, October.
    19. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Blume, Andreas & Lai, Ernest K. & Lim, Wooyoung, 2023. "Mediated talk: An experiment," Journal of Economic Theory, Elsevier, vol. 208(C).
    2. Laura Boudreau & Sylvain Chassang & Ada González-Torre & Rachel Heath, 2023. "Monitoring Harassment in Organizations," Working Papers 2022-19, Princeton University. Economics Department..
    3. Pikulina, Elena S. & Tergiman, Chloe, 2020. "Preferences for power," Journal of Public Economics, Elsevier, vol. 185(C).
    4. Ashwin Kambhampati & Carlos Segura-Rodriguez, 2020. "The Optimal Assortativity of Teams Inside the Firm," PIER Working Paper Archive 20-018, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sylvain Chassang & Christian Zehnder, 2019. "Secure Survey Design in Organizations: Theory and Experiments," Working Papers 2019-22, Princeton University. Economics Department..
    2. Benndorf, Volker & Kübler, Dorothea & Normann, Hans-Theo, 2015. "Privacy concerns, voluntary disclosure of information, and unraveling: An experiment," European Economic Review, Elsevier, vol. 75(C), pages 43-59.
    3. García-Pola, Bernardo & Iriberri, Nagore & Kovářík, Jaromír, 2020. "Non-equilibrium play in centipede games," Games and Economic Behavior, Elsevier, vol. 120(C), pages 391-433.
    4. Külpmann, Philipp & Kuzmics, Christoph, 2022. "Comparing theories of one-shot play out of treatment," Journal of Economic Theory, Elsevier, vol. 205(C).
    5. Benjamin Patrick Evans & Mikhail Prokopenko, 2021. "Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-making," Papers 2106.15844, arXiv.org, revised Mar 2023.
    6. Penczynski, Stefan P., 2017. "The nature of social learning: Experimental evidence," European Economic Review, Elsevier, vol. 94(C), pages 148-165.
    7. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    8. Nichole Szembrot, 2018. "Experimental study of cursed equilibrium in a signaling game," Experimental Economics, Springer;Economic Science Association, vol. 21(2), pages 257-291, June.
    9. Wright, James R. & Leyton-Brown, Kevin, 2017. "Predicting human behavior in unrepeated, simultaneous-move games," Games and Economic Behavior, Elsevier, vol. 106(C), pages 16-37.
    10. Georganas, Sotiris, 2011. "English auctions with resale: An experimental study," Games and Economic Behavior, Elsevier, vol. 73(1), pages 147-166, September.
    11. Allain, Marie-Laure & Chambolle, Claire & Rey, Patrick & Teyssier, Sabrina, 2021. "Vertical integration as a source of hold-up: An experiment," European Economic Review, Elsevier, vol. 137(C).
    12. Breitmoser, Yves, 2019. "Knowing me, imagining you: Projection and overbidding in auctions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 423-447.
    13. Philippe Jehiel, 2022. "Analogy-Based Expectation Equilibrium and Related Concepts:Theory, Applications, and Beyond," PSE Working Papers halshs-03735680, HAL.
    14. Llorente-Saguer, Aniol & Sheremeta, Roman M. & Szech, Nora, 2023. "Designing contests between heterogeneous contestants: An experimental study of tie-breaks and bid-caps in all-pay auctions," European Economic Review, Elsevier, vol. 154(C).
    15. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    16. Despoina Alempaki & Andrew M. Colman & Felix Kölle & Graham Loomes & Briony D. Pulford, 2022. "Investigating the failure to best respond in experimental games," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 656-679, April.
    17. Potters, Jan & Suetens, Sigrid, 2020. "Optimization incentives in dilemma games with strategic complementarity," European Economic Review, Elsevier, vol. 127(C).
    18. Koch, Christian & Penczynski, Stefan P., 2018. "The winner's curse: Conditional reasoning and belief formation," Journal of Economic Theory, Elsevier, vol. 174(C), pages 57-102.
    19. Bosch-Domènech, Antoni & Vriend, Nicolaas J., 2013. "On the role of non-equilibrium focal points as coordination devices," Journal of Economic Behavior & Organization, Elsevier, vol. 94(C), pages 52-67.
    20. Tony Haitao Cui & Yinghao Zhang, 2018. "Cognitive Hierarchy in Capacity Allocation Games," Management Science, INFORMS, vol. 64(3), pages 1250-1270, March.

    More about this item

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior
    • D23 - Microeconomics - - Production and Organizations - - - Organizational Behavior; Transaction Costs; Property Rights
    • D73 - Microeconomics - - Analysis of Collective Decision-Making - - - Bureaucracy; Administrative Processes in Public Organizations; Corruption
    • D74 - Microeconomics - - Analysis of Collective Decision-Making - - - Conflict; Conflict Resolution; Alliances; Revolutions
    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
    • D86 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Economics of Contract Law

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:25918. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.