IDEAS home Printed from https://ideas.repec.org/p/pri/econom/2019-22.html
   My bibliography  Save this paper

Secure Survey Design in Organizations: Theory and Experiments

Author

Listed:
  • Sylvain Chassang

    (New York University)

  • Christian Zehnder

    (HEC Lausanne)

Abstract

We study the impact of secure survey designs ensuring plausible deniability on information transmission in organizations. We are interested in settings in which fear of retaliation makes potential informants reluctant to reveal the truth. Theory predicts that: (i) popular randomized-response designs fail to induce informative reports, because they are strategically equivalent to non-secure direct-elicitation designs, (ii) hard-garbling designs that exogenously distort survey responses improve information transmission, and (iii) unbiased estimates of the impact of survey design on information transmission can be obtained in equilibrium. Laboratory experiments qualify these predictions. While hard-garbling does improve information transmission over direct-elicitation, other predictions fail: randomized response performs much better than expected, and false accusations lead to a small but persistent bias in treatment effect estimates. We show that these deviations from equilibrium can be accounted for in an off-the-shelf model of boundedly rational play, and that this model of play makes specific predictions over the bias of treatment effect estimators. Additional experiments reveal that play converges to equilibrium if players can (socially) learn from cross-sectional data. These results suggest that randomized response cannot be used systematically in organizational settings, whereas hard garbling improves survey quality even under long-run equilibrium conditions.

Suggested Citation

  • Sylvain Chassang & Christian Zehnder, 2019. "Secure Survey Design in Organizations: Theory and Experiments," Working Papers 2019-22, Princeton University. Economics Department..
  • Handle: RePEc:pri:econom:2019-22
    as

    Download full text from publisher

    File URL: https://www.sylvainchassang.org/assets/papers/secure_survey_design.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Juan Ortner & Sylvain Chassang, 2018. "Making Corruption Harder: Asymmetric Information, Collusion, and Crime," Journal of Political Economy, University of Chicago Press, vol. 126(5), pages 2108-2133.
    2. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    3. McFadden, Daniel, 1989. "A Method of Simulated Moments for Estimation of Discrete Response Models without Numerical Integration," Econometrica, Econometric Society, vol. 57(5), pages 995-1026, September.
    4. Philip A. Haile & Ali Hortaçsu & Grigory Kosenok, 2008. "On the Empirical Content of Quantal Response Equilibrium," American Economic Review, American Economic Association, vol. 98(1), pages 180-200, March.
    5. Fudenberg, Drew & Levine, David K, 1993. "Self-Confirming Equilibrium," Econometrica, Econometric Society, vol. 61(3), pages 523-545, May.
    6. Vincent P. Crawford & Nagore Iriberri, 2007. "Level-k Auctions: Can a Nonequilibrium Model of Strategic Thinking Explain the Winner's Curse and Overbidding in Private-Value Auctions?," Econometrica, Econometric Society, vol. 75(6), pages 1721-1770, November.
    7. Steven Kaplan & Joseph Schultz, 2007. "Intentions to Report Questionable Acts: An Examination of the Influence of Anonymous Reporting Channel, Internal Audit Quality, and Setting," Journal of Business Ethics, Springer, vol. 71(2), pages 109-124, March.
    8. Bryn Rosenfeld & Kosuke Imai & Jacob N. Shapiro, 2016. "An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions," American Journal of Political Science, John Wiley & Sons, vol. 60(3), pages 783-802, July.
    9. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    10. Chassang, Sylvain & Zehnder, Christian, 2016. "Rewards and punishments: informal contracting through social preferences," Theoretical Economics, Econometric Society, vol. 11(3), September.
    11. Mechtenberg, Lydia & Muehlheusser, Gerd & Roider, Andreas, 2020. "Whistleblower protection: Theory and experimental evidence," European Economic Review, Elsevier, vol. 126(C).
    12. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    13. Stahl Dale O., 1993. "Evolution of Smartn Players," Games and Economic Behavior, Elsevier, vol. 5(4), pages 604-617, October.
    14. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    15. Camerer, Colin & Nunnari, Salvatore & Palfrey, Thomas R., 2016. "Quantal response and nonequilibrium beliefs explain overbidding in maximum-value auctions," Games and Economic Behavior, Elsevier, vol. 98(C), pages 243-263.
    16. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    17. Graeme Blair & Kosuke Imai & Yang-Yang Zhou, 2015. "Design and Analysis of the Randomized Response Technique," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(511), pages 1304-1319, September.
    18. Teck-Hua Ho & Xuanming Su, 2013. "A Dynamic Level-k Model in Sequential Games," Management Science, INFORMS, vol. 59(2), pages 452-469, March.
    19. John, Leslie K. & Loewenstein, George & Acquisti, Alessandro & Vosgerau, Joachim, 2018. "When and why randomized response techniques (fail to) elicit the truth," Organizational Behavior and Human Decision Processes, Elsevier, vol. 148(C), pages 101-123.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Blume, Andreas & Lai, Ernest K. & Lim, Wooyoung, 2023. "Mediated talk: An experiment," Journal of Economic Theory, Elsevier, vol. 208(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sylvain Chassang & Christian Zehnder, 2019. "Secure Survey Design in Organizations: Theory and Experiments," NBER Working Papers 25918, National Bureau of Economic Research, Inc.
    2. Benndorf, Volker & Kübler, Dorothea & Normann, Hans-Theo, 2015. "Privacy concerns, voluntary disclosure of information, and unraveling: An experiment," European Economic Review, Elsevier, vol. 75(C), pages 43-59.
    3. García-Pola, Bernardo & Iriberri, Nagore & Kovářík, Jaromír, 2020. "Non-equilibrium play in centipede games," Games and Economic Behavior, Elsevier, vol. 120(C), pages 391-433.
    4. Külpmann, Philipp & Kuzmics, Christoph, 2022. "Comparing theories of one-shot play out of treatment," Journal of Economic Theory, Elsevier, vol. 205(C).
    5. Benjamin Patrick Evans & Mikhail Prokopenko, 2021. "Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-making," Papers 2106.15844, arXiv.org, revised Mar 2023.
    6. Penczynski, Stefan P., 2017. "The nature of social learning: Experimental evidence," European Economic Review, Elsevier, vol. 94(C), pages 148-165.
    7. Wright, James R. & Leyton-Brown, Kevin, 2017. "Predicting human behavior in unrepeated, simultaneous-move games," Games and Economic Behavior, Elsevier, vol. 106(C), pages 16-37.
    8. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    9. Georganas, Sotiris, 2011. "English auctions with resale: An experimental study," Games and Economic Behavior, Elsevier, vol. 73(1), pages 147-166, September.
    10. Nichole Szembrot, 2018. "Experimental study of cursed equilibrium in a signaling game," Experimental Economics, Springer;Economic Science Association, vol. 21(2), pages 257-291, June.
    11. Bosch-Domènech, Antoni & Vriend, Nicolaas J., 2013. "On the role of non-equilibrium focal points as coordination devices," Journal of Economic Behavior & Organization, Elsevier, vol. 94(C), pages 52-67.
    12. Philippe Jehiel, 2022. "Analogy-Based Expectation Equilibrium and Related Concepts:Theory, Applications, and Beyond," Working Papers halshs-03735680, HAL.
    13. Allain, Marie-Laure & Chambolle, Claire & Rey, Patrick & Teyssier, Sabrina, 2021. "Vertical integration as a source of hold-up: An experiment," European Economic Review, Elsevier, vol. 137(C).
    14. Breitmoser, Yves, 2019. "Knowing me, imagining you: Projection and overbidding in auctions," Games and Economic Behavior, Elsevier, vol. 113(C), pages 423-447.
    15. Miguel A Costa-Gomes & Vincent P Crawford & Nagore Iriberri, 2008. "Comparing Models of Strategic Thinking in Van Huyck, Battalio, and Beil’s Coordination Games," Levine's Working Paper Archive 122247000000002346, David K. Levine.
    16. Llorente-Saguer, Aniol & Sheremeta, Roman M. & Szech, Nora, 2023. "Designing contests between heterogeneous contestants: An experimental study of tie-breaks and bid-caps in all-pay auctions," European Economic Review, Elsevier, vol. 154(C).
    17. Dan Levin & James Peck & Asen Ivanov, 2016. "Separating Bayesian Updating from Non-Probabilistic Reasoning: An Experimental Investigation," American Economic Journal: Microeconomics, American Economic Association, vol. 8(2), pages 39-60, May.
    18. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    19. Despoina Alempaki & Andrew M. Colman & Felix Kölle & Graham Loomes & Briony D. Pulford, 2022. "Investigating the failure to best respond in experimental games," Experimental Economics, Springer;Economic Science Association, vol. 25(2), pages 656-679, April.
    20. Potters, Jan & Suetens, Sigrid, 2020. "Optimization incentives in dilemma games with strategic complementarity," European Economic Review, Elsevier, vol. 127(C).

    More about this item

    Keywords

    secure survey design; randomized-response; whistleblowing; bounded rationality; mechanism design;
    All these keywords.

    JEL classification:

    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C92 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Group Behavior
    • D23 - Microeconomics - - Production and Organizations - - - Organizational Behavior; Transaction Costs; Property Rights
    • D73 - Microeconomics - - Analysis of Collective Decision-Making - - - Bureaucracy; Administrative Processes in Public Organizations; Corruption
    • D74 - Microeconomics - - Analysis of Collective Decision-Making - - - Conflict; Conflict Resolution; Alliances; Revolutions
    • D82 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Asymmetric and Private Information; Mechanism Design
    • D86 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Economics of Contract Law

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pri:econom:2019-22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Bobray Bordelon (email available below). General contact details of provider: https://economics.princeton.edu/working-papers/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.