IDEAS home Printed from https://ideas.repec.org/a/eee/gamebe/v148y2024icp449-486.html
   My bibliography  Save this article

Inference from biased polls

Author

Listed:
  • Brownback, Andy
  • Burke, Nathaniel
  • Gagnon-Bartsch, Tristan

Abstract

People often attempt to present a positive image by overstating virtuous behaviors when responding to unincentivized “polls.” We examine whether others account for this “socially desirable responding” (SDR) when drawing inferences from such unincentivized responses. In an experiment, we incentivize “predictors” to guess others' choice behaviors across actions with varying social desirability. Predictors observe random subsamples of either (i) incentivized choices or (ii) hypothetical claims. The hypothetical claims exhibit systematic SDR and predictors are reasonably skeptical of them. However, their skepticism is not tailored to the direction or magnitude of SDR. This under-correction occurs even though subjects' stated sentiment toward the actions can predict SDR.

Suggested Citation

  • Brownback, Andy & Burke, Nathaniel & Gagnon-Bartsch, Tristan, 2024. "Inference from biased polls," Games and Economic Behavior, Elsevier, vol. 148(C), pages 449-486.
  • Handle: RePEc:eee:gamebe:v:148:y:2024:i:c:p:449-486
    DOI: 10.1016/j.geb.2024.10.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0899825624001532
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.geb.2024.10.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stephens-Davidowitz, Seth, 2014. "The cost of racial animus on a black candidate: Evidence using Google search data," Journal of Public Economics, Elsevier, vol. 118(C), pages 26-40.
    2. Jens Großer & Arthur Schram, 2010. "Public Opinion Polls, Voter Turnout, and Welfare: An Experimental Study," American Journal of Political Science, John Wiley & Sons, vol. 54(3), pages 700-717, July.
    3. Navin Kartik, 2009. "Strategic Communication with Lying Costs," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(4), pages 1359-1395.
    4. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, June.
    5. Bryn Rosenfeld & Kosuke Imai & Jacob N. Shapiro, 2016. "An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions," American Journal of Political Science, John Wiley & Sons, vol. 60(3), pages 783-802, July.
    6. M. Kathleen Ngangoué & Georg Weizsäcker, 2021. "Learning from Unrealized versus Realized Prices," American Economic Journal: Microeconomics, American Economic Association, vol. 13(2), pages 174-201, May.
    7. Gary Charness & Ryan Oprea & Sevgi Yuksel, 2021. "How do People Choose Between Biased Information Sources? Evidence from a Laboratory Experiment," Journal of the European Economic Association, European Economic Association, vol. 19(3), pages 1656-1691.
    8. Katherine B. Coffman & Lucas C. Coffman & Keith M. Marzilli Ericson, 2017. "The Size of the LGBT Population and the Magnitude of Antigay Sentiment Are Substantially Underestimated," Management Science, INFORMS, vol. 63(10), pages 3168-3186, October.
    9. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    10. Keith M. Marzilli Ericson, 2011. "Forgetting We Forget: Overconfidence And Memory," Journal of the European Economic Association, European Economic Association, vol. 9(1), pages 43-60, February.
    11. Ezequiel Gonzalez‐Ocantos & Chad Kiewiet de Jonge & Carlos Meléndez & Javier Osorio & David W. Nickerson, 2012. "Vote Buying and Social Desirability Bias: Experimental Evidence from Nicaragua," American Journal of Political Science, John Wiley & Sons, vol. 56(1), pages 202-217, January.
    12. Roland Bénabou & Jean Tirole, 2005. "Self-Confidence and Personal Motivation," International Economic Association Series, in: Bina Agarwal & Alessandro Vercelli (ed.), Psychology, Rationality and Economic Behaviour, chapter 2, pages 19-57, Palgrave Macmillan.
    13. Johannes Abeler & Daniele Nosenzo & Collin Raymond, 2019. "Preferences for Truth‐Telling," Econometrica, Econometric Society, vol. 87(4), pages 1115-1153, July.
    14. Marta Serra-Garcia & Uri Gneezy, 2021. "Mistakes, Overconfidence, and the Effect of Sharing on Detecting Lies," American Economic Review, American Economic Association, vol. 111(10), pages 3160-3183, October.
    15. Urs Fischbacher & Franziska Föllmi-Heusi, 2013. "Lies In Disguise—An Experimental Study On Cheating," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 525-547, June.
    16. Marina Agranov & Jacob K Goeree & Julian Romero & Leeat Yariv, 2018. "What Makes Voters Turn Out: The Effects of Polls and Beliefs," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 825-856.
    17. Felipe A. Araujo & Stephanie W. Wang & Alistair J. Wilson, 2021. "The Times They Are A-Changing: Experimenting with Dynamic Adverse Selection," American Economic Journal: Microeconomics, American Economic Association, vol. 13(4), pages 1-22, November.
    18. Alejandro Martínez-Marquina & Muriel Niederle & Emanuel Vespa, 2019. "Failures in Contingent Reasoning: The Role of Uncertainty," American Economic Review, American Economic Association, vol. 109(10), pages 3437-3474, October.
    19. Erin L. Krupka & Roberto A. Weber, 2013. "Identifying Social Norms Using Coordination Games: Why Does Dictator Game Sharing Vary?," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 495-524, June.
    20. Karlan, Dean S. & Zinman, Jonathan, 2012. "List randomization for sensitive behavior: An application for measuring use of loan proceeds," Journal of Development Economics, Elsevier, vol. 98(1), pages 71-75.
    21. Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
    22. Michael Thaler, 2024. "The Fake News Effect: Experimentally Identifying Motivated Reasoning Using Trust in News," American Economic Journal: Microeconomics, American Economic Association, vol. 16(2), pages 1-38, May.
    23. Bagwell, Laurie Simon & Bernheim, B Douglas, 1996. "Veblen Effects in a Theory of Conspicuous Consumption," American Economic Review, American Economic Association, vol. 86(3), pages 349-373, June.
    24. James G. Kane & Stephen C. Craig & Kenneth D. Wald, 2004. "Religion and Presidential Politics in Florida: A List Experiment," Social Science Quarterly, Southwestern Social Science Association, vol. 85(2), pages 281-293, June.
    25. Paul Heidhues & Botond Koszegi, 2010. "Exploiting Naivete about Self-Control in the Credit Market," American Economic Review, American Economic Association, vol. 100(5), pages 2279-2303, December.
    26. Bharadwaj, Prashant & Pai, Mallesh M. & Suziedelyte, Agne, 2017. "Mental health stigma," Economics Letters, Elsevier, vol. 159(C), pages 57-60.
    27. Leonardo Bursztyn & Davide Cantoni & Patricia Funk & Felix Schönenberger & Noam Yuchtman, 2024. "Identifying the Effect of Election Closeness on Voter Turnout: Evidence from Swiss Referenda," Journal of the European Economic Association, European Economic Association, vol. 22(2), pages 876-914.
    28. Crawford, Vincent, 1998. "A Survey of Experiments on Communication via Cheap Talk," Journal of Economic Theory, Elsevier, vol. 78(2), pages 286-298, February.
    29. Brownback, Andy & Novotny, Aaron, 2018. "Social desirability bias and polling errors in the 2016 presidential election," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 38-56.
    30. Leonardo Bursztyn & Bruno Ferman & Stefano Fiorin & Martin Kanz & Gautam Rao, 2018. "Status Goods: Experimental Evidence from Platinum Credit Cards," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(3), pages 1561-1595.
    31. Ned Augenblick & Matthew Rabin, 2019. "An Experiment on Time Preference and Misprediction in Unpleasant Tasks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(3), pages 941-975.
    32. Jennifer A. Heerwig & Brian J. McCabe, 2009. "Education and Social Desirability Bias: The Case of a Black Presidential Candidate," Social Science Quarterly, Southwestern Social Science Association, vol. 90(3), pages 674-686, September.
    33. Alexander L. Janus, 2010. "The Influence of Social Desirability Pressures on Expressed Immigration Attitudes," Social Science Quarterly, Southwestern Social Science Association, vol. 91(4), pages 928-946, December.
    34. Boukouras, Aristotelis & Jennings, Will & Li, Lunzheng & Maniadis, Zacharias, 2023. "Can biased polls distort electoral results? Evidence from the lab," European Journal of Political Economy, Elsevier, vol. 78(C).
    35. Crawford, Vincent P & Sobel, Joel, 1982. "Strategic Information Transmission," Econometrica, Econometric Society, vol. 50(6), pages 1431-1451, November.
    36. Ignacio Esponda Jr. & Emanuel Vespa Jr., 2014. "Hypothetical Thinking and Information Extraction in the Laboratory," American Economic Journal: Microeconomics, American Economic Association, vol. 6(4), pages 180-202, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Brownback, Andy & Novotny, Aaron, 2018. "Social desirability bias and polling errors in the 2016 presidential election," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 74(C), pages 38-56.
    2. Marie Claire Villeval, 2019. "Comportements (non) éthiques et stratégies morales," Revue économique, Presses de Sciences-Po, vol. 70(6), pages 1021-1046.
    3. Fries, Tilman, 2024. "Signaling motives in lying games," Games and Economic Behavior, Elsevier, vol. 147(C), pages 338-376.
    4. Gneezy, Uri & Saccardo, Silvia & Serra-Garcia, Marta & van Veldhuizen, Roel, 2020. "Bribing the Self," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 120, pages 311-324.
    5. Dugar, Subhasish & Shahriar, Quazi, 2023. "Lying for votes," Games and Economic Behavior, Elsevier, vol. 142(C), pages 46-72.
    6. Johannes Abeler & Armin Falk & Fabian Kosse, 2021. "Malleability of Preferences for Honesty," CESifo Working Paper Series 9033, CESifo.
    7. Mechtenberg, Lydia & Perino, Grischa & Treich, Nicolas & Tyran, Jean-Robert & Wang, Stephanie W., 2024. "Self-signaling in voting," Journal of Public Economics, Elsevier, vol. 231(C).
    8. Alain Cohn & Tobias Gesche & Michel André Maréchal, 2022. "Honesty in the Digital Age," Management Science, INFORMS, vol. 68(2), pages 827-845, February.
    9. Huber, Christoph & Huber, Jürgen, 2020. "Bad bankers no more? Truth-telling and (dis)honesty in the finance industry," Journal of Economic Behavior & Organization, Elsevier, vol. 180(C), pages 472-493.
    10. Attanasi, Giuseppe & Rimbaud, Claire & Villeval, Marie Claire, 2019. "Embezzlement and guilt aversion," Journal of Economic Behavior & Organization, Elsevier, vol. 167(C), pages 409-429.
    11. Khalmetski, Kiryl, 2019. "Evasion of guilt in expert advice," Journal of Economic Behavior & Organization, Elsevier, vol. 167(C), pages 296-310.
    12. Jorge M. Agüero & Veronica Frisancho, 2022. "Measuring Violence against Women with Experimental Methods," Economic Development and Cultural Change, University of Chicago Press, vol. 70(4), pages 1565-1590.
    13. Hamid Aghadadashli & Georg Kirchsteiger & Patrick Legros, 2021. "Cheap Talk is not Cheap: Free versus Costly Communication," Working Papers ECARES 2021-07, ULB -- Universite Libre de Bruxelles.
    14. Heike Hennig‐Schmidt & Hendrik Jürges & Daniel Wiesen, 2019. "Dishonesty in health care practice: A behavioral experiment on upcoding in neonatology," Health Economics, John Wiley & Sons, Ltd., vol. 28(3), pages 319-338, March.
    15. Blume, Andreas & Lai, Ernest K. & Lim, Wooyoung, 2019. "Eliciting private information with noise: The case of randomized response," Games and Economic Behavior, Elsevier, vol. 113(C), pages 356-380.
    16. Heller, Yuval & Sturrock, David, 2017. "Promises and Endogenous Reneging Costs," MPRA Paper 78803, University Library of Munich, Germany.
    17. Lang, Matthias & Schudy, Simeon, 2023. "(Dis)honesty and the value of transparency for campaign promises," European Economic Review, Elsevier, vol. 159(C).
    18. Huber, Christoph & Litsios, Christos & Nieper, Annika & Promann, Timo, 2023. "On social norms and observability in (dis)honest behavior," Journal of Economic Behavior & Organization, Elsevier, vol. 212(C), pages 1086-1099.
    19. Eugen Dimant & Tobias Gesche, 2021. "Nudging Enforcers: How Norm Perceptions and Motives for Lying Shape Sanctions," CESifo Working Paper Series 9385, CESifo.
    20. Zhixin Dai & Fabio Galeotti & Marie Claire Villeval, 2018. "Cheating in the Lab Predicts Fraud in the Field: An Experiment in Public Transportation," Management Science, INFORMS, vol. 64(3), pages 1081-1100, March.

    More about this item

    Keywords

    Polling; Social desirability; Inference; Signaling;
    All these keywords.

    JEL classification:

    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making
    • D84 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Expectations; Speculations
    • D72 - Microeconomics - - Analysis of Collective Decision-Making - - - Political Processes: Rent-seeking, Lobbying, Elections, Legislatures, and Voting Behavior

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:gamebe:v:148:y:2024:i:c:p:449-486. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622836 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.