IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v216y2023icp320-331.html
   My bibliography  Save this article

Belief elicitation in political protest experiments: When the mode does not teach us about incentives to protest

Author

Listed:
  • Canen, Nathan
  • Chakraborty, Anujit

Abstract

Many recent experiments studying political protests elicit subjects' beliefs and actions, before and after an information intervention, to assess the causal role of beliefs on actions. We show that unless beliefs are symmetric and unimodal, using a belief elicitation scheme that is mismatched with the research question may affect the magnitude and even reverse the sign of identified effects. We provide a simple characterization of when such a sign reversal occurs. As an example, we revisit Cantoni et al. (2019)'s influential study of whether political protests are strategic complements or substitutes. We show how their belief elicitation method allows, in theory, a novel and alternative interpretation of their results, which could have been avoided with a different method.

Suggested Citation

  • Canen, Nathan & Chakraborty, Anujit, 2023. "Belief elicitation in political protest experiments: When the mode does not teach us about incentives to protest," Journal of Economic Behavior & Organization, Elsevier, vol. 216(C), pages 320-331.
  • Handle: RePEc:eee:jeborg:v:216:y:2023:i:c:p:320-331
    DOI: 10.1016/j.jebo.2023.10.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268123003724
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2023.10.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Terrance Hurley & Jason Shogren, 2005. "An Experimental Comparison of Induced and Elicited Beliefs," Journal of Risk and Uncertainty, Springer, vol. 30(2), pages 169-188, January.
    2. Palfrey, Thomas R. & Rosenthal, Howard, 1984. "Participation and the provision of discrete public goods: a strategic analysis," Journal of Public Economics, Elsevier, vol. 24(2), pages 171-193, July.
    3. Anselm Hager & Lukas Hensel & Johannes Hermle & Christopher Roth, 2023. "Political Activists as Free Riders: Evidence from a Natural Field Experiment," The Economic Journal, Royal Economic Society, vol. 133(653), pages 2068-2084.
    4. Carlsson, Hans & van Damme, Eric, 1993. "Global Games and Equilibrium Selection," Econometrica, Econometric Society, vol. 61(5), pages 989-1018, September.
    5. Gordon Tullock, 1971. "The paradox of revolution," Public Choice, Springer, vol. 11(1), pages 89-99, September.
    6. Andrew Schotter & Isabel Trevino, 2014. "Belief Elicitation in the Laboratory," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 103-128, August.
    7. Tanjim Hossain & Ryo Okui, 2013. "The Binarized Scoring Rule," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(3), pages 984-1001.
    8. Barbera, Salvador & Jackson, Matthew O., 2020. "A Model of Protests, Revolution, and Information," Quarterly Journal of Political Science, now publishers, vol. 15(3), pages 297-335, July.
    9. Simon Gächter & Elke Renner, 2010. "The effects of (incentivized) belief elicitation in public goods experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(3), pages 364-377, September.
    10. Morris, Stephen & Shin, Hyun Song, 2004. "Coordination risk and the price of debt," European Economic Review, Elsevier, vol. 48(1), pages 133-153, February.
    11. Daron Acemoglu & Camilo García-Jimeno & James A. Robinson, 2015. "State Capacity and Economic Development: A Network Approach," American Economic Review, American Economic Association, vol. 105(8), pages 2364-2409, August.
    12. Palfrey, Thomas R. & Wang, Stephanie W., 2009. "On eliciting beliefs in strategic games," Journal of Economic Behavior & Organization, Elsevier, vol. 71(2), pages 98-109, August.
    13. Mehdi Shadmehr, 2021. "Protest Puzzles: Tullock's Paradox, Hong Kong Experiment, and the Strength of Weak States," Quarterly Journal of Political Science, now publishers, vol. 16(3), pages 245-264, July.
    14. Daniel L. McFadden, 1976. "Quantal Choice Analysis: A Survey," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 363-390, National Bureau of Economic Research, Inc.
    15. Hager, Anselm & Hensel, Lukas & Hermle, Johannes & Roth, Christopher, 2022. "Group Size and Protest Mobilization across Movements and Countermovements," American Political Science Review, Cambridge University Press, vol. 116(3), pages 1051-1066, August.
    16. Chad Kendall & Tommaso Nannicini & Francesco Trebbi, 2015. "How Do Voters Respond to Information? Evidence from a Randomized Campaign," American Economic Review, American Economic Association, vol. 105(1), pages 322-353, January.
    17. Francesco Passarelli & Guido Tabellini, 2017. "Emotions and Political Unrest," Journal of Political Economy, University of Chicago Press, vol. 125(3), pages 903-946.
    18. Karl Schlag & James Tremewan, 2021. "Simple belief elicitation: An experimental evaluation," Journal of Risk and Uncertainty, Springer, vol. 62(2), pages 137-155, April.
    19. Davide Cantoni & David Y Yang & Noam Yuchtman & Y Jane Zhang, 2019. "Protests as Strategic Games: Experimental Evidence from Hong Kong's Antiauthoritarian Movement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 1021-1077.
    20. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    21. Leemann, Lucas & Stoetzer, Lukas F. & Traunmüller, Richard, 2021. "Eliciting Beliefs as Distributions in Online Surveys," Political Analysis, Cambridge University Press, vol. 29(4), pages 541-553, October.
    22. Robert G. Nelson & David A. Bessler, 1989. "Subjective Probabilities and Scoring Rules: Experimental Evidence," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 71(2), pages 363-369.
    23. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    24. Antoni Calvó-Armengol & Eleonora Patacchini & Yves Zenou, 2009. "Peer Effects and Social Networks in Education," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(4), pages 1239-1267.
    25. Leonardo Bursztyn & Alessandra L. González & David Yanagizawa-Drott, 2020. "Misperceived Social Norms: Women Working Outside the Home in Saudi Arabia," American Economic Review, American Economic Association, vol. 110(10), pages 2997-3029, October.
    26. Bhattacharya, Sudipto & Pfleiderer, Paul, 1985. "Delegated portfolio management," Journal of Economic Theory, Elsevier, vol. 36(1), pages 1-25, June.
    27. Wang, Stephanie W., 2011. "Incentive effects: The case of belief elicitation from individuals in groups," Economics Letters, Elsevier, vol. 111(1), pages 30-33, April.
    28. David Y. Yang & Leonardo Bursztyn, 2022. "Misperceptions About Others," Annual Review of Economics, Annual Reviews, vol. 14(1), pages 425-452, August.
    29. Chris Edmond, 2013. "Information Manipulation, Coordination, and Regime Change," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(4), pages 1422-1458.
    30. Shadmehr, Mehdi & Bernhardt, Dan, 2011. "Collective Action with Uncertain Payoffs: Coordination, Public Signals, and Punishment Dilemmas," American Political Science Review, Cambridge University Press, vol. 105(4), pages 829-851, November.
    31. Yuyu Chen & David Y. Yang, 2019. "The Impact of Media Censorship: 1984 or Brave New World?," American Economic Review, American Economic Association, vol. 109(6), pages 2294-2332, June.
    32. David Danz & Lise Vesterlund & Alistair J. Wilson, 2022. "Belief Elicitation and Behavioral Incentive Compatibility," American Economic Review, American Economic Association, vol. 112(9), pages 2851-2883, September.
    33. Thomas Fujiwara & Kyle Meng & Tom Vogl, 2016. "Habit Formation in Voting: Evidence from Rainy Elections," American Economic Journal: Applied Economics, American Economic Association, vol. 8(4), pages 160-188, October.
    34. Bound, John & Brown, Charles & Duncan, Greg J & Rodgers, Willard L, 1994. "Evidence on the Validity of Cross-Sectional and Longitudinal Labor Market Data," Journal of Labor Economics, University of Chicago Press, vol. 12(3), pages 345-368, July.
    35. De Mesquita, Ethan Bueno, 2010. "Regime Change and Revolutionary Entrepreneurs," American Political Science Review, Cambridge University Press, vol. 104(3), pages 446-466, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nathan Canen & Anujit Chakraborty, 2022. "Choosing The Best Incentives for Belief Elicitation with an Application to Political Protests," Papers 2210.12549, arXiv.org.
    2. González, Felipe, 2020. "Collective action in networks: Evidence from the Chilean student movement," Journal of Public Economics, Elsevier, vol. 188(C).
    3. Jarke-Neuert, Johannes & Perino, Grischa & Schwickert, Henrike, 2021. "Free-Riding for Future: Field Experimental Evidence of Strategic Substitutability in Climate Protest," SocArXiv sh6dm, Center for Open Science.
    4. Charness, Gary & Gneezy, Uri & Rasocha, Vlastimil, 2021. "Experimental methods: Eliciting beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 234-256.
    5. Rafkin, Charlie & Shreekumar, Advik & Vautrey, Pierre-Luc, 2021. "When guidance changes: Government stances and public beliefs," Journal of Public Economics, Elsevier, vol. 196(C).
    6. Abraham Aldama & Mateo Vásquez-Cortés & Lauren Elyssa Young, 2019. "Fear and citizen coordination against dictatorship," Journal of Theoretical Politics, , vol. 31(1), pages 103-125, January.
    7. Anselm Hager & Lukas Hensel & Johannes Hermle & Christopher Roth, 2023. "Political Activists as Free Riders: Evidence from a Natural Field Experiment," The Economic Journal, Royal Economic Society, vol. 133(653), pages 2068-2084.
    8. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    9. David Danz & Lise Vesterlund & Alistair J. Wilson, 2020. "Belief Elicitation: Limiting Truth Telling with Information on Incentives," NBER Working Papers 27327, National Bureau of Economic Research, Inc.
    10. Grewenig, Elisabeth & Lergetporer, Philipp & Werner, Katharina & Woessmann, Ludger, 2022. "Incentives, search engines, and the elicitation of subjective beliefs: Evidence from representative online survey experiments," Journal of Econometrics, Elsevier, vol. 231(1), pages 304-326.
    11. Kemal Kivanç Aköz & Pablo Hernández‐Lagos, 2019. "Rents from power for a dissident elite and mass mobilization," Scottish Journal of Political Economy, Scottish Economic Society, vol. 66(4), pages 584-604, September.
    12. Markus Eyting & Patrick Schmidt, 2019. "Belief Elicitation with Multiple Point Predictions," Working Papers 1818, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz, revised 16 Nov 2020.
    13. Lata Gangadharan & Philip J. Grossman & Nina Xue, 2022. "Stepping Stone: Identifying self-image concerns from motivated beliefs: Does it matter how and whom you ask?," Monash Economics Working Papers 2022-05, Monash University, Department of Economics.
    14. Eyting, Markus & Schmidt, Patrick, 2021. "Belief elicitation with multiple point predictions," European Economic Review, Elsevier, vol. 135(C).
    15. Cantoni, Davide & Heizlsperger, Louis-Jonas & Yang, David Y. & Yuchtman, Noam & Zhang, Y. Jane, 2022. "The fundamental determinants of protest participation: Evidence from Hong Kong’s antiauthoritarian movement," Journal of Public Economics, Elsevier, vol. 211(C).
    16. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    17. Afridi, Farzana & Basistha, Ahana & Dhillon, Amrita & Serra, Danila, 2023. "Activating Change: The Role of Information and Beliefs in Social Activism," IZA Discussion Papers 16358, Institute of Labor Economics (IZA).
    18. Olga Shurchkov, 2013. "Coordination and learning in dynamic global games: experimental evidence," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 313-334, September.
    19. Alejandra Agustina Martínez, 2023. "Raise your Voice! Activism and Peer Effects in Online Social Networks," Working Papers 277, Red Nacional de Investigadores en Economía (RedNIE).
    20. Crosetto, Paolo & Filippin, Antonio & Katuščák, Peter & Smith, John, 2020. "Central tendency bias in belief elicitation," Journal of Economic Psychology, Elsevier, vol. 78(C).

    More about this item

    Keywords

    Belief elicitation; Experimental designs; Identification; Political protests;
    All these keywords.

    JEL classification:

    • C81 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - Methodology for Collecting, Estimating, and Organizing Microeconomic Data; Data Access
    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • D74 - Microeconomics - - Analysis of Collective Decision-Making - - - Conflict; Conflict Resolution; Alliances; Revolutions
    • P00 - Political Economy and Comparative Economic Systems - - General - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:216:y:2023:i:c:p:320-331. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.