IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v163y2023ics0304387823000639.html
   My bibliography  Save this article

Countering misinformation on social media through educational interventions: Evidence from a randomized experiment in Pakistan

Author

Listed:
  • Ali, Ayesha
  • Qazi, Ihsan Ayyub

Abstract

Fake news is a growing problem in developing countries with potentially far-reaching consequences. This paper evaluates the effectiveness of two educational interventions to counter misinformation among low digital literacy populations in urban Pakistan using a randomized experiment. We find no evidence that video-based general educational messages about misinformation have any statistically significant impact on the ability to correctly identify news items as true or fake. However, when such messages are augmented with personalized feedback based on individuals’ past engagement with fake news, we find an improvement of 3.3 percentage points or 4.5 percent in correctly identifying news (true or fake) relative to the control group. Our results suggest that educational interventions can enable information discernment but their effectiveness depends on how well their features and delivery are customized for the population of interest.

Suggested Citation

  • Ali, Ayesha & Qazi, Ihsan Ayyub, 2023. "Countering misinformation on social media through educational interventions: Evidence from a randomized experiment in Pakistan," Journal of Development Economics, Elsevier, vol. 163(C).
    • Handle: RePEc:eee:deveco:v:163:y:2023:i:c:s0304387823000639
    DOI: 10.1016/j.jdeveco.2023.103108
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387823000639
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jdeveco.2023.103108?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    2. Richard H. Thaler & Shlomo Benartzi, 2004. "Save More Tomorrow (TM): Using Behavioral Economics to Increase Employee Saving," Journal of Political Economy, University of Chicago Press, vol. 112(S1), pages 164-187, February.
    3. Allcott, Hunt & Boxell, Levi & Conway, Jacob & Gentzkow, Matthew & Thaler, Michael & Yang, David, 2020. "Polarization and public health: Partisan differences in social distancing during the coronavirus pandemic," Journal of Public Economics, Elsevier, vol. 191(C).
    4. Christopher J. Doss & Erin M. Fahle & Susanna Loeb & Benjamin N. York, 2018. "More than Just a Nudge: Supporting Kindergarten Parents with Differentiated and Personalized Text-Messages," NBER Working Papers 24450, National Bureau of Economic Research, Inc.
    5. Barrera, Oscar & Guriev, Sergei & Henry, Emeric & Zhuravskaya, Ekaterina, 2020. "Facts, alternative facts, and fact checking in times of post-truth politics," Journal of Public Economics, Elsevier, vol. 182(C).
    6. Stefano DellaVigna & Matthew Gentzkow, 2010. "Persuasion: Empirical Evidence," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 643-669, September.
    7. Kahan, Dan M. & Peters, Ellen & Dawson, Erica Cantrell & Slovic, Paul, 2017. "Motivated numeracy and enlightened self-government," Behavioural Public Policy, Cambridge University Press, vol. 1(1), pages 54-86, May.
    8. Barrera, Oscar & Guriev, Sergei & Henry, Emeric & Zhuravskaya, Ekaterina, 2020. "Facts, alternative facts, and fact checking in times of post-truth politics," Journal of Public Economics, Elsevier, vol. 182(C).
    9. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," American Economic Journal: Economic Policy, American Economic Association, vol. 14(3), pages 55-86, August.
    10. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," NBER Working Papers 23089, National Bureau of Economic Research, Inc.
    11. Ekaterina Zhuravskaya & Maria Petrova & Ruben Enikolopov, 2020. "Political Effects of the Internet and Social Media," Annual Review of Economics, Annual Reviews, vol. 12(1), pages 415-438, August.
    12. repec:cup:judgdm:v:8:y:2013:i:5:p:540-551 is not listed on IDEAS
    13. Matthew Gentzkow & Jesse M. Shapiro, 2006. "Media Bias and Reputation," Journal of Political Economy, University of Chicago Press, vol. 114(2), pages 280-316, April.
    14. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," PSE-Ecole d'économie de Paris (Postprint) halshs-03342759, HAL.
    15. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    16. Pogorelskiy. Kirill & Shum, Matthew, 2019. "News We Like to Share : How News Sharing on Social Networks Influences Voting Outcomes," The Warwick Economics Research Paper Series (TWERPS) 1199, University of Warwick, Department of Economics.
    17. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," Post-Print halshs-03342759, HAL.
    18. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    19. Diva Dhar & Tarun Jain & Seema Jayachandran, 2022. "Reshaping Adolescents' Gender Attitudes: Evidence from a School-Based Experiment in India," American Economic Review, American Economic Association, vol. 112(3), pages 899-927, March.
    20. Sendhil Mullainathan & Andrei Shleifer, 2005. "The Market for News," American Economic Review, American Economic Association, vol. 95(4), pages 1031-1053, September.
    21. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(1), pages 75-98, March.
    22. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    23. Rachael Meager, 2019. "Understanding the Average Impact of Microcredit Expansions: A Bayesian Hierarchical Analysis of Seven Randomized Experiments," American Economic Journal: Applied Economics, American Economic Association, vol. 11(1), pages 57-91, January.
    24. Meager, Rachael, 2019. "Understanding the average impact of microcredit expansions: a Bayesian hierarchical analysis of seven randomized experiments," LSE Research Online Documents on Economics 88190, London School of Economics and Political Science, LSE Library.
    25. repec:cup:judgdm:v:8:y:2013:i:4:p:407-424 is not listed on IDEAS
    26. Levi Boxell & Matthew Gentzkow & Jesse M. Shapiro, 2024. "Cross-Country Trends in Affective Polarization," The Review of Economics and Statistics, MIT Press, vol. 106(2), pages 557-565, March.
    27. Jamil, Sadia, 2021. "From digital divide to digital inclusion: Challenges for wide-ranging digitalization in Pakistan," Telecommunications Policy, Elsevier, vol. 45(8).
    28. Pogorelskiy, Kirill & Shum, Matthew, 2019. "News We Like to Share: How News Sharing on Social Networks Influences Voting Outcomes," CAGE Online Working Paper Series 427, Competitive Advantage in the Global Economy (CAGE).
    29. Hunt Allcott & Matthew Gentzkow, 2017. "Social Media and Fake News in the 2016 Election," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 211-236, Spring.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ayesha Ali & Ihsan Ayyub Qazi, 2021. "Countering Misinformation on Social Media Through Educational Interventions: Evidence from a Randomized Experiment in Pakistan," Papers 2107.02775, arXiv.org.
    2. Joël Cariolle & Yasmine Elkhateeb & Mathilde Maurel, 2024. "Misinformation technology: Internet use and political misperceptions in Africa," Post-Print hal-04423752, HAL.
    3. Choi, Syngjoo & Choi, Chung-Yoon & Kim, Seonghoon, 2023. "Tackling misperceptions about immigrants with fact-checking interventions: A randomized survey experiment," Labour Economics, Elsevier, vol. 84(C).
    4. Felix Chopra & Ingar K. Haaland & Christopher Roth, 2019. "Do People Value More Informative News?," CESifo Working Paper Series 8026, CESifo.
    5. Jiménez Durán, Rafael & Muller, Karsten & Schwarz, Carlo, 2024. "The Effect of Content Moderation on Online and Offline Hate: Evidence from Germany’s NetzDG," CAGE Online Working Paper Series 701, Competitive Advantage in the Global Economy (CAGE).
    6. Guy Aridor & Rafael Jiménez-Durán & Ro'ee Levy & Lena Song, 2024. "The Economics of Social Media," CESifo Working Paper Series 10934, CESifo.
    7. Barrera, Oscar & Guriev, Sergei & Henry, Emeric & Zhuravskaya, Ekaterina, 2020. "Facts, alternative facts, and fact checking in times of post-truth politics," Journal of Public Economics, Elsevier, vol. 182(C).
    8. Sergei Guriev & Elias Papaioannou, 2022. "The Political Economy of Populism," Journal of Economic Literature, American Economic Association, vol. 60(3), pages 753-832, September.
    9. Germano, Fabrizio & Sobbrio, Francesco, 2020. "Opinion dynamics via search engines (and other algorithmic gatekeepers)," Journal of Public Economics, Elsevier, vol. 187(C).
    10. Cagé, Julia, 2017. "Media Competition, Information Provision and Political Participation: Evidence from French Local Newspapers and Elections, 1944," CEPR Discussion Papers 12198, C.E.P.R. Discussion Papers.
    11. repec:hal:wpspec:info:hdl:2441/27dls12b6d8aor7i6sipg9ie3g is not listed on IDEAS
    12. Emeric Henry & Ekaterina Zhuravskaya & Sergei Guriev, 2022. "Checking and Sharing Alt-Facts," American Economic Journal: Economic Policy, American Economic Association, vol. 14(3), pages 55-86, August.
    13. Chopra, Felix & Haaland, Ingar & Roth, Christopher, 2022. "Do people demand fact-checked news? Evidence from U.S. Democrats," Journal of Public Economics, Elsevier, vol. 205(C).
    14. repec:hal:spmain:info:hdl:2441/7jk88md0ar9hga662p2vjjq4kc is not listed on IDEAS
    15. Roberto Mosquera & Mofioluwasademi Odunowo & Trent McNamara & Xiongfei Guo & Ragan Petrie, 2020. "The economic effects of Facebook," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 575-602, June.
    16. repec:hal:wpspec:info:hdl:2441/1dhd1b1s319fbai85khk40fudc is not listed on IDEAS
    17. Cagé, Julia, 2020. "Media competition, information provision and political participation: Evidence from French local newspapers and elections, 1944–2014," Journal of Public Economics, Elsevier, vol. 185(C).
    18. repec:hal:spmain:info:hdl:2441/27dls12b6d8aor7i6sipg9ie3g is not listed on IDEAS
    19. Julia Cage, 2017. "Media Competition, Information Provision and Political Participation: Evidence from French Local Newspapers and Elections, 1944-2014," SciencePo Working papers hal-03393164, HAL.
    20. Robert Gold, 2022. "From a better understanding of the drivers of populism to a new political agenda," Working Papers 4, Forum New Economy.
    21. Derksen, Laura & Michaud-Leclerc, Catherine & Souza, Pedro C.L., 2022. "Restricted access: How the internet can be used to promote reading and learning," Journal of Development Economics, Elsevier, vol. 155(C).
    22. Boyer, Pierre & Delemotte, Thomas & Gauthier, Germain & Rollet, Vincent & Schmutz, Benoit, 2020. "The Gilets jaunes: Offline and Online," CEPR Discussion Papers 14780, C.E.P.R. Discussion Papers.
    23. repec:hal:spmain:info:hdl:2441/478a1feno18otpdr60lclo4fuq is not listed on IDEAS
    24. repec:hal:spmain:info:hdl:2441/1dhd1b1s319fbai85khk40fudc is not listed on IDEAS
    25. Bao, Te & Wei, Lijia & Yu, Yang, 2022. "The impact of information interventions on public opinion on social media regulation: Evidence from a survey on Twitter’s Trump Ban," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 101(C).
    26. Joël Cariolle & Yasmine Elkhateeb & Mathilde Maurel, 2022. "(Mis-)information technology: Internet use and perception of democracy in Africa," Documents de travail du Centre d'Economie de la Sorbonne 22010, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.

    More about this item

    Keywords

    Social media; Fake news; Misinformation; Beliefs; Education; Digital literacy;
    All these keywords.

    JEL classification:

    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • L86 - Industrial Organization - - Industry Studies: Services - - - Information and Internet Services; Computer Software
    • L82 - Industrial Organization - - Industry Studies: Services - - - Entertainment; Media
    • O10 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:163:y:2023:i:c:s0304387823000639. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.