IDEAS home Printed from https://ideas.repec.org/p/wbk/wbrwps/11305.html

How Do Organizations Learn ? The Diffusion of Scientific Evidence on Generative AI

Author

Listed:
  • Shaukat, Mahvish Ifrah
  • Stegmann, Andreas
  • Toma, Mattie

Abstract

This paper studies information diffusion in a large organization through a field experiment at the World Bank. The paper focuses on transmission of scientific evidence on the impacts of generative artificial intelligence by experimentally varying whether research findings are shared with senior or junior staff, and varying beliefs about peer adoption and evidence credibility. Providing evidence to senior staff significantly increases transmission and diffusion as measured by engagement with study materials and colleagues’ recall of study details. In contrast, changing beliefs about peer adoption or credibility has no detectable effects. The results highlight the importance of organizational hierarchy in shaping informal information flows.

Suggested Citation

  • Shaukat, Mahvish Ifrah & Stegmann, Andreas & Toma, Mattie, 2026. "How Do Organizations Learn ? The Diffusion of Scientific Evidence on Generative AI," Policy Research Working Paper Series 11305, The World Bank.
    • Handle: RePEc:wbk:wbrwps:11305
    as

    Download full text from publisher

    File URL: https://documents.worldbank.org/curated/en/099554402092623269/pdf/IDU-1f49a6eb-0b38-4d1a-95ac-b4e917061f55.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Daron Acemoglu, 2025. "The simple macroeconomics of AI," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 40(121), pages 13-58.
    2. Stefano DellaVigna & Woojin Kim & Elizabeth Linos, 2024. "Bottlenecks for Evidence Adoption," Journal of Political Economy, University of Chicago Press, vol. 132(8), pages 2748-2789.
    3. Louise Guillouet & Amit Khandelwal & Rocco Macchiavello & Madhav Malhotra & Matthieu Teachout, 2021. "Language Barriers in Multinationals and Knowledge Transfers," NBER Working Papers 28807, National Bureau of Economic Research, Inc.
    4. Jonas Hjort & Diana Moreira & Gautam Rao & Juan Francisco Santini, 2021. "How Research Affects Policy: Experimental Evidence from 2,150 Brazilian Municipalities," American Economic Review, American Economic Association, vol. 111(5), pages 1442-1480, May.
    5. Menzel, Andreas, 2021. "Knowledge exchange and productivity spill-overs in Bangladeshi garment factories," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 721-746.
    6. Jason J Sandvik & Richard E Saouma & Nathan T Seegert & Christopher T Stanton, 2020. "Workplace Knowledge Flows," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1635-1680.
    7. Nicholas Crafts, 2021. "Artificial intelligence as a general-purpose technology: an historical perspective," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 37(3), pages 521-536.
    8. David Atkin & Azam Chaudhry & Shamyla Chaudry & Amit K. Khandelwal & Eric Verhoogen, 2017. "Organizational Barriers to Technology Adoption: Evidence from Soccer-Ball Producers in Pakistan," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(3), pages 1101-1164.
    9. Kreitmeir, David & Raschky, Paul Anton, 2023. "The Unintended Consequences of Censoring Digital Technology - Evidence from Italy's ChatGPT Ban," SocArXiv v3cgs, Center for Open Science.
    10. Rocco Macchiavello & Ameet Morjaria, 2015. "The Value of Relationships: Evidence from a Supply Shock to Kenyan Rose Exports," American Economic Review, American Economic Association, vol. 105(9), pages 2911-2945, September.
    11. Foster, Andrew D & Rosenzweig, Mark R, 1995. "Learning by Doing and Learning from Others: Human Capital and Technical Change in Agriculture," Journal of Political Economy, University of Chicago Press, vol. 103(6), pages 1176-1209, December.
    12. Anil R. Doshi & Oliver P. Hauser, 2023. "Generative artificial intelligence enhances creativity but reduces the diversity of novel content," Papers 2312.00506, arXiv.org, revised Mar 2024.
    13. Kai Ruggeri & Friederike Stock & S. Alexander Haslam & Valerio Capraro & Paulo Boggio & Naomi Ellemers & Aleksandra Cichocka & Karen M. Douglas & David G. Rand & Sander Linden & Mina Cikara & Eli J. F, 2024. "A synthesis of evidence for policy from behavioural science during COVID-19," Nature, Nature, vol. 625(7993), pages 134-147, January.
    14. Jeremy R. Magruder, 2018. "An Assessment of Experimental Evidence on Agricultural Technology Adoption in Developing Countries," Annual Review of Resource Economics, Annual Reviews, vol. 10(1), pages 299-316, October.
    15. David Eil & Justin M. Rao, 2011. "The Good News-Bad News Effect: Asymmetric Processing of Objective Information about Yourself," American Economic Journal: Microeconomics, American Economic Association, vol. 3(2), pages 114-138, May.
    16. Nicolas Bottan & Ricardo Perez-Truglia, 2025. "Betting on the House: Subjective Expectations and Market Choices," American Economic Journal: Applied Economics, American Economic Association, vol. 17(1), pages 459-500, January.
    17. Leonardo Bursztyn & Alessandra L. González & David Yanagizawa-Drott, 2020. "Misperceived Social Norms: Women Working Outside the Home in Saudi Arabia," American Economic Review, American Economic Association, vol. 110(10), pages 2997-3029, October.
    18. Esther Duflo & Daniel Keniston & Tavneet Suri & Céline Zipfel, 2023. "Chat Over Coffee? Diffusion of Agronomic Practices and Market Spillovers in Rwanda," NBER Working Papers 31368, National Bureau of Economic Research, Inc.
    19. Abhijit Banerjee & Arun G Chandrasekhar & Esther Duflo & Matthew O Jackson, 2019. "Using Gossips to Spread Information: Theory and Evidence from Two Randomized Controlled Trials," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(6), pages 2453-2490.
    20. Anders Humlum & Emilie Vestergaard, 2025. "The unequal adoption of ChatGPT exacerbates existing inequalities among workers," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 122(1), pages 2414972121-, January.
    21. Timothy G. Conley & Christopher R. Udry, 2010. "Learning about a New Technology: Pineapple in Ghana," American Economic Review, American Economic Association, vol. 100(1), pages 35-69, March.
    22. Ariel BenYishay & A Mushfiq Mobarak, 2019. "Social Learning and Incentives for Experimentation and Communication," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(3), pages 976-1009.
    23. repec:osf:socarx:v3cgs_v1 is not listed on IDEAS
    24. Rogger, Daniel & Somani, Ravi, 2023. "Hierarchy and Information," Journal of Public Economics, Elsevier, vol. 219(C).
    25. Matthew Gentzkow & Jesse M. Shapiro, 2006. "Media Bias and Reputation," Journal of Political Economy, University of Chicago Press, vol. 114(2), pages 280-316, April.
    26. Jing Cai & Shing-Yi Wang, 2022. "Improving Management Through Worker Evaluations: Evidence from Auto Manufacturing [“Expectations, Wage Hikes, and Worker Voice,”]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(4), pages 2459-2497.
    27. Réka Juhász & Mara P. Squicciarini & Nico Voigtländer, 2024. "Technology Adoption and Productivity Growth: Evidence from Industrialization in France," Journal of Political Economy, University of Chicago Press, vol. 132(10), pages 3215-3259.
    28. Vivi Alatas & Arun G Chandrasekhar & Markus Mobius & Benjamin A Olken & Cindy Paladines, 2024. "Do Celebrity Endorsements Matter? A Twitter Experiment Promoting Vaccination in Indonesia," The Economic Journal, Royal Economic Society, vol. 134(659), pages 913-933.
    29. Luis Garicano & Luis Rayo, 2016. "Why Organizations Fail: Models and Cases," Journal of Economic Literature, American Economic Association, vol. 54(1), pages 137-192, March.
    30. Morgan R. Frank & David Autor & James E. Bessen & Erik Brynjolfsson & Manuel Cebrian & David J. Deming & Maryann Feldman & Matthew Groh & José Lobo & Esteban Moro & Dashun Wang & Hyejin Youn & Iyad Ra, 2019. "Toward understanding the impact of artificial intelligence on labor," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 116(14), pages 6531-6539, April.
    31. Nicholas Bloom & Benn Eifert & Aprajit Mahajan & David McKenzie & John Roberts, 2013. "Does Management Matter? Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(1), pages 1-51.
    32. Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2023. "Designing Information Provision Experiments," Journal of Economic Literature, American Economic Association, vol. 61(1), pages 3-40, March.
    33. Avi Goldfarb & Bledi Taska & Florenta Teodoridis, 2020. "Artificial Intelligence in Health Care? Evidence from Online Job Postings," AEA Papers and Proceedings, American Economic Association, vol. 110, pages 400-404, May.
    34. Hardy, Morgan & McCasland, Jamie, 2021. "It takes two: Experimental evidence on the determinants of technology diffusion," Journal of Development Economics, Elsevier, vol. 149(C).
    35. Ernesto Dal Bó & Frederico Finan & Nicholas Y. Li & Laura Schechter, 2021. "Information Technology and Government Decentralization: Experimental Evidence From Paraguay," Econometrica, Econometric Society, vol. 89(2), pages 677-701, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Squicciarini, Mara & Juhász, Réka & Voigtländer, Nico, 2020. "Technology Adoption and Productivity Growth: Evidence from Industrialization in France," CEPR Discussion Papers 14970, C.E.P.R. Discussion Papers.
    2. Menzel, Andreas, 2021. "Knowledge exchange and productivity spill-overs in Bangladeshi garment factories," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 721-746.
    3. Liverpool-Tasie, Lenis Saweda & Dillon, Andrew & Bloem, Jeffrey R. & Adjognon, Guigonan Serge, 2022. "Private sector promotion of climate-smart technologies: Experimental evidence from Nigeria," IFPRI discussion papers 2155, International Food Policy Research Institute (IFPRI).
    4. Francesco Capozza & Ingar Haaland & Christopher Roth & Johannes Wohlfart, 2021. "Studying Information Acquisition in the Field: A Practical Guide and Review," CEBI working paper series 21-15, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    5. Andreas Menzel, 2017. "Knowledge Exchange and Productivity Spill-overs in Bangladeshi Garment Factories," CERGE-EI Working Papers wp607, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    6. Francesco Amodio & Miguel A. Martinez-Carrasco, 2023. "Workplace Incentives and Organizational Learning," Journal of Labor Economics, University of Chicago Press, vol. 41(2), pages 453-478.
    7. de Janvry, Alain & Sadoulet, Elisabeth, 2020. "Using agriculture for development: Supply- and demand-side approaches," World Development, Elsevier, vol. 133(C).
    8. Bonan, Jacopo & Battiston, Pietro & Bleck, Jaimie & LeMay-Boucher, Philippe & Pareglio, Stefano & Sarr, Bassirou & Tavoni, Massimo, 2021. "Social interaction and technology adoption: Experimental evidence from improved cookstoves in Mali," World Development, Elsevier, vol. 144(C).
    9. Bin Khaled, Muhammad Nahian & Maredia, Mywish K., 2024. "Long-term influence of social network and peers' characteristics on agricultural technology adoption: Evidence from Tanzania," 2024 Annual Meeting, July 28-30, New Orleans, LA 343777, Agricultural and Applied Economics Association.
    10. Dominik Naeher, 2022. "Technology Adoption Under Costly Information Processing," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 63(2), pages 699-753, May.
    11. Riley, Emma & Shonchoy, Abu S. & Osei, Robert Darko, 2025. "Incentives and endorsement for technology adoption: Evidence from mobile banking in Ghana," Journal of Development Economics, Elsevier, vol. 176(C).
    12. Jacob Moscona & Nathan Nunn & James A. Robinson, 2026. "Searching for Fish in Trees (緣木求魚)? Economic Development when Context Matters," Working Papers 2026-27, Becker Friedman Institute for Research In Economics.
    13. Liverpool-Tasie, Lenis Saweda O & Dillon, Andrew & Bloem, Jeffrey R. & Adjognon, Guigonan Serge, 2025. "Private sector promotion of agricultural technologies: Experimental evidence from Nigeria," Journal of Environmental Economics and Management, Elsevier, vol. 133(C).
    14. Arslan, Cansın & Wollni, Meike & Oduol, Judith & Hughes, Karl, 2022. "Who communicates the information matters for technology adoption," World Development, Elsevier, vol. 158(C).
    15. Chowdhury, Shyamal & Satish, Varun & Sulaiman, Munshi & Sun, Yi, 2022. "Sooner rather than later: Social networks and technology adoption," Journal of Economic Behavior & Organization, Elsevier, vol. 203(C), pages 466-482.
    16. repec:ags:aaea22:343777 is not listed on IDEAS
    17. Chowdhury, Shyamal & Satish, Varun & Sulaiman, Munshi & Sun, Yi, 2021. "Sooner Rather Than Later: Social Networks and Technology Adoption," IZA Discussion Papers 14307, IZA Network @ LISER.
    18. Kazushi Takahashi & Rie Muraoka & Keijiro Otsuka, 2020. "Technology adoption, impact, and extension in developing countries’ agriculture: A review of the recent literature," Agricultural Economics, International Association of Agricultural Economists, vol. 51(1), pages 31-45, January.
    19. David Atkin & Azam Chaudhry & Shamyla Chaudry & Amit K. Khandelwal & Eric Verhoogen, 2017. "Organizational Barriers to Technology Adoption: Evidence from Soccer-Ball Producers in Pakistan," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(3), pages 1101-1164.
    20. Hardy, Morgan & McCasland, Jamie, 2021. "It takes two: Experimental evidence on the determinants of technology diffusion," Journal of Development Economics, Elsevier, vol. 149(C).
    21. Brañas-Garza, Pablo & Kovářík, Jaromír & Rascón Ramírez, Ericka G., 2025. "Diffusion of mobile banking among rural women: Incentivizing local leaders vs. a marketing campaign," Journal of Behavioral and Experimental Finance, Elsevier, vol. 47(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wbk:wbrwps:11305. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Roula I. Yazigi (email available below). General contact details of provider: https://edirc.repec.org/data/dvewbus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.