IDEAS home Printed from https://ideas.repec.org/r/nbr/nberwo/25848.html

The Science of Using Science: Towards an Understanding of the Threats to Scaling Experiments

Citations

Blog mentions

As found by EconAcademics.org, the blog aggregator for Economics research:
  1. Policymaking Is Not a Science (Yet) (Ep. 405 Rebroadcast)
    by Stephen J. Dubner in Freakonomics on 2021-03-25 03:00:27
  2. Policymaking Is Not a Science (Yet) (Ep. 405)
    by Stephen J. Dubner in Freakonomics on 2020-02-13 04:00:34

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as


Cited by:

  1. Bos, Johannes M. & Shonchoy, Abu S. & Ravindran, Saravana & Khan, Akib, 2024. "Early childhood human capital formation at scale," Journal of Public Economics, Elsevier, vol. 231(C).
  2. Francesco Agostinelli & Ciro Avitabile & Matteo Bobba, 2025. "Enhancing Human Capital in Children: A Case Study on Scaling," Journal of Political Economy, University of Chicago Press, vol. 133(2), pages 455-491.
  3. Andreas Löschel & Matthias Rodemeier & Madeline Werthschulte, 2020. "When Nudges Fail to Scale: Field Experimental Evidence from Goal Setting on Mobile Phones," CESifo Working Paper Series 8485, CESifo.
  4. Jana S. Hamdan & Tim Kaiser & Lukas Menkhoff & Yuanwei Xu, 2024. "Scaling Financial Education Among Micro-Entrepreneurs: A Randomized Saturation Experiment," CESifo Working Paper Series 11431, CESifo.
  5. Maria Gabriela Farfan Betran & Genoni,Maria Eugenia & Rubalcava,Luis & Teruel,Graciela M. & Thomas,Duncan, 2022. "Scaling Up Oportunidades and ItsImpact on Child Nutrition," Policy Research Working Paper Series 10088, The World Bank.
  6. Britta Augsburg & Maitreesh Ghatak & Sara Giunti & Bansi Malde, 2026. "At scale implementation and the perils of fragmentation," IFS Working Papers W26/03, Institute for Fiscal Studies.
  7. Germán Gutiérrez & Thomas Philippon, 2017. "Investmentless Growth: An Empirical Investigation," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 48(2 (Fall)), pages 89-190.
  8. Jorge N. Zumaeta, 2025. "Social Preference Parameters Impacting Financial Decisions Among Welfare Recipients," JRFM, MDPI, vol. 18(8), pages 1-18, July.
  9. Gerhard Riener & Sebastian Schneider & Valentin Wagner, 2020. "Addressing Validity and Generalizability Concerns in Field Experiments," Discussion Paper Series of the Max Planck Institute for Behavioral Economics 2020_16, Max Planck Institute for Behavioral Economics.
  10. Snigdha Gupta & John List & Lauren Supplee & Dana Suskind, 2021. "Failed to Scale: Embracing the Challenge of Scaling in Early Childhood," Artefactual Field Experiments 00734, The Field Experiments Website.
  11. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
  12. Oreopoulos, Philip, 2020. "Promises and Limitations of Nudging in Education," IZA Discussion Papers 13718, IZA Network @ LISER.
  13. Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
  14. John A. List, 2024. "Optimally generate policy-based evidence before scaling," Nature, Nature, vol. 626(7999), pages 491-499, February.
  15. Julia Fischer-Mackey, 2024. "What Do Practitioners Want from Research? Exploring Ugandan and American Development Practitioners’ Interest in Research," Progress in Development Studies, , vol. 24(1), pages 27-47, January.
  16. John A. List & Fatemeh Momeni & Yves Zenou, 2020. "The Social Side of Early Human Capital Formation: Using a Field Experiment to Estimate the Causal Impact of Neighborhoods," Working Papers 2020-187, Becker Friedman Institute for Research In Economics.
  17. Holland, Kateryna, 2019. "Government investment in publicly traded firms," Journal of Corporate Finance, Elsevier, vol. 56(C), pages 319-342.
  18. Davide Azzolini & Martina Bazzoli & Sergiu C. Burlacu & Enrico Rettore, 2023. "Starting the school year on the right foot. Effects of a summer learning program targeting vulnerable students in Italy," FBK-IRVAPP Working Papers 2023-05, Research Institute for the Evaluation of Public Policies (IRVAPP), Bruno Kessler Foundation.
  19. Agostinelli, Francesco & Avitabile, Ciro & Bobba, Matteo, 2021. "Enhancing Human Capital at Scale," IZA Discussion Papers 14192, IZA Network @ LISER.
  20. List, John A. & Samek, Anya & Suskind, Dana L., 2018. "Combining behavioral economics and field experiments to reimagine early childhood education," Behavioural Public Policy, Cambridge University Press, vol. 2(1), pages 1-21, May.
  21. Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
  22. Guilfoos, Todd & Kurtz, Kenneth J., 2017. "Evaluating the role of personality trait information in social dilemmas," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 68(C), pages 119-129.
  23. Bruno S. Frey, 2021. "Backward‐oriented economics," Kyklos, Wiley Blackwell, vol. 74(2), pages 187-195, May.
  24. Marc T. Law & Patrick A. McLaughlin, 2022. "Industry size and regulation: Evidence from US states," Public Choice, Springer, vol. 192(1), pages 1-27, July.
  25. Sarah Cattan & Gabriella Conti & Christine Farquharson, 2026. "Workforce quality and early childhood development at scale," IFS Working Papers W26/30, Institute for Fiscal Studies.
  26. Hoffmann, Christin & Thommes, Kirsten, 2024. "Can leaders motivate employees’ energy-efficient behavior with thoughtful communication?," Journal of Environmental Economics and Management, Elsevier, vol. 125(C).
  27. Matilde Giaccherini & David Herberich & David Jimenez-Gomez & John List & Giovanni Ponti & Michael Price, 2020. "Are Economics and Psychology Complements in Household Technology Diffusion? Evidence from a Natural Field Experiment," Natural Field Experiments 00713, The Field Experiments Website.
  28. John A. List, 2020. "Non est Disputandum de Generalizability? A Glimpse into The External Validity Trial," NBER Working Papers 27535, National Bureau of Economic Research, Inc.
  29. Henning Hermesifo & Philipp Lergetporer & Frauke Peter & Simon Wiederhold, 2025. "Application Barriers and the Socioeconomic Gap in Child Care Enrollment," Journal of the European Economic Association, European Economic Association, vol. 23(3), pages 1133-1172.
  30. Shusaku Sasaki & Takunori Ishihara & Hirofumi Kurokawa, 2025. "Scaling Charitable Incentives: Policy Selection, Beliefs, and Evidence from a Field Experiment," Papers 2512.24852, arXiv.org.
  31. Benito-Ostolaza, Juan M. & Hernández, Penélope & Sanchis-Llopis, Juan A., 2016. "Do individuals with higher cognitive ability play more strategically?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 5-11.
  32. Altmann, Steffen & Glenny, Anita Marie & Mahlstedt, Robert & Sebald, Alexander, 2022. "The Direct and Indirect Effects of Online Job Search Advice," IZA Discussion Papers 15830, IZA Network @ LISER.
  33. Albert Bravo-Biosca, 2020. "Experimental Innovation Policy," Innovation Policy and the Economy, University of Chicago Press, vol. 20(1), pages 191-232.
  34. Maris, Robbie & Zack, Dorner & Carlsson, Fredrik, 2024. "Nudges and Monetary Incentives: A Green Partnership?," Working Papers in Economics 842, University of Gothenburg, Department of Economics.
  35. Ana Balsa & Alejandro Cid & Juanita Bloomfield, 2022. "The Replication of a Parenting Behavioral Change Communication Intervention during the COVID-19 Pandemic: Too Much or Too Little Information?," Documentos de Trabajo/Working Papers 2203, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
  36. Busso, Matias & Montaño, Sebastián & Muñoz-Morales, Juan & Pope, Nolan G., 2024. "The unintended consequences of merit-based teacher selection: Evidence from a large-scale reform in Colombia," Journal of Public Economics, Elsevier, vol. 239(C).
  37. John A. List, 2026. "The Economics of Scaling Early Childhood Programs: Lessons from the Chicago School," Journal of Political Economy, University of Chicago Press, vol. 134(1), pages 1-48.
  38. Berkes, Jan & Bouguen, Adrien & Filmer, Deon & Fukao, Tsuyoshi, 2024. "Improving preschool provision and encouraging-demand: Evidence from a large-scale construction program," Journal of Public Economics, Elsevier, vol. 230(C).
  39. Bet Caeyers & Lina Cardona Sosa & Sarah Cattan & Sonya Krutikova & Abu Siddique, 2026. "Parents in the classroom: strengthening government capacity to deliver early childhood education," IFS Working Papers W26/11, Institute for Fiscal Studies.
  40. Difang Huang & Zhengyang Bao, 2020. "Gender Differences in Reaction to Enforcement Mechanisms: A Large-Scale Natural Field Experiment," Monash Economics Working Papers 08-20, Monash University, Department of Economics.
  41. López Bóo, Florencia & de la Paz Ferro, Maria & Carneiro, Pedro, 2024. "Impacts of Integrating Early Childhood with Health Services: Experimental Evidence from the Cresça Com Seu Filho Home Visiting Program," IZA Discussion Papers 17130, IZA Network @ LISER.
  42. Matilde Giaccherini & David H. Herberich & David Jimenez-Gomez & John A. List & Giovanni Ponti & Michael K. Price, 2019. "The Behavioralist Goes Door-To-Door: Understanding Household Technological Diffusion Using a Theory-Driven Natural Field Experiment," NBER Working Papers 26173, National Bureau of Economic Research, Inc.
  43. World Bank, 2023. "Making Teacher Policy Work," World Bank Publications - Reports 40579, The World Bank Group.
  44. John List, 2021. "The Voltage Effect in Behavioral Economics," Artefactual Field Experiments 00733, The Field Experiments Website.
  45. German Gutierrez, 2018. "Investigating Global Labor and Pro t Shares," 2018 Meeting Papers 165, Society for Economic Dynamics.
  46. Olivier Bochet & Manshu Khanna & Simon Siegenthaler, 2024. "Beyond Dividing the Pie: Multi-Issue Bargaining in the Laboratory," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 91(1), pages 163-191.
  47. John A. List & Ragan Petrie & Anya Samek, 2023. "How Experiments with Children Inform Economics," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 504-564, June.
  48. Meier, Johanna & Andor, Mark A. & Doebbe, Friederike C. & Haddaway, Neal R. & Reisch, Lucia A., 2022. "Review: Do green defaults reduce meat consumption?," Food Policy, Elsevier, vol. 110(C).
  49. Simone Busetti, 2023. "Causality is good for practice: policy design and reverse engineering," Policy Sciences, Springer;Society of Policy Sciences, vol. 56(2), pages 419-438, June.
  50. Stutzer, Alois, 2020. "Happiness and public policy: a procedural perspective," Behavioural Public Policy, Cambridge University Press, vol. 4(2), pages 210-225, July.
  51. Robert Ammerman & Anne Duggan & John List & Lauren Supplee & Dana Suskind, 2021. "The role of open science practices in scaling evidence-based prevention programs," Natural Field Experiments 00741, The Field Experiments Website.
  52. Luca A. Panzone & Natasha Auch & Daniel John Zizzo, 2024. "Nudging the Food Basket Green: The Effects of Commitment and Badges on the Carbon Footprint of Food Shopping," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 87(1), pages 89-133, January.
  53. Singhal, Puja & Pahle, Michael & Kalkuhl, Matthias & Levesque, Antoine & Sommer, Stephan & Berneiser, Jessica, 2022. "Beyond good faith: Why evidence-based policy is necessary to decarbonize buildings cost-effectively in Germany," Energy Policy, Elsevier, vol. 169(C).
  54. John List, 2021. "2021 Summary Data of Artefactual Field Experiments Published on Fieldexperiments.com," Artefactual Field Experiments 00749, The Field Experiments Website.
  55. Broughel, James & Chambers, Dustin, 2021. "Federal Regulation and Mortality in the 50 States," Working Papers 10289, George Mason University, Mercatus Center.
  56. Flávio Cunha & Marsha Gerdes & Qinyou Hu & Snejana Nihtianova, 2024. "Language Environment and Maternal Expectations: An Evaluation of the LENA Start Program," Journal of Human Capital, University of Chicago Press, vol. 18(1), pages 105-139.
  57. Karun Adusumilli & Francesco Agostinelli & Emilio Borghesan, 2024. "Heterogeneity and Endogenous Compliance: Implications for Scaling Class Size Interventions," Working Papers 2024-007, Human Capital and Economic Opportunity Working Group.
  58. Löschel, Andreas & Rodemeier, Matthias & Werthschulte, Madeline, 2023. "Can self-set goals encourage resource conservation? Field experimental evidence from a smartphone app," European Economic Review, Elsevier, vol. 160(C).
  59. Ilona Babenko & Viktar Fedaseyeu & Song Zhang, 2017. "Do CEOs affect employees' political choices?," BAFFI CAREFIN Working Papers 1750, BAFFI CAREFIN, Centre for Applied Research on International Markets Banking Finance and Regulation, Universita' Bocconi, Milano, Italy.
  60. Toma, Mattie & Bell, Elizabeth, 2024. "Understanding and increasing policymakers’ sensitivity to program impact," Journal of Public Economics, Elsevier, vol. 234(C).
  61. Grosch, Kerstin & Haeckl, Simone & Rau, Holger & Preuss, Paul, 2023. "A Guide to Conducting School Experiments: Expert Insights and Best Practices for Effective Implementation," UiS Working Papers in Economics and Finance 2023/2, University of Stavanger.
  62. Caroline Gaudreau & Dani Levine & John A. List & Dana Suskind, 2025. "Introducing The SPEAK: A Scalable Computer-Adaptive Tool to Measure Knowledge of Early Human Development," NBER Working Papers 34349, National Bureau of Economic Research, Inc.
  63. Kuchirko, Yana A. & Coskun, Lerzan Z. & Duch, Helena & Castaner, Maria Marti & Gennetian, Lisa A., 2021. "Light-touch design enhancements can boost parent engagement in math activities," Children and Youth Services Review, Elsevier, vol. 128(C).
  64. Omar Al-Ubaydli & John A. List & Danielle LoRe & Dana Suskind, 2017. "Scaling for Economists: Lessons from the Non-Adherence Problem in the Medical Literature," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 125-144, Fall.
  65. Geven, Koen Martijn & Tahir, Ayesha & Fasih, Tazeen & Qureshi, Javaeria & Hasan, Amer & Fazili, Sheena & Malik, Rabea & Macdonald, Kevin Alan David, 2026. "Nudging at Scale : Evidence from a Government Text Messaging Campaign during School Shutdowns in Punjab, Pakistan," Policy Research Working Paper Series 11286, The World Bank.
  66. Mohammed Anam Akhtar & Imran Khan & and Khurram Ajaz Khan, 2023. "Linking Financial Capability, Advice, Anxiety, Social Security, and Residential Status with Outward Remittances: Evidence from the UAE," Contemporary Review of the Middle East, , vol. 10(4), pages 386-407, December.
  67. Hutchinson-Quillian, Jessan & Reiley, David & Samek, Anya, 2021. "Hassle costs and workplace charitable giving: Field experiments with Google employees," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 679-685.
  68. Christian A. Vossler & Timothy N. Cason & James J. Murphy & Paul J. Ferraro & Todd L. Cherry & George Loewenstein & Peter Martinsson & Jason F. Shogren & Leaf van Boven & Daan van Soest, 2024. "The impact of experiments on environmental policy and natural resource management," Working Papers 2024-05, University of Tennessee, Department of Economics.
  69. Eliot Abrams & Jonathan Libgober & John List, 2020. "Research Registries: Facts, Myths, and Possible Improvements," Artefactual Field Experiments 00703, The Field Experiments Website.
  70. Omar Al-Ubaydli & John A. List & Dana L. Suskind, 2017. "What Can We Learn from Experiments? Understanding the Threats to the Scalability of Experimental Results," American Economic Review, American Economic Association, vol. 107(5), pages 282-286, May.
  71. Eric Guerci, 2025. "Laboratory Experiments in Innovation Research," Post-Print hal-05475831, HAL.
  72. Omar Al-Ubaydli & John A. List, 2016. "Field Experiments in Markets," NBER Working Papers 22113, National Bureau of Economic Research, Inc.
IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.