The science of using science: Towards an understanding of the threats to scaling experiments
Citations
Blog mentions
As found by EconAcademics.org, the blog aggregator for Economics research:- Policymaking Is Not a Science (Yet) (Ep. 405 Rebroadcast)
by Stephen J. Dubner in Freakonomics on 2021-03-25 03:00:27 - Policymaking Is Not a Science (Yet) (Ep. 405)
by Stephen J. Dubner in Freakonomics on 2020-02-13 04:00:34
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- Hutchinson-Quillian, Jessan & Reiley, David & Samek, Anya, 2021. "Hassle costs and workplace charitable giving: Field experiments with Google employees," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 679-685.
- Matilde Giaccherini & David H. Herberich & David Jimenez-Gomez & John A. List & Giovanni Ponti & Michael K. Price, 2019. "The Behavioralist Goes Door-To-Door: Understanding Household Technological Diffusion Using a Theory-Driven Natural Field Experiment," NBER Working Papers 26173, National Bureau of Economic Research, Inc.
- World Bank, 2023. "Making Teacher Policy Work," World Bank Publications - Reports 40579, The World Bank Group.
- Toma, Mattie & Bell, Elizabeth, 2024. "Understanding and increasing policymakers’ sensitivity to program impact," Journal of Public Economics, Elsevier, vol. 234(C).
- Davide Azzolini & Martina Bazzoli & Sergiu C. Burlacu & Enrico Rettore, 2023.
"Starting the school year on the right foot. Effects of a summer learning program targeting vulnerable students in Italy,"
FBK-IRVAPP Working Papers
2023-05, Research Institute for the Evaluation of Public Policies (IRVAPP), Bruno Kessler Foundation.
- Azzolini, Davide & Bazzoli, Martina & Burlacu, Sergiu & Rettore, Enrico, 2023. "Starting the School Year on the Right Foot. Effects of a Summer Learning Program Targeting Vulnerable Students in Italy," IZA Discussion Papers 16498, IZA Network @ LISER.
- John List, 2021. "2021 Summary Data of Artefactual Field Experiments Published on Fieldexperiments.com," Artefactual Field Experiments 00749, The Field Experiments Website.
- Bos, Johannes M. & Shonchoy, Abu S. & Ravindran, Saravana & Khan, Akib, 2024.
"Early childhood human capital formation at scale,"
Journal of Public Economics, Elsevier, vol. 231(C).
- Johannes M. Bos & Akib Khan & Saravana Ravindran & Abu S. Shonchoy, 2021. "Early Childhood Human Capital Formation at Scale," Working Papers 2115, Florida International University, Department of Economics.
- John List, 2021. "The Voltage Effect in Behavioral Economics," Artefactual Field Experiments 00733, The Field Experiments Website.
- Francesco Agostinelli & Ciro Avitabile & Matteo Bobba, 2025.
"Enhancing Human Capital in Children: A Case Study on Scaling,"
Journal of Political Economy, University of Chicago Press, vol. 133(2), pages 455-491.
- Agostinelli, Francesco & Avitabile, Ciro & Bobba, Matteo, 2021. "Enhancing Human Capital in Children: A Case Study on Scaling," TSE Working Papers 21-1196, Toulouse School of Economics (TSE), revised Oct 2023.
- Francesco Agostinelli & Ciro Avitabile & Matteo Bobba, 2025. "Enhancing human capital in children: a case study on scaling," Post-Print hal-04960480, HAL.
- Francesco Agostinelli & Ciro Avitabile & Matteo Bobba, 2023. "Enhancing Human Capital in Children: A Case Study on Scaling," NBER Working Papers 31407, National Bureau of Economic Research, Inc.
- Agostinelli, Francesco & Avitabile, Ciro & Bobba, Matteo, 2023. "Enhancing Human Capital in Children: A Case Study on Scaling," CEPR Discussion Papers 18672, Centre for Economic Policy Research.
- Agostinelli,Francesco & Avitabile,Ciro & Bobba,Matteo, 2021. "Enhancing Human Capital in Children : A Case Study on Scaling," Policy Research Working Paper Series 9647, The World Bank.
- Francesco Agostinelli & Ciro Avitable & Matteo Bobba, 2021. "Enhancing Human Capital in Children: A Case Study on Scaling," Working Papers 2021-012, Human Capital and Economic Opportunity Working Group.
- Sarah Cattan & Gabriella Conti & Christine Farquharson, 2026.
"Workforce Quality and Early Childhood Development at Scale,"
CSEF Working Papers
777, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
- Gabriella Conti & Sarah Cattan & Christine Farquharson, 2026. "Workforce Quality and Early Childhood Development at Scale," RFBerlin Discussion Paper Series 26124, ROCKWOOL Foundation Berlin (RFBerlin).
- Sarah Cattan & Gabriella Conti & Christine Farquharson, 2026. "Workforce Quality and Early Childhood Development at Scale," CESifo Working Paper Series 12619, CESifo.
- Cattan, Sarah & Conti, Gabriella & Farquharson, Christine, 2026. "Workforce Quality and Early Childhood Development at Scale," CEPR Discussion Papers 21418, Centre for Economic Policy Research.
- CATTAN, SaRAH & Conti, Gabriella & Farquharson, Christine, 2026. "Workforce Quality and Early Childhood Development at Scale," IZA Discussion Papers 18584, IZA Network @ LISER.
- Sarah Cattan & Gabriella Conti & Christine Farquharson, 2026. "Workforce quality and early childhood development at scale," IFS Working Papers W26/30, Institute for Fiscal Studies.
- Grosch, Kerstin & Haeckl, Simone & Rau, Holger & Preuss, Paul, 2023. "A Guide to Conducting School Experiments: Expert Insights and Best Practices for Effective Implementation," UiS Working Papers in Economics and Finance 2023/2, University of Stavanger.
- Andreas Löschel & Matthias Rodemeier & Madeline Werthschulte, 2020.
"When Nudges Fail to Scale: Field Experimental Evidence from Goal Setting on Mobile Phones,"
CESifo Working Paper Series
8485, CESifo.
- Löschel, Andreas & Rodemeier, Matthias & Werthschulte, Madeline, 2020. "When nudges fail to scale: Field experimental evidence from goal setting on mobile phones," CAWM Discussion Papers 118, University of Münster, Münster Center for Economic Policy (MEP).
- Löschel, Andreas & Rodemeier, Matthias & Werthschulte, Madeline, 2020. "When nudges fail to scale: Field experimental evidence from goal setting on mobile phones," ZEW Discussion Papers 20-039, ZEW - Leibniz Centre for European Economic Research.
- Hoffmann, Christin & Thommes, Kirsten, 2024. "Can leaders motivate employees’ energy-efficient behavior with thoughtful communication?," Journal of Environmental Economics and Management, Elsevier, vol. 125(C).
- Agostinelli, Francesco & Avitabile, Ciro & Bobba, Matteo, 2021. "Enhancing Human Capital at Scale," IZA Discussion Papers 14192, IZA Network @ LISER.
- Jana S. Hamdan & Tim Kaiser & Lukas Menkhoff & Yuanwei Xu, 2024. "Scaling Financial Education Among Micro-Entrepreneurs: A Randomized Saturation Experiment," CESifo Working Paper Series 11431, CESifo.
- Christian A. Vossler & Timothy N. Cason & James J. Murphy & Paul J. Ferraro & Todd L. Cherry & George Loewenstein & Peter Martinsson & Jason F. Shogren & Leaf van Boven & Daan van Soest, 2024. "The impact of experiments on environmental policy and natural resource management," Working Papers 2024-05, University of Tennessee, Department of Economics.
- Matilde Giaccherini & David Herberich & David Jimenez-Gomez & John List & Giovanni Ponti & Michael Price, 2020. "Are Economics and Psychology Complements in Household Technology Diffusion? Evidence from a Natural Field Experiment," Natural Field Experiments 00713, The Field Experiments Website.
- List, John A. & Samek, Anya & Suskind, Dana L., 2018.
"Combining behavioral economics and field experiments to reimagine early childhood education,"
Behavioural Public Policy, Cambridge University Press, vol. 2(1), pages 1-21, May.
- John List & Anya Samek & Dana Suskind, 2017. "Combining Behavioral Economics and Field Experiments to Reimagine Early Childhood Education," Artefactual Field Experiments 00595, The Field Experiments Website.
- Maria Gabriela Farfan Betran & Genoni,Maria Eugenia & Rubalcava,Luis & Teruel,Graciela M. & Thomas,Duncan, 2022. "Scaling Up Oportunidades and ItsImpact on Child Nutrition," Policy Research Working Paper Series 10088, The World Bank.
- Meier, Johanna & Andor, Mark A. & Doebbe, Friederike C. & Haddaway, Neal R. & Reisch, Lucia A., 2022. "Review: Do green defaults reduce meat consumption?," Food Policy, Elsevier, vol. 110(C).
- Eliot Abrams & Jonathan Libgober & John List, 2020.
"Research Registries: Facts, Myths, and Possible Improvements,"
Artefactual Field Experiments
00703, The Field Experiments Website.
- Eliot Abrams & Jonathan Libgober & John A. List, 2020. "Research Registries: Facts, Myths, and Possible Improvements," NBER Working Papers 27250, National Bureau of Economic Research, Inc.
- Altmann, Steffen & Glenny, Anita Marie & Mahlstedt, Robert & Sebald, Alexander, 2022. "The Direct and Indirect Effects of Online Job Search Advice," IZA Discussion Papers 15830, IZA Network @ LISER.
- Britta Augsburg & Maitreesh Ghatak & Sara Giunti & Bansi Malde, 2026. "At scale implementation and the perils of fragmentation," IFS Working Papers W26/03, Institute for Fiscal Studies.
- Karun Adusumilli & Francesco Agostinelli & Emilio Borghesan, 2024. "Heterogeneity and Endogenous Compliance: Implications for Scaling Class Size Interventions," Working Papers 2024-007, Human Capital and Economic Opportunity Working Group.
- Omar Al-Ubaydli & John A. List & Dana L. Suskind, 2017.
"What Can We Learn from Experiments? Understanding the Threats to the Scalability of Experimental Results,"
American Economic Review, American Economic Association, vol. 107(5), pages 282-286, May.
- Omar Al-Ubaydli & John List & Dana Suskind, 2017. "What Can We Learn From Experiments? Understanding the Threats to the Scalability of Experimental Results," Natural Field Experiments 00607, The Field Experiments Website.
- John A. List, 2026.
"The Economics of Scaling Early Childhood Programs: Lessons from the Chicago School,"
Journal of Political Economy, University of Chicago Press, vol. 134(1), pages 1-48.
- John List, 2025. "The Economics of Scaling Early Childhood Programs: Lessons from The Chicago School," Natural Field Experiments 00829, The Field Experiments Website.
- John A. List, 2026. "The Economics of Scaling Early Childhood Programs: Lessons from The Chicago School," Working Papers 2026-11, Becker Friedman Institute for Research In Economics.
- John A. List, 2026. "The Economics of Scaling Early Childhood Programs: Lessons from The Chicago School," NBER Working Papers 34674, National Bureau of Economic Research, Inc.
- Albert Bravo-Biosca, 2020.
"Experimental Innovation Policy,"
Innovation Policy and the Economy, University of Chicago Press, vol. 20(1), pages 191-232.
- Albert Bravo-Biosca, 2019. "Experimental Innovation Policy," NBER Chapters, in: Innovation Policy and the Economy, Volume 20, pages 191-232, National Bureau of Economic Research, Inc.
- Albert Bravo-Biosca, 2019. "Experimental Innovation Policy," SPRU Working Paper Series 2019-19, SPRU - Science Policy Research Unit, University of Sussex Business School.
- Albert Bravo-Biosca, 2019. "Experimental Innovation Policy," NBER Working Papers 26273, National Bureau of Economic Research, Inc.
- Eszter Czibor & David Jimenez‐Gomez & John A. List, 2019.
"The Dozen Things Experimental Economists Should Do (More of),"
Southern Economic Journal, John Wiley & Sons, vol. 86(2), pages 371-432, October.
- Eszter Czibor & David Jimenez-Gomez & John List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," Artefactual Field Experiments 00648, The Field Experiments Website.
- Eszter Czibor & David Jimenez-Gomez & John A. List, 2019. "The Dozen Things Experimental Economists Should Do (More of)," NBER Working Papers 25451, National Bureau of Economic Research, Inc.
- Simone Busetti, 2023. "Causality is good for practice: policy design and reverse engineering," Policy Sciences, Springer;Society of Policy Sciences, vol. 56(2), pages 419-438, June.
- Bruno S. Frey, 2021.
"Backward‐oriented economics,"
Kyklos, Wiley Blackwell, vol. 74(2), pages 187-195, May.
- Bruno S. Frey, 2021. "Backward-Oriented Economics," CREMA Working Paper Series 2021-32, Center for Research in Economics, Management and the Arts (CREMA).
- Maris, Robbie & Zack, Dorner & Carlsson, Fredrik, 2024. "Nudges and Monetary Incentives: A Green Partnership?," Working Papers in Economics 842, University of Gothenburg, Department of Economics.
- Ana Balsa & Alejandro Cid & Juanita Bloomfield, 2022. "The Replication of a Parenting Behavioral Change Communication Intervention during the COVID-19 Pandemic: Too Much or Too Little Information?," Documentos de Trabajo/Working Papers 2203, Facultad de Ciencias Empresariales y Economia. Universidad de Montevideo..
- Stutzer, Alois, 2020.
"Happiness and public policy: a procedural perspective,"
Behavioural Public Policy, Cambridge University Press, vol. 4(2), pages 210-225, July.
- Stutzer, Alois, 2019. "Happiness and Public Policy: A Procedural Perspective," IZA Discussion Papers 12622, IZA Network @ LISER.
- Jorge N. Zumaeta, 2025. "Social Preference Parameters Impacting Financial Decisions Among Welfare Recipients," JRFM, MDPI, vol. 18(8), pages 1-18, July.
- Caroline Gaudreau & Dani Levine & John A. List & Dana Suskind, 2025.
"Introducing The SPEAK: A Scalable Computer-Adaptive Tool to Measure Knowledge of Early Human Development,"
NBER Working Papers
34349, National Bureau of Economic Research, Inc.
- Caroline Gaudreau & Dani Levine & John List & Dana Suskind, 2025. "Introducing The SPEAK: A Scalable Computer-Adaptive Tool to Measure Knowledge of Early Human Development," Artefactual Field Experiments 00827, The Field Experiments Website.
- Gerhard Riener & Sebastian Schneider & Valentin Wagner, 2020.
"Addressing Validity and Generalizability Concerns in Field Experiments,"
Discussion Paper Series of the Max Planck Institute for Behavioral Economics
2020_16, Max Planck Institute for Behavioral Economics.
- Riener, Gerhard & Schneider, Sebastian & Wagner, Valentin, 2020. "Addressing validity and generalizability concerns in field experiments," DICE Discussion Papers 345, Heinrich Heine University Düsseldorf, Düsseldorf Institute for Competition Economics (DICE).
- Gerhard Riener & Sebastian O. Schneider & Valentin Wagner, 2020. "Addressing Validity and Generalizability Concerns in Field Experiments," Working Papers 2019, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz.
- List, John A. & Momeni, Fatemeh & Zenou, Yves, 2020.
"The Social Side of Early Human Capital Formation: Using a Field Experiment to Estimate the Causal Impact of Neighborhoods,"
IZA Discussion Papers
13966, IZA Network @ LISER.
- John A. List & Fatemeh Momeni & Yves Zenou, 2020. "The Social Side of Early Human Capital Formation: Using a Field Experiment to Estimate the Causal Impact of Neighborhoods," Working Papers 2020-187, Becker Friedman Institute for Research In Economics.
- John A. List & Fatemeh Momeni & Yves Zenou, 2020. "The Social Side of Early Human Capital Formation: Using a Field Experiment to Estimate the Causal Impact of Neighborhoods," NBER Working Papers 28283, National Bureau of Economic Research, Inc.
- John List & Fatemeh Momeni & Michael Vlassopoulos & Yves Zenou, 2023. "The Social Side of Early Human Capital Formation: Using a Field Experiment to Estimate the Causal Impact of Neighborhoods," Framed Field Experiments 00722, The Field Experiments Website.
- Busso, Matias & Montaño, Sebastián & Muñoz-Morales, Juan & Pope, Nolan G., 2024.
"The unintended consequences of merit-based teacher selection: Evidence from a large-scale reform in Colombia,"
Journal of Public Economics, Elsevier, vol. 239(C).
- Busso, Matias & Montaño, Sebastián & Muñoz-Morales, Juan S. & Pope, Nolan G., 2024. "The Unintended Consequences of Merit-Based Teacher Selection: Evidence from a Large-Scale Reform in Colombia," IZA Discussion Papers 17294, IZA Network @ LISER.
- Matias Busso & Sebastian Montano & Juan S. Muñoz-Morales & Nolan G. Pope, 2024. "The Unintended Consequences of Merit-based Teacher Selection: Evidence from Large-scale Reform in Colombia," NBER Working Papers 33008, National Bureau of Economic Research, Inc.
- Matias Busso & Sebastián Montaño & Juan Muñoz-Morales & Nolan Pope, 2024. "The unintended consequences of merit-based teacher selection: Evidence from a large-scale reform in Colombia," Post-Print hal-05490584, HAL.
- Snigdha Gupta & John List & Lauren Supplee & Dana Suskind, 2021. "Failed to Scale: Embracing the Challenge of Scaling in Early Childhood," Artefactual Field Experiments 00734, The Field Experiments Website.
- Eric Guerci, 2025. "Laboratory Experiments in Innovation Research," Post-Print hal-05475831, HAL.
- Robert Ammerman & Anne Duggan & John List & Lauren Supplee & Dana Suskind, 2021. "The role of open science practices in scaling evidence-based prevention programs," Natural Field Experiments 00741, The Field Experiments Website.
- Berkes, Jan & Bouguen, Adrien & Filmer, Deon & Fukao, Tsuyoshi, 2024. "Improving preschool provision and encouraging-demand: Evidence from a large-scale construction program," Journal of Public Economics, Elsevier, vol. 230(C).
- Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018.
"Nudging in education,"
Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
- Mette Trier Damgaard & Helena Skyt Nielsen, 2017. "Nudging in education," Economics Working Papers 2017-05, Department of Economics and Business Economics, Aarhus University.
- Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in Education," IZA Discussion Papers 11454, IZA Network @ LISER.
- John A. List, 2020.
"Non est Disputandum de Generalizability? A Glimpse into The External Validity Trial,"
NBER Working Papers
27535, National Bureau of Economic Research, Inc.
- John List, 2020. "Non est Disputandum de Generalizability? A Glimpse into The External Validity Trial," Artefactual Field Experiments 00711, The Field Experiments Website.
- Luca A. Panzone & Natasha Auch & Daniel John Zizzo, 2024.
"Nudging the Food Basket Green: The Effects of Commitment and Badges on the Carbon Footprint of Food Shopping,"
Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 87(1), pages 89-133, January.
- Luca Panzone & Natasha Auch & Daniel Zizzo, 2022. "Nudging The Food Basket Green: The Effects Of Commitment And Badges On The Carbon Footprint Of Food Shopping," Discussion Papers Series 652, School of Economics, University of Queensland, Australia.
- Henning Hermesifo & Philipp Lergetporer & Frauke Peter & Simon Wiederhold, 2025.
"Application Barriers and the Socioeconomic Gap in Child Care Enrollment,"
Journal of the European Economic Association, European Economic Association, vol. 23(3), pages 1133-1172.
- Henning Hermes & Philipp Lergetporer & Frauke Peter & Simon Wiederhold, 2021. "Application Barriers and the Socioeconomic Gap in Child Care Enrollment," CESifo Working Paper Series 9282, CESifo.
- Hermes, Henning & Lergetporer, Philipp & Peter, Frauke & Wiederhold, Simon, 2024. "Application barriers and the socioeconomic gap in child care enrollment," IWH Discussion Papers 13/2024, Halle Institute for Economic Research (IWH).
- Henning Hermes & Philipp Lergetporer & Frauke Peter & Simon Wiederhold, 2024. "Application Barriers and the Socioeconomic Gap in Child Care Enrollment," Working Papers 2024-022, Human Capital and Economic Opportunity Working Group.
- Hermes, Henning & Lergetporer, Philipp & Peter, Frauke & Wiederhold, Simon, 2024. "Application Barriers and the Socioeconomic Gap in Child Care Enrollment," IZA Discussion Papers 16915, IZA Network @ LISER.
- Singhal, Puja & Pahle, Michael & Kalkuhl, Matthias & Levesque, Antoine & Sommer, Stephan & Berneiser, Jessica, 2022. "Beyond good faith: Why evidence-based policy is necessary to decarbonize buildings cost-effectively in Germany," Energy Policy, Elsevier, vol. 169(C).
- Kuchirko, Yana A. & Coskun, Lerzan Z. & Duch, Helena & Castaner, Maria Marti & Gennetian, Lisa A., 2021. "Light-touch design enhancements can boost parent engagement in math activities," Children and Youth Services Review, Elsevier, vol. 128(C).
- Bet Caeyers & Lina Cardona Sosa & Sarah Cattan & Sonya Krutikova & Abu Siddique, 2026. "Parents in the classroom: strengthening government capacity to deliver early childhood education," IFS Working Papers W26/11, Institute for Fiscal Studies.
- Oreopoulos, Philip, 2020. "Promises and Limitations of Nudging in Education," IZA Discussion Papers 13718, IZA Network @ LISER.
- Omar Al-Ubaydli & John List & Claire Mackevicius & Min Sok Lee & Dana Suskind, 2019. "How Can Experiments Play a Greater Role in Public Policy? 12 Proposals from an Economic Model of Scaling," Artefactual Field Experiments 00679, The Field Experiments Website.
- Difang Huang & Zhengyang Bao, 2020. "Gender Differences in Reaction to Enforcement Mechanisms: A Large-Scale Natural Field Experiment," Monash Economics Working Papers 08-20, Monash University, Department of Economics.
- John A. List, 2024.
"Optimally generate policy-based evidence before scaling,"
Nature, Nature, vol. 626(7999), pages 491-499, February.
- John List, 2024. "Optimally Generate Policy-Based Evidence Before Scaling," Natural Field Experiments 00783, The Field Experiments Website.
- Shusaku Sasaki & Takunori Ishihara & Hirofumi Kurokawa, 2025. "Scaling Charitable Incentives: Policy Selection, Beliefs, and Evidence from a Field Experiment," Papers 2512.24852, arXiv.org.
- Julia Fischer-Mackey, 2024. "What Do Practitioners Want from Research? Exploring Ugandan and American Development Practitioners’ Interest in Research," Progress in Development Studies, , vol. 24(1), pages 27-47, January.
- López Bóo, Florencia & de la Paz Ferro, Maria & Carneiro, Pedro, 2024. "Impacts of Integrating Early Childhood with Health Services: Experimental Evidence from the Cresça Com Seu Filho Home Visiting Program," IZA Discussion Papers 17130, IZA Network @ LISER.
- Löschel, Andreas & Rodemeier, Matthias & Werthschulte, Madeline, 2023. "Can self-set goals encourage resource conservation? Field experimental evidence from a smartphone app," European Economic Review, Elsevier, vol. 160(C).
- Omar Al-Ubaydli & John A. List & Danielle LoRe & Dana Suskind, 2017.
"Scaling for Economists: Lessons from the Non-Adherence Problem in the Medical Literature,"
Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 125-144, Fall.
- Omar Al-Ubaydli & John List & Danielle LoRe & Dana Suskind, 2017. "Scaling for economists: lessons from the non-adherence problem in the medical literature," Artefactual Field Experiments 00616, The Field Experiments Website.
- Geven, Koen Martijn & Tahir, Ayesha & Fasih, Tazeen & Qureshi, Javaeria & Hasan, Amer & Fazili, Sheena & Malik, Rabea & Macdonald, Kevin Alan David, 2026. "Nudging at Scale : Evidence from a Government Text Messaging Campaign during School Shutdowns in Punjab, Pakistan," Policy Research Working Paper Series 11286, The World Bank.
Printed from https://ideas.repec.org/r/feb/artefa/00670.html