IDEAS home Printed from https://ideas.repec.org/p/zbw/glodps/1633.html

Using RCTs in Economic Education Research

Author

Listed:
  • Pugatch, Todd
  • Schroeder, Elizabeth

Abstract

Randomized controlled trials (RCTs) have become an essential tool for economists. The credibility revolution in empirical economics emphasizes research designs that identify casual effects, and random assignment of treatment is seen as the gold standard. Implementation can, however, be a challenge in many applications. The field of economic education is in a unique position to learn from RCTs, given the ability to test interventions in the classroom or at educational institutions. We discuss what is needed to run an RCT effectively in an educational setting, drawing from the experimental literature on topics such as student success in higher education and diversity in undergraduate economics. We additionally outline quasi-experimental approaches that can be used when treatment cannot be randomized.

Suggested Citation

  • Pugatch, Todd & Schroeder, Elizabeth, 2025. "Using RCTs in Economic Education Research," GLO Discussion Paper Series 1633, Global Labor Organization (GLO).
    • Handle: RePEc:zbw:glodps:1633
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/321817/1/GLO-DP-1633.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Scott E. Carrell & Michal Kurlaender, 2023. "My Professor Cares: Experimental Evidence on the Role of Faculty Engagement," American Economic Journal: Economic Policy, American Economic Association, vol. 15(4), pages 113-141, November.
    2. Zachary Bleemer & Aashish Mehta, 2022. "Will Studying Economics Make You Rich? A Regression Discontinuity Analysis of the Returns to College Major," American Economic Journal: Applied Economics, American Economic Association, vol. 14(2), pages 1-22, April.
    3. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    4. Kristin F. Butcher & Patrick J. McEwan & Akila Weerapana, 2024. "Women’s Colleges and Economics Major Choice: Evidence from Wellesley College Applicants," Feminist Economics, Taylor & Francis Journals, vol. 30(2), pages 123-161, April.
    5. Philip Oreopoulos & Uros Petronijevic, 2018. "Student Coaching: How Far Can Technology Go?," Journal of Human Resources, University of Wisconsin Press, vol. 53(2), pages 299-329.
    6. Rask, Kevin & Tiefenthaler, Jill, 2008. "The role of grade sensitivity in explaining the gender imbalance in undergraduate economics," Economics of Education Review, Elsevier, vol. 27(6), pages 676-687, December.
    7. Tisha L. N. Emerson & KimMarie McGoldrick & John J. Siegfried, 2018. "The Gender Gap in Economics Degrees: An Investigation of the Role Model and Quantitative Requirements Hypotheses," Southern Economic Journal, John Wiley & Sons, vol. 84(3), pages 898-911, January.
    8. Lei Tang & Shanshan Li & Emma Auden & Elizabeth Dhuey, 2020. "Who benefits from regular class participation?," The Journal of Economic Education, Taylor & Francis Journals, vol. 51(3-4), pages 243-256, August.
    9. Catherine Porter & Danila Serra, 2020. "Gender Differences in the Choice of Major: The Importance of Female Role Models," American Economic Journal: Applied Economics, American Economic Association, vol. 12(3), pages 226-254, July.
    10. Amanda Bayer & Syon P. Bhanot & Fernando Lozano, 2019. "Does Simple Information Provision Lead to More Diverse Classrooms? Evidence from a Field Experiment on Undergraduate Economics," AEA Papers and Proceedings, American Economic Association, vol. 109, pages 110-114, May.
    11. William Bosshardt & Amanda Jennings & Peter Davies, 2024. "Why it works: Using qualitative methods in economic education research," The Journal of Economic Education, Taylor & Francis Journals, vol. 55(4), pages 479-494, October.
    12. Nathan Wozny & Cary Balser & Drew Ives, 2018. "Evaluating the flipped classroom: A randomized controlled trial," The Journal of Economic Education, Taylor & Francis Journals, vol. 49(2), pages 115-129, April.
    13. Jose M. Fernandez & Erin A. Yetter & Kim Holder, 2021. "What do economic education scholars study? Insights from machine learning," The Journal of Economic Education, Taylor & Francis Journals, vol. 52(2), pages 156-172, March.
    14. Todd Pugatch & Elizabeth Schroeder, 2021. "Promoting Female Interest in Economics: Limits to Nudges," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 123-127, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Patnaik, Arpita & Pauley, Gwyn & Venator, Joanna & Wiswall, Matthew, 2024. "The impacts of same and opposite gender alumni speakers on interest in economics," Economics of Education Review, Elsevier, vol. 102(C).
    2. Antman, Francisca M. & Skoy, Evelyn & Flores, Nicholas E., 2025. "Can Better Information Reduce College Gender Gaps? The Impact of Relative Grade Signals on Academic Outcomes for Students in Introductory Economics," IZA Discussion Papers 18001, IZA Network @ LISER.
    3. Kristin F. Butcher & Patrick J. McEwan & Akila Weerapana, 2024. "Women’s Colleges and Economics Major Choice: Evidence from Wellesley College Applicants," Feminist Economics, Taylor & Francis Journals, vol. 30(2), pages 123-161, April.
    4. Graziella Bertocchi & Luca Bonacini & Marina Murat, 2021. "Adams and Eves: The Gender Gap in Economics Majors," EIEF Working Papers Series 2115, Einaudi Institute for Economics and Finance (EIEF), revised Dec 2021.
    5. Graziella Bertocchi & Luca Bonacini & Marina Murat, 2023. "Adams and Eves: High school math and the gender gap in Economics majors," Economic Inquiry, Western Economic Association International, vol. 61(4), pages 798-817, October.
    6. Rebecca Cassells & Leonora Risse & Danielle Wood & Duygu Yengin, 2023. "Lifting Diversity and Inclusion in Economics: How the Australian Women in Economics Network Put the Evidence into Action," Economic Papers, The Economic Society of Australia, vol. 42(1), pages 1-29, March.
    7. Larry Chavis & Laurel Wheeler, 2025. "Applying Indigenous Approaches to Economics Instruction," Journal of Economics, Race, and Policy, Springer, vol. 8(1), pages 57-73, March.
    8. Delaney, Judith M. & Devereux, Paul J., 2021. "Gender and Educational Achievement: Stylized Facts and Causal Evidence," IZA Discussion Papers 14074, IZA Network @ LISER.
    9. Todd Pugatch & Nicholas Wilson, 2024. "Nudging Demand for Academic Support Services: Experimental and Structural Evidence from Higher Education," Journal of Human Resources, University of Wisconsin Press, vol. 59(5), pages 1637-1682.
    10. Graziella Bertocchi & Luca Bonacini & Marina Murat, 2021. "Adams and Eves: The Gender Gap in Economics Majors," Department of Economics 0196, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
    11. Arnold, Ivo J.M., 2020. "Gender and major choice within economics: Evidence from Europe," International Review of Economics Education, Elsevier, vol. 35(C).
    12. Todd Pugatch & Elizabeth Schroeder, 2024. "A simple nudge increases socioeconomic diversity in undergraduate Economics," Economic Inquiry, Western Economic Association International, vol. 62(1), pages 287-307, January.
    13. Halim,Daniel Zefanya & Powers,Elizabeth T. & Thornton,Rebecca Lynn, 2021. "Gender Differences in Economics Course-Taking and Majoring : Findings from an RCT," Policy Research Working Paper Series 9732, The World Bank.
    14. Elaine Kelly & Isabel Stockton, 2024. "A senior doctor like me: Gender match and occupational choice," IFS Working Papers W24/11, Institute for Fiscal Studies.
    15. Todd Pugatch & Elizabeth Schroeder, 2021. "Promoting Female Interest in Economics: Limits to Nudges," AEA Papers and Proceedings, American Economic Association, vol. 111, pages 123-127, May.
    16. Grace Eau & Derek Hoodin & Tareena Musaddiq, 2022. "Testing the effects of adaptive learning courseware on student performance: An experimental approach," Southern Economic Journal, John Wiley & Sons, vol. 88(3), pages 1086-1118, January.
    17. Arpita Patnaik & Matthew J. Wiswall & Basit Zafar, 2020. "College Majors," NBER Working Papers 27645, National Bureau of Economic Research, Inc.
    18. Larissa Fuchs & Pia Pinger & Philipp Seegers, 2025. "Relative Grades and Gender Differences in STEM Enrollment," CRC TR 224 Discussion Paper Series crctr224_2025_633, University of Bonn and University of Mannheim, Germany.
    19. Singhal, Karan & Sierminska, Eva, 2024. "Inequality in the Economics Profession," IZA Discussion Papers 17584, IZA Network @ LISER.
    20. Ugalde A., Paola, 2025. "Gendered effects of labels on advanced course enrollment," Journal of Economic Behavior & Organization, Elsevier, vol. 236(C).

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:glodps:1633. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/glabode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.