IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp18018.html
   My bibliography  Save this paper

Using RCTs in Economic Education Research

Author

Listed:
  • Pugatch, Todd

    (University at Buffalo, SUNY)

  • Schroeder, Elizabeth

    (Oregon State University)

Abstract

Randomized controlled trials (RCTs) have become an essential tool for economists. The credibility revolution in empirical economics emphasizes research designs that identify casual effects, and random assignment of treatment is seen as the gold standard. Implementation can, however, be a challenge in many applications. The field of economic education is in a unique position to learn from RCTs, given the ability to test interventions in the classroom or at educational institutions. We discuss what is needed to run an RCT effectively in an educational setting, drawing from the experimental literature on topics such as student success in higher education and diversity in undergraduate economics. We additionally outline quasi-experimental approaches that can be used when treatment cannot be randomized.

Suggested Citation

  • Pugatch, Todd & Schroeder, Elizabeth, 2025. "Using RCTs in Economic Education Research," IZA Discussion Papers 18018, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp18018
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp18018.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Philip Oreopoulos & Uros Petronijevic, 2018. "Student Coaching: How Far Can Technology Go?," Journal of Human Resources, University of Wisconsin Press, vol. 53(2), pages 299-329.
    2. Duflo, Esther & Glennerster, Rachel & Kremer, Michael, 2008. "Using Randomization in Development Economics Research: A Toolkit," Handbook of Development Economics, in: T. Paul Schultz & John A. Strauss (ed.), Handbook of Development Economics, edition 1, volume 4, chapter 61, pages 3895-3962, Elsevier.
    3. Lei Tang & Shanshan Li & Emma Auden & Elizabeth Dhuey, 2020. "Who benefits from regular class participation?," The Journal of Economic Education, Taylor & Francis Journals, vol. 51(3-4), pages 243-256, August.
    4. Scott E. Carrell & Michal Kurlaender, 2023. "My Professor Cares: Experimental Evidence on the Role of Faculty Engagement," American Economic Journal: Economic Policy, American Economic Association, vol. 15(4), pages 113-141, November.
    5. William Bosshardt & Amanda Jennings & Peter Davies, 2024. "Why it works: Using qualitative methods in economic education research," The Journal of Economic Education, Taylor & Francis Journals, vol. 55(4), pages 479-494, October.
    6. Nathan Wozny & Cary Balser & Drew Ives, 2018. "Evaluating the flipped classroom: A randomized controlled trial," The Journal of Economic Education, Taylor & Francis Journals, vol. 49(2), pages 115-129, April.
    7. Zachary Bleemer & Aashish Mehta, 2022. "Will Studying Economics Make You Rich? A Regression Discontinuity Analysis of the Returns to College Major," American Economic Journal: Applied Economics, American Economic Association, vol. 14(2), pages 1-22, April.
    8. Rask, Kevin & Tiefenthaler, Jill, 2008. "The role of grade sensitivity in explaining the gender imbalance in undergraduate economics," Economics of Education Review, Elsevier, vol. 27(6), pages 676-687, December.
    9. Catherine Porter & Danila Serra, 2020. "Gender Differences in the Choice of Major: The Importance of Female Role Models," American Economic Journal: Applied Economics, American Economic Association, vol. 12(3), pages 226-254, July.
    10. Tisha L. N. Emerson & KimMarie McGoldrick & John J. Siegfried, 2018. "The Gender Gap in Economics Degrees: An Investigation of the Role Model and Quantitative Requirements Hypotheses," Southern Economic Journal, John Wiley & Sons, vol. 84(3), pages 898-911, January.
    11. Jose M. Fernandez & Erin A. Yetter & Kim Holder, 2021. "What do economic education scholars study? Insights from machine learning," The Journal of Economic Education, Taylor & Francis Journals, vol. 52(2), pages 156-172, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antman, Francisca M. & Skoy, Evelyn & Flores, Nicholas E., 2025. "Can Better Information Reduce College Gender Gaps? The Impact of Relative Grade Signals on Academic Outcomes for Students in Introductory Economics," IZA Discussion Papers 18001, Institute of Labor Economics (IZA).
    2. Patnaik, Arpita & Pauley, Gwyn & Venator, Joanna & Wiswall, Matthew, 2024. "The impacts of same and opposite gender alumni speakers on interest in economics," Economics of Education Review, Elsevier, vol. 102(C).
    3. Arnold, Ivo J.M., 2020. "Gender and major choice within economics: Evidence from Europe," International Review of Economics Education, Elsevier, vol. 35(C).
    4. Graziella Bertocchi & Luca Bonacini & Marina Murat, 2023. "Adams and Eves: High school math and the gender gap in Economics majors," Economic Inquiry, Western Economic Association International, vol. 61(4), pages 798-817, October.
    5. Grace Eau & Derek Hoodin & Tareena Musaddiq, 2022. "Testing the effects of adaptive learning courseware on student performance: An experimental approach," Southern Economic Journal, John Wiley & Sons, vol. 88(3), pages 1086-1118, January.
    6. Larissa Fuchs & Pia Pinger & Philipp Seegers, 2025. "Relative Grades and Gender Differences in STEM Enrollment," CRC TR 224 Discussion Paper Series crctr224_2025_633, University of Bonn and University of Mannheim, Germany.
    7. Serena Canaan & Antoine Deeb & Pierre Mouganie, 2022. "Adviser Value Added and Student Outcomes: Evidence from Randomly Assigned College Advisers," American Economic Journal: Economic Policy, American Economic Association, vol. 14(4), pages 151-191, November.
    8. Graziella Bertocchi & Luca Bonacini & Marina Murat, 2021. "Adams and Eves: The Gender Gap in Economics Majors," EIEF Working Papers Series 2115, Einaudi Institute for Economics and Finance (EIEF), revised Dec 2021.
    9. Julie Berry Cullen & Gordon B. Dahl & Richard De Thorpe, 2025. "Job Mismatch and Early Career Success," CESifo Working Paper Series 12104, CESifo.
    10. Kristin F. Butcher & Patrick J. McEwan & Akila Weerapana, 2024. "Women’s Colleges and Economics Major Choice: Evidence from Wellesley College Applicants," Feminist Economics, Taylor & Francis Journals, vol. 30(2), pages 123-161, April.
    11. Busso, Matias & Frisancho, Veronica, 2021. "Good peers have asymmetric gendered effects on female educational outcomes: Experimental evidence from Mexico," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 727-747.
    12. Engelhardt, Bryan & Johnson, Marianne & Meder, Martin E., 2021. "Learning in the time of Covid-19: Some preliminary findings," International Review of Economics Education, Elsevier, vol. 37(C).
    13. Veronica Minaya, 2020. "Do Differential Grading Standards Across Fields Matter for Major Choice? Evidence from a Policy Change in Florida," Research in Higher Education, Springer;Association for Institutional Research, vol. 61(8), pages 943-965, December.
    14. Cullen, Julie Berry & Dahl, Gordon B. & De Thorpe, Richard, 2025. "Job Mismatch and Early Career Success," IZA Discussion Papers 18098, Institute of Labor Economics (IZA).
    15. Todd Pugatch & Nicholas Wilson, 2024. "Nudging Demand for Academic Support Services: Experimental and Structural Evidence from Higher Education," Journal of Human Resources, University of Wisconsin Press, vol. 59(5), pages 1637-1682.
    16. Cullen, Julie Berry & Dahl, Gordon B. & De Thorpe, Richard, 2025. "Job Mismatch and Early Career Success," IZA Discussion Papers 18098, Institute of Labor Economics (IZA).
    17. Halim,Daniel Zefanya & Powers,Elizabeth T. & Thornton,Rebecca Lynn, 2021. "Gender Differences in Economics Course-Taking and Majoring : Findings from an RCT," Policy Research Working Paper Series 9732, The World Bank.
    18. Arpita Patnaik & Matthew J. Wiswall & Basit Zafar, 2020. "College Majors," NBER Working Papers 27645, National Bureau of Economic Research, Inc.
    19. Ersoy, Fulya & Speer, Jamin D., 2025. "Opening the black box of college major choice: Evidence from an information intervention," Journal of Economic Behavior & Organization, Elsevier, vol. 231(C).
    20. Megalokonomou, Rigissa & Vidal-Fernandez, Marian & Yengin, Duygu, 2021. "Underrepresentation of Women in Undergraduate Economics Degrees in Europe: A Comparison with STEM and Business," IZA Policy Papers 175, Institute of Labor Economics (IZA).

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp18018. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.