IDEAS home Printed from https://ideas.repec.org/a/sae/evarev/v47y2023i5p932-943.html

Increasing the Impact of Program Evaluation: The Importance of Challenging Assumptions and Incorporating New Perspectives

Author

Listed:
  • Bridget Terry Long

Abstract

These remarks, which were given as the 2022 Recipient of the Peter H. Rossi Award for Contributions to the Theory or Practice of Program Evaluation, emphasize ways to increase the impact of program evaluation. First, is the importance of asking good questions, including ones that challenge the assumptions and models that dominate the field. Relatedly, we need to question the assumption that “one size fits all†and recognize the variation that exists—across contexts, time, and individuals. The key question is what works for whom under what conditions, and this also pushes us to think about why effects differ and what is driving those differences, that is, the underlying mechanisms. It is also important to incorporate new perspectives to improve our questions, models, research design, and interpretation, thus helping to address the aforementioned points. We should both welcome diverse perspectives into the research community and listen carefully to the communities we seek to study and incorporating their insights. Although the examples focus on a career in education research, the implications of the points are relevant for any aspect of social policy.

Suggested Citation

  • Bridget Terry Long, 2023. "Increasing the Impact of Program Evaluation: The Importance of Challenging Assumptions and Incorporating New Perspectives," Evaluation Review, , vol. 47(5), pages 932-943, October.
  • Handle: RePEc:sae:evarev:v:47:y:2023:i:5:p:932-943
    DOI: 10.1177/0193841X231163674
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0193841X231163674
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0193841X231163674?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Caroline M. Hoxby, 2000. "Does Competition among Public Schools Benefit Students and Taxpayers?," American Economic Review, American Economic Association, vol. 90(5), pages 1209-1238, December.
    2. Caroline M. Hoxby, 2000. "The Effects of Class Size on Student Achievement: New Evidence from Population Variation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(4), pages 1239-1285.
    3. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    4. Eric P. Bettinger & Bridget Terry Long & Philip Oreopoulos & Lisa Sanbonmatsu, 2012. "The Role of Application Assistance and Information in College Decisions: Results from the H&R Block Fafsa Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1205-1242.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rabia Majeed & Javed Iqbal & Zahoor ul Haq & Muhammad Faisal Shahzad, 2025. "Empowering Expecting Women to Obtain High-Quality Healthcare in Pakistan: An Evaluation of Khyber Pakhtunkhwa’s Conditional Cash Transfer Program," Evaluation Review, , vol. 49(2), pages 209-236, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Martin Schlotter & Guido Schwerdt & Ludger Woessmann, 2011. "Econometric methods for causal evaluation of education policies and practices: a non-technical guide," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 109-137.
    2. Foreman-Peck, James & Foreman-Peck, Lorraine, 2006. "Should schools be smaller? The size-performance relationship for Welsh schools," Economics of Education Review, Elsevier, vol. 25(2), pages 157-171, April.
    3. Jürges Hendrik & Schneider Kerstin, 2004. "International Differences in Student Achievement: An Economic Perspective," German Economic Review, De Gruyter, vol. 5(3), pages 357-380, August.
    4. Millimet, Daniel L. & Rangaprasad, Vasudha, 2007. "Strategic competition amongst public schools," Regional Science and Urban Economics, Elsevier, vol. 37(2), pages 199-219, March.
    5. John Bishop & Ludger Wossmann, 2004. "Institutional Effects in a Simple Model of Educational Production," Education Economics, Taylor & Francis Journals, vol. 12(1), pages 17-38.
    6. Vandenberghe, V. & Robin, S., 2004. "Evaluating the effectiveness of private education across countries: a comparison of methods," Labour Economics, Elsevier, vol. 11(4), pages 487-506, August.
    7. Hendrik Jürges & Kerstin Schneider & Felix Büchel, 2005. "The Effect Of Central Exit Examinations On Student Achievement: Quasi-Experimental Evidence From TIMSS Germany," Journal of the European Economic Association, MIT Press, vol. 3(5), pages 1134-1155, September.
    8. Hamermesh, Daniel S., 2007. "Replication in Economics," IZA Discussion Papers 2760, IZA Network @ LISER.
    9. López-Torres, Laura & Nicolini, Rosella & Prior, Diego, 2017. "Does strategic interaction affect demand for school places? A conditional efficiency approach," Regional Science and Urban Economics, Elsevier, vol. 65(C), pages 89-103.
    10. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    11. Dolton, Peter & Bondibene, Chiara Rosazza & Stops, Michael, 2015. "Identifying the employment effect of invoking and changing the minimum wage: A spatial analysis of the UK," Labour Economics, Elsevier, vol. 37(C), pages 54-76.
    12. Alexis Le Chapelain, 2014. "Market for education and student achievement [Marché de l’éducation et réussite scolaire]," SciencePo Working papers tel-03510563, HAL.
    13. Tito Boeri & Jan van Ours, 2013. "The Economics of Imperfect Labor Markets: Second Edition," Economics Books, Princeton University Press, edition 1, number 10142, December.
    14. Alexis Le Chapelain, 2014. "Market for education and student achievement [Marché de l’éducation et réussite scolaire]," Sciences Po Economics Publications (main) tel-03510563, HAL.
    15. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    16. Nevbahar Ertas, 2013. "Charter Schools and Student Compositions of Traditional Public Schools," SAGE Open, , vol. 3(2), pages 21582440134, June.
    17. Felix Büchel & Hendrik Jürges & Kerstin Schneider, 2003. "Die Auswirkungen zentraler Abschlussprüfungen auf die Schulleistung: quasi-experimentelle Befunde aus der deutschen TIMSS-Stichprobe," Vierteljahrshefte zur Wirtschaftsforschung / Quarterly Journal of Economic Research, DIW Berlin, German Institute for Economic Research, vol. 72(2), pages 238-251.
    18. Wößmann, Ludger, 2001. "New Evidence on the Missing Resource-Performance Link in Education," Kiel Working Papers 1051, Kiel Institute for the World Economy.
    19. Peterson, Paul E. & Llaudet, Elena, 2006. "On the Public-Private School Achievement Debate," Working Paper Series rwp06-036, Harvard University, John F. Kennedy School of Government.
    20. López-Torres, Laura & Prior, Diego, 2022. "Long-term efficiency of public service provision in a context of budget restrictions. An application to the education sector," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:evarev:v:47:y:2023:i:5:p:932-943. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.