IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/27312.html
   My bibliography  Save this paper

My Professor Cares: Experimental Evidence on the Role of Faculty Engagement

Author

Listed:
  • Scott E. Carrell
  • Michal Kurlaender

Abstract

Despite a growing body of literature that instructors “matter” in higher education, there is virtually no evidence about how their actions influence student outcomes. We provide experimental evidence on the impact of specific faculty behaviors aimed at increasing student success. We test the effect of professor feedback on student success in higher education classrooms though a "light-touch" randomized intervention. We present results from a small pilot in an introductory-level microeconomics course at a comprehensive research university, and the scale-up conducted in over 43 classrooms and nearly 4,000 students at a large broad-access university. The intervention consisted of several strategically-timed E-mails to students from the professor indicating keys to success in the class, the students’ current standing in the course, and a reminder of when the professor is available. Results from the pilot show that students in the treatment group scored higher on exams, homework assignments, and final course grade. Results from the scaled-up experiment are more mixed—we find significant positive effects on student perceptions of the professor and course for all students. However, we only find positive achievement effects for our target population, first year students from underrepresented minority groups. Finally, we replicated the pilot to test the robustness of these results and again find positive effects on student achievement. We conclude that in certain settings and with some students, targeted feedback from professors can lead to meaningful gains in achievement.

Suggested Citation

  • Scott E. Carrell & Michal Kurlaender, 2020. "My Professor Cares: Experimental Evidence on the Role of Faculty Engagement," NBER Working Papers 27312, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:27312
    Note: ED LS PE
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w27312.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Scott E. Carrell & Marianne E. Page & James E. West, 2010. "Sex and Science: How Professor Gender Perpetuates the Gender Gap," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(3), pages 1101-1144.
    2. Braga, Michela & Paccagnella, Marco & Pellizzari, Michele, 2014. "Evaluating students’ evaluations of professors," Economics of Education Review, Elsevier, vol. 41(C), pages 71-88.
    3. Philip Oreopoulos & Daniel Lang & Joshua Angrist, 2009. "Incentives and Services for College Achievement: Evidence from a Randomized Trial," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 136-163, January.
    4. Joshua Angrist & Philip Oreopoulos & Tyler Williams, 2014. "When Opportunity Knocks, Who Answers?: New Evidence on College Achievement Awards," Journal of Human Resources, University of Wisconsin Press, vol. 49(3), pages 572-610.
    5. Caroline M. Hoxby, 2004. "College Choices: The Economics of Where to Go, When to Go, and How to Pay For It," NBER Books, National Bureau of Economic Research, Inc, number hoxb04-1, July.
    6. Beleche, Trinidad & Fairris, David & Marks, Mindy, 2012. "Do course evaluations truly reflect student learning? Evidence from an objectively graded post-test," Economics of Education Review, Elsevier, vol. 31(5), pages 709-719.
    7. Deven E. Carlson & Felix Elwert & Nicholas Hillman & Alex Schmidt & Barbara L. Wolfe, 2019. "The Effects of Financial Aid Grant Offers on Postsecondary Educational Outcomes: New Experimental Evidence from the Fund for Wisconsin Scholars," NBER Working Papers 26419, National Bureau of Economic Research, Inc.
    8. Christopher Avery & Thomas J. Kane, 2004. "Student Perceptions of College Opportunities. The Boston COACH Program," NBER Chapters, in: College Choices: The Economics of Where to Go, When to Go, and How to Pay For It, pages 355-394, National Bureau of Economic Research, Inc.
    9. Eric P. Bettinger & Bridget Terry Long, 2010. "Does Cheaper Mean Better? The Impact of Using Adjunct Instructors on Student Outcomes," The Review of Economics and Statistics, MIT Press, vol. 92(3), pages 598-613, August.
    10. Scott E. Carrell & James E. West, 2010. "Does Professor Quality Matter? Evidence from Random Assignment of Students to Professors," Journal of Political Economy, University of Chicago Press, vol. 118(3), pages 409-432, June.
    11. Caroline Minter Hoxby, 2004. "Introduction to "College Choices: The Economics of Where to Go, When to Go, and How to Pay For It"," NBER Chapters, in: College Choices: The Economics of Where to Go, When to Go, and How to Pay For It, pages 1-12, National Bureau of Economic Research, Inc.
    12. Ronald G. Ehrenberg & Liang Zhang, 2005. "Do Tenured and Tenure-Track Faculty Matter?," Journal of Human Resources, University of Wisconsin Press, vol. 40(3).
    13. Scott Carrell & Bruce Sacerdote, 2017. "Why Do College-Going Interventions Work?," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 124-151, July.
    14. Eric P. Bettinger & Bridget Terry Long & Philip Oreopoulos & Lisa Sanbonmatsu, 2012. "The Role of Application Assistance and Information in College Decisions: Results from the H&R Block Fafsa Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(3), pages 1205-1242.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pugatch, Todd & Wilson, Nicholas, 2020. "Nudging Demand for Academic Support Services: Experimental and Structural Evidence from Higher Education," GLO Discussion Paper Series 675, Global Labor Organization (GLO).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    2. Serena Canaan & Antoine Deeb & Pierre Mouganie, 2022. "Adviser Value Added and Student Outcomes: Evidence from Randomly Assigned College Advisers," American Economic Journal: Economic Policy, American Economic Association, vol. 14(4), pages 151-191, November.
    3. Ellis, Jimmy R. & Gershenson, Seth, 2016. "LATE for the Meeting: Gender, Peer Advising, and College Success," IZA Discussion Papers 9956, Institute of Labor Economics (IZA).
    4. Ellis, Jimmy R. & Gershenson, Seth, 2020. "Gender, peer advising, and college success," Labour Economics, Elsevier, vol. 62(C).
    5. Avery, Christopher & Castleman, Benjamin L. & Hurwitz, Michael & Long, Bridget Terry & Page, Lindsay C., 2021. "Digital messaging to improve college enrollment and success," Economics of Education Review, Elsevier, vol. 84(C).
    6. Anderson, Drew M. & Goldrick-Rab, Sara, 2018. "Aid after enrollment: Impacts of a statewide grant program at public two-year colleges," Economics of Education Review, Elsevier, vol. 67(C), pages 148-157.
    7. Adam M. Lavecchia & Heidi Liu & Philip Oreopoulos, 2014. "Behavioral Economics of Education: Progress and Possibilities," NBER Working Papers 20609, National Bureau of Economic Research, Inc.
    8. Scott Carrell & Bruce Sacerdote, 2017. "Why Do College-Going Interventions Work?," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 124-151, July.
    9. Taylor K. Odle & Jennifer A. Delaney, 2022. "You are Admitted! Early Evidence on Enrollment from Idaho’s Direct Admissions System," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(6), pages 899-932, September.
    10. Bird, Kelli A. & Castleman, Benjamin L. & Denning, Jeffrey T. & Goodman, Joshua & Lamberton, Cait & Rosinger, Kelly Ochs, 2021. "Nudging at scale: Experimental evidence from FAFSA completion campaigns," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 105-128.
    11. George Spencer, 2019. "Can Transfer Guides Improve the Uptake of Major Prerequisites? Evidence from Ohio’s Transfer and Articulation Policy Reform," Research in Higher Education, Springer;Association for Institutional Research, vol. 60(4), pages 458-484, June.
    12. Brian Holzman & Daniel Klasik & Rachel Baker, 2020. "Gaps in the College Application Gauntlet," Research in Higher Education, Springer;Association for Institutional Research, vol. 61(7), pages 795-822, November.
    13. Joshua Goodman & Michael Hurwitz & Jonathan Smith, "undated". "Access to Four-Year Public Colleges and Degree Completion," Working Paper 175226, Harvard University OpenScholar.
    14. Andrews, Rodney J. & Imberman, Scott A. & Lovenheim, Michael F., 2020. "Recruiting and supporting low-income, high-achieving students at flagship universities," Economics of Education Review, Elsevier, vol. 74(C).
    15. Bleemer, Zachary & Zafar, Basit, 2018. "Intended college attendance: Evidence from an experiment on college returns and costs," Journal of Public Economics, Elsevier, vol. 157(C), pages 184-211.
    16. Charles T. Clotfelter & Steven W. Hemelt & Helen F. Ladd, 2018. "Multifaceted Aid For Low‐Income Students And College Outcomes: Evidence From North Carolina," Economic Inquiry, Western Economic Association International, vol. 56(1), pages 278-303, January.
    17. Michela Braga & Marco Paccagnella & Michele Pellizzari, 2016. "The Impact of College Teaching on Students’ Academic and Labor Market Outcomes," Journal of Labor Economics, University of Chicago Press, vol. 34(3), pages 781-822.
    18. Kalena E. Cortes & Hans Fricke & Susanna Loeb & David S. Song, 2018. "Too little or too much? Actionable Advice in an Early-Childhood Text Messaging Experiment," NBER Working Papers 24827, National Bureau of Economic Research, Inc.
    19. Michela Braga & Marco Paccagnella & Michele Pellizzari, 2014. "The academic and labor market returns of university professors," Temi di discussione (Economic working papers) 981, Bank of Italy, Economic Research and International Relations Area.
    20. Christopher Erwin & Melissa Binder & Cynthia Miller & Kate Krause, 2020. "Performance-based aid, enhanced advising, and the income gap in college graduation: Evidence from a randomized controlled trial," Working Papers 2020-06, Auckland University of Technology, Department of Economics.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:27312. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.