IDEAS home Printed from https://ideas.repec.org/a/spr/reihed/v61y2020i2d10.1007_s11162-019-09558-8.html
   My bibliography  Save this article

Is What Glitters Really Gold? A Quasi-Experimental Study of First-Year Seminars and College Student Success

Author

Listed:
  • K. C. Culver

    (Center for Research on Undergraduate Education, University of Iowa, N438 Lindquist Center)

  • Nicholas A. Bowman

    (Center for Research on Undergraduate Education, University of Iowa, N438 Lindquist Center)

Abstract

First-year seminars are frequently designed to help students adjust to and succeed in college. Although considerable literature has explored this topic, many previous studies may have notable problems with self-selection, since students who choose to participate are likely more motivated academically than those who do not. Therefore, this study used quasi-experimental analyses within a large, longitudinal, multi-institutional dataset to explore the link between seminar participation and several student success outcomes. Overall, the use of propensity score analyses substantially alters the results, such that first-year seminars are positively associated with first-year college satisfaction, but they have no effect on fourth-year satisfaction, college grades, retention, or four-year graduation within the full sample. This lack of impact is largely consistent regardless of whether the seminar is designed to engage students in academic inquiry or to promote orientation and academic success. Additional analyses observed some differential effects of first-year seminars by race/ethnicity, ACT score, and sex; the most consistent finding is that first-year seminars appear to promote the college grades and college satisfaction of Black students. Implications for future research and practice are discussed.

Suggested Citation

  • K. C. Culver & Nicholas A. Bowman, 2020. "Is What Glitters Really Gold? A Quasi-Experimental Study of First-Year Seminars and College Student Success," Research in Higher Education, Springer;Association for Institutional Research, vol. 61(2), pages 167-196, March.
  • Handle: RePEc:spr:reihed:v:61:y:2020:i:2:d:10.1007_s11162-019-09558-8
    DOI: 10.1007/s11162-019-09558-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11162-019-09558-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11162-019-09558-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sophia Rabe‐Hesketh & Anders Skrondal, 2006. "Multilevel modelling of complex survey data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 169(4), pages 805-827, October.
    2. Shadish, William R. & Clark, M. H. & Steiner, Peter M., 2008. "Can Nonrandomized Experiments Yield Accurate Answers? A Randomized Experiment Comparing Random and Nonrandom Assignments," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1334-1344.
    3. Arpino, Bruno & Mealli, Fabrizia, 2011. "The specification of the propensity score in multilevel observational studies," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1770-1780, April.
    4. Zhao, Zhong, 2008. "Sensitivity of propensity score methods to the specifications," Economics Letters, Elsevier, vol. 98(3), pages 309-319, March.
    5. Nicholas A. Bowman & KC Culver, 2018. "When Do Honors Programs Make the Grade? Conditional Effects on College Satisfaction, Achievement, Retention, and Graduation," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(3), pages 249-272, May.
    6. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    7. Fernando de Oliveira Santini & Wagner Junior Ladeira & Claudio Hoffmann Sampaio & Gustavo da Silva Costa, 2017. "Student satisfaction in higher education: a meta-analytic study," Journal of Marketing for Higher Education, Taylor & Francis Journals, vol. 27(1), pages 1-18, January.
    8. Joffe, Marshall M. & Ten Have, Thomas R. & Feldman, Harold I. & Kimmel, Stephen E., 2004. "Model Selection, Confounder Control, and Marginal Structural Models: Review and New Applications," The American Statistician, American Statistical Association, vol. 58, pages 272-279, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Eric P. Bettinger & Benjamin L. Castleman & Alice Choe & Zachary Mabel, 2022. "Finishing the Last Lap: Experimental Evidence on Strategies to Increase Attainment for Students Near College Completion," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 41(4), pages 1040-1059, September.
    2. Nick Huntington-Klein & Andrew Gill, 2021. "Semester Course Load and Student Performance," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(5), pages 623-650, August.
    3. Yu Chen & Xiaodan Hu, 2021. "The Nudge to Finish Up: A National Study of Community College Near-Completion Students," Research in Higher Education, Springer;Association for Institutional Research, vol. 62(5), pages 651-679, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    2. Phuong Nguyen-Hoang, 2012. "Fiscal effects of budget referendums: evidence from New York school districts," Public Choice, Springer, vol. 150(1), pages 77-95, January.
    3. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    4. Apps, Patricia & Mendolia, Silvia & Walker, Ian, 2013. "The impact of pre-school on adolescents’ outcomes: Evidence from a recent English cohort," Economics of Education Review, Elsevier, vol. 37(C), pages 183-199.
    5. Lechner, Michael & Wunsch, Conny & Huber, Martin & Walter, Thomas, 2009. "Do German Welfare-to-Work Programmes Reduce Welfare and Increase Work?," CEPR Discussion Papers 7238, C.E.P.R. Discussion Papers.
    6. Martin Huber & Michael Lechner & Giovanni Mellace, 2017. "Why Do Tougher Caseworkers Increase Employment? The Role of Program Assignment as a Causal Mechanism," The Review of Economics and Statistics, MIT Press, vol. 99(1), pages 180-183, March.
    7. Dettmann, Eva & Becker, Claudia & Schmeißer, Christian, 2010. "Is there a Superior Distance Function for Matching in Small Samples?," IWH Discussion Papers 3/2010, Halle Institute for Economic Research (IWH).
    8. Stefanie Behncke & Markus Frölich & Michael Lechner, 2010. "Unemployed and their caseworkers: should they be friends or foes?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(1), pages 67-92, January.
    9. Frölich, Markus & Huber, Martin & Wiesenfarth, Manuel, 2017. "The finite sample performance of semi- and non-parametric estimators for treatment effects and policy evaluation," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 91-102.
    10. Zhexiao Lin & Peng Ding & Fang Han, 2023. "Estimation Based on Nearest Neighbor Matching: From Density Ratio to Average Treatment Effect," Econometrica, Econometric Society, vol. 91(6), pages 2187-2217, November.
    11. Lenis, David & Ackerman, Benjamin & Stuart, Elizabeth A., 2018. "Measuring model misspecification: Application to propensity score methods with complex survey data," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 48-57.
    12. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The Effect of Firms' Partial Retirement Policies on the Labour Market Outcomes of Their Employees," IZA Discussion Papers 7513, Institute of Labor Economics (IZA).
    13. Janet Currie & Erdal Tekin, 2006. "Does Child Abuse Cause Crime?," NBER Working Papers 12171, National Bureau of Economic Research, Inc.
    14. Khundi, Fydess & Jagger, Pamela & Shively, Gerald & Sserunkuuma, Dick, 2011. "Income, poverty and charcoal production in Uganda," Forest Policy and Economics, Elsevier, vol. 13(3), pages 199-205, March.
    15. Behncke, Stefanie & Frölich, Markus & Lechner, Michael, 2008. "A Caseworker Like Me: Does the Similarity between Unemployed and Caseworker Increase Job Placements?," IZA Discussion Papers 3437, Institute of Labor Economics (IZA).
    16. Lechner, Michael, 2008. "Long-Run Labour Market Effects of Individual Sports Activities," IZA Discussion Papers 3559, Institute of Labor Economics (IZA).
    17. Bruno Arpino & Arnstein Aassve, 2013. "Estimating the causal effect of fertility on economic wellbeing: data requirements, identifying assumptions and estimation methods," Empirical Economics, Springer, vol. 44(1), pages 355-385, February.
    18. Mary Ying-Fang Wang & Paul Tuss & Lihong Qi, 2019. "Augmented Weighted Estimators Dealing with Practical Positivity Violation to Causal inferences in a Random Coefficient Model," Psychometrika, Springer;The Psychometric Society, vol. 84(2), pages 447-467, June.
    19. Michael Lechner & Blaise Melly, 2007. "Earnings Effects of Training Programs," University of St. Gallen Department of Economics working paper series 2007 2007-28, Department of Economics, University of St. Gallen.
    20. Michael Lechner & Conny Wunsch, 2009. "Are Training Programs More Effective When Unemployment Is High?," Journal of Labor Economics, University of Chicago Press, vol. 27(4), pages 653-692, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:reihed:v:61:y:2020:i:2:d:10.1007_s11162-019-09558-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.