IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v73y2021ics0038012120307825.html
   My bibliography  Save this article

Public university orientation for high-school students. A quasi-experimental assessment of the efficiency gains from nudging better career choices

Author

Listed:
  • Cavalletti, Barbara
  • Corsi, Matteo
  • Persico, Luca
  • di Bella, Enrico

Abstract

We adopt a quasi-experimental approach to measure the causal effect, on first-year students in bachelor-level courses at the Department of Economics and Business Studies of the University of Genoa, Italy, of having been treated to a recently activated orientation program when they were high school seniors. Improvements are evaluated at the end of the first academic year in terms of grade point average (GPA), inactivity (failing to pass even a single exam) and number of successfully completed exams. Treatment effects on GPA are estimated both for the overall treatment group and for subsamples consisting of treated students with high and with low high school exit grades. After performing several sensitivity checks, a sizeable treatment effect is confirmed both in terms of inactivity and in terms of average GPA. No clear effect was found on the number of exams. Effects on GPA are considerably stronger on students with lower high school exit grades.

Suggested Citation

  • Cavalletti, Barbara & Corsi, Matteo & Persico, Luca & di Bella, Enrico, 2021. "Public university orientation for high-school students. A quasi-experimental assessment of the efficiency gains from nudging better career choices," Socio-Economic Planning Sciences, Elsevier, vol. 73(C).
    • Handle: RePEc:eee:soceps:v:73:y:2021:i:c:s0038012120307825
    DOI: 10.1016/j.seps.2020.100945
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012120307825
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.seps.2020.100945?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Massimiliano Bratti & Daniele Checchi & Guido De Blasio, 2008. "Does the Expansion of Higher Education Increase the Equality of Educational Opportunities? Evidence from Italy," LABOUR, CEIS, vol. 22(s1), pages 53-88, June.
    2. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.
    3. Jo Blanden, 2004. "Family Income and Educational Attainment: A Review of Approaches and Evidence for Britain," Oxford Review of Economic Policy, Oxford University Press, vol. 20(2), pages 245-263, Summer.
    4. Contini, Dalit & Tommaso, Maria Laura Di & Mendolia, Silvia, 2017. "The gender gap in mathematics achievement: Evidence from Italian data," Economics of Education Review, Elsevier, vol. 58(C), pages 32-42.
    5. Hendrik Jürges & Kerstin Schneider & Felix Büchel, 2005. "The Effect Of Central Exit Examinations On Student Achievement: Quasi-Experimental Evidence From TIMSS Germany," Journal of the European Economic Association, MIT Press, vol. 3(5), pages 1134-1155, September.
    6. Bandiera, Oriana & Larcinese, Valentino & Rasul, Imran, 2015. "Blissful ignorance? A natural experiment on the effect of feedback on students' performance," Labour Economics, Elsevier, vol. 34(C), pages 13-25.
    7. Tommaso Nannicini, 2007. "Simulation-based sensitivity analysis for matching estimators," Stata Journal, StataCorp LP, vol. 7(3), pages 334-350, September.
    8. Ryan Bosworth, 2014. "Class size, class composition, and the distribution of student achievement," Education Economics, Taylor & Francis Journals, vol. 22(2), pages 141-165, April.
    9. Dronkers, Jaap & Avram, S, 2009. "A cross-national analysis of the relations between school choice and effectiveness differences between private-dependent and public schools," MPRA Paper 23911, University Library of Munich, Germany.
    10. Giorgio Brunello & Lorenzo Rocco, 2008. "Educational Standards in Private and Public Schools," Economic Journal, Royal Economic Society, vol. 118(533), pages 1866-1887, November.
    11. William H. Sewell & Robert M. Hauser, 1972. "Causes and Consequences of Higher Edueation: Models of the Status Attainment Process," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 54(5), pages 851-861.
    12. Philip Oreopoulos & Uros Petronijevic, 2018. "Student Coaching: How Far Can Technology Go?," Journal of Human Resources, University of Wisconsin Press, vol. 53(2), pages 299-329.
    13. Christopher Avery, 2013. "Evaluation of the College Possible Program: Results from a Randomized Controlled Trial," NBER Working Papers 19562, National Bureau of Economic Research, Inc.
    14. Arpino, Bruno & Mealli, Fabrizia, 2011. "The specification of the propensity score in multilevel observational studies," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1770-1780, April.
    15. Lucio Masserini & Matilde Bini & Monica Pratesi, 2017. "Effectiveness of non-selective evaluation test scores for predicting first-year performance in university career: a zero-inflated beta regression approach," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(2), pages 693-708, March.
    16. Page, Lindsay C. & Scott-Clayton, Judith, 2016. "Improving college access in the United States: Barriers and policy responses," Economics of Education Review, Elsevier, vol. 51(C), pages 4-22.
    17. Leonardo Grilli & Fabrizia Mealli, 2008. "Nonparametric Bounds on the Causal Effect of University Studies on Job Opportunities Using Principal Stratification," Journal of Educational and Behavioral Statistics, , vol. 33(1), pages 111-130, March.
    18. Zhang, Junni L. & Rubin, Donald B. & Mealli, Fabrizia, 2009. "Likelihood-Based Analysis of Causal Effects of Job-Training Programs Using Principal Stratification," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 166-176.
    19. Kerr, Sari Pekkala & Pekkarinen, Tuomas & Sarvimäki, Matti & Uusitalo, Roope, 2020. "Post-secondary education and information on labor market prospects: A randomized field experiment," Labour Economics, Elsevier, vol. 66(C).
    20. Michaéla C Schippers & Ad W A Scheepers & Jordan B Peterson, 2015. "A scalable goal-setting intervention closes both the gender and ethnic minority achievement gap," Palgrave Communications, Palgrave Macmillan, vol. 1(palcomms2), pages 15014-15014, June.
    21. Benjamin L. Castleman & Lindsay C. Page, 2016. "Freshman Year Financial Aid Nudges: An Experiment to Increase FAFSA Renewal and College Persistence," Journal of Human Resources, University of Wisconsin Press, vol. 51(2), pages 389-415.
    22. Gordon C. Winston, 1999. "Subsidies, Hierarchy and Peers: The Awkward Economics of Higher Education," Journal of Economic Perspectives, American Economic Association, vol. 13(1), pages 13-36, Winter.
    23. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    24. By Vincenzo Carrieri & Marcello D’Amato & Roberto Zotti, 2015. "On the causal effects of selective admission policies on students’ performances: evidence from a quasi-experiment in a large Italian university," Oxford Economic Papers, Oxford University Press, vol. 67(4), pages 1034-1056.
    25. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
    26. Peter, Frauke H. & Zambre, Vaishali, 2017. "Intended college enrollment and educational inequality: Do students lack information?," Economics of Education Review, Elsevier, vol. 60(C), pages 125-141.
    27. Caroline M. Hoxby, 2000. "The Effects of Class Size on Student Achievement: New Evidence from Population Variation," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 115(4), pages 1239-1285.
    28. Scott Carrell & Bruce Sacerdote, 2017. "Why Do College-Going Interventions Work?," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 124-151, July.
    29. Karen Jeong Robinson & Josipa Roksa, 2016. "Counselors, Information, and High School College-Going Culture: Inequalities in the College Application Process," Research in Higher Education, Springer;Association for Institutional Research, vol. 57(7), pages 845-868, November.
    30. De Paola, Maria & Scoppa, Vincenzo, 2015. "Procrastination, academic success and the effectiveness of a remedial program," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 217-236.
    31. Craig Holmes & Ken Mayhew, 2016. "The economics of higher education," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 32(4), pages 475-496.
    32. Philip Oreopoulos & Reuben Ford, 2019. "Keeping College Options Open: A Field Experiment to Help all High School Seniors Through the College Application Process," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 38(2), pages 426-454, March.
    33. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    34. French, Robert & Oreopoulos, Philip, 2017. "Behavioral barriers transitioning to college," Labour Economics, Elsevier, vol. 47(C), pages 48-63.
    35. Aina, Carmen & Baici, Eliana & Casalone, Giorgia & Pastore, Francesco, 2018. "The economics of university dropouts and delayed graduation: a survey," GLO Discussion Paper Series 189, Global Labor Organization (GLO).
    36. Ryan Bosworth, 2014. "Class size, class composition, and the distribution of student achievement," Education Economics, Taylor & Francis Journals, vol. 22(2), pages 141-165, April.
    37. Pistolesi, Nicolas, 2017. "Advising students on their field of study: Evidence from a French University reform," Labour Economics, Elsevier, vol. 44(C), pages 106-121.
    38. Belman, Dale & Heywood, John S, 1991. "Sheepskin Effects in the Returns to Education: An Examination on Women and Minorities," The Review of Economics and Statistics, MIT Press, vol. 73(4), pages 720-724, November.
    39. Løken, Katrine V., 2010. "Family income and children's education: Using the Norwegian oil boom as a natural experiment," Labour Economics, Elsevier, vol. 17(1), pages 118-129, January.
    40. Christopher Avery, 2010. "The Effects of College Counseling on High-Achieving, Low-Income Students," NBER Working Papers 16359, National Bureau of Economic Research, Inc.
    41. Jaeger, David A & Page, Marianne E, 1996. "Degrees Matter: New Evidence on Sheepskin Effects in the Returns to Education," The Review of Economics and Statistics, MIT Press, vol. 78(4), pages 733-740, November.
    42. Dalit Contini & Andrea Scagni, 2011. "Inequality of opportunity in secondary school enrolment in Italy, Germany and the Netherlands," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(2), pages 441-464, February.
    43. Herber, Stefanie P., 2018. "The role of information in the application for highly selective scholarships: Evidence from a randomized field experiment," Economics of Education Review, Elsevier, vol. 62(C), pages 287-301.
    44. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    45. Foote, Andrew & Schulkind, Lisa & Shapiro, Teny M., 2015. "Missed signals: The effect of ACT college-readiness measures on post-secondary decisions," Economics of Education Review, Elsevier, vol. 46(C), pages 39-51.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Damgaard, Mette Trier & Nielsen, Helena Skyt, 2018. "Nudging in education," Economics of Education Review, Elsevier, vol. 64(C), pages 313-342.
    2. Peter, Frauke & Spiess, C. Katharina & Zambre, Vaishali, 2021. "Informing students about college: Increasing enrollment using a behavioral intervention?," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 524-549.
    3. repec:hal:spmain:info:hdl:2441/527ht1a96e837pq2dubgo2953q is not listed on IDEAS
    4. Estelle Herbaut & Koen Geven, 2019. "What Works to Reduce Inequalities in Higher Education? A Systematic Review of the (Quasi-)Experimental Literature on Outreach and Financial Aid," Sciences Po publications info:hdl:2441/527ht1a96e8, Sciences Po.
    5. Estelle Herbaut & Koen Geven, 2019. "What Works to Reduce Inequalities in Higher Education? A Systematic Review of the (Quasi-)Experimental Literature on Outreach and Financial Aid," SciencePo Working papers Main hal-03456943, HAL.
    6. Estelle Herbaut & Koen Geven, 2019. "What Works to Reduce Inequalities in Higher Education? A Systematic Review of the (Quasi-)Experimental Literature on Outreach and Financial Aid," Working Papers hal-03456943, HAL.
    7. French, Robert & Oreopoulos, Philip, 2017. "Behavioral barriers transitioning to college," Labour Economics, Elsevier, vol. 47(C), pages 48-63.
    8. Ballarino, Gabriele & Filippin, Antonio & Abbiati, Giovanni & Argentin, Gianluca & Barone, Carlo & Schizzerotto, Antonio, 2022. "The effects of an information campaign beyond university enrolment: A large-scale field experiment on the choices of high school students," Economics of Education Review, Elsevier, vol. 91(C).
    9. Meredith Phillips & Sarah J. Reber, 2019. "Does Virtual Advising Increase College Enrollment? Evidence from a Random Assignment College Access Field Experiment," NBER Working Papers 26509, National Bureau of Economic Research, Inc.
    10. Joshua Hyman, 2018. "Nudges, College Enrollment, and College Persistence: Evidence From a Statewide Experiment in Michigan," Working papers 2018-10, University of Connecticut, Department of Economics.
    11. Andrea Mercatanti & Fan Li, 2017. "Do debit cards decrease cash demand?: causal inference and sensitivity analysis using principal stratification," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(4), pages 759-776, August.
    12. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.
    13. Cheng Yuan & Xiaoxiao Wang & Li Lin, 2023. "Why Do Financially Illiterate Students Perceive Lower Education Returns? Evidence From a Survey in Rural China," SAGE Open, , vol. 13(2), pages 21582440231, June.
    14. Bonilla-Mejía, Leonardo & Bottan, Nicolas L. & Ham, Andrés, 2019. "Information policies and higher education choices experimental evidence from Colombia," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 83(C).
    15. Oreopoulos, Philip & Petronijevic, Uros & Logel, Christine & Beattie, Graham, 2020. "Improving non-academic student outcomes using online and text-message coaching," Journal of Economic Behavior & Organization, Elsevier, vol. 171(C), pages 342-360.
    16. Jan Berkes & Frauke Peter & C. Katharina Spiess & Felix Weinhardt, 2022. "Information Provision and Postgraduate Studies," Economica, London School of Economics and Political Science, vol. 89(355), pages 627-646, July.
    17. Bird, Kelli A. & Castleman, Benjamin L. & Denning, Jeffrey T. & Goodman, Joshua & Lamberton, Cait & Rosinger, Kelly Ochs, 2021. "Nudging at scale: Experimental evidence from FAFSA completion campaigns," Journal of Economic Behavior & Organization, Elsevier, vol. 183(C), pages 105-128.
    18. Frauke H. Peter & C. Katharina Spieß & Vaishali Zambre, 2018. "Informing Students about College: An Efficient Way to Decrease the Socio-Economic Gap in Enrollment: Evidence from a Randomized Field Experiment," Discussion Papers of DIW Berlin 1770, DIW Berlin, German Institute for Economic Research.
    19. Renée, Laëtitia, 2022. "The long-term effects of financial aid and career education: Evidence from a randomized experiment," CLEF Working Paper Series 46, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    20. Olivier Dagnelie & Philippe Lemay‐Boucher, 2012. "Rosca Participation in Benin: A Commitment Issue," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 235-252, April.
    21. Caloffi, Annalisa & Freo, Marzia & Ghinoi, Stefano & Mariani, Marco & Rossi, Federica, 2022. "Assessing the effects of a deliberate policy mix: The case of technology and innovation advisory services and innovation vouchers," Research Policy, Elsevier, vol. 51(6).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:73:y:2021:i:c:s0038012120307825. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.