IDEAS home Printed from https://ideas.repec.org/p/ucl/cepeow/20-14.html
   My bibliography  Save this paper

Grade Expectations: How well can we predict future grades based on past performance?

Author

Listed:
  • Jake Anders

    (Centre for Education Policy and Equalising Opportunities, UCL Institute of Education, University College London)

  • Catherine Dilnot

    (Oxford Brookes Business School)

  • Lindsey Macmillan

    (Centre for Education Policy and Equalising Opportunities, UCL Institute of Education, University College London)

  • Gill Wyness

    (Centre for Education Policy and Equalising Opportunities, UCL Institute of Education, University College London)

Abstract

The Covid-19 pandemic has led to unprecedented disruption of England's education system, including the cancellation of all formal examination. Instead of sitting exams, the class of 2020 will be assigned "calculated grades" based on predictions by their teachers. However, teacher predictions of pupil grades are a common feature of the English education system, with such predictions forming the basis of university applications in normal years. But previous research has shown these predictions are highly inaccurate, creating concern for teachers, pupils and parents. In this paper, we ask whether it is possible to improve on teachers' predictions, using detailed measures of pupils' past performance and non-linear and machine learning approaches. Despite lacking their informal knowledge, we can make modest improvements on the accuracy of teacher predictions with our models, with around 1 in 4 pupils being correctly predicted. We show that predictions are improved where we have information on 'related' GCSEs. We also find heterogeneity in the ability to predict successfully, according to student achievement, school type and subject of study. Notably, high achieving non-selective state school pupils are more likely to be under-predicted compared to their selective state and private school counterparts. Overall, the low rates of prediction, regardless of the approach taken, raises the question as to why predicted grades form such a crucial part of our education system.

Suggested Citation

  • Jake Anders & Catherine Dilnot & Lindsey Macmillan & Gill Wyness, 2020. "Grade Expectations: How well can we predict future grades based on past performance?," CEPEO Working Paper Series 20-14, UCL Centre for Education Policy and Equalising Opportunities, revised Aug 2020.
  • Handle: RePEc:ucl:cepeow:20-14
    as

    Download full text from publisher

    File URL: https://repec-cepeo.ucl.ac.uk/cepeow/cepeowp20-14.pdf
    File Function: First version, 2020
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Richard Murphy & Gill Wyness, 2020. "Minority report: the impact of predicted grades on university admissions of disadvantaged groups," Education Economics, Taylor & Francis Journals, vol. 28(4), pages 333-350, July.
    2. Haroon Chowdry & Claire Crawford & Lorraine Dearden & Alissa Goodman & Anna Vignoles, 2013. "Widening participation in higher education: analysis using linked administrative data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(2), pages 431-457, February.
    3. Claire Crawford, 2014. "Socio-economic differences in university outcomes in the UK: drop-out, degree completion and degree class," IFS Working Papers W14/31, Institute for Fiscal Studies.
    4. Simon Burgess & Ellen Greaves, 2013. "Test Scores, Subjective Assessment, and Stereotyping of Ethnic Minorities," Journal of Labor Economics, University of Chicago Press, vol. 31(3), pages 535-576.
    5. Rebecca Diamond & Petra Persson, 2016. "The Long-term Consequences of Teacher Discretion in Grading of High-stakes Tests," NBER Working Papers 22207, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gill Wyness, 2021. "Should we abolish GCSEs?," CEPEO Briefing Note Series 14, UCL Centre for Education Policy and Equalising Opportunities, revised Aug 2021.
    2. Gill Wyness, 2020. "Higher education applications and admissions," CEPEO Briefing Note Series 7, UCL Centre for Education Policy and Equalising Opportunities, revised Aug 2020.
    3. Jake Anders & Lindsey Macmillan & Patrick Sturgis & Gill Wyness, 2021. "Inequalities in young peoples' educational experiences and wellbeing during the Covid-19 pandemic," CEPEO Working Paper Series 21-08, UCL Centre for Education Policy and Equalising Opportunities, revised Jul 2021.
    4. Jake Anders, 2020. "How should universities select students?," CEPEO Briefing Note Series 8, UCL Centre for Education Policy and Equalising Opportunities, revised Nov 2020.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fumagalli, Laura & Rabe, Birgitta & Burn, Hettie, 2023. "Teacher grade predictions for ethnic minority groups: evidence from England," ISER Working Paper Series 2023-03, Institute for Social and Economic Research.
    2. Erich Battistin & Lorenzo Neri, 2017. "School Performance, Score Inflation and Economic Geography," Working Papers 837, Queen Mary University of London, School of Economics and Finance.
    3. Judith M. Delaney & Paul J. Devereux, 2020. "How Gender and Prior Disadvantage Predict Performance in College," The Economic and Social Review, Economic and Social Studies, vol. 51(2), pages 189-239.
    4. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    5. Cornelisz, Ilja & Meeter, Martijn & van Klaveren, Chris, 2019. "Educational equity and teacher discretion effects in high stake exams," Economics of Education Review, Elsevier, vol. 73(C).
    6. Foliano, Francesca & Green, Francis & Sartarelli, Marcello, 2019. "Away from home, better at school. The case of a British boarding school," Economics of Education Review, Elsevier, vol. 73(C).
    7. Stans, Renske A., 2022. "Short-run shock, long-run consequences? The impact of grandparental death on educational outcomes," Economics of Education Review, Elsevier, vol. 91(C).
    8. Ferman, Bruno & Fontes, Luiz Felipe, 2020. "Discriminating Behavior: Evidence from teachers’ grading bias," MPRA Paper 100400, University Library of Munich, Germany.
    9. Ferman, Bruno & Fontes, Luiz Felipe, 2022. "Assessing knowledge or classroom behavior? Evidence of teachers’ grading bias," Journal of Public Economics, Elsevier, vol. 216(C).
    10. Terrier, Camille, 2020. "Boys lag behind: How teachers’ gender biases affect student achievement," Economics of Education Review, Elsevier, vol. 77(C).
    11. Adamecz-Völgyi, Anna & Henderson, Morag & Shure, Nikki, 2020. "Is ‘first in family’ a good indicator for widening university participation?," Economics of Education Review, Elsevier, vol. 78(C).
    12. Maragkou, Konstantina, 2020. "Socio-economic inequality and academic match among post-compulsory education participants," Economics of Education Review, Elsevier, vol. 79(C).
    13. Lisa Meehan & Gail Pacheco & Zoe Pushon, 2017. "Explaining ethnic disparities in bachelor's qualifications: Participation, retention and completion in NZ," Working Papers 2017/01, New Zealand Productivity Commission.
    14. Oliver Anderson, 2023. "Walking the line: Does crossing a high-stakes exam threshold matter for labor market outcomes?," French Stata Users' Group Meetings 2023 01, Stata Users Group.
    15. Battaglia, Marianna & Lebedinski, Lara, 2022. "With a little help from my friends: Medium-Term effects of a remedial education program targeting Roma minority," Economics of Education Review, Elsevier, vol. 86(C).
    16. Burgess, Simon & Hauberg, Daniel Sloth & Rangvid, Beatrice Schindler & Sievertsen, Hans Henrik, 2022. "The importance of external assessments: High school math and gender gaps in STEM degrees," Economics of Education Review, Elsevier, vol. 88(C).
    17. Oliver Anderson, 2022. "Walking the line: Does crossing a high stakes exam threshold matter for labour market outcomes?," CEPEO Working Paper Series 22-05, UCL Centre for Education Policy and Equalising Opportunities, revised Apr 2022.
    18. Simon Burgess & Claire Crawford & Lindsey Macmillan, 2017. "Assessing the role of grammar schools in promoting social mobility," DoQSS Working Papers 17-09, Quantitative Social Science - UCL Social Research Institute, University College London.
    19. Lisa Meehan & Gail Pacheco & Zoe Pushon, 2017. "Explaining ethnic disparities in bachelor’s degree participation: Evidence from NZ," Working Papers 2017-03, Auckland University of Technology, Department of Economics.
    20. Homonoff, Tatiana & Spreen, Thomas Luke & St. Clair, Travis, 2020. "Balance sheet insolvency and contribution revenue in public charities," Journal of Public Economics, Elsevier, vol. 186(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ucl:cepeow:20-14. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jake Anders (email available below). General contact details of provider: https://edirc.repec.org/data/epucluk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.