IDEAS home Printed from https://ideas.repec.org/p/sza/wpaper/wpapers372.html
   My bibliography  Save this paper

What lies behind South Africa's improvements in PIRLS? An Oaxaca-Blinder analysis of the 2011 and 2016 data

Author

Listed:
  • Martin Gustafsson

    (ReSEP, Stellenbosch University and Department of Basic Education)

  • Stephen Taylor

    (Stellenbosch University and Department of Basic Education)

Abstract

Three international testing programmes, including PIRLS, point to educational quality improvements in South Africa during the period 2002 to 2019. The gains were substantial, relative to the steepness of improvements seen in other countries. What lay behind these trends? National education quality trends are not easy to explain, and this is seldom attempted in a systematic manner. This is in part because there is little guidance on the optimal methods to follow, methods which must inevitably employ a mix of statistical and non-statistical approaches. This paper offers a brief historical account of major policy and implementation shifts in South Africa's schooling sector, with a focus on the primary level, the level tested by PIRLS. A statistical analysis then employs an Oaxaca-Blinder decomposition, using the PIRLS 2011 and 2016 data in an attempt to identify factors that explain the improvement in reading scores between the two surveys. While this technique adds value to the analysis, there are serious limitations relating to missing values in the background questionnaire data and the fact that these questionnaires are international, and thus do not capture many local policy specificities. When viewed jointly, the historical account and statistical analysis point to improvements in the home background circumstances of learners, including more educated adults and increased access to digital technologies, playing an important role. Certain policy interventions are likely to have played an important role: a large expansion of participation in pre-school education; an increased focus on learning outcomes prompted in part by standardised national assessments; improved initial teacher education; increased provision and use of books in classrooms; and curriculum reforms.

Suggested Citation

  • Martin Gustafsson & Stephen Taylor, 2022. "What lies behind South Africa's improvements in PIRLS? An Oaxaca-Blinder analysis of the 2011 and 2016 data," Working Papers 02/2022, Stellenbosch University, Department of Economics.
  • Handle: RePEc:sza:wpaper:wpapers372
    as

    Download full text from publisher

    File URL: https://www.ekon.sun.ac.za/wpapers/2022/wp022022/wp022022.pdf
    File Function: First version, 2022
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Barrera-Osorio, F. & García-Moreno, V. & Patrinos, H., & Porta, E., 2011. "Using the Oaxaca-Blinder Decomposition Technique to Analyze Learning Outcomes Changes over Time: An Application to Indonesia’s Results in PISA Mathematics," Regional and Sectoral Economic Studies, Euro-American Association of Economic Development, vol. 11(3).
    2. Ben Jann, 2008. "The Blinder–Oaxaca decomposition for linear regression models," Stata Journal, StataCorp LP, vol. 8(4), pages 453-479, December.
    3. World Bank, 2012. "Learning Outcomes in Thailand : What Can We Learn from International Assessments?," World Bank Publications - Reports 2723, The World Bank Group.
    4. Martin Gustafsson & Stephen Taylor, 2018. "Treating Schools to a New Administration: Evidence of the Impact of Better Practices in the System-Level Administration of Schools," Journal of African Economies, Centre for the Study of African Economies, vol. 27(5), pages 515-537.
    5. Eduardo Pol, 2013. "Causality in Economics: A Menu of Approaches," Journal of Reviews on Global Economics, Lifescience Global, vol. 2, pages 356-374.
    6. José M. Cordero & Víctor Cristóbal & Daniel Santín, 2018. "Causal Inference On Education Policies: A Survey Of Empirical Studies Using Pisa, Timss And Pirls," Journal of Economic Surveys, Wiley Blackwell, vol. 32(3), pages 878-915, July.
    7. Gabrielle Wills, 2020. "Teachers’ unions and industrial action in South African primary schools: Exploring their impacts on learning," Development Southern Africa, Taylor & Francis Journals, vol. 37(2), pages 328-347, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Juan F. Castro, 2015. "Linear decompositions of cognitive achievement gaps a cautionary note and an illustration using peruvian data," Working Papers 15-08, Centro de Investigación, Universidad del Pacífico.
    2. Fernandez-Dominguez Amilcar Orlian, 2020. "Effect of Actual and Perceived Violence on Internal Migration: Evidence from Mexico’s Drug War," IZA Journal of Development and Migration, Sciendo & Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 11(1), pages 1-27, January.
    3. Valentina S. Consiglio & Denisa M. Sologon, 2022. "The Myth of Equal Opportunity in Germany? Wage Inequality and the Role of (Non-)academic Family Background for Differences in Capital Endowments and Returns on the Labour Market," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 159(2), pages 455-493, January.
    4. Valentina S. Consiglio & Denisa M. Sologon, 2019. "The Myth of Equal Opportunity in Germany?," SOEPpapers on Multidisciplinary Panel Data Research 1060, DIW Berlin, The German Socio-Economic Panel (SOEP).
    5. Thomas Y. Mathä & Alessandro Porpiglia & Michael Ziegelmeyer, 2014. "Wealth differences across borders and the effect of real estate price dynamics: Evidence from two household surveys," BCL working papers 90, Central Bank of Luxembourg.
    6. Marco Caliendo & Frank M. Fossen & Alexander Kritikos & Miriam Wetter, 2015. "The Gender Gap in Entrepreneurship: Not just a Matter of Personality," CESifo Economic Studies, CESifo, vol. 61(1), pages 202-238.
    7. Ashwini Deshpande & Rajesh Ramachandran, 2013. "How Backward are the Other Backward Classes? Changing Contours of Caste Disadvantage in India," Working Papers id:5422, eSocialSciences.
    8. Huong Thu Le & Ha Trong Nguyen, 2018. "The evolution of the gender test score gap through seventh grade: new insights from Australia using unconditional quantile regression and decomposition," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 7(1), pages 1-42, December.
    9. Cowan, Benjamin & Schwab, Benjamin, 2016. "Employer-sponsored health insurance and the gender wage gap," Journal of Health Economics, Elsevier, vol. 45(C), pages 103-114.
    10. Derek Headey & David Stifel & Liangzhi You & Zhe Guo, 2018. "Remoteness, urbanization, and child nutrition in sub‐Saharan Africa," Agricultural Economics, International Association of Agricultural Economists, vol. 49(6), pages 765-775, November.
    11. Bethelhem Legesse Debela, 2017. "Factors Affecting Differences in Livestock Asset Ownership Between Male- and Female-Headed Households in Northern Ethiopia," The European Journal of Development Research, Palgrave Macmillan;European Association of Development Research and Training Institutes (EADI), vol. 29(2), pages 328-347, April.
    12. Daniel A. Dias & Carlos Robalo Marques & Christine Richmond, 2020. "A Tale of Two Sectors: Why is Misallocation Higher in Services than in Manufacturing?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 66(2), pages 361-393, June.
    13. Kilic, Talip & Palacios-López, Amparo & Goldstein, Markus, 2015. "Caught in a Productivity Trap: A Distributional Perspective on Gender Differences in Malawian Agriculture," World Development, Elsevier, vol. 70(C), pages 416-463.
    14. Brahim Boudarbat & Marie Connolly, 2013. "The gender wage gap among recent post‐secondary graduates in Canada: a distributional approach," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 46(3), pages 1037-1065, August.
    15. Adam Pilny, 2017. "Explaining Differentials in Subsidy Levels Among Hospital Ownership Types in Germany," Health Economics, John Wiley & Sons, Ltd., vol. 26(5), pages 566-581, May.
    16. Tymon Słoczyński, 2015. "The Oaxaca–Blinder Unexplained Component as a Treatment Effects Estimator," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(4), pages 588-604, August.
    17. Montse Gomendio, 2023. "The Level of Skills in Spain: How to Solve the Puzzle using International Surveys," Studies on the Spanish Economy eee2023-35, FEDEA.
    18. Silvia Vannutelli & Sergio Scicchitano & Marco Biagetti, 2022. "Routine-biased technological change and wage inequality: do workers’ perceptions matter?," Eurasian Business Review, Springer;Eurasia Business and Economics Society, vol. 12(3), pages 409-450, September.
    19. Bachmann, Ronald & Martinez Flores, Fernanda & Rulff, Christian, 2022. "Die Lohnlücke in der Zeitarbeit: Eine empirische Analyse auf Grundlage von BA-Daten und der Verdienststrukturerhebung," RWI Projektberichte, RWI - Leibniz-Institut für Wirtschaftsforschung, number 262219.
    20. Sánchez-Jabba, Andrés Mauricio, 2014. "Etnia y rendimiento académico en Colombia," Chapters, in: Sánchez Jabba, Andrés & Otero Cortés, Andrea (ed.), Educación y desarrollo regional en Colombia, chapter 2, pages 59-100, Banco de la Republica de Colombia.

    More about this item

    Keywords

    PIRLS; educational improvement; Oaxaca-Blinder; South Africa;
    All these keywords.

    JEL classification:

    • B50 - Schools of Economic Thought and Methodology - - Current Heterodox Approaches - - - General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sza:wpaper:wpapers372. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Melt van Schoor (email available below). General contact details of provider: https://edirc.repec.org/data/desunza.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.