IDEAS home Printed from https://ideas.repec.org/p/cor/louvco/2010046.html
   My bibliography  Save this paper

School system evaluation by value-added analysis under endogeneity

Author

Listed:
  • MANZI, Jorge

    (Measurement Center MIDE UC, Pontificia Universidad Católica de Chile, Chile)

  • SAN MARTIN, Ernesto

    (Measurement Center MIDE UC & Dep. Of Statistics, Pontificia Universidad Católica de Chile, Chile)

  • VAN BELLEGEM, Sébastien

    (Toulouse School of Economics, France; Université catholique de Louvain, CORE, B-1348 Louvain-la-Neuve, Belgium)

Abstract

Value-added analysis is a common tool in analysing school performances. In this paper, we analyse the SIMCE panel data which provides individual scores of about 200,000 students in Chile, and whose aim is to rank schools according to their educational achievement. Based on the data collection procedure and on empirical evidences, we argue that the exogeneity of some covariates is questionable. This means that a nonvanishing correlation appears between the school-specific effect and some covariates. We show the impact of this phenomenon on the calculation of the value-added and on the ranking, and provide an estimation method that is based on instrumental variables in order to correct the bias of endogeneity. Revisiting the definition of the value-added, we propose a new calculation robust to endogeneity that we illustrate on the SIMCE data.

Suggested Citation

  • MANZI, Jorge & SAN MARTIN, Ernesto & VAN BELLEGEM, Sébastien, 2010. "School system evaluation by value-added analysis under endogeneity," LIDAM Discussion Papers CORE 2010046, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    • Handle: RePEc:cor:louvco:2010046
    as

    Download full text from publisher

    File URL: https://sites.uclouvain.be/core/publications/coredp/coredp2010.html
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Joshua D. Angrist & Alan B. Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Journal of Economic Perspectives, American Economic Association, vol. 15(4), pages 69-85, Fall.
    2. Pierre-Philippe Combes & Thierry Mayer & Jacques-François Thisse, 2008. "Economic Geography: The Integration of Regions and Nations," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) hal-00311000, HAL.
    3. Rabah Amir, 2005. "Supermodularity and Complementarity in Economics: An Elementary Survey," Southern Economic Journal, John Wiley & Sons, vol. 71(3), pages 636-660, January.
    4. Peter Ebbes & Ulf Böckenholt & Michel Wedel, 2004. "Regressor and random‐effects dependencies in multilevel models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 58(2), pages 161-178, May.
    5. Hanushek, Eric A., 2006. "School Resources," Handbook of the Economics of Education, in: Erik Hanushek & F. Welch (ed.), Handbook of the Economics of Education, edition 1, volume 2, chapter 14, pages 865-908, Elsevier.
    6. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 1, number 1, June.
    7. Claudio Sapelli & Bernardita Vial, 2002. "The Performance of Private and Public Schools in the Chilean Voucher System," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 39(118), pages 423-454.
    8. Christopher F Baum, 2006. "An Introduction to Modern Econometrics using Stata," Stata Press books, StataCorp LP, number imeus, March.
    9. Fiona Steele & Anna Vignoles & Andrew Jenkins, 2007. "The effect of school resources on pupil attainment: a multilevel simultaneous equation modelling approach," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 170(3), pages 801-824, July.
    10. Jee-Seon Kim & Edward Frees, 2006. "Omitted Variables in Multilevel Models," Psychometrika, Springer;The Psychometric Society, vol. 71(4), pages 659-690, December.
    11. Huriot,Jean-Marie & Thisse,Jacques-François (ed.), 2009. "Economics of Cities," Cambridge Books, Cambridge University Press, number 9780521118279.
    12. Hendry, David F., 1995. "Dynamic Econometrics," OUP Catalogue, Oxford University Press, number 9780198283164.
    13. Paredes, Ricardo D. & Paredes, Valentina, 2009. "Chile: academic performance and educational management under a rigid employment regime," Revista CEPAL, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), December.
    14. Erik Hanushek & F. Welch (ed.), 2006. "Handbook of the Economics of Education," Handbook of the Economics of Education, Elsevier, edition 1, volume 2, number 2, June.
    15. Belleflamme,Paul & Peitz,Martin, 2015. "Industrial Organization," Cambridge Books, Cambridge University Press, number 9781107069978.
    16. Winfried Pohlmeier & Luc Bauwens & David Veredas, 2007. "High frequency financial econometrics. Recent developments," ULB Institutional Repository 2013/136223, ULB -- Universite Libre de Bruxelles.
    17. Jee-Seon Kim & Edward Frees, 2007. "Multilevel Modeling with Correlated Effects," Psychometrika, Springer;The Psychometric Society, vol. 72(4), pages 505-533, December.
    18. Luc Bauwens & Winfried Pohlmeier & David Veredas (ed.), 2008. "High Frequency Financial Econometrics," Studies in Empirical Economics, Springer, number 978-3-7908-1992-2, April.
    19. Harvey Goldstein & Sally Thomas, 1996. "Using Examination Results as Indicators of School and College Performance," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 159(1), pages 149-163, January.
    20. Joshua Angrist & Alan Krueger, 2001. "Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments," Working Papers 834, Princeton University, Department of Economics, Industrial Relations Section..
    21. Belleflamme,Paul & Peitz,Martin, 2015. "Industrial Organization," Cambridge Books, Cambridge University Press, number 9781107687899.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alejandro Carrasco & Ernesto San Mart’n, 2012. "Voucher system and school effectiveness: Reassessing school performance difference and parental choice decision-making," Estudios de Economia, University of Chile, Department of Economics, vol. 39(2 Year 20), pages 123-141, December.
    2. Vanhems, Anne & Van Keilegom, Ingrid, 2019. "Estimation Of A Semiparametric Transformation Model In The Presence Of Endogeneity," Econometric Theory, Cambridge University Press, vol. 35(1), pages 73-110, February.
    3. Jorge Manzi & Ernesto San Martín & Sébastien Van Bellegem, 2014. "School System Evaluation by Value Added Analysis Under Endogeneity," Psychometrika, Springer;The Psychometric Society, vol. 79(1), pages 130-153, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Johannes, Jan & Van Bellegem, Sébastien & Vanhems, Anne, 2010. "Iterative Regularization in Nonparametric Instrumental Regression," TSE Working Papers 10-184, Toulouse School of Economics (TSE).
    2. Jorge Manzi & Ernesto San Martín & Sébastien Van Bellegem, 2014. "School System Evaluation by Value Added Analysis Under Endogeneity," Psychometrika, Springer;The Psychometric Society, vol. 79(1), pages 130-153, January.
    3. Pierre Pestieau & Maria Racionero, 2015. "Tagging with leisure needs," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 45(4), pages 687-706, December.
    4. M.-L. Leroux & P. Pestieau, 2012. "The political economy of derived pension rights," International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 19(5), pages 753-776, October.
    5. Cremer, Helmuth & Gahvari, Firouz & Pestieau, Pierre, 2011. "Fertility, human capital accumulation, and the pension system," Journal of Public Economics, Elsevier, vol. 95(11), pages 1272-1279.
    6. Michel Le Breton & Juan Moreno-Ternero & Alexei Savvateev & Shlomo Weber, 2013. "Stability and fairness in models with a multiple membership," International Journal of Game Theory, Springer;Game Theory Society, vol. 42(3), pages 673-694, August.
    7. STEPHAN, Rüdiger, 2010. "An extension of disjunctive programming and its impact for compact tree formulations," LIDAM Discussion Papers CORE 2010045, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    8. Moreno-Ternero, Juan D., 2011. "Voting over piece-wise linear tax methods," Journal of Mathematical Economics, Elsevier, vol. 47(1), pages 29-36, January.
    9. Leroux, Marie-Louise & Ponthiere, Gregory, 2013. "Utilitarianism and unequal longevities: A remedy?," Economic Modelling, Elsevier, vol. 30(C), pages 888-899.
    10. Bréchet, Thierry & Jouvet, Pierre-André & Rotillon, Gilles, 2013. "Tradable pollution permits in dynamic general equilibrium: Can optimality and acceptability be reconciled?," Ecological Economics, Elsevier, vol. 91(C), pages 89-97.
    11. DI SUMMA, Marco & WOLSEY, Laurence, 2010. "Mixing sets linked by bidirected paths," LIDAM Discussion Papers CORE 2010063, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    12. LUTTENS, Roland Iwan, 2010. "Lower bounds rule!," LIDAM Discussion Papers CORE 2010069, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    13. GILLIS, Nicolas & GLINEUR, François, 2010. "On the geometric interpretation of the nonnegative rank," LIDAM Discussion Papers CORE 2010051, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    14. Florens, Jean-Pierre & Schwarz, Maik & Van Bellegem, Sébastien, 2010. "Nonparametric Frontier Estimation from Noisy Data," TSE Working Papers 10-179, Toulouse School of Economics (TSE).
    15. GABSZEWICZ, Jean & TAROLA, Ornella, 2010. "Product innovation and market acquisition of firms," LIDAM Discussion Papers CORE 2010078, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    16. Rombouts, Jeroen V.K. & Stentoft, Lars, 2015. "Option pricing with asymmetric heteroskedastic normal mixture models," International Journal of Forecasting, Elsevier, vol. 31(3), pages 635-650.
    17. MIYAGIWA, Kaz & SONG, Huasheng & VANDENBUSSCHE, Hylke, 2010. "Innovation, antidumping and retaliation," LIDAM Discussion Papers CORE 2010064, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    18. GILLIS, Nicolas & GLINEUR, François, 2010. "A multilevel approach for nonnegative matrix factorization," LIDAM Discussion Papers CORE 2010047, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    19. GILLIS, Nicolas & GLINEUR, François, 2010. "Low-rank matrix approximation with weights or missing data is NP-hard," LIDAM Discussion Papers CORE 2010075, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    20. A. Mauleon & Vincent Vannetelbosch & Cecilia Vergari, 2014. "Unions' Relative Concerns And Strikes In Wage Bargaining," Bulletin of Economic Research, Wiley Blackwell, vol. 66(4), pages 374-383, October.

    More about this item

    Keywords

    value-added; school effectiveness; multilevel model; endogeneity; instrumental variables;
    All these keywords.

    JEL classification:

    • C33 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Models with Panel Data; Spatio-temporal Models
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cor:louvco:2010046. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alain GILLIS (email available below). General contact details of provider: https://edirc.repec.org/data/coreebe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.