IDEAS home Printed from https://ideas.repec.org/a/pal/jorsoc/v61y2010i7d10.1057_jors.2009.85.html
   My bibliography  Save this article

Analysis of complementary methodologies for the estimation of school value added

Author

Listed:
  • M C A S Portela

    (Universidade Católica Portuguesa)

  • A S Camanho

    (Faculdade de Engenharia, Universidade do Porto)

Abstract

This paper analyses the value added (VA) of a sample of Portuguese schools using two methodologies: data envelopment analysis (DEA) and the methodology used presently by the UK Department for Children, Schools and Families (DCSF). The VA estimates obtained by the two methods are substantially different. This reflects their different focus: DEA emphasizes on best-observed performance, whereas the DCSF method reveals average performance. The main advantage of the methodology used by the DCSF is its simplicity, although it confounds pupil effects with school effects in the estimation of school VA. In contrast, the DEA methodology can differentiate these effects, but the complexity may prevent its use in a systematic way. This paper shows that the two methods provide complementary information regarding the VA of schools, and their joint use can improve the understanding of the relative effectiveness of schools regarding the progress that pupils make between educational stages.

Suggested Citation

  • M C A S Portela & A S Camanho, 2010. "Analysis of complementary methodologies for the estimation of school value added," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 61(7), pages 1122-1132, July.
  • Handle: RePEc:pal:jorsoc:v:61:y:2010:i:7:d:10.1057_jors.2009.85
    DOI: 10.1057/jors.2009.85
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/jors.2009.85
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1057/jors.2009.85?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Banker, Rajiv D. & Janakiraman, Surya & Natarajan, Ram, 2004. "Analysis of trends in technical and allocative efficiency: An application to Texas public school districts," European Journal of Operational Research, Elsevier, vol. 154(2), pages 477-491, April.
    2. Silva Portela, Maria Conceicao A. & Thanassoulis, Emmanuel, 2001. "Decomposing school and school-type efficiency," European Journal of Operational Research, Elsevier, vol. 132(2), pages 357-373, July.
    3. Andrew Worthington, 2001. "An Empirical Survey of Frontier Efficiency Measurement Techniques in Education," Education Economics, Taylor & Francis Journals, vol. 9(3), pages 245-268.
    4. Bradley, Steve & Johnes, Geraint & Millington, Jim, 2001. "The effect of competition on the efficiency of secondary schools in England," European Journal of Operational Research, Elsevier, vol. 135(3), pages 545-568, December.
    5. D J Mayston, 2003. "Measuring and managing educational performance," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 54(7), pages 679-691, July.
    6. Eric A. Hanushek & Lori L. Taylor, 1990. "Alternative Assessments of the Performance of Schools: Measurement of State Variations in Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 25(2), pages 179-201.
    7. Meyer, Robert H., 1997. "Value-added indicators of school performance: A primer," Economics of Education Review, Elsevier, vol. 16(3), pages 283-301, June.
    8. Primont, Diane F. & Domazlicky, Bruce, 2006. "Student achievement and efficiency in Missouri schools and the No Child Left Behind Act," Economics of Education Review, Elsevier, vol. 25(1), pages 77-90, February.
    9. Kirjavainen, Tanja & Loikkanent, Heikki A., 1998. "Efficiency differences of finnish senior secondary schools: An application of DEA and Tobit analysis," Economics of Education Review, Elsevier, vol. 17(4), pages 377-394, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    2. Silva, Maria Conceição A., 2018. "Output-specific inputs in DEA: An application to courts of justice in Portugal," Omega, Elsevier, vol. 79(C), pages 43-53.
    3. Aparicio, Juan & López-Torres, Laura & Santín, Daniel, 2018. "Economic crisis and public education. A productivity analysis using a Hicks-Moorsteen index," Economic Modelling, Elsevier, vol. 71(C), pages 34-44.
    4. Azar, Paola & Sicilia, Gabriela, 2023. "Assessing potential improvement in education: Unravelling pupils' and schools’ inefficiencies using a multi-level metafrontier approach," Economic Modelling, Elsevier, vol. 118(C).
    5. Morais, Paulo & Camanho, Ana S., 2011. "Evaluation of performance of European cities with the aim to promote quality of life improvements," Omega, Elsevier, vol. 39(4), pages 398-409, August.
    6. Silva, Pedro Luís & DesJardins, Stephen L. & Biscaia, Ricardo & Sá, Carla & Teixeira, Pedro N., 2023. "Public and Private School Grade Inflations Patterns in Secondary Education," IZA Discussion Papers 16016, Institute of Labor Economics (IZA).
    7. Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2013. "A multilevel decomposition of school performance using robust nonparametric frontier techniques," Economics of Education Review, Elsevier, vol. 32(C), pages 104-121.
    8. Camanho, Ana S. & Varriale, Luisa & Barbosa, Flávia & Sobral, Thiago, 2021. "Performance assessment of upper secondary schools in Italian regions using a circular pseudo-Malmquist index," European Journal of Operational Research, Elsevier, vol. 289(3), pages 1188-1208.
    9. Henriques, C.O. & Marcenaro-Gutierrez, O.D., 2021. "Efficiency of secondary schools in Portugal: A novel DEA hybrid approach," Socio-Economic Planning Sciences, Elsevier, vol. 74(C).
    10. Johnes, Jill, 2015. "Operational Research in education," European Journal of Operational Research, Elsevier, vol. 243(3), pages 683-696.
    11. Silva, Maria C.A. & Camanho, Ana S. & Barbosa, Flávia, 2020. "Benchmarking of secondary schools based on Students’ results in higher education," Omega, Elsevier, vol. 95(C).
    12. M. Portela & A. Camanho & A. Keshvari, 2013. "Assessing the evolution of school performance and value-added: trends over four years," Journal of Productivity Analysis, Springer, vol. 39(1), pages 1-14, February.
    13. Maria Conceição Portela, 2016. "Output-specific inputs in DEA: an application to courts," Working Papers de Gestão (Management Working Papers) 02, Católica Porto Business School, Universidade Católica Portuguesa.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    2. M. C. Portela & A. S. Camanho, 2007. "Performance Assessment of Portuguese Secondary Schools," Working Papers de Economia (Economics Working Papers) 07, Católica Porto Business School, Universidade Católica Portuguesa.
    3. Tommaso Agasisti, 2014. "How does schools’ efficiency look like across Europe? An empirical analysis of Germany, Spain, France, Italy and UK using OECD PISA2012 data," Working papers 9, Società Italiana di Economia Pubblica.
    4. M J Mancebón & M A Muñiz, 2008. "Private versus public high schools in Spain: disentangling managerial and programme efficiencies," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(7), pages 892-901, July.
    5. K. Kounetas & G. Androulakis & M. Kaisari & G. Manousakis, 2023. "Educational reforms and secondary school's efficiency performance in Greece: a bootstrap DEA and multilevel approach," Operational Research, Springer, vol. 23(1), pages 1-29, March.
    6. M. Portela & A. Camanho & A. Keshvari, 2013. "Assessing the evolution of school performance and value-added: trends over four years," Journal of Productivity Analysis, Springer, vol. 39(1), pages 1-14, February.
    7. Son Nghiem & Ha Trong Nguyen & Luke B. Connelly, 2016. "The Efficiency of Australian Schools: A Nationwide Analysis Using Gains in Test Scores of Students as Outputs," Economic Papers, The Economic Society of Australia, vol. 35(3), pages 256-268, September.
    8. López-Torres, Laura & Nicolini, Rosella & Prior, Diego, 2017. "Does strategic interaction affect demand for school places? A conditional efficiency approach," Regional Science and Urban Economics, Elsevier, vol. 65(C), pages 89-103.
    9. José Manuel Cordero & Daniel Santín & Rosa Simancas, 2017. "Assessing European primary school performance through a conditional nonparametric model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 364-376, April.
    10. M-J Mancebón & J Calero & Á Choi & D P Ximénez-de-Embún, 2012. "The efficiency of public and publicly subsidized high schools in Spain: Evidence from PISA-2006," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 63(11), pages 1516-1533, November.
    11. Agasisti, Tommaso & de Oliveira Ribeiro, Celma & Montemor, Daniel Sanches, 2022. "The efficiency of Brazilian elementary public schools," International Journal of Educational Development, Elsevier, vol. 93(C).
    12. Silva, Maria C.A. & Camanho, Ana S. & Barbosa, Flávia, 2020. "Benchmarking of secondary schools based on Students’ results in higher education," Omega, Elsevier, vol. 95(C).
    13. Johnes, Jill, 2015. "Operational Research in education," European Journal of Operational Research, Elsevier, vol. 243(3), pages 683-696.
    14. Agasisti, Tommaso, 2011. "How competition affects schools' performances: Does specification matter?," Economics Letters, Elsevier, vol. 110(3), pages 259-261, March.
    15. López-Torres, Laura & Johnes, Jill & Elliott, Caroline & Polo, Cristina, 2021. "The effects of competition and collaboration on efficiency in the UK independent school sector," Economic Modelling, Elsevier, vol. 96(C), pages 40-53.
    16. V Giménez & D Prior & C Thieme, 2007. "Technical efficiency, managerial efficiency and objective-setting in the educational system: an international comparison," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 58(8), pages 996-1007, August.
    17. Brasington, D. M., 2003. "The supply of public school quality," Economics of Education Review, Elsevier, vol. 22(4), pages 367-377, August.
    18. David Brasington & Don Haurin, 2005. "Capitalization of Parent, School, and Peer Group Components of School Quality into House Price," Departmental Working Papers 2005-04, Department of Economics, Louisiana State University.
    19. Aparicio, Juan & Ortiz, Lidia & Santín, Daniel, 2021. "Comparing group performance over time through the Luenberger productivity indicator: An application to school ownership in European countries," European Journal of Operational Research, Elsevier, vol. 294(2), pages 651-672.
    20. Jorge Calero & Josep-Oriol Escardíbul, 2007. "Evaluación de servicios educativos: el rendimiento en los centros públicos y privados medido en PISA-2003," Hacienda Pública Española, IEF, vol. 183(4), pages 33-66, december.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jorsoc:v:61:y:2010:i:7:d:10.1057_jors.2009.85. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave-journals.com/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.