IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Causal Inference on Education Policies: A Survey of Empirical Studies Using PISA, TIMSS and PIRLS

Listed author(s):
  • Cordero, José Manuel
  • Cristobal, Victor
  • Santín, Daniel

The identification of the causal effects of educational policies is the top priority in recent education economics literature. As a result, a shift can be observed in the strategies of empirical studies. They have moved from the use of standard multivariate statistical methods, which identify correlations or associations between variables only, to more complex econometric strategies, which can help to identify causal relationships. However, exogenous variations in databases have to be identified in order to apply causal inference techniques. This is a far from straightforward task. For this reason, this paper provides an extensive and comprehensive overview of the literature using quasi-experimental techniques applied to three well-known international large-scale comparative assessments, such as PISA, PIRLS or TIMSS, over the period 2004-2016. In particular, we review empirical studies employing instrumental variables, regression discontinuity designs, difference in differences and propensity score matching to the above databases. Additionally, we provide a detailed summary of estimation strategies, issues treated and profitability in terms of the quality of publications to encourage further potential evaluations. The paper concludes with some operational recommendations for prospective researchers in the field.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: https://mpra.ub.uni-muenchen.de/76295/3/MPRA_paper_76295.pdf
File Function: original version
Download Restriction: no

Paper provided by University Library of Munich, Germany in its series MPRA Paper with number 76295.

as
in new window

Length:
Date of creation: 17 Jan 2017
Handle: RePEc:pra:mprapa:76295
Contact details of provider: Postal:
Ludwigstraße 33, D-80539 Munich, Germany

Phone: +49-(0)89-2180-2459
Fax: +49-(0)89-2180-992459
Web page: https://mpra.ub.uni-muenchen.de

More information through EDIRC

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as
in new window


  1. Andreas Ammermueller & Jörn-Steffen Pischke, 2009. "Peer Effects in European Primary Schools: Evidence from the Progress in International Reading Literacy Study," Journal of Labor Economics, University of Chicago Press, vol. 27(3), pages 315-348, July.
  2. Steven G. Rivkin & Eric A. Hanushek & John F. Kain, 2005. "Teachers, Schools, and Academic Achievement," Econometrica, Econometric Society, vol. 73(2), pages 417-458, 03.
  3. Oliver Falck & Ludger Woessmann, 2013. "School competition and students’ entrepreneurial intentions: international evidence using historical Catholic roots of private schooling," Small Business Economics, Springer, vol. 40(2), pages 459-478, February.
  4. Isphording, Ingo E. & Piopiunik, Marc & Rodríguez-Planas, Núria, 2016. "Speaking in numbers: The effect of reading performance on math performance among immigrants," Economics Letters, Elsevier, vol. 139(C), pages 52-56.
  5. Schwerdt, Guido & Wuppermann, Amelie C., 2011. "Is traditional teaching really all that bad? A within-student between-subject approach," Economics of Education Review, Elsevier, vol. 30(2), pages 365-379, April.
  6. Wo[ss]mann, Ludger & West, Martin, 2006. "Class-size effects in school systems around the world: Evidence from between-grade variation in TIMSS," European Economic Review, Elsevier, vol. 50(3), pages 695-736, April.
  7. David Kiss, 2013. "Are immigrants and girls graded worse? Results of a matching approach," Education Economics, Taylor & Francis Journals, vol. 21(5), pages 447-463, December.
  8. Martin R. West & Ludger Woessmann, 2010. "'Every Catholic Child in a Catholic School': Historical Resistance to State Schooling, Contemporary Private Competition and Student Achievement across Countries," Economic Journal, Royal Economic Society, vol. 120(546), pages 229-255, 08.
  9. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters,in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492 National Bureau of Economic Research, Inc.
  10. Edwards, Sebastian & Garcia Marin, Alvaro, 2015. "Constitutional rights and education: An international comparative study," Journal of Comparative Economics, Elsevier, vol. 43(4), pages 938-955.
  11. Piopiunik, Marc, 2014. "The effects of early tracking on student performance: Evidence from a school reform in Bavaria," Economics of Education Review, Elsevier, vol. 42(C), pages 12-33.
  12. Eric A. Hanushek & Ludger Wössmann, 2006. "Does Educational Tracking Affect Performance and Inequality? Differences- in-Differences Evidence Across Countries," Economic Journal, Royal Economic Society, vol. 116(510), pages 63-76, 03.
  13. Hanushek, Eric A. & Woessmann, Ludger, 2011. "The Economics of International Differences in Educational Achievement," Handbook of the Economics of Education, Elsevier.
  14. Patrick Puhani & Andrea Weber, 2007. "Does the early bird catch the worm?," Empirical Economics, Springer, vol. 32(2), pages 359-386, May.
  15. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
  16. Hendrik Jürges & Kerstin Schneider & Felix Büchel, 2005. "The Effect Of Central Exit Examinations On Student Achievement: Quasi-Experimental Evidence From TIMSS Germany," Journal of the European Economic Association, MIT Press, vol. 3(5), pages 1134-1155, 09.
  17. Kristof de Witte & Laura López-Torres, 2015. "Efficiency in Education. A Review of Literature and a Way Forward," Working Papers 1501, Departament Empresa, Universitat Autònoma de Barcelona, revised Apr 2015.
  18. Hanushek, Eric A. & Link, Susanne & Woessmann, Ludger, 2013. "Does school autonomy make sense everywhere? Panel estimates from PISA," Journal of Development Economics, Elsevier, vol. 104(C), pages 212-232.
  19. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
  20. Eric A. Hanushek, 1979. "Conceptual and Empirical Issues in the Estimation of Educational Production Functions," Journal of Human Resources, University of Wisconsin Press, vol. 14(3), pages 351-388.
  21. Ruhose, Jens & Schwerdt, Guido, 2016. "Does early educational tracking increase migrant-native achievement gaps? Differences-in-differences evidence across countries," Economics of Education Review, Elsevier, vol. 52(C), pages 134-154.
  22. West, Martin R. & Woessmann, Ludger, 2006. "Which school systems sort weaker students into smaller classes? International evidence," European Journal of Political Economy, Elsevier, vol. 22(4), pages 944-968, December.
  23. Paul J. Gertler & Sebastian Martinez & Patrick Premand & Laura B. Rawlings & Christel M. J. Vermeersch, 2016. "Impact Evaluation in Practice, Second Edition," World Bank Publications, The World Bank, number 25030, December.
  24. Oecd, 2016. "Fields of education, gender and the labour market," Education Indicators in Focus 45, OECD Publishing.
  25. Denny, Kevin & Oppedisano, Veruska, 2013. "The surprising effect of larger class sizes: Evidence using two identification strategies," Labour Economics, Elsevier, vol. 23(C), pages 57-65.
  26. Eva Crespo-Cebada & Francisco Pedraja-Chaparro & Daniel Santín, 2014. "Does school ownership matter? An unbiased efficiency comparison for regions of Spain," Journal of Productivity Analysis, Springer, vol. 41(1), pages 153-172, February.
  27. Dronkers, Jaap & Avram, S, 2009. "A cross-national analysis of the relations between school choice and effectiveness differences between private-dependent and public schools," MPRA Paper 23911, University Library of Munich, Germany.
  28. Cho, Insook, 2012. "The effect of teacher–student gender matching: Evidence from OECD countries," Economics of Education Review, Elsevier, vol. 31(3), pages 54-67.
  29. Hanushek, Eric A. & Piopiunik, Marc & Wiederhold, Simon, 2014. "The Value of Smarter Teachers: International Evidence on Teacher Cognitive Skills and Student Performance," Discussion Papers in Economics 22032, University of Munich, Department of Economics.
  30. Martin Schlotter & Guido Schwerdt & Ludger Woessmann, 2011. "Econometric methods for causal evaluation of education policies and practices: a non-technical guide," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 109-137.
  31. Petra E. Todd & Kenneth I. Wolpin, 2003. "On The Specification and Estimation of The Production Function for Cognitive Achievement," Economic Journal, Royal Economic Society, vol. 113(485), pages 3-33, February.
  32. Wößmann, Ludger, 2007. "International evidence on school competition, autonomy, and accountability: A review," Munich Reprints in Economics 19649, University of Munich, Department of Economics.
  33. ., 2016. "Demographics, education, health, and labor," Chapters,in: Economic Reform in Asia, chapter 8, pages 141-157 Edward Elgar Publishing.
  34. Francisco Pedraja-Chaparro & Daniel Santín & Rosa Simancas, 2016. "The impact of immigrant concentration in schools on grade retention in Spain: a difference-in-differences approach," Applied Economics, Taylor & Francis Journals, vol. 48(21), pages 1978-1990, May.
  35. Joshua D. Angrist & Jörn-Steffen Pischke, 2014. "Mastering ’Metrics: The Path from Cause to Effect," Economics Books, Princeton University Press, edition 1, number 10363.
  36. Christina Felfe & Natalia Nollenberger & Núria Rodríguez-Planas, 2015. "Can’t buy mommy’s love? Universal childcare and children’s long-term cognitive development," Journal of Population Economics, Springer;European Society for Population Economics, vol. 28(2), pages 393-422, April.
  37. Brindusa Anghel & Antonio Cabrales & Jorge Sainz & Ismael Sanz, 2015. "Publicizing the results of standardized external tests: does it have an effect on school outcomes?," IZA Journal of European Labor Studies, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-20, December.
  38. Steven G. Rivkin & Jeffrey C. Schiman, 2015. "Instruction Time, Classroom Quality, and Academic Achievement," Economic Journal, Royal Economic Society, vol. 0(588), pages 425-448, November.
  39. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
  40. Vardardottir, Arna, 2015. "The impact of classroom peers in a streaming system," Economics of Education Review, Elsevier, vol. 49(C), pages 110-128.
  41. James Heckman & Salvador Navarro-Lozano, 2004. "Using Matching, Instrumental Variables, and Control Functions to Estimate Economic Choice Models," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 30-57, February.
  42. Sergio Perelman & Daniel Santin, 2011. "Measuring educational efficiency at student level with parametric stochastic distance functions: an application to Spanish PISA results," Education Economics, Taylor & Francis Journals, vol. 19(1), pages 29-49.
  43. Maciej Jakubowski, 2015. "Latent variables and propensity score matching: a simulation study with application to data from the Programme for International Student Assessment in Poland," Empirical Economics, Springer, vol. 48(3), pages 1287-1325, May.
  44. Gamboa, Luis Fernando & Rodríguez Acosta, Mauricio & García Suaza, Andrés, 2013. "Differences in motivations and academic achievement," REVISTA LECTURAS DE ECONOMÍA, UNIVERSIDAD DE ANTIOQUIA - CIE, issue 78, pages 9-44, March.
  45. J. Ignacio García-Pérez & Marisa Hidalgo-Hidalgo & J. Antonio Robles-Zurita, 2014. "Does grade retention affect students' achievement? Some evidence from Spain," Applied Economics, Taylor & Francis Journals, vol. 46(12), pages 1373-1392, April.
  46. Kosuke Imai & David A. van Dyk, 2004. "Causal Inference With General Treatment Regimes: Generalizing the Propensity Score," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 854-866, January.
  47. Vandenberghe, V. & Robin, S., 2004. "Evaluating the effectiveness of private education across countries: a comparison of methods," Labour Economics, Elsevier, vol. 11(4), pages 487-506, August.
  48. Shahidur R. Khandker & Gayatri B. Koolwal & Hussain A. Samad, 2010. "Handbook on Impact Evaluation : Quantitative Methods and Practices," World Bank Publications, The World Bank, number 2693, December.
  49. Paul R. Rosenbaum, 1986. "Dropping out of High School in the United States: An Observational Study," Journal of Educational and Behavioral Statistics, , vol. 11(3), pages 207-224, September.
  50. Ponzo, Michela & Scoppa, Vincenzo, 2014. "The long-lasting effects of school entry age: Evidence from Italian students," Journal of Policy Modeling, Elsevier, vol. 36(3), pages 578-599.
  51. Kelly Bedard & Elizabeth Dhuey, 2006. "The Persistence of Early Childhood Maturity: International Evidence of Long-Run Age Effects," The Quarterly Journal of Economics, Oxford University Press, vol. 121(4), pages 1437-1472.
  52. Elaine L. Hill & David J. G. Slusky, 2017. "Birth Spacing and Educational Outcomes," Advances in Health Economics and Health Services Research,in: Human Capital and Health Behavior, volume 25, pages 3-29 Emerald Publishing Ltd.
  53. Ponzo, Michela, 2013. "Does bullying reduce educational achievement? An evaluation using matching estimators," Journal of Policy Modeling, Elsevier, vol. 35(6), pages 1057-1078.
  54. Charles T. Clotfelter & Helen F. Ladd & Jacob L. Vigdor, 2010. "Teacher Credentials and Student Achievement in High School: A Cross-Subject Analysis with Student Fixed Effects," Journal of Human Resources, University of Wisconsin Press, vol. 45(3).
  55. Oecd, 2016. "What influences spending on education?," Education Indicators in Focus 46, OECD Publishing.
  56. Elizabeth Ty Wilde & Robinson Hollister, 2007. "How close is close enough? Evaluating propensity score matching using data from a class size reduction experiment," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 26(3), pages 455-477.
  57. Clotfelter, Charles T. & Ladd, Helen F. & Vigdor, Jacob L., 2007. "Teacher credentials and student achievement: Longitudinal analysis with student fixed effects," Economics of Education Review, Elsevier, vol. 26(6), pages 673-682, December.
  58. Bietenbeck, Jan, 2014. "Teaching practices and cognitive skills," Labour Economics, Elsevier, vol. 30(C), pages 143-153.
  59. Jensen, Peter & Rasmussen, Astrid Würtz, 2011. "The effect of immigrant concentration in schools on native and immigrant children's reading and math skills," Economics of Education Review, Elsevier, vol. 30(6), pages 1503-1515.
  60. ., 2016. "Education, individualism and inequality," Chapters,in: Individualism and Inequality, chapter 8, pages 126-144 Edward Elgar Publishing.
  61. Hendrik Jürges & Kerstin Schneider, 2004. "International Differences in Student Achievement: An Economic Perspective," German Economic Review, Verein für Socialpolitik, vol. 5(3), pages 357-380, August.
  62. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, Oxford University Press, vol. 114(2), pages 533-575.
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:76295. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Joachim Winter)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.