IDEAS home Printed from https://ideas.repec.org/p/umc/wpaper/1122.html
   My bibliography  Save this paper

Large-Scale Evaluations of Curricular Effectiveness: The Case of Elementary Mathematics in Indiana

Author

Abstract

We use data from one of the few states where information on curriculum adoptions is available – Indiana – to empirically evaluate differences in performance across three elementary-mathematics curricula. The three curricula that we evaluate were popular nationally during the time of our study, and two of the three remain popular today. We find large differences in effectiveness between the curricula, most notably between the two that held the largest market shares in Indiana. Both are best-characterized as traditional in pedagogy. We also show that the publisher of the least-effective curriculum did not lose market share in Indiana in the following adoption cycle; one explanation is that educational decision makers lack information about differences in curricular effectiveness.

Suggested Citation

  • Cory Koedel & Rachana Bhatt, 2011. "Large-Scale Evaluations of Curricular Effectiveness: The Case of Elementary Mathematics in Indiana," Working Papers 1122, Department of Economics, University of Missouri, revised 31 Jan 2012.
    • Handle: RePEc:umc:wpaper:1122
    as

    Download full text from publisher

    File URL: https://drive.google.com/file/d/1ZdYX79T4uZVUlGjaiES4WtI-0wNsV783/view?usp=sharing
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
    2. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 605-654.
    3. Millimet, Daniel L. & Tchernis, Rusty, 2009. "On the Specification of Propensity Scores, With Applications to the Analysis of Trade Policies," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(3), pages 397-415.
    4. Black, Dan A. & Smith, J.A.Jeffrey A., 2004. "How robust is the evidence on the effects of college quality? Evidence from matching," Journal of Econometrics, Elsevier, vol. 121(1-2), pages 99-124.
    5. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    6. Roberto Agodini & Barbara Harris & Melissa Thomas & Robert Murphy & Lawrence Gallagher, "undated". "Achievement Effects of Four Early Elementary School Math Curricula: Findings for First and Second Graders," Mathematica Policy Research Reports 42014cad41884fa9a53007635, Mathematica Policy Research.
    7. repec:mpr:mprres:7064 is not listed on IDEAS
    8. repec:mpr:mprres:6192 is not listed on IDEAS
    9. Alberto Abadie & Guido W. Imbens, 2008. "On the Failure of the Bootstrap for Matching Estimators," Econometrica, Econometric Society, vol. 76(6), pages 1537-1557, November.
    10. John C. Ham & Xianghong Li & Patricia B. Reagan, 2004. "Propensity Score Matching, a Distance-Based Measure of Migration, and the Wage Growth of Young Men," IEPR Working Papers 05.13, Institute of Economic Policy Research (IEPR).
    11. Roland G. Fryer & Steven D. Levitt, 2006. "The Black-White Test Score Gap Through Third Grade," American Law and Economics Review, Oxford University Press, vol. 8(2), pages 249-281.
    12. Brian A. Jacob & Lars Lefgren & David Sims, 2008. "The Persistence of Teacher-Induced Learning Gains," NBER Working Papers 14065, National Bureau of Economic Research, Inc.
    13. repec:mpr:mprres:7723 is not listed on IDEAS
    14. repec:mpr:mprres:6586 is not listed on IDEAS
    15. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    16. Roberto Agodini & Barbara Harris & Sally Atkins-Burnett & Sheila Heaviside & Timothy Novak & Robert Murphy, "undated". "Achievement Effects of Four Early Elementary School Math Curricula: Findings from First Graders in 39 Schools," Mathematica Policy Research Reports 467194cd2d6f4cbaba7e23745, Mathematica Policy Research.
    17. Stephen W. Raudenbush, 1988. "Educational Applications of Hierarchical Linear Models: A Review," Journal of Educational and Behavioral Statistics, , vol. 13(2), pages 85-116, June.
    18. Millimet, Daniel L. & Tchernis, Rusty, 2009. "On the Specification of Propensity Scores, With Applications to the Analysis of Trade Policies," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(3), pages 397-415.
    19. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    20. Roberto Agodini, 2009. "Achievement Effects of Four Early Elementary School Math Curricula: Findings from First Graders in 39 Schools (Conference Paper)," Mathematica Policy Research Reports a08d661306a843fa89aff4c30, Mathematica Policy Research.
    21. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    22. Dale Ballou, 1996. "Do Public Schools Hire the Best Applicants?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 111(1), pages 97-133.
    23. Zhong Zhao, 2004. "Using Matching to Estimate Treatment Effects: Data Requirements, Matching Metrics, and Monte Carlo Evidence," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 91-107, February.
    24. repec:mpr:mprres:6816 is not listed on IDEAS
    25. repec:mpr:mprres:7337 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Quỳnh Tiên Nguyên Lê & Morgan S. Polikoff, 2021. "Do English Language Development Curriculum Materials Matter for Students’ English Proficiency?," SAGE Open, , vol. 11(3), pages 21582440211, July.
    2. Cory Koedel & Diyi Li & Morgan S. Polikoff & Tenice Hardaway & Stephani L. Wrabel, 2016. "Mathematics Curriculum Effects on Student Achievement in California," Working Papers 1612, Department of Economics, University of Missouri.
    3. Bhatt, Rachana & Koedel, Cory & Lehmann, Douglas, 2013. "Is curriculum quality uniform? Evidence from Florida," Economics of Education Review, Elsevier, vol. 34(C), pages 107-121.
    4. David Blazar & Blake Heller & Thomas J. Kane & Morgan Polikoff & Douglas O. Staiger & Scott Carrell & Dan Goldhaber & Douglas N. Harris & Rachel Hitch & Kristian L. Holden & Michal Kurlaender, 2020. "Curriculum Reform in The Common Core Era: Evaluating Elementary Math Textbooks Across Six U.S. States," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(4), pages 966-1019, September.
    5. Kim, Dongwoo & Koedel, Cory & Ni, Shawn & Podgursky, Michael, 2017. "Labor market frictions and production efficiency in public schools," Economics of Education Review, Elsevier, vol. 60(C), pages 54-67.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cory Koedel & Diyi Li & Morgan S. Polikoff & Tenice Hardaway & Stephani L. Wrabel, 2016. "Mathematics Curriculum Effects on Student Achievement in California," Working Papers 1612, Department of Economics, University of Missouri.
    2. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    3. Flores, Carlos A. & Mitnik, Oscar A., 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," IZA Discussion Papers 4451, Institute of Labor Economics (IZA).
    4. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    5. Ji, Sisi & Zhu, Zheyi, 2022. "Does higher education matter for health?," Cardiff Economics Working Papers E2022/4, Cardiff University, Cardiff Business School, Economics Section.
    6. Bernhard Schmidpeter, 2015. "The Fatal Consequences of Grief," CDL Aging, Health, Labor working papers 2015-07, The Christian Doppler (CD) Laboratory Aging, Health, and the Labor Market, Johannes Kepler University Linz, Austria.
    7. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    8. Heinrich, Carolyn J. & Mueser, Peter R. & Troske, Kenneth & Jeon, Kyung-Seong & Kahvecioglu, Daver C., 2009. "New Estimates of Public Employment and Training Program Net Impacts: A Nonexperimental Evaluation of the Workforce Investment Act Program," IZA Discussion Papers 4569, Institute of Labor Economics (IZA).
    9. Andrea Ichino & Fabrizia Mealli & Tommaso Nannicini, 2008. "From temporary help jobs to permanent employment: what can we learn from matching estimators and their sensitivity?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 23(3), pages 305-327.
    10. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    11. Andreas C. Drichoutis & Rodolfo M. Nayga, Jr. & Panagiotis Lazaridis, 2009. "Can Nutritional Label Use Influence Body Weight Outcomes?," Kyklos, Wiley Blackwell, vol. 62(4), pages 500-525, November.
    12. Christian Volpe Martincus & Jerónimo Carballo, 2012. "Export promotion activities in developing countries: What kind of trade do they promote?," The Journal of International Trade & Economic Development, Taylor & Francis Journals, vol. 21(4), pages 539-578, June.
    13. Stephan, Gesine & Pahnke, André, 2008. "The Relative Effectiveness of Selected Active Labour Market Programmes and the Common Support Problem," IZA Discussion Papers 3767, Institute of Labor Economics (IZA).
    14. Christian Volpe Martincus, 2010. "Odyssey in International Markets: An Assessment of the Effectiveness of Export Promotion in Latin America and the Caribbean," IDB Publications (Books), Inter-American Development Bank, number 16458, February.
    15. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    16. Steven Lehrer & Gregory Kordas, 2013. "Matching using semiparametric propensity scores," Empirical Economics, Springer, vol. 44(1), pages 13-45, February.
    17. Liu, Xiaolu & Li, Xiaoyu & Li, Honglin, 2016. "R&D subsidies and business R&D: Evidence from high-tech manufacturing firms in Jiangsu," China Economic Review, Elsevier, vol. 41(C), pages 1-22.
    18. Quỳnh Tiên Nguyên Lê & Morgan S. Polikoff, 2021. "Do English Language Development Curriculum Materials Matter for Students’ English Proficiency?," SAGE Open, , vol. 11(3), pages 21582440211, July.
    19. Eva Dettmann & Jutta Günther, 2013. "Subsidized Vocational Training: Stepping Stone or Trap? Assessing Empirical Effects Using Matching Techniques," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 149(IV), pages 405-443, December.
    20. repec:jku:cdlwps:2015_07 is not listed on IDEAS
    21. Ulf Rinne & Arne Uhlendorff & Zhong Zhao, 2013. "Vouchers and caseworkers in training programs for the unemployed," Empirical Economics, Springer, vol. 45(3), pages 1089-1127, December.

    More about this item

    Keywords

    curricular effectiveness; math curricula; non-experimental methods; matching methods; education policy;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy
    • H75 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Government: Health, Education, and Welfare

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:umc:wpaper:1122. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chao Gu (email available below). General contact details of provider: https://edirc.repec.org/data/edumous.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.