IDEAS home Printed from https://ideas.repec.org/a/wly/jpamgt/v39y2020i4p966-1019.html
   My bibliography  Save this article

Curriculum Reform in The Common Core Era: Evaluating Elementary Math Textbooks Across Six U.S. States

Author

Listed:
  • David Blazar
  • Blake Heller
  • Thomas J. Kane
  • Morgan Polikoff
  • Douglas O. Staiger
  • Scott Carrell
  • Dan Goldhaber
  • Douglas N. Harris
  • Rachel Hitch
  • Kristian L. Holden
  • Michal Kurlaender

Abstract

Can a school or district improve student achievement simply by switching to a higher‐quality textbook or curriculum? We conducted the first multi‐textbook, multi‐state effort to estimate textbook efficacy following widespread adoption of the Common Core State Standards (CCSS) and associated changes in the textbook market. Pooling textbook adoption and student test score data across six geographically and demographically diverse U.S. states, we found little evidence of differences in average achievement gains for schools using different math textbooks. We found some evidence of greater variation in achievement gains among schools using pre‐CCSS editions, which may have been more varied in their content than post‐CCSS editions because they were written for a broader set of standards. We also found greater variation among schools that had more exposure to a given text. However, these differences were small. Despite considerable interest and attention to textbooks as a low‐cost, “silver bullet” intervention for improving student outcomes, we conclude that the adoption of a new textbook or set of curriculum materials, on its own, is unlikely to achieve this goal.

Suggested Citation

  • David Blazar & Blake Heller & Thomas J. Kane & Morgan Polikoff & Douglas O. Staiger & Scott Carrell & Dan Goldhaber & Douglas N. Harris & Rachel Hitch & Kristian L. Holden & Michal Kurlaender, 2020. "Curriculum Reform in The Common Core Era: Evaluating Elementary Math Textbooks Across Six U.S. States," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 39(4), pages 966-1019, September.
  • Handle: RePEc:wly:jpamgt:v:39:y:2020:i:4:p:966-1019
    DOI: 10.1002/pam.22257
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/pam.22257
    Download Restriction: no

    File URL: https://libkey.io/10.1002/pam.22257?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Thomas J. Kane & Douglas O. Staiger, 2008. "Estimating Teacher Impacts on Student Achievement: An Experimental Evaluation," NBER Working Papers 14607, National Bureau of Economic Research, Inc.
    2. Kirabo Jackson & Alexey Makarin, 2018. "Can Online Off-the-Shelf Lessons Improve Student Outcomes? Evidence from a Field Experiment," American Economic Journal: Economic Policy, American Economic Association, vol. 10(3), pages 226-254, August.
    3. Kristian L. Holden, 2016. "Buy the Book? Evidence on the Effect of Textbook Funding on School-Level Achievement," American Economic Journal: Applied Economics, American Economic Association, vol. 8(4), pages 100-127, October.
    4. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The Skill Content of Recent Technological Change: An Empirical Exploration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1279-1333.
    5. Joseph G. Altonji & Erica Blom & Costas Meghir, 2012. "Heterogeneity in Human Capital Investments: High School Curriculum, College Major, and Careers," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 185-223, July.
    6. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    7. Cory Koedel & Rachana Bhatt, 2011. "Large-Scale Evaluations of Curricular Effectiveness: The Case of Elementary Mathematics in Indiana," Working Papers 1122, Department of Economics, University of Missouri, revised 31 Jan 2012.
    8. repec:mpr:mprres:8149 is not listed on IDEAS
    9. Bhatt, Rachana & Koedel, Cory & Lehmann, Douglas, 2013. "Is curriculum quality uniform? Evidence from Florida," Economics of Education Review, Elsevier, vol. 34(C), pages 107-121.
    10. Roberto Agodini & Barbara Harris & Sally Atkins-Burnett & Sheila Heaviside & Timothy Novak & Robert Murphy, "undated". "Achievement Effects of Four Early Elementary School Math Curricula: Findings from First Graders in 39 Schools," Mathematica Policy Research Reports 467194cd2d6f4cbaba7e23745, Mathematica Policy Research.
    11. repec:mpr:mprres:6586 is not listed on IDEAS
    12. James E. Pustejovsky & Elizabeth Tipton, 2018. "Small-Sample Methods for Cluster-Robust Variance Estimation and Hypothesis Testing in Fixed Effects Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(4), pages 672-683, October.
    13. repec:mpr:mprres:6816 is not listed on IDEAS
    14. Jonah E. Rockoff, 2004. "The Impact of Individual Teachers on Student Achievement: Evidence from Panel Data," American Economic Review, American Economic Association, vol. 94(2), pages 247-252, May.
    15. Cassandra M. Guarino & Michelle Maxfield & Mark D. Reckase & Paul N. Thompson & Jeffrey M. Wooldridge, 2015. "An Evaluation of Empirical Bayes’s Estimation of Value-Added Teacher Performance Measures," Journal of Educational and Behavioral Statistics, , vol. 40(2), pages 190-222, April.
    16. repec:mpr:mprres:7064 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nirav Mehta, 2019. "Measuring quality for use in incentive schemes: The case of “shrinkage” estimators," Quantitative Economics, Econometric Society, vol. 10(4), pages 1537-1577, November.
    2. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    3. Michael Gilraine & Jiaying Gu & Robert McMillan, 2020. "A New Method for Estimating Teacher Value-Added," NBER Working Papers 27094, National Bureau of Economic Research, Inc.
    4. Brehm, Margaret & Imberman, Scott A. & Lovenheim, Michael F., 2017. "Achievement effects of individual performance incentives in a teacher merit pay tournament," Labour Economics, Elsevier, vol. 44(C), pages 133-150.
    5. Michael Gilraine & Jiaying Gu & Robert McMillan, 2021. "A Nonparametric Method for Estimating Teacher Value-Added," Working Papers tecipa-689, University of Toronto, Department of Economics.
    6. Koedel Cory & Leatherman Rebecca & Parsons Eric, 2012. "Test Measurement Error and Inference from Value-Added Models," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 12(1), pages 1-37, November.
    7. Thomas S. Dee & Emily K. Penner, 2021. "My Brother's Keeper? The Impact of Targeted Educational Supports," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(4), pages 1171-1196, September.
    8. Michael Bates & Michael Dinerstein & Andrew C. Johnston & Isaac Sorkin, 2022. "Teacher Labor Market Equilibrium and Student Achievement," CESifo Working Paper Series 9551, CESifo.
    9. Papay, John P. & Kraft, Matthew A., 2015. "Productivity returns to experience in the teacher labor market: Methodological challenges and new evidence on long-term career improvement," Journal of Public Economics, Elsevier, vol. 130(C), pages 105-119.
    10. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2023. "Fast and reliable jackknife and bootstrap methods for cluster‐robust inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(5), pages 671-694, August.
    11. Ingo E. Isphording & Ulf Zölitz, 2020. "The value of a peer," ECON - Working Papers 342, Department of Economics - University of Zurich.
    12. Rendall, Michelle & Weiss, Franziska J., 2016. "Employment polarization and the role of the apprenticeship system," European Economic Review, Elsevier, vol. 82(C), pages 166-186.
    13. Condie, Scott & Lefgren, Lars & Sims, David, 2014. "Teacher heterogeneity, value-added and education policy," Economics of Education Review, Elsevier, vol. 40(C), pages 76-92.
    14. Roland G. Fryer, Jr, 2010. "Financial Incentives and Student Achievement: Evidence from Randomized Trials," NBER Working Papers 15898, National Bureau of Economic Research, Inc.
    15. Stacy, Brian & Guarino, Cassandra & Wooldridge, Jeffrey, 2018. "Does the precision and stability of value-added estimates of teacher performance depend on the types of students they serve?," Economics of Education Review, Elsevier, vol. 64(C), pages 50-74.
    16. Gerald Eisenkopf & Pascal A. Sulser, 2016. "Randomized controlled trial of teaching methods: Do classroom experiments improve economic education in high schools?," The Journal of Economic Education, Taylor & Francis Journals, vol. 47(3), pages 211-225, July.
    17. Clark, Damon, 2023. "School quality and the return to schooling in Britain: New evidence from a large-scale compulsory schooling reform," Journal of Public Economics, Elsevier, vol. 223(C).
    18. C. Kirabo Jackson, 2013. "Match Quality, Worker Productivity, and Worker Mobility: Direct Evidence from Teachers," The Review of Economics and Statistics, MIT Press, vol. 95(4), pages 1096-1116, October.
    19. Robert Metcalfe & Simon Burgess and Steven Proud, 2011. "Student effort and educational attainment: Using the England football team to identify the education production function," Economics Series Working Papers 586, University of Oxford, Department of Economics.
    20. Roland G. Fryer, Jr, 2016. "The Production of Human Capital in Developed Countries: Evidence from 196 Randomized Field Experiments," NBER Working Papers 22130, National Bureau of Economic Research, Inc.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jpamgt:v:39:y:2020:i:4:p:966-1019. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/journal/34787/home .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.