IDEAS home Printed from https://ideas.repec.org/a/aea/aerins/v1y2019i3p291-308.html
   My bibliography  Save this article

Measuring Success in Education: The Role of Effort on the Test Itself

Author

Listed:
  • Uri Gneezy
  • John A. List
  • Jeffrey A. Livingston
  • Xiangdong Qin
  • Sally Sadoff
  • Yang Xu

Abstract

US students often rank poorly on standardized tests that estimate and compare educational achievements. We investigate whether this might reflect not only differences in ability but also differences in effort on the test. We experimentally offer students incentives to put forth effort in two US high schools and four Shanghai high schools. US students improve performance substantially in response to incentives, while Shanghai students—who are top performers on assessments—do not. These results raise the possibility that ranking countries based on low-stakes assessments may not reflect only differences in ability, but also motivation to perform well on the test.

Suggested Citation

  • Uri Gneezy & John A. List & Jeffrey A. Livingston & Xiangdong Qin & Sally Sadoff & Yang Xu, 2019. "Measuring Success in Education: The Role of Effort on the Test Itself," American Economic Review: Insights, American Economic Association, vol. 1(3), pages 291-308, December.
    • Handle: RePEc:aea:aerins:v:1:y:2019:i:3:p:291-308
    Note: DOI: 10.1257/aeri.20180633
    as

    Download full text from publisher

    File URL: https://www.aeaweb.org/doi/10.1257/aeri.20180633
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/aeri.20180633.data
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/aeri.20180633.appx
    Download Restriction: no
    File URL: https://www.aeaweb.org/doi/10.1257/aeri.20180633.ds
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jalava, Nina & Joensen, Juanna Schrøter & Pellas, Elin, 2015. "Grades and rank: Impacts of non-financial incentives on test performance," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 161-196.
    2. Ludger Woessmann, 2016. "The Importance of School Systems: Evidence from International Differences in Student Achievement," Journal of Economic Perspectives, American Economic Association, vol. 30(3), pages 3-32, Summer.
    3. Ghazala Azmat & Caterina Calsamiglia & Nagore Iriberri, 2016. "Gender Differences In Response To Big Stakes," Journal of the European Economic Association, European Economic Association, vol. 14(6), pages 1372-1400, December.
    4. Richard J. Murnane & John B. Willett & Yves Duhaldeborde & John H. Tyler, 2000. "How important are the cognitive skills of teenagers in predicting subsequent earnings?," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 19(4), pages 547-568.
    5. Anderson, Michael L, 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series qt15n8j26f, Department of Agricultural & Resource Economics, UC Berkeley.
    6. Attali, Yigal & Neeman, Zvika & Schlosser, Analia, 2011. "Rise to the Challenge or Not Give a Damn: Differential Performance in High vs. Low Stakes Tests," Foerder Institute for Economic Research Working Papers 275743, Tel-Aviv University > Foerder Institute for Economic Research.
    7. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    8. Wößmann, Ludger, 2016. "The Importance of School Systems," Munich Reprints in Economics 43463, University of Munich, Department of Economics.
    9. Ivan A. Canay & Joseph P. Romano & Azeem M. Shaikh, 2017. "Randomization Tests Under an Approximate Symmetry Assumption," Econometrica, Econometric Society, vol. 85, pages 1013-1030, May.
    10. Stefano DellaVigna & Devin Pope, 2018. "What Motivates Effort? Evidence and Expert Forecasts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 1029-1069.
    11. Balart, Pau & Oosterveen, Matthijs & Webbink, Dinand, 2015. "Test Scores, Noncognitive Skills and Economic Growth," IZA Discussion Papers 9559, Institute of Labor Economics (IZA).
    12. Eric A. Hanushek & Ludger Woessmann, 2011. "How much do educational outcomes matter in OECD countries? [‘Accountability and flexibility in public schools: Evidence from Boston’s charters and pilots’]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 26(67), pages 427-491.
    13. Steven D. Levitt & John A. List & Susanne Neckermann & Sally Sadoff, 2016. "The Behavioralist Goes to School: Leveraging Behavioral Economics to Improve Educational Performance," American Economic Journal: Economic Policy, American Economic Association, vol. 8(4), pages 183-219, November.
    14. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    15. Anderson, Michael L., 2008. "Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1481-1495.
    16. Imas, Alex, 2014. "Working for the “warm glow”: On the benefits and limits of prosocial incentives," Journal of Public Economics, Elsevier, vol. 114(C), pages 14-18.
    17. Carmit Segal, 2012. "Working When No One Is Watching: Motivation, Test Scores, and Economic Success," Management Science, INFORMS, vol. 58(8), pages 1438-1457, August.
    18. Schmid, Friedrich & Trede, Mark, 1995. "A distribution free test for the two sample problem for general alternatives," Computational Statistics & Data Analysis, Elsevier, vol. 20(4), pages 409-419, October.
    19. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    20. Uri Gneezy & Stephan Meier & Pedro Rey-Biel, 2011. "When and Why Incentives (Don't) Work to Modify Behavior," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 191-210, Fall.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Islam, Asad & Kwon, Sungoh & Masood, Eema & Prakash, Nishith & Sabarwal, Shwetlena & Saraswat, Deepak, 2020. "When Goal-Setting Forges Ahead but Stops Short," GLO Discussion Paper Series 526, Global Labor Organization (GLO).
    2. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).
    3. Xiqian Cai & Yi Lu & Jessica Pan & Songfa Zhong, 2019. "Gender Gap under Pressure: Evidence from China's National College Entrance Examination," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 249-263, May.
    4. Jalava, Nina & Joensen, Juanna Schrøter & Pellas, Elin, 2015. "Grades and rank: Impacts of non-financial incentives on test performance," Journal of Economic Behavior & Organization, Elsevier, vol. 115(C), pages 161-196.
    5. List, John A. & Livingston, Jeffrey A. & Neckermann, Susanne, 2018. "Do financial incentives crowd out intrinsic motivation to perform on standardized tests?," Economics of Education Review, Elsevier, vol. 66(C), pages 125-136.
    6. Brunello, Giorgio & Kiss, David, 2022. "Math scores in high stakes grades," Economics of Education Review, Elsevier, vol. 87(C).
    7. Cantoni, Enrico & Gazzè, Ludovica & Schafer, Jerome, 2021. "Turnout in concurrent elections: Evidence from two quasi-experiments in Italy," European Journal of Political Economy, Elsevier, vol. 70(C).
    8. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    9. David Neumark & Diego Grijalva, 2017. "The Employment Effects of State Hiring Credits," ILR Review, Cornell University, ILR School, vol. 70(5), pages 1111-1145, October.
    10. Dahmann, Sarah C., 2017. "How does education improve cognitive skills? Instructional time versus timing of instruction," Labour Economics, Elsevier, vol. 47(C), pages 35-47.
    11. Fitzsimons, Emla & Malde, Bansi & Mesnard, Alice & Vera-Hernández, Marcos, 2016. "Nutrition, information and household behavior: Experimental evidence from Malawi," Journal of Development Economics, Elsevier, vol. 122(C), pages 113-126.
    12. Alex Imas & Sally Sadoff & Anya Samek, 2017. "Do People Anticipate Loss Aversion?," Management Science, INFORMS, vol. 63(5), pages 1271-1284, May.
    13. Bobonis, Gustavo J. & Stabile, Mark & Tovar, Leonardo, 2020. "Military training exercises, pollution, and their consequences for health," Journal of Health Economics, Elsevier, vol. 73(C).
    14. Elsner, Benjamin & Wozny, Florian, 2023. "Long-run exposure to low-dose radiation reduces cognitive performance," Journal of Environmental Economics and Management, Elsevier, vol. 118(C).
    15. Marshall Burke & Lauren Falcao Bergquist & Edward Miguel, 2019. "Sell Low and Buy High: Arbitrage and Local Price Effects in Kenyan Markets," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(2), pages 785-842.
    16. Damon Clark & David Gill & Victoria Prowse & Mark Rush, 2020. "Using Goals to Motivate College Students: Theory and Evidence From Field Experiments," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 648-663, October.
    17. Timothy B. Armstrong & Shu Shen, 2013. "Inference on Optimal Treatment Assignments," Cowles Foundation Discussion Papers 1927RR, Cowles Foundation for Research in Economics, Yale University, revised Apr 2015.
    18. Uwe Dulleck & Juliana Silva-Goncalves & Benno Torgler, 2016. "Evaluation of an Incentive Program on Educational Achievement of Indigenous Students," The Economic Record, The Economic Society of Australia, vol. 92(298), pages 329-347, September.
    19. Will Dobbie & Roland G. Fryer, Jr, 2013. "The Medium-Term Impacts of High-Achieving Charter Schools on Non-Test Score Outcomes," NBER Working Papers 19581, National Bureau of Economic Research, Inc.
    20. Nicholas Haas & Prabin B. Khadka, 2020. "If They Endorse It, I Can't Trust It: How Outgroup Leader Endorsements Undercut Public Support for Civil War Peace Settlements," American Journal of Political Science, John Wiley & Sons, vol. 64(4), pages 982-1000, October.

    More about this item

    JEL classification:

    • C93 - Mathematical and Quantitative Methods - - Design of Experiments - - - Field Experiments
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education
    • O15 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development - - - Economic Development: Human Resources; Human Development; Income Distribution; Migration
    • P36 - Political Economy and Comparative Economic Systems - - Socialist Institutions and Their Transitions - - - Consumer Economics; Health; Education and Training; Welfare, Income, Wealth, and Poverty

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:aerins:v:1:y:2019:i:3:p:291-308. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Michael P. Albert (email available below). General contact details of provider: https://edirc.repec.org/data/aeaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.