IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/28976.html
   My bibliography  Save this paper

Teaching and Incentives: Substitutes or Complements?

Author

Listed:
  • James Allen IV
  • Arlete Mahumane
  • James Riddell IV
  • Tanya Rosenblat
  • Dean Yang
  • Hang Yu

Abstract

Interventions to promote learning are often categorized into supply- and demand-side approaches. In a randomized experiment to promote learning about COVID-19 among Mozambican adults, we study the interaction between a supply and a demand intervention, respectively: teaching via targeted feedback, and providing financial incentives to learners. In theory, teaching and learner-incentives may be substitutes (crowding out one another) or complements (enhancing one another). Experts surveyed in advance predicted a high degree of substitutability between the two treatments. In contrast, we find substantially more complementarity than experts predicted. Combining teaching and incentive treatments raises COVID-19 knowledge test scores by 0.5 standard deviations, though the standalone teaching treatment is the most cost-effective. The complementarity between teaching and incentives persists in the longer run, over nine months post-treatment.

Suggested Citation

  • James Allen IV & Arlete Mahumane & James Riddell IV & Tanya Rosenblat & Dean Yang & Hang Yu, 2021. "Teaching and Incentives: Substitutes or Complements?," NBER Working Papers 28976, National Bureau of Economic Research, Inc.
  • Handle: RePEc:nbr:nberwo:28976
    Note: DEV ED EH
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w28976.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Noam Angrist & Peter Bergman & David K. Evans & Susannah Hares & Matthew C. H. Jukes & Thato Letsomo, 2020. "Practical Lessons for Phone-Based Assessments of Learning," Working Papers 534, Center for Global Development, revised 10 Jul 2020.
    2. Roland G. Fryer, 2011. "Financial Incentives and Student Achievement: Evidence from Randomized Trials," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 1755-1798.
    3. Esther Duflo, 2001. "Schooling and Labor Market Consequences of School Construction in Indonesia: Evidence from an Unusual Policy Experiment," American Economic Review, American Economic Association, vol. 91(4), pages 795-813, September.
    4. Abhijit V. Banerjee & Shawn Cole & Esther Duflo & Leigh Linden, 2007. "Remedying Education: Evidence from Two Randomized Experiments in India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1235-1264.
    5. Finkelstein, Eric A. & Bilger, Marcel & Baid, Drishti, 2019. "Effectiveness and cost-effectiveness of incentives as a tool for prevention of non-communicable diseases: A systematic review," Social Science & Medicine, Elsevier, vol. 232(C), pages 340-350.
    6. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    7. David K. Evans & Anna Popova, 2016. "What Really Works to Improve Learning in Developing Countries? An Analysis of Divergent Findings in Systematic Reviews," The World Bank Research Observer, World Bank, vol. 31(2), pages 242-270.
    8. Tim Kaiser & Lukas Menkhoff, 2017. "Does Financial Education Impact Financial Literacy and Financial Behavior, and If So, When?," The World Bank Economic Review, World Bank, vol. 31(3), pages 611-630.
    9. Esther Duflo & Pascaline Dupas & Michael Kremer, 2011. "Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya," American Economic Review, American Economic Association, vol. 101(5), pages 1739-1774, August.
    10. Abhijit Banerjee & Esther Duflo & Amy Finkelstein & Lawrence F. Katz & Benjamin A. Olken & Anja Sautmann, 2020. "In Praise of Moderation: Suggestions for the Scope and Use of Pre-Analysis Plans for RCTs in Economics," NBER Working Papers 26993, National Bureau of Economic Research, Inc.
    11. Li, Tao & Han, Li & Zhang, Linxiu & Rozelle, Scott, 2014. "Encouraging classroom peer interactions: Evidence from Chinese migrant schools," Journal of Public Economics, Elsevier, vol. 111(C), pages 29-45.
    12. Glewwe, Paul & Kremer, Michael & Moulin, Sylvie & Zitzewitz, Eric, 2004. "Retrospective vs. prospective analyses of school inputs: the case of flip charts in Kenya," Journal of Development Economics, Elsevier, vol. 74(1), pages 251-268, June.
    13. Bahety, Girija & Bauhoff, Sebastian & Patel, Dev & Potter, James, 2021. "Texts don’t nudge: An adaptive trial to prevent the spread of COVID-19 in India," Journal of Development Economics, Elsevier, vol. 153(C).
    14. Jere R. Behrman & Susan W. Parker & Petra E. Todd & Kenneth I. Wolpin, 2015. "Aligning Learning Incentives of Students and Teachers: Results from a Social Experiment in Mexican High Schools," Journal of Political Economy, University of Chicago Press, vol. 123(2), pages 325-364.
    15. Burgess, Simon & Metcalfe, Robert & Sadoff, Sally, 2021. "Understanding the response to financial and non-financial incentives in education: Field experimental evidence using high-stakes assessments," Economics of Education Review, Elsevier, vol. 85(C).
    16. Fryer, Roland G., 2016. "Information, non-financial incentives, and student achievement: Evidence from a text messaging experiment," Journal of Public Economics, Elsevier, vol. 144(C), pages 109-121.
    17. Sylvie Moulin & Michael Kremer & Paul Glewwe, 2009. "Many Children Left Behind? Textbooks and Test Scores in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 112-135, January.
    18. Michael Kremer & Edward Miguel & Rebecca Thornton, 2009. "Incentives to Learn," The Review of Economics and Statistics, MIT Press, vol. 91(3), pages 437-456, August.
    19. Noam Angrist & Peter Bergman & Moitshepi Matsheng, 2020. "School’s Out: Experimental Evidence on Limiting Learning Loss Using “Low-Tech” in a Pandemic," NBER Working Papers 28205, National Bureau of Economic Research, Inc.
    20. John A. List & Azeem M. Shaikh & Yang Xu, 2019. "Multiple hypothesis testing in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 22(4), pages 773-793, December.
    21. Twinam, Tate, 2017. "Complementarity And Identification," Econometric Theory, Cambridge University Press, vol. 33(5), pages 1154-1185, October.
    22. Martina Björkman Nyqvist & Lucia Corno & Damien de Walque & Jakob Svensson, 2018. "Incentivizing Safer Sexual Behavior: Evidence from a Lottery Experiment on HIV Prevention," American Economic Journal: Applied Economics, American Economic Association, vol. 10(3), pages 287-314, July.
    23. Rebecca L. Thornton, 2008. "The Demand for, and Impact of, Learning HIV Status," American Economic Review, American Economic Association, vol. 98(5), pages 1829-1863, December.
    24. Mistree, Dinsha & Loyalka, Prashant & Fairlie, Robert & Bhuradia, Ashutosh & Angrish, Manyu & Lin, Jason & Karoshi, Amar & Yen, Sara J. & Mistri, Jamsheed & Bayat, Vafa, 2021. "Instructional interventions for improving COVID-19 knowledge, attitudes, behaviors: Evidence from a large-scale RCT in India," Social Science & Medicine, Elsevier, vol. 276(C).
    25. Toman Barsbai & Victoria Licuanan & Andreas Steinmayr & Erwin Tiongson & Dean Yang, 2020. "Information and the Acquisition of Social Network Connections," NBER Working Papers 27346, National Bureau of Economic Research, Inc.
    26. Anderson, Jock R. & Feder, Gershon, 2007. "Agricultural Extension," Handbook of Agricultural Economics, in: Robert Evenson & Prabhu Pingali (ed.), Handbook of Agricultural Economics, edition 1, volume 3, chapter 44, pages 2343-2378, Elsevier.
    27. Elisa M. Maffioli, 2020. "Collecting Data During an Epidemic: A Novel Mobile Phone Research Method," Journal of International Development, John Wiley & Sons, Ltd., vol. 32(8), pages 1231-1255, November.
    28. Abhijit Banerjee & Marcella Alsan & Emily Breza & Arun G. Chandrasekhar & Abhijit Chowdhury & Esther Duflo & Paul Goldsmith-Pinkham & Benjamin A. Olken, 2020. "Messages on COVID-19 Prevention in India Increased Symptoms Reporting and Adherence to Preventive Behaviors Among 25 Million Recipients with Similar Effects on Non-recipient Members of Their Communiti," NBER Working Papers 27496, National Bureau of Economic Research, Inc.
    29. Isaac Mbiti & Karthik Muralidharan & Mauricio Romero & Youdi Schipper & Constantine Manda & Rakesh Rajani, 2019. "Inputs, Incentives, and Complementarities in Education: Experimental Evidence from Tanzania," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(3), pages 1627-1673.
    30. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    31. List, John A. & Livingston, Jeffrey A. & Neckermann, Susanne, 2018. "Do financial incentives crowd out intrinsic motivation to perform on standardized tests?," Economics of Education Review, Elsevier, vol. 66(C), pages 125-136.
    32. Pascaline Dupas, 2011. "Health Behavior in Developing Countries," Annual Review of Economics, Annual Reviews, vol. 3(1), pages 425-449, September.
    33. Yang, Dean & Allen, James & Mahumane, Arlete & Riddell, James & Yu, Hang, 2023. "Knowledge, stigma, and HIV testing: An analysis of a widespread HIV/AIDS program," Journal of Development Economics, Elsevier, vol. 160(C).
    34. Sarojini Hirshleifer, 2017. "Incentives for Effort or Outputs? A Field Experiment to Improve Student Performance," Working Papers 201701, University of California at Riverside, Department of Economics.
    35. James Allen IV & Arlete Mahumane & James Riddell IV & Tanya Rosenblat & Dean Yang & Hang Yu, 2021. "Correcting Perceived Social Distancing Norms to Combat COVID-19," NBER Working Papers 28651, National Bureau of Economic Research, Inc.
    36. Robert Jensen, 2010. "The (Perceived) Returns to Education and the Demand for Schooling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 515-548.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang, Dean & Allen, James & Mahumane, Arlete & Riddell, James & Yu, Hang, 2023. "Knowledge, stigma, and HIV testing: An analysis of a widespread HIV/AIDS program," Journal of Development Economics, Elsevier, vol. 160(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francesca Marchetta & Tom Dilly, 2019. "Supporting Education in Africa: Opportunities and Challenges for an Impact Investor," Working Papers hal-02288103, HAL.
    2. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    3. Alejandro J. Ganimian & Richard J. Murnane, 2014. "Improving Educational Outcomes in Developing Countries: Lessons from Rigorous Impact Evaluations," NBER Working Papers 20284, National Bureau of Economic Research, Inc.
    4. Bach, Maximilian & Fischer, Mira, 2020. "Understanding the Response to High-Stakes Incentives in Primary Education," Rationality and Competition Discussion Paper Series 261, CRC TRR 190 Rationality and Competition.
    5. Miguel Urquiola, 2015. "Progress and challenges in achieving an evidence-based education policy in Latin America and the Caribbean," Latin American Economic Review, Springer;Centro de Investigaciòn y Docencia Económica (CIDE), vol. 24(1), pages 1-30, December.
    6. Karthik Muralidharan & Abhijeet Singh & Alejandro J. Ganimian, 2019. "Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India," American Economic Review, American Economic Association, vol. 109(4), pages 1426-1460, April.
    7. Peters, Jörg & Langbein, Jörg & Roberts, Gareth, 2016. "Policy evaluation, randomized controlled trials, and external validity—A systematic review," Economics Letters, Elsevier, vol. 147(C), pages 51-54.
    8. Avitabile, Ciro & de Hoyos, Rafael, 2018. "The heterogeneous effect of information on student performance: Evidence from a randomized control trial in Mexico," Journal of Development Economics, Elsevier, vol. 135(C), pages 318-348.
    9. David K. Evans & Arkadipta Ghosh, 2008. "Prioritizing Educational Investments in Children in the Developing World," Working Papers WR-587, RAND Corporation.
    10. Jörg Peters & Jörg Langbein & Gareth Roberts, 2018. "Generalization in the Tropics – Development Policy, Randomized Controlled Trials, and External Validity," The World Bank Research Observer, World Bank, vol. 33(1), pages 34-64.
    11. David K. Evans & Arkadipta Ghosh, 2008. "Prioritizing Educational Investments in Children in the Developing World," Working Papers 587, RAND Corporation.
    12. Damien de Walque & Christine Valente, 2023. "Incentivizing School Attendance in the Presence of Parent-Child Information Frictions," American Economic Journal: Economic Policy, American Economic Association, vol. 15(3), pages 256-285, August.
    13. Figlio, D. & Karbownik, K. & Salvanes, K.G., 2016. "Education Research and Administrative Data," Handbook of the Economics of Education,, Elsevier.
    14. Harounan Kazianga & Leigh Linden & Ali Protik & Matt Sloan, 2015. "Impact Evaluation of Burkina Faso's BRIGHT Program: Design Report," Mathematica Policy Research Reports c0250cd3f27d448ea70d909c3, Mathematica Policy Research.
    15. Heath, Rachel & Mushfiq Mobarak, A., 2015. "Manufacturing growth and the lives of Bangladeshi women," Journal of Development Economics, Elsevier, vol. 115(C), pages 1-15.
    16. Facundo Albornoz & María Victoria Anauati & Melina Furman & Mariana Luzuriaga & María Eugenia Podestá & Inés Taylor, 2020. "Training to Teach Science: Experimental Evidence from Argentina," The World Bank Economic Review, World Bank, vol. 34(2), pages 393-417.
    17. Fazzio, Ila & Eble, Alex & Lumsdaine, Robin L. & Boone, Peter & Bouy, Baboucarr & Hsieh, Pei-Tseng Jenny & Jayanty, Chitra & Johnson, Simon & Silva, Ana Filipa, 2021. "Large learning gains in pockets of extreme poverty: Experimental evidence from Guinea Bissau," Journal of Public Economics, Elsevier, vol. 199(C).
    18. Yasuyuki Sawada & Minhaj Mahmud & Mai Seki & An Le & Hikaru Kawarazaki, 2019. "Fighting the Learning Crisis in Developing Countries: A Randomized Experiment of Self-Learning at the Right Level," CIRJE F-Series CIRJE-F-1127, CIRJE, Faculty of Economics, University of Tokyo.
    19. Felipe Barrera-Osorio & Deon Filmer, 2016. "Incentivizing Schooling for Learning: Evidence on the Impact of Alternative Targeting Approaches," Journal of Human Resources, University of Wisconsin Press, vol. 51(2), pages 461-499.
    20. Masino, Serena & Niño-Zarazúa, Miguel, 2016. "What works to improve the quality of student learning in developing countries?," International Journal of Educational Development, Elsevier, vol. 48(C), pages 53-65.

    More about this item

    JEL classification:

    • D90 - Microeconomics - - Micro-Based Behavioral Economics - - - General
    • I12 - Health, Education, and Welfare - - Health - - - Health Behavior

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:28976. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.