IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v170y2024ics0304387824000567.html

Using technology to prevent fraud in high stakes national school examinations: Evidence from Indonesia

Author

Listed:
  • Berkhout, Emilie
  • Pradhan, Menno
  • Rahmawati,
  • Suryadarma, Daniel
  • Swarnata, Arya

Abstract

Cheating reduces the signaling value of examinations. It also shifts the focus of teachers and students away from learning. Combating widespread cheating is difficult as students, teachers, and bureaucrats all benefit from high reported grades. We evaluate the impact of computer-based testing (CBT), an at-scale policy implemented by the Indonesian government to reduce widespread cheating in the national examinations. Exploiting the phased roll-out of the program from 2015 to 2019, we find that test scores declined dramatically, by 0.5 standard deviations, after the introduction of CBT. Schools with response patterns that indicated cheating prior to CBT adoption experienced a steeper decline. The effect is similar between schools with and without access to a computer lab, indicating that the reduction in the opportunity to cheat is the main reason for the test score decline. In districts with high adoption of CBT, schools that still used paper-based exams cheated less and scored lower, indicating spillovers of CBT. The results highlight the potential role of technology in improving the effectiveness in efforts to overcome collusive behavior in the education sector.

Suggested Citation

  • Berkhout, Emilie & Pradhan, Menno & Rahmawati, & Suryadarma, Daniel & Swarnata, Arya, 2024. "Using technology to prevent fraud in high stakes national school examinations: Evidence from Indonesia," Journal of Development Economics, Elsevier, vol. 170(C).
  • Handle: RePEc:eee:deveco:v:170:y:2024:i:c:s0304387824000567
    DOI: 10.1016/j.jdeveco.2024.103307
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387824000567
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jdeveco.2024.103307?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    2. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    3. Derek Neal, 2013. "The Consequences of Using one Assessment System to Pursue two Objectives," The Journal of Economic Education, Taylor & Francis Journals, vol. 44(4), pages 339-352, October.
    4. Karthik Muralidharan & Paul Niehaus, 2017. "Experimentation at Scale," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 103-124, Fall.
    5. Noam Angrist & David K. Evans & Deon Filmer & Rachel Glennerster & F. Halsey Rogers & Shwetlena Sabarwal, 2020. "How to Improve Education Outcomes Most Efficiently? A Comparison of 150 Interventions Using the New Learning-Adjusted Years of Schooling Metric," Working Papers 558, Center for Global Development.
    6. Bertoni, Marco & Brunello, Giorgio & Rocco, Lorenzo, 2013. "When the cat is near, the mice won't play: The effect of external examiners in Italian schools," Journal of Public Economics, Elsevier, vol. 104(C), pages 65-77.
    7. César Martinelli & Susan W. Parker & Ana Cristina Pérez-Gea & Rodimiro Rodrigo, 2018. "Cheating and Incentives: Learning from a Policy Experiment," American Economic Journal: Economic Policy, American Economic Association, vol. 10(1), pages 298-325, February.
    8. Derek Neal, 2013. "The Consequences of Using One Assessment System To Pursue Two Objectives," NBER Working Papers 19214, National Bureau of Economic Research, Inc.
    9. Roberto Galbiati & Emeric Henry & Nicolas Jacquemet & Max Lobeck, 2021. "How laws affect the perception of norms: Empirical evidence from the lockdown," PLOS ONE, Public Library of Science, vol. 16(9), pages 1-14, September.
    10. Joshua Angrist & Victor Lavy, 2009. "The Effects of High Stakes High School Achievement Awards: Evidence from a Randomized Trial," American Economic Review, American Economic Association, vol. 99(4), pages 1384-1414, September.
    11. Brian A. Jacob & Steven D. Levitt, 2003. "Rotten Apples: An Investigation of the Prevalence and Predictors of Teacher Cheating," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(3), pages 843-877.
    12. Claudio Lucifora & Marco Tonello, 2020. "Monitoring and Sanctioning Cheating at School: What Works? Evidence from a National Evaluation Program," Journal of Human Capital, University of Chicago Press, vol. 14(4), pages 584-616.
    13. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    14. Battistin, Erich & De Nadai, Michele & Vuri, Daniela, 2017. "Counting rotten apples: Student achievement and score manipulation in Italian elementary Schools," Journal of Econometrics, Elsevier, vol. 200(2), pages 344-362.
    15. Oana Borcan & Mikael Lindahl & Andreea Mitrut, 2017. "Fighting Corruption in Education: What Works and Who Benefits?," American Economic Journal: Economic Policy, American Economic Association, vol. 9(1), pages 180-209, February.
    16. Thomas S. Dee & Will Dobbie & Brian A. Jacob & Jonah Rockoff, 2019. "The Causes and Consequences of Test Score Manipulation: Evidence from the New York Regents Examinations," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 382-423, July.
    17. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    18. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    19. Jacob, Brian A., 2005. "Accountability, incentives and behavior: the impact of high-stakes testing in the Chicago Public Schools," Journal of Public Economics, Elsevier, vol. 89(5-6), pages 761-796, June.
    20. Daniel Rodriguez-Segura, 2022. "EdTech in Developing Countries: A Review of the Evidence [From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application]," The World Bank Research Observer, World Bank, vol. 37(2), pages 171-203.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Singh, Abhijeet & Berg, Petter, 2024. "Myths of official measurement: Limits to test-based education reforms with weak governance," Journal of Public Economics, Elsevier, vol. 239(C).
    2. Clara Augustin & Daniel Gutknecht & Cenchen Liu, 2025. "Staggered Adoption DiD Designs with Misclassification and Anticipation," Papers 2507.20415, arXiv.org, revised Dec 2025.
    3. Asadullah, M. Niaz & Jilani, Amir Hamza & Negara, Siwage Dharma & Suryadarma, Daniel, 2025. "Improving the quality of basic education in ASEAN–Emerging challenges and reforms," International Journal of Educational Development, Elsevier, vol. 116(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Bertoni & Giorgio Brunello & Marco Alberto De Benedetto & Maria De Paola, 2019. "External Monitors And Score Manipulation In Italian Schools: Symptomatic Treatment Or Cure?," Working Papers 201907, Università della Calabria, Dipartimento di Economia, Statistica e Finanza "Giovanni Anania" - DESF.
    2. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    3. Sergio Longobardi & Patrizia Falzetti & Margherita Maria Pagliuca, 2018. "Quis custiodet ipsos custodes? How to detect and correct teacher cheating in Italian student data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 27(3), pages 515-543, August.
    4. Shirin, Farzana, 2023. "Does Teacher Salary Support Improve Student Learning Outcomes," 2023 Annual Meeting, July 23-25, Washington D.C. 335793, Agricultural and Applied Economics Association.
    5. Kim, Yoonjung, 2025. "The effects of universal free lunch provision on student achievement: Evidence from South Korea," Journal of Economic Behavior & Organization, Elsevier, vol. 238(C).
    6. Erich Battistin, 2016. "How manipulating test scores affects school accountability and student achievement," World of Labour, LISER, pages 295-295, September.
    7. repec:ags:aaea22:335793 is not listed on IDEAS
    8. Morton, Emily & Thompson, Paul N. & Kuhfeld, Megan, 2024. "A multi-state, student-level analysis of the effects of the four-day school week on student achievement and growth," Economics of Education Review, Elsevier, vol. 100(C).
    9. Cuesta, José Ignacio & González, Felipe & Larroulet Philippi, Cristian, 2020. "Distorted quality signals in school markets," Journal of Development Economics, Elsevier, vol. 147(C).
    10. Singh, Abhijeet & Berg, Petter, 2024. "Myths of official measurement: Limits to test-based education reforms with weak governance," Journal of Public Economics, Elsevier, vol. 239(C).
    11. Leschnig, Lisa & Schwerdt, Guido & Zigova, Katarina, 2022. "Central exams and adult skills: Evidence from PIAAC," Economics of Education Review, Elsevier, vol. 90(C).
    12. Bas Scheer & Wiljan van den Berge & Maarten Goos & Alan Manning & Anna Salomons, 2022. "Alternative Work Arrangements and Worker Outcomes: Evidence from Payrolling," CPB Discussion Paper 435, CPB Netherlands Bureau for Economic Policy Analysis.
    13. Mac Clay, Pablo & Börner, Jan & Sellare, Jorge, 2023. "Institutional and macroeconomic stability mediate the effect of auctions on renewable energy capacity," Energy Policy, Elsevier, vol. 180(C).
    14. Nadja van 't Hoff & Giovanni Mellace & Seetha Menon, 2025. "Gender Differences in Healthcare Utilisation -- Evidence from Unexpected Adverse Health Shocks," Papers 2509.01310, arXiv.org.
    15. Stefan Bauernschuster & Michael Grimm & Cathy M. Hajo, 2023. "The Impact of Margaret Sanger’s Birth Control Clinics on Early 20th Century U.S. Fertility and Mortality," CESifo Working Paper Series 10421, CESifo.
    16. Cocco, Valentin & Chakir, Raja & Mouysset, Lauriane, 2025. "Guilty or scapegoat? Land consolidation and hedgerow decline," Journal of Environmental Economics and Management, Elsevier, vol. 133(C).
    17. Rik Chakraborti & Gavin Roberts, 2023. "How price-gouging regulation undermined COVID-19 mitigation: county-level evidence of unintended consequences," Public Choice, Springer, vol. 196(1), pages 51-83, July.
    18. Luo, Lianfa & Cheng, Zhiming & Ye, Qingqing & Cheng, Yanjun & Smyth, Russell & Yang, Zhiqing & Zhang, Le, 2024. "Nonmonetary awards and innovation: Evidence from winning China's Top Brand Contest," China Economic Review, Elsevier, vol. 86(C).
    19. Görg, Holger & Lehr, Jakob, 2024. "Short and medium-term effects of foreign acquisitions on manufacturing firms: Evidence from Germany," Open Access Publications from Kiel Institute for the World Economy 302104, Kiel Institute for the World Economy.
    20. Hashida, Yukiko & Dundas, Steven J., 2023. "The effects of a voluntary property buyout and acquisition program on coastal housing markets: Evidence from New York," Journal of Environmental Economics and Management, Elsevier, vol. 121(C).
    21. Maclean, J. Catherine & Pichler, Stefan & Ziebarth, Nicolas R., 2020. "Mandated Sick Pay: Coverage, Utilization, and Welfare Effects," IZA Discussion Papers 13132, IZA Network @ LISER.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • H52 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Education
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:170:y:2024:i:c:s0304387824000567. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.