IDEAS home Printed from https://ideas.repec.org/p/bdp/dpaper/0027.html
   My bibliography  Save this paper

Machine predictions and human decisions with variation in payoffs and skill: the case of antibiotic prescribing

Author

Listed:
  • Hannes Ullrich
  • Michael Allan Ribers

Abstract

We analyze how machine learning predictions may improve antibiotic prescribing in the context of the global health policy challenge of increasing antibiotic resistance. Estimating a binary antibiotic treatment choice model, we find variation in the skill to diagnose bacterial urinary tract infections and in how general practitioners trade off the expected cost of resistance against antibiotic curative benefits. In counterfactual analyses we find that providing machine learning predictions of bacterial infections to physicians increases prescribing efficiency. However, to achieve the policy objective of reducing antibiotic prescribing, physicians must also be incentivized. Our results highlight the potential misalignment of social and heterogeneous individual objectives in utilizing machine learning for prediction policy problems.

Suggested Citation

  • Hannes Ullrich & Michael Allan Ribers, 2023. "Machine predictions and human decisions with variation in payoffs and skill: the case of antibiotic prescribing," Berlin School of Economics Discussion Papers 0027, Berlin School of Economics.
  • Handle: RePEc:bdp:dpaper:0027
    DOI: 10.48462/opus4-5111
    as

    Download full text from publisher

    File URL: https://opus4.kobv.de/opus4-hsog/files/5111/BSE_DP_0027.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.48462/opus4-5111?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ashesh Rambachan, 2022. "Identifying Prediction Mistakes in Observational Data," NBER Chapters, in: Economics of Artificial Intelligence, National Bureau of Economic Research, Inc.
    2. Kwon, Illoong & Jun, Daesung, 2015. "Information disclosure and peer effects in the use of antibiotics," Journal of Health Economics, Elsevier, vol. 42(C), pages 1-16.
    3. Amitabh Chandra & Douglas O. Staiger, 2007. "Productivity Spillovers in Health Care: Evidence from the Treatment of Heart Attacks," Journal of Political Economy, University of Chicago Press, vol. 115(1), pages 103-140.
    4. Will Dobbie & Andres Liberman & Daniel Paravisini & Vikram Pathania, 2021. "Measuring Bias in Consumer Lending [Loan Prospecting and the Loss of Soft Information]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(6), pages 2799-2832.
    5. Jon Kleinberg & Jens Ludwig & Sendhil Mullainathan & Ziad Obermeyer, 2015. "Prediction Policy Problems," American Economic Review, American Economic Association, vol. 105(5), pages 491-495, May.
    6. Epstein, Andrew J. & Nicholson, Sean, 2009. "The formation and evolution of physician treatment styles: An application to cesarean sections," Journal of Health Economics, Elsevier, vol. 28(6), pages 1126-1140, December.
    7. Sendhil Mullainathan & Ziad Obermeyer, 2022. "Diagnosing Physician Error: A Machine Learning Approach to Low-Value Health Care [“The Determinants of Productivity in Medical Testing: Intensity and Allocation of Care,”]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 679-727.
    8. Shan Huang & Hannes Ullrich, 2023. "Provider effects in antibiotic prescribing: Evidence from physician exits," Berlin School of Economics Discussion Papers 0018, Berlin School of Economics.
    9. Aaron Chalfin & Oren Danieli & Andrew Hillis & Zubin Jelveh & Michael Luca & Jens Ludwig & Sendhil Mullainathan, 2016. "Productivity and Selection of Human Capital with Machine Learning," American Economic Review, American Economic Association, vol. 106(5), pages 124-127, May.
    10. Daniel Bennett & Che-Lun Hung & Tsai-Ling Lauderdale, 2015. "Health Care Competition and Antibiotic Use in Taiwan," Journal of Industrial Economics, Wiley Blackwell, vol. 63(2), pages 371-393, June.
    11. Nikhil Agarwal & Alex Moehring & Pranav Rajpurkar & Tobias Salz, 2023. "Combining Human Expertise with Artificial Intelligence: Experimental Evidence from Radiology," NBER Working Papers 31422, National Bureau of Economic Research, Inc.
    12. Janet Currie & W. Bentley MacLeod, 2017. "Diagnosing Expertise: Human Capital, Decision Making, and Performance among Physicians," Journal of Labor Economics, University of Chicago Press, vol. 35(1), pages 1-43.
    13. Mohsen Bayati & Mark Braverman & Michael Gillam & Karen M Mack & George Ruiz & Mark S Smith & Eric Horvitz, 2014. "Data-Driven Decisions for Reducing Readmissions for Heart Failure: General Methodology and Case Study," PLOS ONE, Public Library of Science, vol. 9(10), pages 1-9, October.
    14. Manski, Charles F., 2023. "Probabilistic prediction for binary treatment choice: With focus on personalized medicine," Journal of Econometrics, Elsevier, vol. 234(2), pages 647-663.
    15. Jason Abaluck & Leila Agha & Chris Kabrhel & Ali Raja & Arjun Venkatesh, 2016. "The Determinants of Productivity in Medical Testing: Intensity and Allocation of Care," American Economic Review, American Economic Association, vol. 106(12), pages 3730-3764, December.
    16. Amy Finkelstein & Matthew Gentzkow & Heidi Williams, 2016. "Sources of Geographic Variation in Health Care: Evidence From PatientMigration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1681-1726.
    17. Currie, Janet & MacLeod, W. Bentley & Van Parys, Jessica, 2016. "Provider practice style and patient health outcomes: The case of heart attacks," Journal of Health Economics, Elsevier, vol. 47(C), pages 64-80.
    18. Ida Lykke Kristiansen & Sophie Yanying Sheng, 2022. "Doctor Who? The Effect of Physician-Patient Match on The SES-Health Gradient," CEBI working paper series 22-05, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    19. Michael Allan Ribers & Hannes Ullrich, 2023. "Machine learning and physician prescribing: a path to reduced antibiotic use," Berlin School of Economics Discussion Papers 0019, Berlin School of Economics.
    20. Jishnu Das & Alaka Holla & Aakash Mohpal & Karthik Muralidharan, 2016. "Quality and Accountability in Health Care Delivery: Audit-Study Evidence from Primary Care in India," American Economic Review, American Economic Association, vol. 106(12), pages 3765-3799, December.
    21. Andini, Monica & Ciani, Emanuele & de Blasio, Guido & D'Ignazio, Alessio & Salvestrini, Viola, 2018. "Targeting with machine learning: An application to a tax rebate program in Italy," Journal of Economic Behavior & Organization, Elsevier, vol. 156(C), pages 86-102.
    22. David C Chan & Matthew Gentzkow & Chuan Yu, 2022. "Selection with Variation in Diagnostic Skill: Evidence from Radiologists [The Determinants of Productivity in Medical Testing: Intensity and Allocation of Care]," The Quarterly Journal of Economics, Oxford University Press, vol. 137(2), pages 729-783.
    23. Dubois, Pierre & Gokkoca, Gokce, 2023. "Antibiotic Demand in the Presence of Antimicrobial Resistance," TSE Working Papers 23-1457, Toulouse School of Economics (TSE).
    24. Sergei Koulayev & Emilia Simeonova & Niels Skipper, 2017. "Can Physicians Affect Patient Adherence With Medication?," Health Economics, John Wiley & Sons, Ltd., vol. 26(6), pages 779-794, June.
    25. Jason Abaluck & Leila Agha & David C. Chan Jr & Daniel Singer & Diana Zhu, 2020. "Fixing Misallocation with Guidelines: Awareness vs. Adherence," NBER Working Papers 27467, National Bureau of Economic Research, Inc.
    26. Jon Kleinberg & Himabindu Lakkaraju & Jure Leskovec & Jens Ludwig & Sendhil Mullainathan, 2018. "Human Decisions and Machine Predictions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(1), pages 237-293.
    27. Currie, Janet & Lin, Wanchuan & Meng, Juanjuan, 2014. "Addressing antibiotic abuse in China: An experimental audit study," Journal of Development Economics, Elsevier, vol. 110(C), pages 39-51.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Michael Allan Ribers & Hannes Ullrich, 2020. "Machine Predictions and Human Decisions with Variation in Payoffs and Skill," CESifo Working Paper Series 8702, CESifo.
    2. Michael Allan Ribers & Hannes Ullrich, 2023. "Machine learning and physician prescribing: a path to reduced antibiotic use," Berlin School of Economics Discussion Papers 0019, Berlin School of Economics.
    3. Michael A. Ribers & Hannes Ullrich, 2019. "Battling Antibiotic Resistance: Can Machine Learning Improve Prescribing?," Discussion Papers of DIW Berlin 1803, DIW Berlin, German Institute for Economic Research.
    4. Shan Huang & Hannes Ullrich, 2023. "Provider effects in antibiotic prescribing: Evidence from physician exits," Berlin School of Economics Discussion Papers 0018, Berlin School of Economics.
    5. Shan Huang & Hannes Ullrich, 2021. "Physician Effects in Antibiotic Prescribing: Evidence from Physician Exits," CESifo Working Paper Series 9204, CESifo.
    6. Attema, Arthur E. & Galizzi, Matteo M. & Groß, Mona & Hennig-Schmidt, Heike & Karay, Yassin & L’Haridon, Olivier & Wiesen, Daniel, 2023. "The formation of physician altruism," Journal of Health Economics, Elsevier, vol. 87(C).
    7. Avdic, Daniel & Ivets, Maryna & Lagerqvist, Bo & Sriubaite, Ieva, 2023. "Providers, peers and patients. How do physicians’ practice environments affect patient outcomes?," Journal of Health Economics, Elsevier, vol. 89(C).
    8. Diego Comin & Jonathan Skinner & Douglas Staiger, 2022. "Overconfidence and technology adoption in health care," IFS Working Papers W22/33, Institute for Fiscal Studies.
    9. Tafti, Elena Ashtari, 2023. "Technology, Skills, and Performance: The Case of Robots in Surgery," CINCH Working Paper Series (since 2020) 78746, Duisburg-Essen University Library, DuEPublico.
    10. Gautam Gowrisankaran & Keith Joiner & Pierre Thomas Léger, 2023. "Physician Practice Style and Healthcare Costs: Evidence from Emergency Departments," Management Science, INFORMS, vol. 69(6), pages 3202-3219, June.
    11. Ivan Badinski & Amy Finkelstein & Matthew Gentzkow & Peter Hull, 2023. "Geographic Variation in Healthcare Utilization: The Role of Physicians," NBER Working Papers 31749, National Bureau of Economic Research, Inc.
    12. Elena Ashtari Tafti, 2022. "Technology, skills, and performance: the case of robots in surgery," IFS Working Papers W22/46, Institute for Fiscal Studies.
    13. Simonsen, Marianne & Skipper, Lars & Skipper, Niels & Thingholm, Peter Rønø, 2021. "Discontinuity in care: Practice closures among primary care providers and patient health care utilization," Journal of Health Economics, Elsevier, vol. 80(C).
    14. W. Bentley MacLeod, 2017. "Viewpoint: The human capital approach to inference," Canadian Journal of Economics, Canadian Economics Association, vol. 50(1), pages 5-39, February.
    15. Emilia Simeonova & Niels Skipper & Peter R. Thingholm, 2020. "Physician Health Management Skills and Patient Outcomes," NBER Working Papers 26735, National Bureau of Economic Research, Inc.
    16. Garbero, Alessandra & Sakos, Grayson & Cerulli, Giovanni, 2023. "Towards data-driven project design: Providing optimal treatment rules for development projects," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    17. Sendhil Mullainathan & Ziad Obermeyer, 2019. "Diagnosing Physician Error: A Machine Learning Approach to Low-Value Health Care," NBER Working Papers 26168, National Bureau of Economic Research, Inc.
    18. Fadlon, Itzik & Van Parys, Jessica, 2020. "Primary care physician practice styles and patient care: Evidence from physician exits in Medicare," Journal of Health Economics, Elsevier, vol. 71(C).
    19. Shan Huang & Michael Allan Ribers & Hannes Ullrich, 2021. "The Value of Data for Prediction Policy Problems: Evidence from Antibiotic Prescribing," Discussion Papers of DIW Berlin 1939, DIW Berlin, German Institute for Economic Research.
    20. Wu, Bingxiao & David, Guy, 2022. "Information, relative skill, and technology abandonment," Journal of Health Economics, Elsevier, vol. 83(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bdp:dpaper:0027. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Christian Reiter (email available below). General contact details of provider: https://edirc.repec.org/data/bdpemde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.