IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0284153.html

Analysis of the medical residency matching algorithm to validate and improve equity

Author

Listed:
  • Briance Mascarenhas
  • Kartikeye Puranam

Abstract

Algorithms are becoming prevalent but are often opaque and need external validation to assess whether or not they meet their purported objectives. The purpose of this study is to validate, using the limited information available, the algorithm used by the National Resident Matching Program (NRMP) whose intention is to match applicants to medical residencies based on applicants’ prioritized preferences. The methodology involved first using randomized computer-generated data to overcome the inaccessible proprietary data on applicant and program rankings. Simulations using these data were run through the compiled algorithm’s procedures to obtain match outcomes. The study’s findings are that the current algorithm’s matches are related to program input but not to applicant input, the applicant’s prioritized ranking of programs. A modified algorithm with student input as the primary factor is then developed and run using the same data, resulting in match outcomes that are related to both applicant and program inputs, improving equity.

Suggested Citation

  • Briance Mascarenhas & Kartikeye Puranam, 2023. "Analysis of the medical residency matching algorithm to validate and improve equity," PLOS ONE, Public Library of Science, vol. 18(4), pages 1-11, April.
    • Handle: RePEc:plo:pone00:0284153
    DOI: 10.1371/journal.pone.0284153
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0284153
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0284153&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0284153?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Maria De‐Arteaga & Stefan Feuerriegel & Maytal Saar‐Tsechansky, 2022. "Algorithmic fairness in business analytics: Directions for research and practice," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3749-3770, October.
    2. Roth, Alvin E., 2003. "The origins, history, and design of the resident match," Scholarly Articles 35059715, Harvard University Department of Economics.
    3. Kartik K. Ganju & Hilal Atasoy & Jeffery McCullough & Brad Greenwood, 2020. "The Role of Decision Support Systems in Attenuating Racial Biases in Healthcare Delivery," Management Science, INFORMS, vol. 66(11), pages 5171-5181, November.
    4. Chia-Yu Chiu & Amara Sarwal & Muzamil Jawed & Venkata Sireesha Chemarthi & Nehad Shabarek, 2021. "Telemedicine experience of NYC Internal Medicine residents during COVID-19 pandemic," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-8, February.
    5. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Felipe Caro & Jean-Edouard Colliard & Elena Katok & Axel Ockenfels & Nicolas Stier-Moses & Catherine Tucker & D. J. Wu, 2026. "Introduction to the Special Issue on the Human-Algorithm Connection," Management Science, INFORMS, vol. 72(1), pages 1-13, January.
    2. Jesse C. Bockstedt & Joseph R. Buckman, 2026. "Humans’ Use of AI Assistance: The Effect of Loss Aversion on Willingness to Delegate Decisions," Management Science, INFORMS, vol. 72(1), pages 323-342, January.
    3. Maria De‐Arteaga & Stefan Feuerriegel & Maytal Saar‐Tsechansky, 2022. "Algorithmic fairness in business analytics: Directions for research and practice," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3749-3770, October.
    4. Muriel Niederle & Alvin E. Roth, 2009. "The Effects of a Centralized Clearinghouse on Job Placement, Wages, and Hiring Practices," NBER Chapters, in: Studies of Labor Market Intermediation, pages 235-271, National Bureau of Economic Research, Inc.
    5. Yongping Bao & Ludwig Danwitz & Fabian Dvorak & Sebastian Fehrler & Lars Hornuf & Hsuan Yu Lin & Bettina von Helversen, 2022. "Similarity and Consistency in Algorithm-Guided Exploration," CESifo Working Paper Series 10188, CESifo.
    6. Marco LiCalzi, 2022. "Bipartite choices," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 45(2), pages 551-568, December.
    7. Michael Vössing & Niklas Kühl & Matteo Lind & Gerhard Satzger, 2022. "Designing Transparency for Effective Human-AI Collaboration," Information Systems Frontiers, Springer, vol. 24(3), pages 877-895, June.
    8. Hamsa Bastani & Osbert Bastani & Wichinpong Park Sinchaisri, 2026. "Improving Human Sequential Decision Making with Reinforcement Learning," Management Science, INFORMS, vol. 72(1), pages 733-755, January.
    9. Samuel N. Kirshner, 2025. "Psychological Distance and Algorithm Aversion: Congruency and Advisor Confidence," Service Science, INFORMS, vol. 17(2-3), pages 74-91, June.
    10. Dimitris Bertsimas & Agni Orfanoudaki, 2021. "Algorithmic Insurance," Papers 2106.00839, arXiv.org, revised Mar 2026.
    11. Mahmud, Hasan & Islam, A.K.M. Najmul & Ahmed, Syed Ishtiaque & Smolander, Kari, 2022. "What influences algorithmic decision-making? A systematic literature review on algorithm aversion," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    12. Bryce McLaughlin & Jann Spiess, 2022. "Algorithmic Assistance with Recommendation-Dependent Preferences," Papers 2208.07626, arXiv.org, revised Oct 2025.
    13. Doumpos, Michalis & Zopounidis, Constantin & Gounopoulos, Dimitrios & Platanakis, Emmanouil & Zhang, Wenke, 2023. "Operational research and artificial intelligence methods in banking," European Journal of Operational Research, Elsevier, vol. 306(1), pages 1-16.
    14. Markus Jung & Mischa Seiter, 2021. "Towards a better understanding on mitigating algorithm aversion in forecasting: an experimental study," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 32(4), pages 495-516, December.
    15. Jan René Judek, 2024. "Willingness to Use Algorithms Varies with Social Information on Weak vs. Strong Adoption: An Experimental Study on Algorithm Aversion," FinTech, MDPI, vol. 3(1), pages 1-11, January.
    16. Kohei Kawaguchi, 2021. "When Will Workers Follow an Algorithm? A Field Experiment with a Retail Business," Management Science, INFORMS, vol. 67(3), pages 1670-1695, March.
    17. Francis de Véricourt & Huseyin Gurkan, 2022. "Is your machine better than you? You may never know," ESMT Research Working Papers ESMT-22-02, ESMT European School of Management and Technology.
    18. Zhu, Yimin & Zhang, Jiemin & Wu, Jifei & Liu, Yingyue, 2022. "AI is better when I'm sure: The influence of certainty of needs on consumers' acceptance of AI chatbots," Journal of Business Research, Elsevier, vol. 150(C), pages 642-652.
    19. Jens Josephson & Joel Shapiro, 2008. "Interviews and adverse selection," Economics Working Papers 1093, Department of Economics and Business, Universitat Pompeu Fabra.
    20. Alvin E. Roth, 2010. "Marketplace Institutions Related to the Timing of Transactions," NBER Working Papers 16556, National Bureau of Economic Research, Inc.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0284153. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.