IDEAS home Printed from https://ideas.repec.org/a/wly/hlthec/v31y2022i7p1368-1380.html
   My bibliography  Save this article

Comparing risk adjustment estimation methods under data availability constraints

Author

Listed:
  • Marica Iommi
  • Savannah Bergquist
  • Gianluca Fiorentini
  • Francesco Paolucci

Abstract

The Italian National Healthcare Service relies on per capita allocation for healthcare funds, despite having a highly detailed and wide range of data to potentially build a complex risk‐adjustment formula. However, heterogeneity in data availability limits the development of a national model. This paper implements and ealuates machine learning (ML) and standard risk‐adjustment models on different data scenarios that a Region or Country may face, to optimize information with the most predictive model. We show that ML achieves a small but generally statistically insignificant improvement of adjusted R2 and mean squared error with fine data granularity compared to linear regression, while in coarse granularity and poor range of variables scenario no differences were observed. The advantage of ML algorithms is greater in the coarse granularity and fair/rich range of variables set and limited with fine granularity scenarios. The inclusion of detailed morbidity‐ and pharmacy‐based adjustors generally increases fit, although the trade‐off of creating adverse economic incentives must be considered.

Suggested Citation

  • Marica Iommi & Savannah Bergquist & Gianluca Fiorentini & Francesco Paolucci, 2022. "Comparing risk adjustment estimation methods under data availability constraints," Health Economics, John Wiley & Sons, Ltd., vol. 31(7), pages 1368-1380, July.
  • Handle: RePEc:wly:hlthec:v:31:y:2022:i:7:p:1368-1380
    DOI: 10.1002/hec.4512
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/hec.4512
    Download Restriction: no

    File URL: https://libkey.io/10.1002/hec.4512?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Thomas G. McGuire & Anna L. Zink & Sherri Rose, 2020. "Simplifying and Improving the Performance of Risk Adjustment Systems," NBER Working Papers 26736, National Bureau of Economic Research, Inc.
    2. Bauhoff, Sebastian & Fischer, Lisa & Göpffarth, Dirk & Wuppermann, Amelie C., 2017. "Plan responses to diagnosis-based payment: Evidence from Germany’s morbidity-based risk adjustment," Journal of Health Economics, Elsevier, vol. 56(C), pages 397-413.
    3. Hong J Kan & Hadi Kharrazi & Hsien-Yen Chang & Dave Bodycombe & Klaus Lemke & Jonathan P Weiner, 2019. "Exploring the use of machine learning for risk adjustment: A comparison of standard and penalized linear regression models in predicting health care costs in older adults," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-13, March.
    4. S. Veen & R. Kleef & W. Ven & R. Vliet, 2015. "Improving the prediction model used in risk equalization: cost and diagnostic information from multiple prior years," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 16(2), pages 201-218, March.
    5. Geruso, Michael & McGuire, Thomas G., 2016. "Tradeoffs in the design of health plan payment systems: Fit, power and balance," Journal of Health Economics, Elsevier, vol. 47(C), pages 1-19.
    6. Michael Geruso & Timothy Layton, 2020. "Upcoding: Evidence from Medicare on Squishy Risk Adjustment," Journal of Political Economy, University of Chicago Press, vol. 128(3), pages 984-1026.
    7. van Kleef, R.C. & van Vliet, R.C.J.A. & van Rooijen, E.M., 2014. "Diagnoses-based cost groups in the Dutch risk-equalization model: The effects of including outpatient diagnoses," Health Policy, Elsevier, vol. 115(1), pages 52-59.
    8. Florian Buchner & Jürgen Wasem & Sonja Schillo, 2017. "Regression Trees Identify Relevant Interactions: Can This Improve the Predictive Performance of Risk Adjustment?," Health Economics, John Wiley & Sons, Ltd., vol. 26(1), pages 74-85, January.
    9. Jones, A.M, 2010. "Models For Health Care," Health, Econometrics and Data Group (HEDG) Working Papers 10/01, HEDG, c/o Department of Economics, University of York.
    10. S. H. C. M. van Veen & R. C. van Kleef & W. P. M. M. van de Ven & R. C. J. A. van Vliet, 2018. "Exploring the predictive power of interaction terms in a sophisticated risk equalization model using regression trees," Health Economics, John Wiley & Sons, Ltd., vol. 27(2), pages 1-12, February.
    11. Beck, Konstantin & Trottmann, Maria & Zweifel, Peter, 2010. "Risk adjustment in health insurance and its long-term effectiveness," Journal of Health Economics, Elsevier, vol. 29(4), pages 489-498, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anell, Anders & Dackehag, Margareta & Dietrichson, Jens & Ellegård, Lina Maria & Kjellsson, Gustav, 2022. "Better Off by Risk Adjustment? Socioeconomic Disparities in Care Utilization in Sweden Following a Payment Reform," Working Papers 2022:15, Lund University, Department of Economics, revised 12 Mar 2024.
    2. Richard C. van Kleef & René C. J. A. van Vliet, 2022. "How to deal with persistently low/high spenders in health plan payment systems?," Health Economics, John Wiley & Sons, Ltd., vol. 31(5), pages 784-805, May.
    3. Timothy J. Layton & Randall P. Ellis & Thomas G. McGuire, 2015. "Assessing Incentives for Adverse Selection in Health Plan Payment Systems," Boston University - Department of Economics - Working Papers Series wp2015-024, Boston University - Department of Economics.
    4. Alexandre Vimont & Henri Leleu & Isabelle Durand-Zaleski, 2022. "Machine learning versus regression modelling in predicting individual healthcare costs from a representative sample of the nationwide claims database in France," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(2), pages 211-223, March.
    5. Richard van Kleef & Thomas McGuire & Rene van Vliet & Wynand van de Ven, 2015. "Improving Risk Equalization with Constrained Regression," NBER Working Papers 21570, National Bureau of Economic Research, Inc.
    6. Richard C. Kleef & Thomas G. McGuire & René C. J. A. Vliet & Wynand P. P. M. de Ven, 2017. "Improving risk equalization with constrained regression," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 18(9), pages 1137-1156, December.
    7. Schmid, Christian P.R. & Beck, Konstantin, 2016. "Re-insurance in the Swiss health insurance market: Fit, power, and balance," Health Policy, Elsevier, vol. 120(7), pages 848-855.
    8. Michael Geruso & Timothy J. Layton & Grace McCormack & Mark Shepard, 2023. "The Two-Margin Problem in Insurance Markets," The Review of Economics and Statistics, MIT Press, vol. 105(2), pages 237-257, March.
    9. Colleen Carey, 2017. "Technological Change and Risk Adjustment: Benefit Design Incentives in Medicare Part D," American Economic Journal: Economic Policy, American Economic Association, vol. 9(1), pages 38-73, February.
    10. Josefa Henriquez & Marica Iommi & Thomas McGuire & Emmanouil Mentzakis & Francesco Paolucci, 2023. "Designing feasible and effective health plan payments in countries with data availability constraints," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 90(1), pages 33-57, March.
    11. Benjamin R. Handel & Jonathan T. Kolstad, 2021. "The Affordable Care Act After a Decade: Industrial Organization of the Insurance Exchanges," NBER Working Papers 29178, National Bureau of Economic Research, Inc.
    12. Pilny, Adam & Wübker, Ansgar & Ziebarth, Nicolas R., 2017. "Introducing risk adjustment and free health plan choice in employer-based health insurance: Evidence from Germany," Journal of Health Economics, Elsevier, vol. 56(C), pages 330-351.
    13. Michael Geruso & Timothy J. Layton, 2017. "Selection in Health Insurance Markets and Its Policy Remedies," Journal of Economic Perspectives, American Economic Association, vol. 31(4), pages 23-50, Fall.
    14. Joseph P. Newhouse & Mary Beth Landrum & Mary Price & J. Michael McWilliams & John Hsu & Thomas G. McGuire, 2019. "The Comparative Advantage of Medicare Advantage," American Journal of Health Economics, University of Chicago Press, vol. 5(2), pages 281-301, Spring.
    15. Daniel W. Sacks & Khoa Vu & Tsan-Yao Huang & Pinar Karaca-Mandic, 2017. "How do insurance firms respond to financial risk sharing regulations? Evidence from the Affordable Care Act," NBER Working Papers 24129, National Bureau of Economic Research, Inc.
    16. Michael Geruso & Timothy Layton & Daniel Prinz, 2019. "Screening in Contract Design: Evidence from the ACA Health Insurance Exchanges," American Economic Journal: Economic Policy, American Economic Association, vol. 11(2), pages 64-107, May.
    17. Daniel W. Sacks & Khoa Vu & Tsan‐Yao Huang & Pinar Karaca‐Mandic, 2021. "How do insurance firms respond to financial risk sharing regulations? Evidence from the Affordable Care Act," Health Economics, John Wiley & Sons, Ltd., vol. 30(6), pages 1443-1460, June.
    18. Timothy J. Layton & Thomas G. McGuire, 2017. "Marketplace Plan Payment Options for Dealing with High-Cost Enrollees," American Journal of Health Economics, University of Chicago Press, vol. 3(2), pages 165-191, Spring.
    19. Richard C. Kleef & Mieke Reuser, 2021. "How the COVID-19 pandemic can distort risk adjustment of health plan payment," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 22(7), pages 1005-1016, September.
    20. Keith M. Marzilli Ericson & Kimberley H. Geissler & Benjamin Lubin, 2018. "The Impact of Partial-Year Enrollment on the Accuracy of Risk-Adjustment Systems: A Framework and Evidence," American Journal of Health Economics, MIT Press, vol. 4(4), pages 454-478, Fall.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:hlthec:v:31:y:2022:i:7:p:1368-1380. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www3.interscience.wiley.com/cgi-bin/jhome/5749 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.