IDEAS home Printed from https://ideas.repec.org/a/eee/jhecon/v78y2021ics0167629621000667.html
   My bibliography  Save this article

How do machine learning algorithms perform in predicting hospital choices? evidence from changing environments

Author

Listed:
  • Raval, Devesh
  • Rosenbaum, Ted
  • Wilson, Nathan E.

Abstract

Researchers have found that machine learning methods are typically better at prediction than econometric models when the choice environment is stable. We study hospital demand models, and evaluate the relative performance of machine learning algorithms when the choice environment changes substantially due to natural disasters that closed previously available hospitals. While machine learning algorithms outperform traditional econometric models in prediction, the gain they provide shrinks when patients’ choice sets are more profoundly affected. We show that traditional econometric methods provide important additional information when there are major changes in the choice environment.

Suggested Citation

  • Raval, Devesh & Rosenbaum, Ted & Wilson, Nathan E., 2021. "How do machine learning algorithms perform in predicting hospital choices? evidence from changing environments," Journal of Health Economics, Elsevier, vol. 78(C).
  • Handle: RePEc:eee:jhecon:v:78:y:2021:i:c:s0167629621000667
    DOI: 10.1016/j.jhealeco.2021.102481
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167629621000667
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jhealeco.2021.102481?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kate Ho & Robin S. Lee, 2019. "Equilibrium Provider Networks: Bargaining and Exclusion in Health Care Markets," American Economic Review, American Economic Association, vol. 109(2), pages 473-522, February.
    2. Gautam Gowrisankaran & Aviv Nevo & Robert Town, 2015. "Mergers When Prices Are Negotiated: Evidence from the Hospital Industry," American Economic Review, American Economic Association, vol. 105(1), pages 172-203, January.
    3. Martin Gaynor & Kate Ho & Robert J. Town, 2015. "The Industrial Organization of Health-Care Markets," Journal of Economic Literature, American Economic Association, vol. 53(2), pages 235-284, June.
    4. Stefan Wager & Susan Athey, 2018. "Estimation and Inference of Heterogeneous Treatment Effects using Random Forests," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1228-1242, July.
    5. Patrick Bajari & Denis Nekipelov & Stephen P. Ryan & Miaoyu Yang, 2015. "Demand Estimation with Machine Learning and Model Combination," NBER Working Papers 20955, National Bureau of Economic Research, Inc.
    6. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    7. Timmermann, Allan, 2006. "Forecast Combinations," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196, Elsevier.
    8. Capistrán, Carlos & Timmermann, Allan, 2009. "Forecast Combination With Entry and Exit of Experts," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
    9. Katherine Ho, 2006. "The welfare effects of restricted hospital choice in the US medical care market," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(7), pages 1039-1079.
    10. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    11. Athey, Susan & Imbens, Guido W., 2019. "Machine Learning Methods Economists Should Know About," Research Papers 3776, Stanford University, Graduate School of Business.
    12. Scornet, Erwan, 2016. "On the asymptotics of random forests," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 72-83.
    13. Ciliberto, Federico & Dranove, David, 2006. "The effect of physician-hospital affiliations on hospital prices in California," Journal of Health Economics, Elsevier, vol. 25(1), pages 29-38, January.
    14. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    15. Martin S. Gaynor & Samuel A. Kleiner & William B. Vogt, 2013. "A Structural Approach to Market Definition With an Application to the Hospital Industry," Journal of Industrial Economics, Wiley Blackwell, vol. 61(2), pages 243-289, June.
    16. Fu, Wei & Simonoff, Jeffrey S., 2015. "Unbiased regression trees for longitudinal and clustered data," Computational Statistics & Data Analysis, Elsevier, vol. 88(C), pages 53-74.
    17. Susan Athey & Guido W. Imbens, 2019. "Machine Learning Methods That Economists Should Know About," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 685-725, August.
    18. Patrick Bajari & Denis Nekipelov & Stephen P. Ryan & Miaoyu Yang, 2015. "Machine Learning Methods for Demand Estimation," American Economic Review, American Economic Association, vol. 105(5), pages 481-485, May.
    19. Devesh Raval & Ted Rosenbaum, 2018. "Why Do Previous Choices Matter for Hospital Demand? Decomposing Switching Costs from Unobserved Preferences," The Review of Economics and Statistics, MIT Press, vol. 100(5), pages 906-915, December.
    20. Capps, Cory & Dranove, David & Satterthwaite, Mark, 2003. "Competition and Market Power in Option Demand Markets," RAND Journal of Economics, The RAND Corporation, vol. 34(4), pages 737-763, Winter.
    21. Joseph Farrell & David Balan & Keith Brand & Brett Wendling, 2011. "Economics at the FTC: Hospital Mergers, Authorized Generic Drugs, and Consumer Credit Markets," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 39(4), pages 271-296, December.
    22. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    23. Christopher Garmon, 2017. "The accuracy of hospital merger screening methods," RAND Journal of Economics, RAND Corporation, vol. 48(4), pages 1068-1102, December.
    24. Devesh Raval & Ted Rosenbaum & Steven A. Tenn, 2017. "A Semiparametric Discrete Choice Model: An Application To Hospital Mergers," Economic Inquiry, Western Economic Association International, vol. 55(4), pages 1919-1944, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Devesh Raval & Ted Rosenbaum & Nathan E. Wilson, 2022. "Using disaster‐induced closures to evaluate discrete choice models of hospital demand," RAND Journal of Economics, RAND Corporation, vol. 53(3), pages 561-589, September.
    2. Devesh Raval & Ted Rosenbaum, 2021. "Why is Distance Important for Hospital Choice? Separating Home Bias From Transport Costs," Journal of Industrial Economics, Wiley Blackwell, vol. 69(2), pages 338-368, June.
    3. Abigail Ferguson & Nellie Lew & Michael Lipsitz & Devesh Raval, 2023. "Economics at the FTC: Spatial Demand, Veterinary Hospital Mergers, Rulemaking, and Noncompete Agreements," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 63(4), pages 435-465, December.
    4. Ellis, Cameron M. & Esson, Meghan I., 2021. "Crowd-Out and Emergency Department Utilization," Journal of Health Economics, Elsevier, vol. 80(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Devesh Raval & Ted Rosenbaum & Nathan E. Wilson, 2022. "Using disaster‐induced closures to evaluate discrete choice models of hospital demand," RAND Journal of Economics, RAND Corporation, vol. 53(3), pages 561-589, September.
    2. Martin Gaynor & Kate Ho & Robert J. Town, 2015. "The Industrial Organization of Health-Care Markets," Journal of Economic Literature, American Economic Association, vol. 53(2), pages 235-284, June.
    3. Abigail Ferguson & Nellie Lew & Michael Lipsitz & Devesh Raval, 2023. "Economics at the FTC: Spatial Demand, Veterinary Hospital Mergers, Rulemaking, and Noncompete Agreements," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 63(4), pages 435-465, December.
    4. Netta Barak‐Corren & Yoav Kan‐Tor & Nelson Tebbe, 2022. "Examining the effects of antidiscrimination laws on children in the foster care and adoption systems," Journal of Empirical Legal Studies, John Wiley & Sons, vol. 19(4), pages 1003-1066, December.
    5. Rodríguez-Vargas, Adolfo, 2020. "Forecasting Costa Rican inflation with machine learning methods," Latin American Journal of Central Banking (previously Monetaria), Elsevier, vol. 1(1).
    6. Michael C Knaus, 2022. "Double machine learning-based programme evaluation under unconfoundedness [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 602-627.
    7. David J. Balan & Keith Brand, 2023. "Simulating Hospital Merger Simulations," Journal of Industrial Economics, Wiley Blackwell, vol. 71(1), pages 47-123, March.
    8. Eric Barrette & Gautam Gowrisankaran & Robert Town, 2020. "Countervailing Market Power and Hospital Competition," NBER Working Papers 27005, National Bureau of Economic Research, Inc.
    9. Akash Malhotra, 2021. "A hybrid econometric–machine learning approach for relative importance analysis: prioritizing food policy," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 11(3), pages 549-581, September.
    10. Nathan E. Wilson, 2021. "The Impact of Competition on Investment: Evidence From California Hospitals," Journal of Industrial Economics, Wiley Blackwell, vol. 69(1), pages 1-32, March.
    11. Michael Vita & Keith Brand & Miriam Larson-Koester & Nathan Petek & Charles Taragin & William Violette & Daniel H. Wood, 2022. "Economics at the FTC: Estimating Harm from Deception and Analyzing Mergers," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 61(4), pages 405-438, December.
    12. Tatiana de Macedo Nogueira Lima, 2022. "Documento de Trabalho 03/2022 - Aprendizado de máquina e antitruste," Documentos de Trabalho 2022030, Conselho Administrativo de Defesa Econômica (Cade), Departamento de Estudos Econômicos.
    13. Tsang, Andrew, 2021. "Uncovering Heterogeneous Regional Impacts of Chinese Monetary Policy," MPRA Paper 110703, University Library of Munich, Germany.
    14. Kyle Colangelo & Ying-Ying Lee, 2019. "Double debiased machine learning nonparametric inference with continuous treatments," CeMMAP working papers CWP54/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    15. Christopher Conlon & Julie Holland Mortimer, 2021. "Empirical properties of diversion ratios," RAND Journal of Economics, RAND Corporation, vol. 52(4), pages 693-726, December.
    16. Kyle Colangelo & Ying-Ying Lee, 2020. "Double Debiased Machine Learning Nonparametric Inference with Continuous Treatments," Papers 2004.03036, arXiv.org, revised Sep 2023.
    17. Aysegül Kayaoglu & Ghassan Baliki & Tilman Brück & Melodie Al Daccache & Dorothee Weiffen, 2023. "How to conduct impact evaluations in humanitarian and conflict settings," HiCN Working Papers 387, Households in Conflict Network.
    18. Amitabh Chandra & Courtney Coile & Corina Mommaerts, 2023. "What Can Economics Say about Alzheimer's Disease?," Journal of Economic Literature, American Economic Association, vol. 61(2), pages 428-470, June.
    19. Combes, Pierre-Philippe & Gobillon, Laurent & Zylberberg, Yanos, 2022. "Urban economics in a historical perspective: Recovering data with machine learning," Regional Science and Urban Economics, Elsevier, vol. 94(C).
    20. Goller, Daniel & Lechner, Michael & Moczall, Andreas & Wolff, Joachim, 2020. "Does the estimation of the propensity score by machine learning improve matching estimation? The case of Germany's programmes for long term unemployed," Labour Economics, Elsevier, vol. 65(C).

    More about this item

    Keywords

    Machine learning; Hospitals; Natural experiment; Patient choice; Prediction;
    All these keywords.

    JEL classification:

    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General
    • I11 - Health, Education, and Welfare - - Health - - - Analysis of Health Care Markets
    • L1 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance
    • L41 - Industrial Organization - - Antitrust Issues and Policies - - - Monopolization; Horizontal Anticompetitive Practices

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jhecon:v:78:y:2021:i:c:s0167629621000667. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505560 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.