IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v341y2024i1d10.1007_s10479-024-06008-2.html
   My bibliography  Save this article

COVID-19 vaccination performance of the U.S. states: a hybrid model of DEA and ensemble machine learning methods

Author

Listed:
  • Ozlem Cosgun

    (Montclair State University)

  • Gamze Ogcu Kaya

    (Sampoerna University)

  • Cumhur Cosgun

    (Pennsylvania Department of Transportation, Bureau of Construction and Materials)

Abstract

Vaccination is seen as the most promising one among the efforts to stop COVID-19 and the U.S. government has given great importance to vaccination. However, which states have performed well in administering COVID-19 vaccines and which have not is an open significant question. Another important question is what makes a state more successful than others when evaluating vaccination performance. To answer both of these questions, we proposed a hybrid method that consists of Data Envelopment Analysis and Ensemble ML Methods. DEA was employed to find the vaccine efficiency of the states using the data aggregated from counties. ML techniques are then applied for the vaccine efficiency prediction and understanding the significance of the variables in the prediction. Our findings revealed that there are considerable differences between U.S. States’ performance and only 16 of the states were efficient in terms of their vaccination performance. Furthermore, Light GBM, Random Forest and XGBoost models provided the best results among the five ensemble machine learning methods that were applied. Therefore, an information fusion-based sensitivity analysis method was used to combine the results of each ML technique and ascertain the relative significance of the factors in the prediction of the efficiency. As the findings for factors affecting vaccination performance, percentage of vaccine doses delivered and COVID-19 deaths were found to be the major influential factors on the prediction of the efficiency and percentage of fully vaccinated people, the number of healthcare employees and human development index followed these variables.

Suggested Citation

  • Ozlem Cosgun & Gamze Ogcu Kaya & Cumhur Cosgun, 2024. "COVID-19 vaccination performance of the U.S. states: a hybrid model of DEA and ensemble machine learning methods," Annals of Operations Research, Springer, vol. 341(1), pages 699-729, October.
  • Handle: RePEc:spr:annopr:v:341:y:2024:i:1:d:10.1007_s10479-024-06008-2
    DOI: 10.1007/s10479-024-06008-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-024-06008-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10479-024-06008-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Krauss, Christopher & Do, Xuan Anh & Huck, Nicolas, 2017. "Deep neural networks, gradient-boosted trees, random forests: Statistical arbitrage on the S&P 500," European Journal of Operational Research, Elsevier, vol. 259(2), pages 689-702.
    2. Zehra Önen & Serpil Sayın, 2018. "Evaluating Healthcare System Efficiency of OECD Countries: A DEA-Based Study," International Series in Operations Research & Management Science, in: Cengiz Kahraman & Y. Ilker Topcu (ed.), Operations Research Applications in Health Care Management, chapter 0, pages 141-158, Springer.
    3. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    4. Nahra, Tammie A. & Mendez, David & Alexander, Jeffrey A., 2009. "Employing super-efficiency analysis as an alternative to DEA: An application in outpatient substance abuse treatment," European Journal of Operational Research, Elsevier, vol. 196(3), pages 1097-1106, August.
    5. Ya Chen & Justin Wang & Joe Zhu & H. David Sherman & Shin-Yi Chou, 2019. "How the Great Recession affects performance: a case of Pennsylvania hospitals using DEA," Annals of Operations Research, Springer, vol. 278(1), pages 77-99, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wen-Min Lu & Qian Long Kweh & Kai-Chu Yang, 2022. "Multiplicative efficiency aggregation to evaluate Taiwanese local auditing institutions performance," Annals of Operations Research, Springer, vol. 315(2), pages 1243-1262, August.
    2. Tsolas, Ioannis E., 2014. "Precious metal mutual fund performance appraisal using DEA modeling," Resources Policy, Elsevier, vol. 39(C), pages 54-60.
    3. Chen Kaihua & Kou Mingting, 2014. "Staged efficiency and its determinants of regional innovation systems: a two-step analytical procedure," The Annals of Regional Science, Springer;Western Regional Science Association, vol. 52(2), pages 627-657, March.
    4. Cayir Ervural, Beyzanur & Zaim, Selim & Delen, Dursun, 2018. "A two-stage analytical approach to assess sustainable energy efficiency," Energy, Elsevier, vol. 164(C), pages 822-836.
    5. Baldin, Andrea, 2017. "A DEA approach for selecting a bundle of tickets for performing arts events," Journal of Retailing and Consumer Services, Elsevier, vol. 39(C), pages 190-200.
    6. Kai Xu & Lawrence Loh & Qiang Chen, 2020. "Sustainable Innovation Governance: An Analysis of Regional Innovation with a Super Efficiency Slack-Based Measure Model," Sustainability, MDPI, vol. 12(7), pages 1-19, April.
    7. Fragoudaki, Alexandra & Giokas, Dimitris, 2016. "Airport performance in a tourism receiving country: Evidence from Greece," Journal of Air Transport Management, Elsevier, vol. 52(C), pages 80-89.
    8. Huang, Chao & Dai, Chong & Guo, Miao, 2015. "A hybrid approach using two-level DEA for financial failure prediction and integrated SE-DEA and GCA for indicators selection," Applied Mathematics and Computation, Elsevier, vol. 251(C), pages 431-441.
    9. Friesner, Daniel & Mittelhammer, Ron & Rosenman, Robert, 2013. "Inferring the incidence of industry inefficiency from DEA estimates," European Journal of Operational Research, Elsevier, vol. 224(2), pages 414-424.
    10. Yang, Wen-Chi & Lee, Yuh-Ming & Hu, Jin-Li, 2016. "Urban sustainability assessment of Taiwan based on data envelopment analysis," Renewable and Sustainable Energy Reviews, Elsevier, vol. 61(C), pages 341-353.
    11. Franz R. Hahn, 2007. "Determinants of Bank Efficiency in Europe. Assessing Bank Performance Across Markets," WIFO Studies, WIFO, number 31499, March.
    12. repec:lan:wpaper:1115 is not listed on IDEAS
    13. Azarnoosh Kafi & Behrouz Daneshian & Mohsen Rostamy-Malkhalifeh, 2021. "Forecasting the confidence interval of efficiency in fuzzy DEA," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 31(1), pages 41-59.
    14. Costa, Marcelo Azevedo & Lopes, Ana Lúcia Miranda & de Pinho Matos, Giordano Bruno Braz, 2015. "Statistical evaluation of Data Envelopment Analysis versus COLS Cobb–Douglas benchmarking models for the 2011 Brazilian tariff revision," Socio-Economic Planning Sciences, Elsevier, vol. 49(C), pages 47-60.
    15. Kristiaan Kerstens & Ignace Van de Woestyne, 2018. "Enumeration algorithms for FDH directional distance functions under different returns to scale assumptions," Annals of Operations Research, Springer, vol. 271(2), pages 1067-1078, December.
    16. Ahmad, Usman, 2011. "Financial Reforms and Banking Efficiency: Case of Pakistan," MPRA Paper 34220, University Library of Munich, Germany.
    17. Bowlin, W. F., 1995. "A characterization of the financial condition of the United States' aerospace-defense industrial base," Omega, Elsevier, vol. 23(5), pages 539-555, October.
    18. Büschken, Joachim, 2009. "When does data envelopment analysis outperform a naïve efficiency measurement model?," European Journal of Operational Research, Elsevier, vol. 192(2), pages 647-657, January.
    19. António Afonso & Ana Patricia Montes & José M. Domínguez, 2024. "Measuring Tax Burden Efficiency in OECD Countries: An International Comparison," CESifo Working Paper Series 11333, CESifo.
    20. Helmi Hammami & Thanh Ngo & David Tripe & Dinh-Tri Vo, 2022. "Ranking with a Euclidean common set of weights in data envelopment analysis: with application to the Eurozone banking sector," Annals of Operations Research, Springer, vol. 311(2), pages 675-694, April.
    21. Khanal, Aditya & Koirala, Krishna & Regmi, Madhav, 2016. "Do Financial Constraints Affect Production Efficiency in Drought Prone Areas? A Case from Indonesian Rice Growers," 2016 Annual Meeting, February 6-9, 2016, San Antonio, Texas 230087, Southern Agricultural Economics Association.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:341:y:2024:i:1:d:10.1007_s10479-024-06008-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.