IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0292090.html
   My bibliography  Save this article

A fairness assessment of mobility-based COVID-19 case prediction models

Author

Listed:
  • Abdolmajid Erfani
  • Vanessa Frias-Martinez

Abstract

In light of the outbreak of COVID-19, analyzing and measuring human mobility has become increasingly important. A wide range of studies have explored spatiotemporal trends over time, examined associations with other variables, evaluated non-pharmacologic interventions (NPIs), and predicted or simulated COVID-19 spread using mobility data. Despite the benefits of publicly available mobility data, a key question remains unanswered: are models using mobility data performing equitably across demographic groups? We hypothesize that bias in the mobility data used to train the predictive models might lead to unfairly less accurate predictions for certain demographic groups. To test our hypothesis, we applied two mobility-based COVID infection prediction models at the county level in the United States using SafeGraph data, and correlated model performance with sociodemographic traits. Findings revealed that there is a systematic bias in models’ performance toward certain demographic characteristics. Specifically, the models tend to favor large, highly educated, wealthy, young, and urban counties. We hypothesize that the mobility data currently used by many predictive models tends to capture less information about older, poorer, less educated and people from rural regions, which in turn negatively impacts the accuracy of the COVID-19 prediction in these areas. Ultimately, this study points to the need of improved data collection and sampling approaches that allow for an accurate representation of the mobility patterns across demographic groups.

Suggested Citation

  • Abdolmajid Erfani & Vanessa Frias-Martinez, 2023. "A fairness assessment of mobility-based COVID-19 case prediction models," PLOS ONE, Public Library of Science, vol. 18(10), pages 1-16, October.
  • Handle: RePEc:plo:pone00:0292090
    DOI: 10.1371/journal.pone.0292090
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0292090
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0292090&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0292090?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jina Mahmoudi & Chenfeng Xiong, 2022. "How social distancing, mobility, and preventive policies affect COVID-19 outcomes: Big data-driven evidence from the District of Columbia-Maryland-Virginia (DMV) megaregion," PLOS ONE, Public Library of Science, vol. 17(2), pages 1-21, February.
    2. Griffin, Greg Phillip & Mulhall, Megan & Simek, Chris & Riggs, William W., 2020. "Mitigating Bias in Big Data for Transportation," SocArXiv trbv9, Center for Open Science.
    3. Lingyao Li & Abdolmajid Erfani & Yu Wang & Qingbin Cui, 2021. "Anatomy into the battle of supporting or opposing reopening amid the COVID-19 pandemic on Twitter: A temporal and spatial analysis," PLOS ONE, Public Library of Science, vol. 16(7), pages 1-23, July.
    4. Sundar Natarajan & Stuart R. Lipsitz & Garrett M. Fitzmaurice & Debajyoti Sinha & Joseph G. Ibrahim & Jennifer Haas & Walid Gellad, 2012. "An extension of the Wilcoxon rank sum test for complex sample survey data," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 61(4), pages 653-664, August.
    5. Songhua Hu & Weiyu Luo & Aref Darzi & Yixuan Pan & Guangchen Zhao & Yuxuan Liu & Chenfeng Xiong, 2021. "Do racial and ethnic disparities in following stay-at-home orders influence COVID-19 health outcomes? A mediation analysis approach," PLOS ONE, Public Library of Science, vol. 16(11), pages 1-22, November.
    6. Nima Kordzadeh & Maryam Ghasemaghaei, 2022. "Algorithmic bias: review, synthesis, and future research directions," European Journal of Information Systems, Taylor & Francis Journals, vol. 31(3), pages 388-409, May.
    7. Nicolò Gozzi & Michele Tizzoni & Matteo Chinazzi & Leo Ferres & Alessandro Vespignani & Nicola Perra, 2021. "Estimating the effect of social inequalities on the mitigation of COVID-19 across communities in Santiago de Chile," Nature Communications, Nature, vol. 12(1), pages 1-9, December.
    8. repec:osf:socarx:trbv9_v1 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Monica Lestari Paramita & Maria Kasinidou & Styliani Kleanthous & Paolo Rosso & Tsvi Kuflik & Frank Hopfgartner, 2024. "Towards improving user awareness of search engine biases: A participatory design approach," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(5), pages 581-599, May.
    2. Kuzmanic, Danilo & Valenzuela, Juan Pablo & Claro, Susana & Canales, Andrea & Cerda, Daniela & Undurraga, Eduardo A., 2023. "Socioeconomic disparities in the reopening of schools during the pandemic in Chile," International Journal of Educational Development, Elsevier, vol. 100(C).
    3. Alattar, Mohammad Anwar & Cottrill, Caitlin & Beecroft, Mark, 2021. "Public participation geographic information system (PPGIS) as a method for active travel data acquisition," Journal of Transport Geography, Elsevier, vol. 96(C).
    4. David Horneber & Sven Laumer, 2023. "Algorithmic Accountability," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 65(6), pages 723-730, December.
    5. Lin Chen & Fengli Xu & Zhenyu Han & Kun Tang & Pan Hui & James Evans & Yong Li, 2022. "Strategic COVID-19 vaccine distribution can simultaneously elevate social utility and equity," Nature Human Behaviour, Nature, vol. 6(11), pages 1503-1514, November.
    6. Skinner, Chris J., 2018. "Analysis of categorical data for complex surveys," LSE Research Online Documents on Economics 89707, London School of Economics and Political Science, LSE Library.
    7. Trautwein, Yannik & Zechiel, Felix & Coussement, Kristof & Meire, Matthijs & Büttgen, Marion, 2025. "Opening the ‘black box’ of HRM algorithmic biases – How hiring practices induce discrimination on freelancing platforms," Journal of Business Research, Elsevier, vol. 192(C).
    8. Hao, Xinyue & Demir, Emrah & Eyers, Daniel, 2024. "Exploring collaborative decision-making: A quasi-experimental study of human and Generative AI interaction," Technology in Society, Elsevier, vol. 78(C).
    9. Chen, Qian & Jing, Yufan & Gong, Yeming & Tan, Jie, 2025. "Will users fall in love with ChatGPT? a perspective from the triangular theory of love," Journal of Business Research, Elsevier, vol. 186(C).
    10. Mallory Avery & Andreas Leibbrandt & Joseph Vecci, 2023. "Does Artificial Intelligence Help or Hurt Gender Diversity? Evidence from Two Field Experiments on Recruitment in Tech," Monash Economics Working Papers 2023-09, Monash University, Department of Economics.
    11. Zahra Movahedi Nia & Ali Ahmadi & Nicola L Bragazzi & Woldegebriel Assefa Woldegerima & Bruce Mellado & Jianhong Wu & James Orbinski & Ali Asgary & Jude Dzevela Kong, 2022. "A cross-country analysis of macroeconomic responses to COVID-19 pandemic using Twitter sentiments," PLOS ONE, Public Library of Science, vol. 17(8), pages 1-16, August.
    12. De Bock, Koen W. & Coussement, Kristof & Caigny, Arno De & Słowiński, Roman & Baesens, Bart & Boute, Robert N. & Choi, Tsan-Ming & Delen, Dursun & Kraus, Mathias & Lessmann, Stefan & Maldonado, Sebast, 2024. "Explainable AI for Operational Research: A defining framework, methods, applications, and a research agenda," European Journal of Operational Research, Elsevier, vol. 317(2), pages 249-272.
    13. Koen W. de Bock & Kristof Coussement & Arno De Caigny & Roman Slowiński & Bart Baesens & Robert N Boute & Tsan-Ming Choi & Dursun Delen & Mathias Kraus & Stefan Lessmann & Sebastián Maldonado & David , 2023. "Explainable AI for Operational Research: A Defining Framework, Methods, Applications, and a Research Agenda," Post-Print hal-04219546, HAL.
    14. Le Cheng & Xiuli Liu & Chunlei Si, 2024. "Identifying stance in legislative discourse: a corpus-driven study of data protection laws," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-13, December.
    15. Liang, Zhenglin & Jiang, Chen & Sun, Muxia & Xue, Zongqi & Li, Yan-Fu, 2023. "Resilience analysis for confronting the spreading risk of contagious diseases," Reliability Engineering and System Safety, Elsevier, vol. 239(C).
    16. Camila Vantini Capasso Palamim & Matheus Negri Boschiero & Felipe Eduardo Valencise & Fernando Augusto Lima Marson, 2022. "Human Development Index Is Associated with COVID-19 Case Fatality Rate in Brazil: An Ecological Study," IJERPH, MDPI, vol. 19(9), pages 1-21, April.
    17. Christian Fieberg & Lars Hornuf & Maximilian Meiler & David J. Streich, 2025. "Using Large Language Models for Financial Advice," CESifo Working Paper Series 11666, CESifo.
    18. F. Vendrell-Herrero & M. Opazo-Basáez & Josip Marić, 2023. "Open and Social: Portraying the Resilient, Social and Competitive, Upcoming Enterprise," Post-Print hal-04434045, HAL.
    19. Jiping Cao & Hartwig H. Hochmair & Fisal Basheeh, 2022. "The Effect of Twitter App Policy Changes on the Sharing of Spatial Information through Twitter Users," Geographies, MDPI, vol. 2(3), pages 1-14, September.
    20. Adriana Manna & Júlia Koltai & Márton Karsai, 2024. "Importance of social inequalities to contact patterns, vaccine uptake, and epidemic dynamics," Nature Communications, Nature, vol. 15(1), pages 1-11, December.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0292090. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.