IDEAS home Printed from https://ideas.repec.org/a/plo/pcbi00/1007165.html
   My bibliography  Save this article

Estimating influenza incidence using search query deceptiveness and generalized ridge regression

Author

Listed:
  • Reid Priedhorsky
  • Ashlynn R Daughton
  • Martha Barnard
  • Fiona O’Connell
  • Dave Osthus

Abstract

Seasonal influenza is a sometimes surprisingly impactful disease, causing thousands of deaths per year along with much additional morbidity. Timely knowledge of the outbreak state is valuable for managing an effective response. The current state of the art is to gather this knowledge using in-person patient contact. While accurate, this is time-consuming and expensive. This has motivated inquiry into new approaches using internet activity traces, based on the theory that lay observations of health status lead to informative features in internet data. These approaches risk being deceived by activity traces having a coincidental, rather than informative, relationship to disease incidence; to our knowledge, this risk has not yet been quantitatively explored. We evaluated both simulated and real activity traces of varying deceptiveness for influenza incidence estimation using linear regression. We found that deceptiveness knowledge does reduce error in such estimates, that it may help automatically-selected features perform as well or better than features that require human curation, and that a semantic distance measure derived from the Wikipedia article category tree serves as a useful proxy for deceptiveness. This suggests that disease incidence estimation models should incorporate not only data about how internet features map to incidence but also additional data to estimate feature deceptiveness. By doing so, we may gain one more step along the path to accurate, reliable disease incidence estimation using internet data. This capability would improve public health by decreasing the cost and increasing the timeliness of such estimates.Author summary: While often considered a minor infection, seasonal flu kills many thousands of people every year and sickens millions more. The more accurate and up-to-date public health officials’ view of what the seasonal outbreak is, the more effectively the outbreak can be addressed. Currently, this knowledge is based on collating information on patients who enter the health care system. This approach is accurate, but it’s also expensive and slow. Researchers hope that new approaches based on examining what people do and share on the internet may work more cheaply and quickly. Some internet activity, however, has a history of correspondence with disease activity, but this relationship is coincidental rather than informative. For example, some prior work has found a correspondence between zombie-related social media messages and the flu season, so one could plausibly build accurate flu estimates using such messages that are then fooled by the appearance of a new zombie movie. We tested flu estimation models that incorporate information about this risk of deception, finding that knowledge of deceptiveness does indeed produce more accurate estimates; we also identified a method to estimate deceptiveness. Our results suggest that estimation models used in practice should use information about both how inputs maps to disease activity and also what the potential of each input to be deceptive is. This may get us one step closer to accurate, reliable disease estimates based on internet data, which would improve public health by making those estimates faster and cheaper.

Suggested Citation

  • Reid Priedhorsky & Ashlynn R Daughton & Martha Barnard & Fiona O’Connell & Dave Osthus, 2019. "Estimating influenza incidence using search query deceptiveness and generalized ridge regression," PLOS Computational Biology, Public Library of Science, vol. 15(10), pages 1-23, October.
  • Handle: RePEc:plo:pcbi00:1007165
    DOI: 10.1371/journal.pcbi.1007165
    as

    Download full text from publisher

    File URL: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1007165
    Download Restriction: no

    File URL: https://journals.plos.org/ploscompbiol/article/file?id=10.1371/journal.pcbi.1007165&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pcbi.1007165?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Logan C Brooks & David C Farrow & Sangwon Hyun & Ryan J Tibshirani & Roni Rosenfeld, 2018. "Nonmechanistic forecasts of seasonal influenza with iterative one-week-ahead distributions," PLOS Computational Biology, Public Library of Science, vol. 14(6), pages 1-29, June.
    2. Artem Sokolov & Daniel E Carlin & Evan O Paull & Robert Baertsch & Joshua M Stuart, 2016. "Pathway-Based Genomics Prediction using Generalized Elastic Net," PLOS Computational Biology, Public Library of Science, vol. 12(3), pages 1-23, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Raúl Gómez‐Martínez & Carmen Orden‐Cruz & Juan Gabriel Martínez‐Navalón, 2022. "Wikipedia pageviews as investors’ attention indicator for Nasdaq," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 29(1), pages 41-49, January.
    2. Dave Osthus & Ashlynn R Daughton & Reid Priedhorsky, 2019. "Even a good influenza forecasting model can benefit from internet-based nowcasts, but those benefits are limited," PLOS Computational Biology, Public Library of Science, vol. 15(2), pages 1-19, February.
    3. Wei Wang & Linjian Li & Sheng Li & Fei Yin & Fang Liao & Tao Zhang & Xiaosong Li & Xiong Xiao & Yue Ma, 2022. "Average ordinary least squares‐centered penalized regression: A more efficient way to address multicollinearity than ridge regression," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 76(3), pages 347-368, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. John M Drake & Tobias S Brett & Shiyang Chen & Bogdan I Epureanu & Matthew J Ferrari & Éric Marty & Paige B Miller & Eamon B O’Dea & Suzanne M O’Regan & Andrew W Park & Pejman Rohani, 2019. "The statistics of epidemic transitions," PLOS Computational Biology, Public Library of Science, vol. 15(5), pages 1-14, May.
    2. Sasikiran Kandula & Jeffrey Shaman, 2019. "Reappraising the utility of Google Flu Trends," PLOS Computational Biology, Public Library of Science, vol. 15(8), pages 1-16, August.
    3. Junyi Lu & Sebastian Meyer, 2020. "Forecasting Flu Activity in the United States: Benchmarking an Endemic-Epidemic Beta Model," IJERPH, MDPI, vol. 17(4), pages 1-13, February.
    4. Victor Olsavszky & Mihnea Dosius & Cristian Vladescu & Johannes Benecke, 2020. "Time Series Analysis and Forecasting with Automated Machine Learning on a National ICD-10 Database," IJERPH, MDPI, vol. 17(14), pages 1-17, July.
    5. Edward W Huang & Ameya Bhope & Jing Lim & Saurabh Sinha & Amin Emad, 2020. "Tissue-guided LASSO for prediction of clinical drug response using preclinical samples," PLOS Computational Biology, Public Library of Science, vol. 16(1), pages 1-22, January.
    6. Ray, Evan L. & Brooks, Logan C. & Bien, Jacob & Biggerstaff, Matthew & Bosse, Nikos I. & Bracher, Johannes & Cramer, Estee Y. & Funk, Sebastian & Gerding, Aaron & Johansson, Michael A. & Rumack, Aaron, 2023. "Comparing trained and untrained probabilistic ensemble forecasts of COVID-19 cases and deaths in the United States," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1366-1383.
    7. Nicholas G Reich & Craig J McGowan & Teresa K Yamana & Abhinav Tushar & Evan L Ray & Dave Osthus & Sasikiran Kandula & Logan C Brooks & Willow Crawford-Crudell & Graham Casey Gibson & Evan Moore & Reb, 2019. "Accuracy of real-time multi-model ensemble forecasts for seasonal influenza in the U.S," PLOS Computational Biology, Public Library of Science, vol. 15(11), pages 1-19, November.
    8. Graham Casey Gibson & Kelly R Moran & Nicholas G Reich & Dave Osthus, 2021. "Improving probabilistic infectious disease forecasting through coherence," PLOS Computational Biology, Public Library of Science, vol. 17(1), pages 1-20, January.
    9. Michal Ben-Nun & Pete Riley & James Turtle & David P Bacon & Steven Riley, 2019. "Forecasting national and regional influenza-like illness for the USA," PLOS Computational Biology, Public Library of Science, vol. 15(5), pages 1-20, May.
    10. Kookjin Lee & Jaideep Ray & Cosmin Safta, 2021. "The predictive skill of convolutional neural networks models for disease forecasting," PLOS ONE, Public Library of Science, vol. 16(7), pages 1-26, July.
    11. Prashant Rangarajan & Sandeep K Mody & Madhav Marathe, 2019. "Forecasting dengue and influenza incidences using a sparse representation of Google trends, electronic health records, and time series data," PLOS Computational Biology, Public Library of Science, vol. 15(11), pages 1-24, November.
    12. Dave Osthus & Ashlynn R Daughton & Reid Priedhorsky, 2019. "Even a good influenza forecasting model can benefit from internet-based nowcasts, but those benefits are limited," PLOS Computational Biology, Public Library of Science, vol. 15(2), pages 1-19, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pcbi00:1007165. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ploscompbiol (email available below). General contact details of provider: https://journals.plos.org/ploscompbiol/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.