IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0307970.html
   My bibliography  Save this article

Uncertainty quantification in neural-network based pain intensity estimation

Author

Listed:
  • Burcu Ozek
  • Zhenyuan Lu
  • Srinivasan Radhakrishnan
  • Sagar Kamarthi

Abstract

Improper pain management leads to severe physical or mental consequences, including suffering, a negative impact on quality of life, and an increased risk of opioid dependency. Assessing the presence and severity of pain is imperative to prevent such outcomes and determine the appropriate intervention. However, the evaluation of pain intensity is a challenging task because different individuals experience pain differently. To overcome this, many researchers in the field have employed machine learning models to evaluate pain intensity objectively using physiological signals. However, these efforts have primarily focused on pain point estimation, disregarding inherent uncertainty and variability in the data and model. A point estimate, which provides only partial information, is not sufficient for sound clinical decision-making. This study proposes a neural network-based method for objective pain interval estimation, and quantification of uncertainty. Our approach, which enables objective pain intensity estimation with desired confidence probabilities, affords clinicians a better understanding of a person’s pain intensity. We explored three distinct algorithms: the bootstrap method, lower and upper bound estimation (LossL) optimized by genetic algorithm, and modified lower and upper bound estimation (LossS) optimized by gradient descent algorithm. Our empirical results demonstrate that LossS outperforms the other two by providing narrower prediction intervals. For 50%, 75%, 85%, and 95% prediction interval coverage probability, LossS provides average interval widths that are 22.4%, 7.9%, 16.7%, and 9.1% narrower than those of LossL, and 19.3%, 21.1%, 23.6%, and 26.9% narrower than those of bootstrap. As LossS outperforms, we assessed its performance in three different model-building approaches: (1) a generalized approach using a single model for the entire population, (2) a personalized approach with separate models for each individual, and (3) a hybrid approach with models for clusters of individuals. Results demonstrate that the hybrid model-building approach provides the best performance.

Suggested Citation

  • Burcu Ozek & Zhenyuan Lu & Srinivasan Radhakrishnan & Sagar Kamarthi, 2024. "Uncertainty quantification in neural-network based pain intensity estimation," PLOS ONE, Public Library of Science, vol. 19(8), pages 1-21, August.
    • Handle: RePEc:plo:pone00:0307970
    DOI: 10.1371/journal.pone.0307970
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0307970
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0307970&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0307970?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Sascha Gruss & Roi Treister & Philipp Werner & Harald C Traue & Stephen Crawcour & Adriano Andrade & Steffen Walter, 2015. "Pain Intensity Recognition Rates via Biopotential Feature Patterns with Support Vector Machines," PLOS ONE, Public Library of Science, vol. 10(10), pages 1-14, October.
    2. Yankun Wang & Huiming Tang & Tao Wen & Junwei Ma, 2020. "Direct Interval Prediction of Landslide Displacements Using Least Squares Support Vector Machines," Complexity, Hindawi, vol. 2020, pages 1-15, May.
    3. Quan, Hao & Srinivasan, Dipti & Khosravi, Abbas, 2014. "Uncertainty handling using neural network-based prediction intervals for electrical load forecasting," Energy, Elsevier, vol. 73(C), pages 916-925.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mark J Panaggio & Daniel M Abrams & Fan Yang & Tanvi Banerjee & Nirmish R Shah, 2021. "Can subjective pain be inferred from objective physiological data? Evidence from patients with sickle cell disease," PLOS Computational Biology, Public Library of Science, vol. 17(3), pages 1-20, March.
    2. Barman, Mayur & Dev Choudhury, N.B. & Sutradhar, Suman, 2018. "A regional hybrid GOA-SVM model based on similar day approach for short-term load forecasting in Assam, India," Energy, Elsevier, vol. 145(C), pages 710-720.
    3. Wang, Jianzhou & Wang, Shuai & Zeng, Bo & Lu, Haiyan, 2022. "A novel ensemble probabilistic forecasting system for uncertainty in wind speed," Applied Energy, Elsevier, vol. 313(C).
    4. van der Meer, D.W. & Shepero, M. & Svensson, A. & Widén, J. & Munkhammar, J., 2018. "Probabilistic forecasting of electricity consumption, photovoltaic power generation and net demand of an individual building using Gaussian Processes," Applied Energy, Elsevier, vol. 213(C), pages 195-207.
    5. Yang, YouLong & Che, JinXing & Li, YanYing & Zhao, YanJun & Zhu, SuLing, 2016. "An incremental electric load forecasting model based on support vector regression," Energy, Elsevier, vol. 113(C), pages 796-808.
    6. Junwei Ma & Xiao Liu & Xiaoxu Niu & Yankun Wang & Tao Wen & Junrong Zhang & Zongxing Zou, 2020. "Forecasting of Landslide Displacement Using a Probability-Scheme Combination Ensemble Prediction Technique," IJERPH, MDPI, vol. 17(13), pages 1-23, July.
    7. Zhang, Dongxue & Wang, Shuai & Liang, Yuqiu & Du, Zhiyuan, 2023. "A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer," Energy, Elsevier, vol. 264(C).
    8. Grothe, Oliver & Kächele, Fabian & Krüger, Fabian, 2023. "From point forecasts to multivariate probabilistic forecasts: The Schaake shuffle for day-ahead electricity price forecasting," Energy Economics, Elsevier, vol. 120(C).
    9. Eren, Yavuz & Küçükdemiral, İbrahim, 2024. "A comprehensive review on deep learning approaches for short-term load forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    10. Yin, He & Yang, Mao-sen & Lan, Hai & Hong, Ying-Yi & Guo, Dong & Jin, Feng, 2024. "A hybrid graph attention network based method for interval prediction of shipboard solar irradiation," Energy, Elsevier, vol. 298(C).
    11. Tziolis, Georgios & Spanias, Chrysovalantis & Theodoride, Maria & Theocharides, Spyros & Lopez-Lorente, Javier & Livera, Andreas & Makrides, George & Georghiou, George E., 2023. "Short-term electric net load forecasting for solar-integrated distribution systems based on Bayesian neural networks and statistical post-processing," Energy, Elsevier, vol. 271(C).
    12. Munkhammar, Joakim & van der Meer, Dennis & Widén, Joakim, 2021. "Very short term load forecasting of residential electricity consumption using the Markov-chain mixture distribution (MCM) model," Applied Energy, Elsevier, vol. 282(PA).
    13. Li, Jingrui & Wang, Jiyang & Li, Zhiwu, 2023. "A novel combined forecasting system based on advanced optimization algorithm - A study on optimal interval prediction of wind speed," Energy, Elsevier, vol. 264(C).
    14. He, Yaoyao & Zheng, Yaya, 2018. "Short-term power load probability density forecasting based on Yeo-Johnson transformation quantile regression and Gaussian kernel function," Energy, Elsevier, vol. 154(C), pages 143-156.
    15. Li, Ranran & Jin, Yu, 2018. "A wind speed interval prediction system based on multi-objective optimization for machine learning method," Applied Energy, Elsevier, vol. 228(C), pages 2207-2220.
    16. Yan, Yi & Wang, Xuerui & Li, Ke & Li, Chengdong & Tian, Chongyi & Shao, Zhuliang & Li, Ji, 2024. "Stochastic optimisation of district integrated energy systems based on a hybrid probability forecasting model," Energy, Elsevier, vol. 306(C).
    17. Torres-Ramírez, M. & Elizondo, D. & García-Domingo, B. & Nofuentes, G. & Talavera, D.L., 2015. "Modelling the spectral irradiance distribution in sunny inland locations using an ANN-based methodology," Energy, Elsevier, vol. 86(C), pages 323-334.
    18. Saeed, Adnan & Li, Chaoshun & Gan, Zhenhao, 2024. "Short-term wind speed interval prediction using improved quality-driven loss based gated multi-scale convolutional sequence model," Energy, Elsevier, vol. 300(C).
    19. Hiroki Yamamoto & Junji Kondoh & Daisuke Kodaira, 2022. "Assessing the Impact of Features on Probabilistic Modeling of Photovoltaic Power Generation," Energies, MDPI, vol. 15(15), pages 1-17, July.
    20. Wang, Yun & Hu, Qinghua & Meng, Deyu & Zhu, Pengfei, 2017. "Deterministic and probabilistic wind power forecasting using a variational Bayesian-based adaptive robust multi-kernel regression model," Applied Energy, Elsevier, vol. 208(C), pages 1097-1112.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0307970. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.