IDEAS home Printed from https://ideas.repec.org/a/inm/orijds/v5y2026i1p43-64.html

Online Modeling and Monitoring for Dependent Dynamic Processes Under Resource Constraints

Author

Listed:
  • Tanapol Kosolwattana

    (Department of Industrial and Systems Engineering, University of Houston, Houston, Texas 77204)

  • Huazheng Wang

    (School of Electrical Engineering and Computer Science, Oregon State University, Corvallis, Oregon 97331)

  • Ying Lin

    (Department of Industrial and Systems Engineering, University of Houston, Houston, Texas 77204)

Abstract

Adaptive monitoring of a large population of dynamic units is critical for the timely detection of abnormal events under limited resources in many healthcare and engineering systems. Examples include risk-based disease screening and condition-based unit monitoring. However, existing adaptive monitoring models either ignore the dependency among units or overlook the uncertainty in unit modeling. To design an optimal monitoring strategy that accurately monitors the units with poor health conditions and actively collects information for uncertainty reduction, a novel online collaborative learning method is proposed in this study. The proposed method designs a collaborative learning–based upper confidence bound algorithm to optimally balance the exploitation and exploration of dependent units under limited resources. Efficiency of the proposed method is demonstrated through theoretical analysis, simulation studies, and an empirical study of adaptive cognitive monitoring in Alzheimer’s disease.

Suggested Citation

  • Tanapol Kosolwattana & Huazheng Wang & Ying Lin, 2026. "Online Modeling and Monitoring for Dependent Dynamic Processes Under Resource Constraints," INFORMS Joural on Data Science, INFORMS, vol. 5(1), pages 43-64, January.
    • Handle: RePEc:inm:orijds:v:5:y:2026:i:1:p:43-64
    DOI: 10.1287/ijds.2023.0021
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/ijds.2023.0021
    Download Restriction: no
    File URL: https://libkey.io/10.1287/ijds.2023.0021?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Turgay Ayer & Oguzhan Alagoz & Natasha K. Stout, 2012. "OR Forum---A POMDP Approach to Personalize Mammography Screening Decisions," Operations Research, INFORMS, vol. 60(5), pages 1019-1034, October.
    2. Wayne DeSarbo & William Cron, 1988. "A maximum likelihood methodology for clusterwise linear regression," Journal of Classification, Springer;The Classification Society, vol. 5(2), pages 249-282, September.
    3. Daniel Gartner & Rainer Kolisch & Daniel B. Neill & Rema Padman, 2015. "Machine Learning Approaches for Early DRG Classification and Resource Allocation," INFORMS Journal on Computing, INFORMS, vol. 27(4), pages 718-734, November.
    4. Akhil Kumar & Wen Yao & Chao-Hsien Chu, 2013. "Flexible Process Compliance with Semantic Constraints Using Mixed-Integer Programming," INFORMS Journal on Computing, INFORMS, vol. 25(3), pages 543-559, August.
    5. Shutong Chen & Weijun Xie, 2022. "On Cluster-Aware Supervised Learning: Frameworks, Convergent Algorithms, and Applications," INFORMS Journal on Computing, INFORMS, vol. 34(1), pages 481-502, January.
    6. Papakonstantinou, K.G. & Shinozuka, M., 2014. "Planning structural inspection and maintenance policies via dynamic programming and Markov processes. Part II: POMDP implementation," Reliability Engineering and System Safety, Elsevier, vol. 130(C), pages 214-224.
    7. Ashraf Virk, Mati-ur-Rasool & Mysorewala, Muhammad Faizan & Cheded, Lahouari & Aliyu, AbdulRahman, 2022. "Review of energy harvesting techniques in wireless sensor-based pipeline monitoring networks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 157(C).
    8. P. S. Bradley & Usama M. Fayyad & O. L. Mangasarian, 1999. "Mathematical Programming for Data Mining: Formulations and Challenges," INFORMS Journal on Computing, INFORMS, vol. 11(3), pages 217-238, August.
    9. Qingxin Meng & Keli Xiao & Dazhong Shen & Hengshu Zhu & Hui Xiong, 2022. "Fine-Grained Job Salary Benchmarking with a Nonparametric Dirichlet Process–Based Latent Factor Model," INFORMS Journal on Computing, INFORMS, vol. 34(5), pages 2443-2463, September.
    10. Jin Wang & Michael R. Taaffe, 2015. "Multivariate Mixtures of Normal Distributions: Properties, Random Vector Generation, Fitting, and as Models of Market Daily Changes," INFORMS Journal on Computing, INFORMS, vol. 27(2), pages 193-203, May.
    11. Miao Bai & Robert H. Storer & Gregory L. Tonkay, 2022. "Surgery Sequencing Coordination with Recovery Resource Constraints," INFORMS Journal on Computing, INFORMS, vol. 34(2), pages 1207-1223, March.
    12. Vishal Ahuja & John R. Birge, 2020. "An Approximation Approach for Response-Adaptive Clinical Trial Design," INFORMS Journal on Computing, INFORMS, vol. 32(4), pages 877-894, October.
    13. Abderrahmane Abbou & Viliam Makis, 2019. "Group Maintenance: A Restless Bandits Approach," INFORMS Journal on Computing, INFORMS, vol. 31(4), pages 719-731, October.
    14. Kai Han & Yuntian He & Alex X. Liu & Shaojie Tang & He Huang, 2020. "Differentially Private and Budget-Limited Bandit Learning over Matroids," INFORMS Journal on Computing, INFORMS, vol. 32(3), pages 790-804, July.
    15. Ulf‐G. Gerdtham & Pravin K. Trivedi, 2001. "Equity in Swedish health care reconsidered: new results based on the finite mixture model," Health Economics, John Wiley & Sons, Ltd., vol. 10(6), pages 565-572, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haoting Zhang & Donglin Zhan & James Anderson & Rhonda Righter & Zeyu Zheng, 2025. "Clustering Then Estimation of Spatio-Temporal Self-Exciting Processes," INFORMS Journal on Computing, INFORMS, vol. 37(4), pages 874-893, July.
    2. Hossein Kamalzadeh & Vishal Ahuja & Michael Hahsler & Michael E. Bowen, 2021. "An Analytics‐Driven Approach for Optimal Individualized Diabetes Screening," Production and Operations Management, Production and Operations Management Society, vol. 30(9), pages 3161-3191, September.
    3. Gianfranco DI VAIO & Michele BATTISTI, 2010. "A Spatially-Filtered Mixture of Beta-Convergence Regression for EU Regions, 1980-2002," Regional and Urban Modeling 284100013, EcoMod.
    4. Frenkel Ter Hofstede & Michel Wedel & Jan-Benedict E.M. Steenkamp, 2002. "Identifying Spatial Segments in International Markets," Marketing Science, INFORMS, vol. 21(2), pages 160-177, July.
    5. Yu Ding & Wayne S. DeSarbo & Dominique M. Hanssens & Kamel Jedidi & John G. Lynch & Donald R. Lehmann, 2020. "The past, present, and future of measurement and methods in marketing analysis," Marketing Letters, Springer, vol. 31(2), pages 175-186, September.
    6. Eike Nohdurft & Elisa Long & Stefan Spinler, 2017. "Was Angelina Jolie Right? Optimizing Cancer Prevention Strategies Among BRCA Mutation Carriers," Decision Analysis, INFORMS, vol. 14(3), pages 139-169, September.
    7. Aardal, Karen & van den Berg, Pieter L. & Gijswijt, Dion & Li, Shanfei, 2015. "Approximation algorithms for hard capacitated k-facility location problems," European Journal of Operational Research, Elsevier, vol. 242(2), pages 358-368.
    8. Erik Schokkaert & Tom Van Ourti & Diana De Graeve & Ann Lecluyse & Carine Van de Voorde, 2010. "Supplemental health insurance and equality of access in Belgium," Health Economics, John Wiley & Sons, Ltd., vol. 19(4), pages 377-395, April.
    9. Azizi, Fariba & Salari, Nooshin, 2023. "A novel condition-based maintenance framework for parallel manufacturing systems based on bivariate birth/birth–death processes," Reliability Engineering and System Safety, Elsevier, vol. 229(C).
    10. Urtzi Ayesta & Manu K. Gupta & Ina Maria Verloop, 2021. "On the computation of Whittle’s index for Markovian restless bandits," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 93(1), pages 179-208, February.
    11. Zhou, Yang & Shi, Zhixiong & Shi, Zhengyu & Gao, Qing & Wu, Libo, 2019. "Disaggregating power consumption of commercial buildings based on the finite mixture model," Applied Energy, Elsevier, vol. 243(C), pages 35-46.
    12. Xuejuan Liu & Wenbin Wang & Rui Peng & Fei Zhao, 2015. "A delay-time-based inspection model for parallel systems," Journal of Risk and Reliability, , vol. 229(6), pages 556-567, December.
    13. Pennings, Joost M.E. & Garcia, Philip & Irwin, Scott H. & Good, Darrel L., 2003. "How To Group Market Participants? Heterogeneity In Hedging Behavior," 2003 Annual meeting, July 27-30, Montreal, Canada 21963, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    14. KarabaÄŸ, Oktay & Eruguz, Ayse Sena & Basten, Rob, 2020. "Integrated optimization of maintenance interventions and spare part selection for a partially observable multi-component system," Reliability Engineering and System Safety, Elsevier, vol. 200(C).
    15. Sphiwe B. Skhosana & Salomon M. Millard & Frans H. J. Kanfer, 2023. "A Novel EM-Type Algorithm to Estimate Semi-Parametric Mixtures of Partially Linear Models," Mathematics, MDPI, vol. 11(5), pages 1-20, February.
    16. Renato Cordeiro Amorim, 2016. "A Survey on Feature Weighting Based K-Means Algorithms," Journal of Classification, Springer;The Classification Society, vol. 33(2), pages 210-242, July.
    17. José Niño-Mora, 2020. "Fast Two-Stage Computation of an Index Policy for Multi-Armed Bandits with Setup Delays," Mathematics, MDPI, vol. 9(1), pages 1-36, December.
    18. Nabanita Datta Gupta & Jane Greve, 2011. "Overweight and obesity and the utilization of primary care physicians," Health Economics, John Wiley & Sons, Ltd., vol. 20(S1), pages 53-67, September.
    19. Ece Zeliha Demirci & Joachim Arts & Geert-Jan van Houtum, 2025. "A restless bandit approach for capacitated condition based maintenance scheduling," Flexible Services and Manufacturing Journal, Springer, vol. 37(1), pages 179-207, March.
    20. Heungsun Hwang & Marc Tomiuk, 2010. "Fuzzy clusterwise quasi-likelihood generalized linear models," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 4(4), pages 255-270, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orijds:v:5:y:2026:i:1:p:43-64. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.