IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i11p1187-d561263.html
   My bibliography  Save this article

Using Markov Models to Characterize and Predict Process Target Compliance

Author

Listed:
  • Sally McClean

    (School of Computing, Ulster University, Belfast BT37 0QB, Northern Ireland, UK)

Abstract

Processes are everywhere, covering disparate fields such as business, industry, telecommunications, and healthcare. They have previously been analyzed and modelled with the aim of improving understanding and efficiency as well as predicting future events and outcomes. In recent years, process mining has appeared with the aim of uncovering, observing, and improving processes, often based on data obtained from logs. This typically requires task identification, predicting future pathways, or identifying anomalies. We here concentrate on using Markov processes to assess compliance with completion targets or, inversely, we can determine appropriate targets for satisfactory performance. Previous work is extended to processes where there are a number of possible exit options, with potentially different target completion times. In particular, we look at distributions of the number of patients failing to meet targets, through time. The formulae are illustrated using data from a stroke patient unit, where there are multiple discharge destinations for patients, namely death, private nursing home, or the patient’s own home, where different discharge destinations may require disparate targets. Key performance indicators (KPIs) of this sort are commonplace in healthcare, business, and industrial processes. Markov models, or their extensions, have an important role to play in this work where the approach can be extended to include more expressive assumptions, with the aim of assessing compliance in complex scenarios.

Suggested Citation

  • Sally McClean, 2021. "Using Markov Models to Characterize and Predict Process Target Compliance," Mathematics, MDPI, vol. 9(11), pages 1-12, May.
  • Handle: RePEc:gam:jmathe:v:9:y:2021:i:11:p:1187-:d:561263
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/11/1187/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/9/11/1187/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. McClean, Sally & Gillespie, Jennifer & Garg, Lalit & Barton, Maria & Scotney, Bryan & Kullerton, Ken, 2014. "Using phase-type models to cost stroke patient care across health, social and community services," European Journal of Operational Research, Elsevier, vol. 236(1), pages 190-199.
    2. Otten, Maarten & Timmer, Judith & Witteveen, Annemieke, 2020. "Stratified breast cancer follow-up using a continuous state partially observable Markov decision process," European Journal of Operational Research, Elsevier, vol. 281(2), pages 464-474.
    3. Sergey A. Dudin & Moon Ho Lee, 2016. "Analysis of Single-Server Queue with Phase-Type Service and Energy Harvesting," Mathematical Problems in Engineering, Hindawi, vol. 2016, pages 1-16, March.
    4. Alexander Dudin & Sergei Dudin, 2016. "Analysis of a Priority Queue with Phase-Type Service and Failures," International Journal of Stochastic Analysis, Hindawi, vol. 2016, pages 1-11, July.
    5. Alexander Dudin & Chesoong Kim & Olga Dudina & Sergey Dudin, 2016. "Multi-server queueing system with a generalized phase-type service time distribution as a model of call center with a call-back option," Annals of Operations Research, Springer, vol. 239(2), pages 401-428, April.
    6. Sally McClean & Owen Gribbin, 1991. "A non‐parametric competing risks model for manpower planning," Applied Stochastic Models and Data Analysis, John Wiley & Sons, vol. 7(4), pages 327-341, December.
    7. Yonit Barron & David Perry & Wolfgang Stadje, 2016. "A make-to-stock production/inventory model with MAP arrivals and phase-type demands," Annals of Operations Research, Springer, vol. 241(1), pages 373-409, June.
    8. Griffiths, J.D. & Williams, J.E. & Wood, R.M., 2013. "Modelling activities at a neurological rehabilitation unit," European Journal of Operational Research, Elsevier, vol. 226(2), pages 301-312.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. A. N. Dudin & S. A. Dudin & O. S. Dudina, 2023. "Randomized Threshold Strategy for Providing Flexible Priority in Multi-Server Queueing System with a Marked Markov Arrival Process and Phase-Type Distribution of Service Time," Mathematics, MDPI, vol. 11(12), pages 1-23, June.
    2. Kozlowski, Dawid & Worthington, Dave, 2015. "Use of queue modelling in the analysis of elective patient treatment governed by a maximum waiting time policy," European Journal of Operational Research, Elsevier, vol. 244(1), pages 331-338.
    3. Barron, Yonit, 2023. "A stochastic card balance management problem with continuous and batch-type bilateral transactions," Operations Research Perspectives, Elsevier, vol. 10(C).
    4. Robert Kraig Helmeczi & Can Kavaklioglu & Mucahit Cevik & Davood Pirayesh Neghab, 2023. "A multi-objective constrained partially observable Markov decision process model for breast cancer screening," Operational Research, Springer, vol. 23(2), pages 1-42, June.
    5. Pablo Azcue & Esther Frostig & Nora Muler, 2023. "Optimal Strategies in a Production Inventory Control Model," Methodology and Computing in Applied Probability, Springer, vol. 25(1), pages 1-43, March.
    6. Malek Ebadi & Raha Akhavan-Tabatabaei, 2021. "Personalized Cotesting Policies for Cervical Cancer Screening: A POMDP Approach," Mathematics, MDPI, vol. 9(6), pages 1-20, March.
    7. Daniel F. Otero-Leon & Mariel S. Lavieri & Brian T. Denton & Jeremy Sussman & Rodney A. Hayward, 2023. "Monitoring policy in the context of preventive treatment of cardiovascular disease," Health Care Management Science, Springer, vol. 26(1), pages 93-116, March.
    8. P.-C.G. Vassiliou, 2020. "Non-Homogeneous Semi-Markov and Markov Renewal Processes and Change of Measure in Credit Risk," Mathematics, MDPI, vol. 9(1), pages 1-27, December.
    9. Alexander Dudin & Olga Dudina & Sergei Dudin & Konstantin Samouylov, 2021. "Analysis of Single-Server Multi-Class Queue with Unreliable Service, Batch Correlated Arrivals, Customers Impatience, and Dynamical Change of Priorities," Mathematics, MDPI, vol. 9(11), pages 1-17, May.
    10. Gogi, Anastasia & Tako, Antuela A. & Robinson, Stewart, 2016. "An experimental investigation into the role of simulation models in generating insights," European Journal of Operational Research, Elsevier, vol. 249(3), pages 931-944.
    11. De Vuyst, Stijn & Bruneel, Herwig & Fiems, Dieter, 2014. "Computationally efficient evaluation of appointment schedules in health care," European Journal of Operational Research, Elsevier, vol. 237(3), pages 1142-1154.
    12. Li, Weiyu & Denton, Brian T. & Morgan, Todd M., 2023. "Optimizing active surveillance for prostate cancer using partially observable Markov decision processes," European Journal of Operational Research, Elsevier, vol. 305(1), pages 386-399.
    13. Walid W. Nasr, 2022. "Inventory systems with stochastic and batch demand: computational approaches," Annals of Operations Research, Springer, vol. 309(1), pages 163-187, February.
    14. Sergei Dudin & Olga Dudina & Konstantin Samouylov & Alexander Dudin, 2020. "Improvement of the Fairness of Non-Preemptive Priorities in the Transmission of Heterogeneous Traffic," Mathematics, MDPI, vol. 8(6), pages 1-17, June.
    15. P. -C. G. Vassiliou, 2022. "Limiting Distributions of a Non-Homogeneous Markov System in a Stochastic Environment in Continuous Time," Mathematics, MDPI, vol. 10(8), pages 1-16, April.
    16. Alexander Moiseev & Maria Shklennik & Evgeny Polin, 2023. "Infinite-server queueing tandem with Markovian arrival process and service depending on its state," Annals of Operations Research, Springer, vol. 326(1), pages 261-279, July.
    17. Gong, Jue & Liu, Shan, 2023. "Partially observable collaborative model for optimizing personalized treatment selection," European Journal of Operational Research, Elsevier, vol. 309(3), pages 1409-1419.
    18. Baek, Jung Woo & Bae, Yun Han, 2022. "A queuing-inventory model for manufacturing systems with fluid-type inventory," Omega, Elsevier, vol. 111(C).
    19. Marynissen, Joren & Demeulemeester, Erik, 2019. "Literature review on multi-appointment scheduling problems in hospitals," European Journal of Operational Research, Elsevier, vol. 272(2), pages 407-419.
    20. Bruce Jones & Sally McClean & David Stanford, 2019. "Modelling mortality and discharge of hospitalized stroke patients using a phase-type recovery model," Health Care Management Science, Springer, vol. 22(4), pages 570-588, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:11:p:1187-:d:561263. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.