IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i15p1745-d600539.html
   My bibliography  Save this article

On State Occupancies, First Passage Times and Duration in Non-Homogeneous Semi-Markov Chains

Author

Listed:
  • Andreas C. Georgiou

    (Quantitative Methods and Decision Analytics Lab, Department of Business Administration, University of Macedonia, 54636 Thessaloniki, Greece)

  • Alexandra Papadopoulou

    (Department of Mathematics, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece)

  • Pavlos Kolias

    (Department of Mathematics, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece)

  • Haris Palikrousis

    (Department of Mathematics, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece)

  • Evanthia Farmakioti

    (Department of Mathematics, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece)

Abstract

Semi-Markov processes generalize the Markov chains framework by utilizing abstract sojourn time distributions. They are widely known for offering enhanced accuracy in modeling stochastic phenomena. The aim of this paper is to provide closed analytic forms for three types of probabilities which describe attributes of considerable research interest in semi-Markov modeling: (a) the number of transitions to a state through time (Occupancy), (b) the number of transitions or the amount of time required to observe the first passage to a state (First passage time) and (c) the number of transitions or the amount of time required after a state is entered before the first real transition is made to another state (Duration). The non-homogeneous in time recursive relations of the above probabilities are developed and a description of the corresponding geometric transforms is produced. By applying appropriate properties, the closed analytic forms of the above probabilities are provided. Finally, data from human DNA sequences are used to illustrate the theoretical results of the paper.

Suggested Citation

  • Andreas C. Georgiou & Alexandra Papadopoulou & Pavlos Kolias & Haris Palikrousis & Evanthia Farmakioti, 2021. "On State Occupancies, First Passage Times and Duration in Non-Homogeneous Semi-Markov Chains," Mathematics, MDPI, vol. 9(15), pages 1-17, July.
    • Handle: RePEc:gam:jmathe:v:9:y:2021:i:15:p:1745-:d:600539
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/15/1745/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/9/15/1745/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. P.-C. G. Vassiliou & A. C. Georgiou, 1990. "Asymptotically Attainable Structures in Nonhomogeneous Markov Systems," Operations Research, INFORMS, vol. 38(3), pages 537-545, June.
    2. Papapetrou, M. & Kugiumtzis, D., 2013. "Markov chain order estimation with conditional mutual information," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(7), pages 1593-1601.
    3. F.I. Ugwuowo & S.I. McClean, 2000. "Modelling heterogeneity in a manpower system: a review," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 16(2), pages 99-110, April.
    4. V. A. Dimitriou & A. C. Georgiou, 2021. "Introduction, analysis and asymptotic behavior of a multi-level manpower planning model in a continuous time setting under potential department contraction," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 50(5), pages 1173-1199, March.
    5. P.‐C. G. Vassiliou, 1997. "The evolution of the theory of non‐homogeneous Markov systems," Applied Stochastic Models and Data Analysis, John Wiley & Sons, vol. 13(3‐4), pages 159-176, September.
    6. Zhang, Xuan & Hou, Zhenting, 2012. "The first-passage times of phase semi-Markov processes," Statistics & Probability Letters, Elsevier, vol. 82(1), pages 40-48.
    7. R. J. Boys & D. A. Henderson & D. J. Wilkinson, 2000. "Detecting homogeneous segments in DNA sequences by using hidden Markov models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 49(2), pages 269-285.
    8. M. L. Menéndez & L. Pardo & M. C. Pardo & K. Zografos, 2011. "Testing the Order of Markov Dependence in DNA Sequences," Methodology and Computing in Applied Probability, Springer, vol. 13(1), pages 59-74, March.
    9. Jeffrey J. Hunter, 2007. "Simple Procedures For Finding Mean First Passage Times In Markov Chains," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 24(06), pages 813-829.
    10. M-A Guerry & T De Feyter, 2012. "Optimal recruitment strategies in a multi-level manpower planning model," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 63(7), pages 931-940, July.
    11. Dimitriou, V.A. & Georgiou, A.C. & Tsantas, N., 2013. "The multivariate non-homogeneous Markov manpower system in a departmental mobility framework," European Journal of Operational Research, Elsevier, vol. 228(1), pages 112-121.
    12. Maria Symeonaki, 2015. "Theory of fuzzy non homogeneous Markov systems with fuzzy states," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(6), pages 2369-2385, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tim De Feyter & Marie-Anne Guerry & Komarudin, 2017. "Optimizing cost-effectiveness in a stochastic Markov manpower planning system under control by recruitment," Annals of Operations Research, Springer, vol. 253(1), pages 117-131, June.
    2. P.-C. G. Vassiliou, 2020. "Laws of Large Numbers for Non-Homogeneous Markov Systems," Methodology and Computing in Applied Probability, Springer, vol. 22(4), pages 1631-1658, December.
    3. E. O. Ossai & M. S. Madukaife & A. U. Udom & U. C. Nduka & T. E. Ugah, 2023. "Effects of Prioritized Input on Human Resource Control in Departmentalized Markov Manpower Framework," Methodology and Computing in Applied Probability, Springer, vol. 25(1), pages 1-19, March.
    4. Georgiou, Andreas C. & Thanassoulis, Emmanuel & Papadopoulou, Alexandra, 2022. "Using data envelopment analysis in markovian decision making," European Journal of Operational Research, Elsevier, vol. 298(1), pages 276-292.
    5. Papapetrou, M. & Kugiumtzis, D., 2020. "Tsallis conditional mutual information in investigating long range correlation in symbol sequences," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 540(C).
    6. P.-C. G. Vassiliou & T. P. Moysiadis, 2010. "$\boldsymbol{\mathcal{G}-}$ Inhomogeneous Markov Systems of High Order," Methodology and Computing in Applied Probability, Springer, vol. 12(2), pages 271-292, June.
    7. P.-C.G. Vassiliou, 2021. "Non-Homogeneous Markov Set Systems," Mathematics, MDPI, vol. 9(5), pages 1-25, February.
    8. Komarudin & Tim De Feyter & Marie-Anne Guerry & Greet Vanden Berghe, 2020. "The extended roster quality staffing problem: addressing roster quality variation within a staffing planning period," Journal of Scheduling, Springer, vol. 23(2), pages 253-264, April.
    9. Dimitriou, V.A. & Georgiou, A.C. & Tsantas, N., 2013. "The multivariate non-homogeneous Markov manpower system in a departmental mobility framework," European Journal of Operational Research, Elsevier, vol. 228(1), pages 112-121.
    10. Tsantas, N., 1995. "Stochastic analysis of a non-homogeneous Markov system," European Journal of Operational Research, Elsevier, vol. 85(3), pages 670-685, September.
    11. Khrystyna Prysyazhnyk & Iryna Bazylevych & Ludmila Mitkova & Iryna Ivanochko, 2021. "Period-Life of a Branching Process with Migration and Continuous Time," Mathematics, MDPI, vol. 9(8), pages 1-10, April.
    12. O. Zeynep Akşin, 2007. "On valuing appreciating human assets in services," Naval Research Logistics (NRL), John Wiley & Sons, vol. 54(2), pages 221-235, March.
    13. Fokianos, Konstantinos & Fried, Roland & Kharin, Yuriy & Voloshko, Valeriy, 2022. "Statistical analysis of multivariate discrete-valued time series," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    14. Papapetrou, M. & Kugiumtzis, D., 2013. "Markov chain order estimation with conditional mutual information," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 392(7), pages 1593-1601.
    15. Komarudin, & Guerry, Marie-Anne & De Feyter, Tim & Vanden Berghe, Greet, 2013. "The roster quality staffing problem – A methodology for improving the roster quality by modifying the personnel structure," European Journal of Operational Research, Elsevier, vol. 230(3), pages 551-562.
    16. Nasroallah Abdelaziz & Elkimakh Karima, 2017. "HMM with emission process resulting from a special combination of independent Markovian emissions," Monte Carlo Methods and Applications, De Gruyter, vol. 23(4), pages 287-306, December.
    17. Grossmann, Wolf D. & Grossmann, Iris & Steininger, Karl W., 2014. "Solar electricity generation across large geographic areas, Part II: A Pan-American energy system based on solar," Renewable and Sustainable Energy Reviews, Elsevier, vol. 32(C), pages 983-993.
    18. Elkimakh Karima & Nasroallah Abdelaziz, 2020. "Hidden Markov Model with Markovian emission," Monte Carlo Methods and Applications, De Gruyter, vol. 26(4), pages 303-313, December.
    19. Maria Symeonaki, 2015. "Theory of fuzzy non homogeneous Markov systems with fuzzy states," Quality & Quantity: International Journal of Methodology, Springer, vol. 49(6), pages 2369-2385, November.
    20. Nikolaos Stavropoulos & Alexandra Papadopoulou & Pavlos Kolias, 2021. "Evaluating the Efficiency of Off-Ball Screens in Elite Basketball Teams via Second-Order Markov Modelling," Mathematics, MDPI, vol. 9(16), pages 1-13, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:15:p:1745-:d:600539. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.