IDEAS home Printed from https://ideas.repec.org/a/spr/operea/v22y2022i3d10.1007_s12351-020-00613-2.html
   My bibliography  Save this article

Transient study of Markov models with time-dependent transition rates

Author

Listed:
  • Narayanan C. Viswanath

    (Government Engineering College)

Abstract

We apply the external uniformization (EU) method for the transient study of continuous-time Markov chain models in which the transition rates could be either constant or time-dependent. In the method, we run an exponential clock for watching the Markov chain. Each realization epoch of the random clock is considered as an absorption epoch. The approximate transient probability that the Markov chain is found at a particular state is then found as the probability of absorption from that state. The convergence of the method to the analytical value has been proved. In the case of infinite/huge dimensional Markov chains, implementation of the method needs truncation of the state-space into a finite window of states. A comparison of the results obtained using the EU method with some of the existing analytical results shows that the described method produces highly accurate results on numerical implementation. Several examples considered also reveal that the EU method required much less computational time when compared to the uniformization/randomization (U/R) method.

Suggested Citation

  • Narayanan C. Viswanath, 2022. "Transient study of Markov models with time-dependent transition rates," Operational Research, Springer, vol. 22(3), pages 2209-2243, July.
    • Handle: RePEc:spr:operea:v:22:y:2022:i:3:d:10.1007_s12351-020-00613-2
    DOI: 10.1007/s12351-020-00613-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s12351-020-00613-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s12351-020-00613-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Linda V. Green & Peter J. Kolesar & João Soares, 2001. "Improving the Sipp Approach for Staffing Service Systems That Have Cyclic Demands," Operations Research, INFORMS, vol. 49(4), pages 549-564, August.
    2. Ward Whitt, 2004. "A Diffusion Approximation for the G/GI/n/m Queue," Operations Research, INFORMS, vol. 52(6), pages 922-941, December.
    3. Armann Ingolfsson & Elvira Akhmetshina & Susan Budge & Yongyue Li & Xudong Wu, 2007. "A Survey and Experimental Comparison of Service-Level-Approximation Methods for Nonstationary M(t)/M/s(t) Queueing Systems with Exhaustive Discipline," INFORMS Journal on Computing, INFORMS, vol. 19(2), pages 201-214, May.
    4. Schwarz, Justus Arne & Selinka, Gregor & Stolletz, Raik, 2016. "Performance analysis of time-dependent queueing systems: Survey and classification," Omega, Elsevier, vol. 63(C), pages 170-189.
    5. Tirdad, Ali & Grassmann, Winfried K. & Tavakoli, Javad, 2016. "Optimal policies of M(t)/M/c/c queues with two different levels of servers," European Journal of Operational Research, Elsevier, vol. 249(3), pages 1124-1130.
    6. Stolletz, Raik, 2008. "Approximation of the non-stationary M(t)/M(t)/c(t)-queue using stationary queueing models: The stationary backlog-carryover approach," European Journal of Operational Research, Elsevier, vol. 190(2), pages 478-493, October.
    7. William H. Kaczynski & Lawrence M. Leemis & John H. Drew, 2012. "Transient Queueing Analysis," INFORMS Journal on Computing, INFORMS, vol. 24(1), pages 10-28, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alex Roubos & Ger Koole & Raik Stolletz, 2012. "Service-Level Variability of Inbound Call Centers," Manufacturing & Service Operations Management, INFORMS, vol. 14(3), pages 402-413, July.
    2. Niyirora, Jerome & Zhuang, Jun, 2017. "Fluid approximations and control of queues in emergency departments," European Journal of Operational Research, Elsevier, vol. 261(3), pages 1110-1124.
    3. Rodríguez-Sanz, à lvaro & Fernández de Marcos, Alberto & Pérez-Castán, Javier A. & Comendador, Fernando Gómez & Arnaldo Valdés, Rosa & París Loreiro, à ngel, 2021. "Queue behavioural patterns for passengers at airport terminals: A machine learning approach," Journal of Air Transport Management, Elsevier, vol. 90(C).
    4. Ran Liu & Xiaolan Xie, 2018. "Physician Staffing for Emergency Departments with Time-Varying Demand," INFORMS Journal on Computing, INFORMS, vol. 30(3), pages 588-607, August.
    5. Yue Zhang & Martin L. Puterman & Matthew Nelson & Derek Atkins, 2012. "A Simulation Optimization Approach to Long-Term Care Capacity Planning," Operations Research, INFORMS, vol. 60(2), pages 249-261, April.
    6. Alexander Zeifman & Yacov Satin & Ivan Kovalev & Rostislav Razumchik & Victor Korolev, 2020. "Facilitating Numerical Solutions of Inhomogeneous Continuous Time Markov Chains Using Ergodicity Bounds Obtained with Logarithmic Norm Method," Mathematics, MDPI, vol. 9(1), pages 1-20, December.
    7. Gabriel Zayas-Cabán & Mark E. Lewis, 2020. "Admission control in a two-class loss system with periodically varying parameters and abandonments," Queueing Systems: Theory and Applications, Springer, vol. 94(1), pages 175-210, February.
    8. Ad Ridder, 2022. "Rare-event analysis and simulation of queues with time-varying rates," Queueing Systems: Theory and Applications, Springer, vol. 100(3), pages 545-547, April.
    9. William A. Massey & Jamol Pender, 2018. "Dynamic rate Erlang-A queues," Queueing Systems: Theory and Applications, Springer, vol. 89(1), pages 127-164, June.
    10. Pei, Zhi & Dai, Xu & Yuan, Yilun & Du, Rui & Liu, Changchun, 2021. "Managing price and fleet size for courier service with shared drones," Omega, Elsevier, vol. 104(C).
    11. Legros, Benjamin & Fransoo, Jan C., 2023. "Admission and pricing optimization of on-street parking with delivery bays," Other publications TiSEM 6d41ee5c-27dc-4d34-aff1-4, Tilburg University, School of Economics and Management.
    12. Castillo, Ignacio & Joro, Tarja & Li, Yong Yue, 2009. "Workforce scheduling with multiple objectives," European Journal of Operational Research, Elsevier, vol. 196(1), pages 162-170, July.
    13. Dietz, Dennis C., 2011. "Practical scheduling for call center operations," Omega, Elsevier, vol. 39(5), pages 550-557, October.
    14. Dimitrakopoulos, Y. & Burnetas, A.N., 2016. "Customer equilibrium and optimal strategies in an M/M/1 queue with dynamic service control," European Journal of Operational Research, Elsevier, vol. 252(2), pages 477-486.
    15. Amir Rastpour & Armann Ingolfsson & Bora Kolfal, 2020. "Modeling Yellow and Red Alert Durations for Ambulance Systems," Production and Operations Management, Production and Operations Management Society, vol. 29(8), pages 1972-1991, August.
    16. Andriy Shapoval & Eva K. Lee, 2022. "Managing Guest Flow in Georgia Aquarium After the Dolphin Tales Show Opening," SN Operations Research Forum, Springer, vol. 3(3), pages 1-21, September.
    17. Flötteröd, G. & Osorio, C., 2017. "Stochastic network link transmission model," Transportation Research Part B: Methodological, Elsevier, vol. 102(C), pages 180-209.
    18. Ding, S. & Koole, G. & van der Mei, R.D., 2015. "On the estimation of the true demand in call centers with redials and reconnects," European Journal of Operational Research, Elsevier, vol. 246(1), pages 250-262.
    19. Yacov Satin & Rostislav Razumchik & Ivan Kovalev & Alexander Zeifman, 2023. "Ergodicity and Related Bounds for One Particular Class of Markovian Time—Varying Queues with Heterogeneous Servers and Customer’s Impatience," Mathematics, MDPI, vol. 11(9), pages 1-15, April.
    20. Ward Whitt, 2005. "Heavy-Traffic Limits for the G / H 2 */ n / m Queue," Mathematics of Operations Research, INFORMS, vol. 30(1), pages 1-27, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:operea:v:22:y:2022:i:3:d:10.1007_s12351-020-00613-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.