IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v310y2022i2d10.1007_s10479-020-03693-7.html
   My bibliography  Save this article

Approximation of the exit probability of a stable Markov modulated constrained random walk

Author

Listed:
  • Fatma Başoğlu Kabran

    (Middle East Technical University
    İzmir Kavram Vocational School)

  • Ali Devin Sezer

    (Middle East Technical University)

Abstract

Let X be the constrained random walk on $${\mathbb {Z}}_+^2$$ Z + 2 having increments (1, 0), $$(-\,1,1)$$ ( - 1 , 1 ) , $$(0,-\,1)$$ ( 0 , - 1 ) with jump probabilities $$\lambda (M_k)$$ λ ( M k ) , $$\mu _1(M_k)$$ μ 1 ( M k ) , and $$\mu _2(M_k)$$ μ 2 ( M k ) where M is an irreducible aperiodic finite state Markov chain. The process X represents the lengths of two tandem queues with arrival rate $$\lambda (M_k)$$ λ ( M k ) , and service rates $$\mu _1(M_k)$$ μ 1 ( M k ) , and $$\mu _2(M_k)$$ μ 2 ( M k ) ; the process M represents the random environment within which the system operates. We assume that the average arrival rate with respect to the stationary measure of M is less than the average service rates, i.e., X is assumed stable. Let $$\tau _n$$ τ n be the first time when the sum of the components of X equals n for the first time. Let Y be the random walk on $${{\mathbb {Z}}} \times {{\mathbb {Z}}}_+$$ Z × Z + having increments $$(-\,1,0)$$ ( - 1 , 0 ) , (1, 1), $$(0,-\,1)$$ ( 0 , - 1 ) with probabilities $$\lambda (M_k)$$ λ ( M k ) , $$\mu _1(M_k)$$ μ 1 ( M k ) , and $$\mu _2(M_k)$$ μ 2 ( M k ) . Supposing that the queues share a joint buffer of size n, $$p_n =P_{(x_n,m)}(\tau _n 0$$ x ( 1 ) > 0 , and $$x_n = \lfloor nx \rfloor $$ x n = ⌊ n x ⌋ , we show that $$P_{(n-x_n(1),x_n(2),m)}( \tau

Suggested Citation

  • Fatma Başoğlu Kabran & Ali Devin Sezer, 2022. "Approximation of the exit probability of a stable Markov modulated constrained random walk," Annals of Operations Research, Springer, vol. 310(2), pages 431-475, March.
  • Handle: RePEc:spr:annopr:v:310:y:2022:i:2:d:10.1007_s10479-020-03693-7
    DOI: 10.1007/s10479-020-03693-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-020-03693-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10479-020-03693-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ridder, Ad, 2009. "Importance sampling algorithms for first passage time probabilities in the infinite server queue," European Journal of Operational Research, Elsevier, vol. 199(1), pages 176-186, November.
    2. Dean, Thomas & Dupuis, Paul, 2009. "Splitting for rare event simulation: A large deviation approach to design and analysis," Stochastic Processes and their Applications, Elsevier, vol. 119(2), pages 562-587, February.
    3. P. T. de Boer & D. P. Kroese & R. Y. Rubinstein, 2004. "A Fast Cross-Entropy Method for Estimating Buffer Overflows in Queueing Networks," Management Science, INFORMS, vol. 50(7), pages 883-895, July.
    4. Thomas Dean & Paul Dupuis, 2011. "The design and analysis of a generalized RESTART/DPR algorithm for rare event simulation," Annals of Operations Research, Springer, vol. 189(1), pages 63-102, September.
    5. Jose Blanchet, 2013. "Optimal Sampling of Overflow Paths in Jackson Networks," Mathematics of Operations Research, INFORMS, vol. 38(4), pages 698-719, November.
    6. Sezer, Ali Devin, 2009. "Importance sampling for a Markov modulated queuing network," Stochastic Processes and their Applications, Elsevier, vol. 119(2), pages 491-517, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kamil Demirberk Ünlü & Ali Devin Sezer, 2020. "Excessive backlog probabilities of two parallel queues," Annals of Operations Research, Springer, vol. 293(1), pages 141-174, October.
    2. Thomas Dean & Paul Dupuis, 2011. "The design and analysis of a generalized RESTART/DPR algorithm for rare event simulation," Annals of Operations Research, Springer, vol. 189(1), pages 63-102, September.
    3. K.-P. Hui & N. Bean & M. Kraetzl & Dirk Kroese, 2005. "The Cross-Entropy Method for Network Reliability Estimation," Annals of Operations Research, Springer, vol. 134(1), pages 101-118, February.
    4. O. J. Boxma & E. J. Cahen & D. Koops & M. Mandjes, 2019. "Linear Stochastic Fluid Networks: Rare-Event Simulation and Markov Modulation," Methodology and Computing in Applied Probability, Springer, vol. 21(1), pages 125-153, March.
    5. Loretta Mastroeni & Giuseppe D'Acquisto & Maurizio Naldi, 2014. "Evaluation of Credit Risk Under Correlated Defaults: The Cross-Entropy Simulation Approach," Departmental Working Papers of Economics - University 'Roma Tre' 0193, Department of Economics - University Roma Tre.
    6. Kaynar, Bahar & Ridder, Ad, 2010. "The cross-entropy method with patching for rare-event simulation of large Markov chains," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1380-1397, December.
    7. Zdravko I. Botev & Pierre L’Ecuyer, 2020. "Sampling Conditionally on a Rare Event via Generalized Splitting," INFORMS Journal on Computing, INFORMS, vol. 32(4), pages 986-995, October.
    8. Ali Kadhem, Athraa & Abdul Wahab, Noor Izzri & Aris, Ishak & Jasni, Jasronita & Abdalla, Ahmed N., 2017. "Computational techniques for assessing the reliability and sustainability of electrical power systems: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 80(C), pages 1175-1186.
    9. Pieter-Tjerk de Boer & Dirk Kroese & Shie Mannor & Reuven Rubinstein, 2005. "A Tutorial on the Cross-Entropy Method," Annals of Operations Research, Springer, vol. 134(1), pages 19-67, February.
    10. Cheung, Eric C.K. & Rabehasaina, Landy & Woo, Jae-Kyung & Xu, Ran, 2019. "Asymptotic correlation structure of discounted Incurred But Not Reported claims under fractional Poisson arrival process," European Journal of Operational Research, Elsevier, vol. 276(2), pages 582-601.
    11. Joakim Kalvenes & Neil Keon, 2007. "Traffic Estimation and Capacity Assignment in Multimedia Distribution Networks with Guaranteed Quality of Service," Operations Research, INFORMS, vol. 55(3), pages 518-531, June.
    12. Anne Buijsrogge & Pieter-Tjerk Boer & Werner R. W. Scheinhardt, 2019. "Importance sampling for non-Markovian tandem queues using subsolutions," Queueing Systems: Theory and Applications, Springer, vol. 93(1), pages 31-65, October.
    13. Jose Blanchet & Henry Lam, 2014. "Rare-Event Simulation for Many-Server Queues," Mathematics of Operations Research, INFORMS, vol. 39(4), pages 1142-1178, November.
    14. Hult, Henrik & Nyquist, Pierre, 2016. "Large deviations for weighted empirical measures arising in importance sampling," Stochastic Processes and their Applications, Elsevier, vol. 126(1), pages 138-170.
    15. M. Garvels, 2011. "A combined splitting—cross entropy method for rare-event probability estimation of queueing networks," Annals of Operations Research, Springer, vol. 189(1), pages 167-185, September.
    16. Joshua C. C. Chan & Eric Eisenstat, 2015. "Marginal Likelihood Estimation with the Cross-Entropy Method," Econometric Reviews, Taylor & Francis Journals, vol. 34(3), pages 256-285, March.
    17. Bahar Kaynar & Ad Ridder, 2009. "The Cross-Entropy Method with Patching for Rare-Event Simulation of Large Markov Chains," Tinbergen Institute Discussion Papers 09-084/4, Tinbergen Institute.
    18. Cadini, F. & Santos, F. & Zio, E., 2014. "An improved adaptive kriging-based importance technique for sampling multiple failure regions of low probability," Reliability Engineering and System Safety, Elsevier, vol. 131(C), pages 109-117.
    19. Jianhui Yang & Yaoben Lin, 2019. "Study on Evolution of Food Safety Status and Supervision Policy—A System Based on Quantity, Quality, and Development Safety," Sustainability, MDPI, vol. 11(23), pages 1-13, November.
    20. Pieter-Tjerk de Boer, 2005. "Rare-Event Simulation of Non-Markovian Queueing Networks Using a State-Dependent Change of Measure Determined Using Cross-Entropy," Annals of Operations Research, Springer, vol. 134(1), pages 69-100, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:310:y:2022:i:2:d:10.1007_s10479-020-03693-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.