IDEAS home Printed from https://ideas.repec.org/a/wly/jnljam/v2020y2020i1n2678374.html

Finite‐State‐Space Truncations for Infinite Quasi‐Birth‐Death Processes

Author

Listed:
  • Hendrik Baumann

Abstract

For dealing numerically with the infinite‐state‐space Markov chains, a truncation of the state space is inevitable, that is, an approximation by a finite‐state‐space Markov chain has to be performed. In this paper, we consider level‐dependent quasi‐birth‐death processes, and we focus on the computation of stationary expectations. In previous literature, efficient methods for computing approximations to these characteristics have been suggested and established. These methods rely on truncating the process at some level N, and for N⟶∞, convergence of the approximation to the desired characteristic is guaranteed. This paper’s main goal is to quantify the speed of convergence. Under the assumption of an f‐modulated drift condition, we derive terms for a lower bound and an upper bound on stationary expectations which converge quickly to the same value and which can be efficiently computed.

Suggested Citation

  • Hendrik Baumann, 2020. "Finite‐State‐Space Truncations for Infinite Quasi‐Birth‐Death Processes," Journal of Applied Mathematics, John Wiley & Sons, vol. 2020(1).
    • Handle: RePEc:wly:jnljam:v:2020:y:2020:i:1:n:2678374
    DOI: 10.1155/2020/2678374
    as

    Download full text from publisher

    File URL: https://doi.org/10.1155/2020/2678374
    Download Restriction: no
    File URL: https://libkey.io/10.1155/2020/2678374?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jesús R. Artalejo & Antonio Gómez-Corral, 2008. "Retrial Queueing Systems," Springer Books, Springer, number 978-3-540-78725-9, March.
    2. Baumann, Hendrik & Sandmann, Werner, 2014. "On finite long run costs and rewards in infinite Markov chains," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 41-46.
    3. A. G. Pakes, 1969. "Some Conditions for Ergodicity and Recurrence of Markov Chains," Operations Research, INFORMS, vol. 17(6), pages 1058-1061, December.
    4. Winfried K. Grassmann & Michael I. Taksar & Daniel P. Heyman, 1985. "Regenerative Analysis and Steady State Distributions for Markov Chains," Operations Research, INFORMS, vol. 33(5), pages 1107-1116, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jeongsim Kim & Bara Kim, 2016. "A survey of retrial queueing systems," Annals of Operations Research, Springer, vol. 247(1), pages 3-36, December.
    2. Tijms, H.C. & Coevering, M.C.T. van de, 1990. "How to solve numerically the equilibrium equations of a Markov chain with infinitely many states," Serie Research Memoranda 0046, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    3. S. K. Samanta & R. Nandi, 2021. "Queue-Length, Waiting-Time and Service Batch Size Analysis for the Discrete-Time GI/D-MSP (a,b) / 1 / ∞ $^{\text {(a,b)}}/1/\infty $ Queueing System," Methodology and Computing in Applied Probability, Springer, vol. 23(4), pages 1461-1488, December.
    4. A. Banik & U. Gupta, 2007. "Analyzing the finite buffer batch arrival queue under Markovian service process: GI X /MSP/1/N," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 15(1), pages 146-160, July.
    5. Kao, Edward P. C. & Wilson, Sandra D., 1999. "Analysis of nonpreemptive priority queues with multiple servers and two priority classes," European Journal of Operational Research, Elsevier, vol. 118(1), pages 181-193, October.
    6. Baumann, Hendrik & Sandmann, Werner, 2014. "On finite long run costs and rewards in infinite Markov chains," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 41-46.
    7. Amod J. Basnet & Isaac M. Sonin, 2022. "Parallel computing for Markov chains with islands and ports," Annals of Operations Research, Springer, vol. 317(2), pages 335-352, October.
    8. Falin, G.I., 2010. "A single-server batch arrival queue with returning customers," European Journal of Operational Research, Elsevier, vol. 201(3), pages 786-790, March.
    9. Souvik Ghosh & A. D. Banik & Joris Walraevens & Herwig Bruneel, 2022. "A detailed note on the finite-buffer queueing system with correlated batch-arrivals and batch-size-/phase-dependent bulk-service," 4OR, Springer, vol. 20(2), pages 241-272, June.
    10. Shweta Upadhyaya, 2020. "Investigating a general service retrial queue with damaging and licensed units: an application in local area networks," OPSEARCH, Springer;Operational Research Society of India, vol. 57(3), pages 716-745, September.
    11. T. Deepak, 2015. "On a retrial queueing model with single/batch service and search of customers from the orbit," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(2), pages 493-520, July.
    12. A. D. Banik & M. L. Chaudhry & U. C. Gupta, 2008. "On the Finite Buffer Queue with Renewal Input and Batch Markovian Service Process: GI/BMSP/1/N," Methodology and Computing in Applied Probability, Springer, vol. 10(4), pages 559-575, December.
    13. Ioannis Dimitriou, 2013. "A preemptive resume priority retrial queue with state dependent arrivals, unreliable server and negative customers," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 21(3), pages 542-571, October.
    14. Senthil K. Veeraraghavan & Laurens G. Debo, 2011. "Herding in Queues with Waiting Costs: Rationality and Regret," Manufacturing & Service Operations Management, INFORMS, vol. 13(3), pages 329-346, July.
    15. Isaac M. Sonin & Constantine Steinberg, 2016. "Continue, quit, restart probability model," Annals of Operations Research, Springer, vol. 241(1), pages 295-318, June.
    16. R. Harini & K. Indhira, 2024. "Dynamical modelling and cost optimization of a 5G base station for energy conservation using feedback retrial queue with sleeping strategy," Telecommunication Systems: Modelling, Analysis, Design and Management, Springer, vol. 86(4), pages 661-690, August.
    17. Edmundo de Souza e Silva & Rosa M. M. Leão & Raymond Marie, 2013. "Efficient Transient Analysis of Markovian Models Using a Block Reduction Approach," INFORMS Journal on Computing, INFORMS, vol. 25(4), pages 743-757, November.
    18. Grassmann, Winfried K., 1996. "Optimizing steady state Markov chains by state reduction," European Journal of Operational Research, Elsevier, vol. 89(2), pages 277-284, March.
    19. V. Jailaxmi & R. Arumuganathan & M. Senthil Kumar, 2017. "Performance analysis of an M/G/1 retrial queue with general retrial time, modified M-vacations and collision," Operational Research, Springer, vol. 17(2), pages 649-667, July.
    20. Kahraman, Aykut & Gosavi, Abhijit, 2011. "On the distribution of the number stranded in bulk-arrival, bulk-service queues of the M/G/1 form," European Journal of Operational Research, Elsevier, vol. 212(2), pages 352-360, July.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:jnljam:v:2020:y:2020:i:1:n:2678374. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://onlinelibrary.wiley.com/journal/4185 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.