IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v9y2021i11p1267-d566655.html
   My bibliography  Save this article

Estimation of the Optimal Threshold Policy in a Queue with Heterogeneous Servers Using a Heuristic Solution and Artificial Neural Networks

Author

Listed:
  • Dmitry Efrosinin

    (Insitute for Stochastics, Johannes Kepler University Linz, 4030 Linz, Austria
    Department of Information Technologies, Faculty of Mathematics and Natural Sciences, Peoples’ Friendship University of Russia (RUDN University), 117198 Moscow, Russia)

  • Natalia Stepanova

    (Laboratory N17, Trapeznikov Institute of Control Sciences of RAS, 117997 Moscow, Russia)

Abstract

This paper deals with heterogeneous queues where servers differ not only in service rates but also in operating costs. The classical optimisation problem in queueing systems with heterogeneous servers consists in the optimal allocation of customers between the servers with the aim to minimise the long-run average costs of the system per unit of time. As it is known, under some assumptions the optimal allocation policy for this system is of threshold type, i.e., the policy depends on the queue length and the state of faster servers. The optimal thresholds can be calculated using a Markov decision process by implementing the policy-iteration algorithm. This algorithm may have certain limitations on obtaining a result for the entire range of system parameter values. However, the available data sets for evaluated optimal threshold levels and values of system parameters can be used to provide estimations for optimal thresholds through artificial neural networks. The obtained results are accompanied by a simple heuristic solution. Numerical examples illustrate the quality of estimations.

Suggested Citation

  • Dmitry Efrosinin & Natalia Stepanova, 2021. "Estimation of the Optimal Threshold Policy in a Queue with Heterogeneous Servers Using a Heuristic Solution and Artificial Neural Networks," Mathematics, MDPI, vol. 9(11), pages 1-14, May.
  • Handle: RePEc:gam:jmathe:v:9:y:2021:i:11:p:1267-:d:566655
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/9/11/1267/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/9/11/1267/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Thomas B. Crabill & Donald Gross & Michael J. Magazine, 1977. "A Classified Bibliography of Research on Optimal Design and Control of Queues," Operations Research, INFORMS, vol. 25(2), pages 219-232, April.
    2. Efrosinin, Dmitry & Sztrik, Janos, 2018. "An algorithmic approach to analysing the reliability of a controllable unreliable queue with two heterogeneous servers," European Journal of Operational Research, Elsevier, vol. 271(3), pages 934-952.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gorbunova, A.V. & Lebedev, A.V., 2023. "Nonlinear approximation of characteristics of a fork–join queueing system with Pareto service as a model of parallel structure of data processing," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 214(C), pages 409-428.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kyle Y. Lin, 2003. "Decentralized admission control of a queueing system: A game‐theoretic model," Naval Research Logistics (NRL), John Wiley & Sons, vol. 50(7), pages 702-718, October.
    2. Kyle Y. Lin & Sheldon M. Ross, 2003. "Admission Control with Incomplete Information of a Queueing System," Operations Research, INFORMS, vol. 51(4), pages 645-654, August.
    3. Srinivas R. Chakravarthy & Alexander N. Dudin & Sergey A. Dudin & Olga S. Dudina, 2023. "Queueing System with Potential for Recruiting Secondary Servers," Mathematics, MDPI, vol. 11(3), pages 1-24, January.
    4. Irina Kochetkova & Kseniia Leonteva & Ibram Ghebrial & Anastasiya Vlaskina & Sofia Burtseva & Anna Kushchazli & Konstantin Samouylov, 2023. "Controllable Queuing System with Elastic Traffic and Signals for Resource Capacity Planning in 5G Network Slicing," Future Internet, MDPI, vol. 16(1), pages 1-23, December.
    5. Dmitry Efrosinin & Natalia Stepanova & Janos Sztrik & Andreas Plank, 2020. "Approximations in Performance Analysis of a Controllable Queueing System with Heterogeneous Servers," Mathematics, MDPI, vol. 8(10), pages 1-18, October.
    6. Wei Li & Attahiru Sule Alfa, 2000. "Optimal policies for M/M/m queue with two different kinds of (N, T)‐policies," Naval Research Logistics (NRL), John Wiley & Sons, vol. 47(3), pages 240-258, April.
    7. Kurt M. Bretthauer, 2000. "Optimal service and arrival rates in Jackson queueing networks," Naval Research Logistics (NRL), John Wiley & Sons, vol. 47(1), pages 1-17, February.
    8. J. R. Artalejo & A. Economou, 2005. "Markovian Controllable Queueing Systems with Hysteretic Policies: Busy Period and Waiting Time Analysis," Methodology and Computing in Applied Probability, Springer, vol. 7(3), pages 353-378, September.
    9. Mouloud Cherfaoui & Aicha Bareche, 2020. "An optimal approximation of the characteristics of the GI/M/1 queue with two-stage service policy," Operational Research, Springer, vol. 20(2), pages 959-983, June.
    10. R. E. Lillo, 2000. "Optimal Operating Policy for an M/G/1 Exhaustive Server-Vacation Model," Methodology and Computing in Applied Probability, Springer, vol. 2(2), pages 153-167, August.
    11. Simin Huang & Rajan Batta & Rakesh Nagi, 2005. "Distribution network design: Selection and sizing of congested connections," Naval Research Logistics (NRL), John Wiley & Sons, vol. 52(8), pages 701-712, December.
    12. Barış Ata, 2006. "Dynamic Control of a Multiclass Queue with Thin Arrival Streams," Operations Research, INFORMS, vol. 54(5), pages 876-892, October.
    13. Jae‐Dong Son & Yaghoub Khojasteh Ghamari, 2008. "Optimal admission and pricing control problems in service industries with multiple servers and sideline profit," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 24(4), pages 325-342, July.
    14. Nasuh Buyukkaramikli & J. Bertrand & Henny Ooijen, 2013. "Flexible hiring in a make to order system with parallel processing units," Annals of Operations Research, Springer, vol. 209(1), pages 159-178, October.
    15. Chen-An Lin & Kevin Shang & Peng Sun, 2023. "Wait Time–Based Pricing for Queues with Customer-Chosen Service Times," Management Science, INFORMS, vol. 69(4), pages 2127-2146, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:9:y:2021:i:11:p:1267-:d:566655. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.