IDEAS home Printed from https://ideas.repec.org/a/inm/ormoor/v50y2025i2p813-837.html

Simple and Explicit Bounds for Multiserver Queues with 1 1 − ρ Scaling

Author

Listed:
  • Yuan Li

    (Amazon, Bellevue, Washington 98004)

  • David A. Goldberg

    (Cornell Operations Research and Information Engineering, Ithaca, New York 14853)

Abstract

We consider the first-come-first-serve (FCFS) G I / G I / n queue and prove the first simple and explicit bounds that scale as 1 1 − ρ under only the assumption that interarrival times have finite second moment, and service times have finite 2 + ϵ moment for some ϵ > 0 . Here, ρ denotes the corresponding traffic intensity. Conceptually, our results can be viewed as a multiserver analogue of Kingman’s bound. Our main results are bounds for the tail of the steady-state queue length and the steady-state probability of delay. The strength of our bounds (e.g., in the form of tail decay rate) is a function of how many moments of the service distribution are assumed finite. Our bounds scale gracefully, even when the number of servers grows large and the traffic intensity converges to unity simultaneously, as in the Halfin-Whitt scaling regime. Some of our bounds scale better than 1 1 − ρ in certain asymptotic regimes. In these same asymptotic regimes, we also prove bounds for the tail of the steady-state number in service. Our main proofs proceed by explicitly analyzing the bounding process that arises in the stochastic comparison bounds of Gamarnik and Goldberg for multiserver queues. Along the way, we derive several novel results for suprema of random walks and pooled renewal processes, which may be of independent interest. We also prove several additional bounds using drift arguments (which have much smaller prefactors) and point out a conjecture that would imply further related bounds and generalizations. We also show that when all moments of the service distribution are finite and satisfy a mild growth rate assumption, our bounds can be strengthened to yield explicit tail estimates decaying as O ( exp ( − x α ) ) , with α ∈ ( 0 , 1 ) , depending on the growth rate of these moments.

Suggested Citation

  • Yuan Li & David A. Goldberg, 2025. "Simple and Explicit Bounds for Multiserver Queues with 1 1 − ρ Scaling," Mathematics of Operations Research, INFORMS, vol. 50(2), pages 813-837, May.
  • Handle: RePEc:inm:ormoor:v:50:y:2025:i:2:p:813-837
    DOI: 10.1287/moor.2022.0131
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/moor.2022.0131
    Download Restriction: no

    File URL: https://libkey.io/10.1287/moor.2022.0131?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Dimitris Bertsimas & Daisuke Nakazato, 1995. "The Distributional Little's Law and Its Applications," Operations Research, INFORMS, vol. 43(2), pages 298-310, April.
    2. Reza Aghajani & Kavita Ramanan, 2020. "The Limit of Stationary Distributions of Many-Server Queues in the Halfin–Whitt Regime," Mathematics of Operations Research, INFORMS, vol. 45(3), pages 1016-1055, August.
    3. Avishai Mandelbaum & Petar Momčilović, 2012. "Queues with Many Servers and Impatient Customers," Mathematics of Operations Research, INFORMS, vol. 37(1), pages 41-65, February.
    4. Alberto Vera & Siddhartha Banerjee, 2021. "The Bayesian Prophet: A Low-Regret Framework for Online Decision Making," Management Science, INFORMS, vol. 67(3), pages 1368-1391, March.
    5. Chaithanya Bandi & Dimitris Bertsimas & Nataly Youssef, 2015. "Robust Queueing Theory," Operations Research, INFORMS, vol. 63(3), pages 676-700, June.
    6. Peter J. Downey, 1991. "Bounding Synchronization Overhead for Parallel Iteration," INFORMS Journal on Computing, INFORMS, vol. 3(4), pages 288-298, November.
    7. D Worthington, 2009. "Reflections on queue modelling from the last 50 years," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(1), pages 83-92, May.
    8. Alan Scheller-Wolf, 2003. "Necessary and Sufficient Conditions for Delay Moments in FIFO Multiserver Queues with an Application Comparing s Slow Servers with One Fast One," Operations Research, INFORMS, vol. 51(5), pages 748-758, October.
    9. Elja Arjas & Tapani Lehtonen, 1978. "Approximating Many Server Queues by Means of Single Server Queues," Mathematics of Operations Research, INFORMS, vol. 3(3), pages 205-223, August.
    10. Toji Makino, 1969. "Investigation of the mean waiting time for queueing system with many servers," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 21(1), pages 357-366, December.
    11. A. J. E. M. Janssen & J. S. H. van Leeuwaarden & Bert Zwart, 2011. "Refining Square-Root Safety Staffing by Expanding Erlang C," Operations Research, INFORMS, vol. 59(6), pages 1512-1522, December.
    12. Linwei Xin & David A. Goldberg, 2016. "Optimality Gap of Constant-Order Policies Decays Exponentially in the Lead Time for Lost Sales Models," Operations Research, INFORMS, vol. 64(6), pages 1556-1565, December.
    13. Martin I. Reiman, 1984. "Open Queueing Networks in Heavy Traffic," Mathematics of Operations Research, INFORMS, vol. 9(3), pages 441-458, August.
    14. Gaunt, Robert E. & Walton, Neil, 2020. "Stein’s method for the single server queue in heavy traffic," Statistics & Probability Letters, Elsevier, vol. 156(C).
    15. Shlomo Halfin & Ward Whitt, 1981. "Heavy-Traffic Limits for Queues with Many Exponential Servers," Operations Research, INFORMS, vol. 29(3), pages 567-588, June.
    16. David Y. Burman & Donald R. Smith, 1983. "A Light-Traffic Theorem for Multi-Server Queues," Mathematics of Operations Research, INFORMS, vol. 8(1), pages 15-25, February.
    17. Sem Borst & Avi Mandelbaum & Martin I. Reiman, 2004. "Dimensioning Large Call Centers," Operations Research, INFORMS, vol. 52(1), pages 17-34, February.
    18. David A. Goldberg & Dmitriy A. Katz-Rogozhnikov & Yingdong Lu & Mayank Sharma & Mark S. Squillante, 2016. "Asymptotic Optimality of Constant-Order Policies for Lost Sales Inventory Models with Large Lead Times," Mathematics of Operations Research, INFORMS, vol. 41(3), pages 898-913, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jaap Storm & Wouter Berkelmans & René Bekker, 2024. "Diffusion-Based Staffing for Multitasking Service Systems with Many Servers," Mathematics of Operations Research, INFORMS, vol. 49(4), pages 2684-2722, November.
    2. Bo Zhang & Johan S. H. van Leeuwaarden & Bert Zwart, 2012. "Staffing Call Centers with Impatient Customers: Refinements to Many-Server Asymptotics," Operations Research, INFORMS, vol. 60(2), pages 461-474, April.
    3. Ying Chen & John J. Hasenbein, 2017. "Staffing large-scale service systems with distributional uncertainty," Queueing Systems: Theory and Applications, Springer, vol. 87(1), pages 55-79, October.
    4. Rouba Ibrahim & Mor Armony & Achal Bassamboo, 2017. "Does the Past Predict the Future? The Case of Delay Announcements in Service Systems," Management Science, INFORMS, vol. 63(6), pages 1762-1780, June.
    5. Josh Reed & Yair Shaki, 2015. "A Fair Policy for the G / GI / N Queue with Multiple Server Pools," Mathematics of Operations Research, INFORMS, vol. 40(3), pages 558-595, March.
    6. Hassan Hmedi & Ari Arapostathis & Guodong Pang, 2023. "On System-Wide Safety Staffing of Large-Scale Parallel Server Networks," Operations Research, INFORMS, vol. 71(2), pages 415-432, March.
    7. Mor Armony & Constantinos Maglaras, 2004. "On Customer Contact Centers with a Call-Back Option: Customer Decisions, Routing Rules, and System Design," Operations Research, INFORMS, vol. 52(2), pages 271-292, April.
    8. Josh Reed & Bo Zhang, 2017. "Managing capacity and inventory jointly for multi-server make-to-stock queues," Queueing Systems: Theory and Applications, Springer, vol. 86(1), pages 61-94, June.
    9. Jayakrishnan Nair & Adam Wierman & Bert Zwart, 2016. "Provisioning of Large-Scale Systems: The Interplay Between Network Effects and Strategic Behavior in the User Base," Management Science, INFORMS, vol. 62(6), pages 1830-1841, June.
    10. Ramandeep S. Randhawa, 2016. "Optimality gap of asymptotically derived prescriptions in queueing systems," Queueing Systems: Theory and Applications, Springer, vol. 83(1), pages 131-155, June.
    11. Eugene Furman & Adam Diamant & Murat Kristal, 2021. "Customer Acquisition and Retention: A Fluid Approach for Staffing," Production and Operations Management, Production and Operations Management Society, vol. 30(11), pages 4236-4257, November.
    12. Noa Zychlinski, 2023. "Applications of fluid models in service operations management," Queueing Systems: Theory and Applications, Springer, vol. 103(1), pages 161-185, February.
    13. Ragavendran Gopalakrishnan & Sherwin Doroudi & Amy R. Ward & Adam Wierman, 2016. "Routing and Staffing When Servers Are Strategic," Operations Research, INFORMS, vol. 64(4), pages 1033-1050, August.
    14. Petar Momčilović & Amir Motaei, 2018. "QED limits for many-server systems under a priority policy," Queueing Systems: Theory and Applications, Springer, vol. 90(1), pages 125-159, October.
    15. Heemskerk, M. & Mandjes, M. & Mathijsen, B., 2022. "Staffing for many-server systems facing non-standard arrival processes," European Journal of Operational Research, Elsevier, vol. 296(3), pages 900-913.
    16. Galit B. Yom-Tov & Avishai Mandelbaum, 2014. "Erlang-R: A Time-Varying Queue with Reentrant Customers, in Support of Healthcare Staffing," Manufacturing & Service Operations Management, INFORMS, vol. 16(2), pages 283-299, May.
    17. Avishai Mandelbaum & Petar Momčilović, 2017. "Personalized queues: the customer view, via a fluid model of serving least-patient first," Queueing Systems: Theory and Applications, Springer, vol. 87(1), pages 23-53, October.
    18. Niyirora, Jerome & Zhuang, Jun, 2017. "Fluid approximations and control of queues in emergency departments," European Journal of Operational Research, Elsevier, vol. 261(3), pages 1110-1124.
    19. Achal Bassamboo & Assaf Zeevi, 2009. "On a Data-Driven Method for Staffing Large Call Centers," Operations Research, INFORMS, vol. 57(3), pages 714-726, June.
    20. van Leeuwaarden, Johan S.H. & Knessl, Charles, 2011. "Transient behavior of the Halfin-Whitt diffusion," Stochastic Processes and their Applications, Elsevier, vol. 121(7), pages 1524-1545, July.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormoor:v:50:y:2025:i:2:p:813-837. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.