IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v66y2020i8p3501-3527.html
   My bibliography  Save this article

Constrained Load-Balancing Policies for Parallel Single-Server Queue Systems

Author

Listed:
  • Hung T. Do

    (Grossman School of Business, University of Vermont, Burlington, Vermont 05405)

  • Masha Shunko

    (Foster School of Business, University of Washington, Seattle, Washington 98027)

Abstract

Flow-control policies that balance server loads are well known for improving performance of queueing systems with multiple nodes. However, although load balancing benefits the system overall, it may negatively impact some of the queueing nodes. For example, it may reduce throughput rates or engender unfairness with respect to some performance measures. For queueing systems with multiple single-server nodes, we propose a set of constrained load-balancing policies that ensures the expected arrival rate to each queueing node is not reduced, and we show that such policies provide multiple benefits for each queueing node: stochastically fewer customers and lower variance of the number of customers at each queueing node. These results imply performance improvement as measured by multiple general objective functions, including but not limited to the expected number of customers at a queueing node, probability of having a high number of customers, variance of the number of customers, and expected number of customers conditional on exceeding a threshold defined by a fixed service level. We demonstrate numerically that our proposed policies capture a large portion of the potential maximal improvement.

Suggested Citation

  • Hung T. Do & Masha Shunko, 2020. "Constrained Load-Balancing Policies for Parallel Single-Server Queue Systems," Management Science, INFORMS, vol. 66(8), pages 3501-3527, August.
    • Handle: RePEc:inm:ormnsc:v:66:y:2020:i:8:p:3501-3527
    DOI: 10.1287/mnsc.2019.3363
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/mnsc.2019.3363
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.2019.3363?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Itai Gurvich & Ohad Perry, 2012. "Overflow Networks: Approximations and Implications to Call Center Outsourcing," Operations Research, INFORMS, vol. 60(4), pages 996-1009, August.
    2. Sarang Deo & Itai Gurvich, 2011. "Centralized vs. Decentralized Ambulance Diversion: A Network Perspective," Management Science, INFORMS, vol. 57(7), pages 1300-1319, July.
    3. Ramirez-Nafarrate, Adrian & Baykal Hafizoglu, A. & Gel, Esma S. & Fowler, John W., 2014. "Optimal control policies for ambulance diversion," European Journal of Operational Research, Elsevier, vol. 236(1), pages 298-312.
    4. Johri, Pravin K., 1986. "Stochastically minimizing the number of customers in exponential queuing systems," European Journal of Operational Research, Elsevier, vol. 27(1), pages 111-116, October.
    5. Johri, Pravin K., 1989. "Optimality of the shortest line discipline with state-dependent service rates," European Journal of Operational Research, Elsevier, vol. 41(2), pages 157-161, July.
    6. Tolga Tezcan, 2008. "Optimal Control of Distributed Parallel Server Systems Under the Halfin and Whitt Regime," Mathematics of Operations Research, INFORMS, vol. 33(1), pages 51-90, February.
    7. Rockafellar, R. Tyrrell & Uryasev, Stanislav, 2002. "Conditional value-at-risk for general loss distributions," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1443-1471, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Siddharth Prakash Singh & Mohammad Delasay & Alan Scheller‐Wolf, 2023. "Real‐time delay announcement under competition," Production and Operations Management, Production and Operations Management Society, vol. 32(3), pages 863-881, March.
    2. Mengyu Li & Peter Vanberkel & Alix J. E. Carter, 2019. "A review on ambulance offload delay literature," Health Care Management Science, Springer, vol. 22(4), pages 658-675, December.
    3. Powell, Warren B., 2019. "A unified framework for stochastic optimization," European Journal of Operational Research, Elsevier, vol. 275(3), pages 795-821.
    4. Hyun-Rok Lee & Taesik Lee, 2018. "Markov decision process model for patient admission decision at an emergency department under a surge demand," Flexible Services and Manufacturing Journal, Springer, vol. 30(1), pages 98-122, June.
    5. Cao, Ping & Zhong, Zhiheng & Huang, Junfei, 2021. "Dynamic routing in a distributed parallel many-server service system: The effect of ξ-choice," European Journal of Operational Research, Elsevier, vol. 294(1), pages 219-235.
    6. Cui, Xueting & Zhu, Shushang & Sun, Xiaoling & Li, Duan, 2013. "Nonlinear portfolio selection using approximate parametric Value-at-Risk," Journal of Banking & Finance, Elsevier, vol. 37(6), pages 2124-2139.
    7. Zhi Chen & Melvyn Sim & Huan Xu, 2019. "Distributionally Robust Optimization with Infinitely Constrained Ambiguity Sets," Operations Research, INFORMS, vol. 67(5), pages 1328-1344, September.
    8. Dominique Guégan & Wayne Tarrant, 2012. "On the necessity of five risk measures," Annals of Finance, Springer, vol. 8(4), pages 533-552, November.
    9. Giovanni Masala & Filippo Petroni, 2023. "Drawdown risk measures for asset portfolios with high frequency data," Annals of Finance, Springer, vol. 19(2), pages 265-289, June.
    10. Ke Zhou & Jiangjun Gao & Duan Li & Xiangyu Cui, 2017. "Dynamic mean–VaR portfolio selection in continuous time," Quantitative Finance, Taylor & Francis Journals, vol. 17(10), pages 1631-1643, October.
    11. Malavasi, Matteo & Ortobelli Lozza, Sergio & Trück, Stefan, 2021. "Second order of stochastic dominance efficiency vs mean variance efficiency," European Journal of Operational Research, Elsevier, vol. 290(3), pages 1192-1206.
    12. Rostagno, Luciano Martin, 2005. "Empirical tests of parametric and non-parametric Value-at-Risk (VaR) and Conditional Value-at-Risk (CVaR) measures for the Brazilian stock market index," ISU General Staff Papers 2005010108000021878, Iowa State University, Department of Economics.
    13. Alois Pichler, 2013. "Premiums And Reserves, Adjusted By Distortions," Papers 1304.0490, arXiv.org.
    14. Alexander, Gordon J. & Baptista, Alexandre M. & Yan, Shu, 2013. "A comparison of the original and revised Basel market risk frameworks for regulating bank capital," Journal of Economic Behavior & Organization, Elsevier, vol. 85(C), pages 249-268.
    15. Rockafellar, R.T. & Royset, J.O., 2010. "On buffered failure probability in design and optimization of structures," Reliability Engineering and System Safety, Elsevier, vol. 95(5), pages 499-510.
    16. Li, Bo & Hou, Peng-Wen & Chen, Ping & Li, Qing-Hua, 2016. "Pricing strategy and coordination in a dual channel supply chain with a risk-averse retailer," International Journal of Production Economics, Elsevier, vol. 178(C), pages 154-168.
    17. Jin, Xin & Zhang, Zhaolong & Shi, Xiaoqiang & Ju, Wenbin, 2014. "A review on wind power industry and corresponding insurance market in China: Current status and challenges," Renewable and Sustainable Energy Reviews, Elsevier, vol. 38(C), pages 1069-1082.
    18. Alexander, Gordon J. & Baptista, Alexandre M. & Yan, Shu, 2012. "When more is less: Using multiple constraints to reduce tail risk," Journal of Banking & Finance, Elsevier, vol. 36(10), pages 2693-2716.
    19. Kull, Andreas, 2009. "Sharing Risk – An Economic Perspective," ASTIN Bulletin, Cambridge University Press, vol. 39(2), pages 591-613, November.
    20. Mínguez, R. & Conejo, A.J. & García-Bertrand, R., 2011. "Reliability and decomposition techniques to solve certain class of stochastic programming problems," Reliability Engineering and System Safety, Elsevier, vol. 96(2), pages 314-323.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:66:y:2020:i:8:p:3501-3527. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.