IDEAS home Printed from https://ideas.repec.org/a/eee/oprepe/v7y2020ics221471602030052x.html
   My bibliography  Save this article

Stochastic simulation under input uncertainty: A Review

Author

Listed:
  • Corlu, Canan G.
  • Akcay, Alp
  • Xie, Wei

Abstract

Stochastic simulation is an invaluable tool for operations-research practitioners for the performance evaluation of systems with random behavior and mathematically intractable performance measures. An important step in the development of a simulation model is input modeling, which is the selection of appropriate probability models that characterize the stochastic behavior of the system inputs. For example, in a queueing-system simulation, input modeling includes choosing the probability distributions for stochastic interarrival and service times. The lack of knowledge about the true input models is an important practical challenge. The impact of the lack of information about the true input model on the simulation output is referred to as ‘input uncertainty’ in the simulation literature. Ignoring input uncertainty often leads to poor estimates of the system performance, especially when there is limited amount of historical data to make inference on the input models. Therefore, it is critically important to assess the impact of input uncertainty on the estimated performance measures in a statistically valid and computationally efficient way. The goal of this paper is to present input uncertainty research in stochastic simulations by providing a classification of major research streams and focusing on the new developments in recent years. We also review application papers that investigate the value of representing input uncertainty in the simulation of real-world stochastic systems in various industries. We provide a self-contained presentation of the major research streams with a special attention on the new developments in the last couple of years.

Suggested Citation

  • Corlu, Canan G. & Akcay, Alp & Xie, Wei, 2020. "Stochastic simulation under input uncertainty: A Review," Operations Research Perspectives, Elsevier, vol. 7(C).
  • Handle: RePEc:eee:oprepe:v:7:y:2020:i:c:s221471602030052x
    DOI: 10.1016/j.orp.2020.100162
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S221471602030052X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.orp.2020.100162?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Canan G. Corlu & Bahar Biller & Sridhar Tayur, 2017. "Demand fulfillment probability in a multi-item inventory system with limited historical data," IISE Transactions, Taylor & Francis Journals, vol. 49(12), pages 1087-1100, December.
    2. Helin Zhu & Joshua Hale & Enlu Zhou, 2018. "Simulation optimization of risk measures with adaptive risk levels," Journal of Global Optimization, Springer, vol. 70(4), pages 783-809, April.
    3. Henry Lam, 2016. "Robust Sensitivity Analysis for Stochastic Systems," Mathematics of Operations Research, INFORMS, vol. 41(4), pages 1248-1275, November.
    4. Bahar Biller, 2009. "Copula-Based Multivariate Input Models for Stochastic Simulation," Operations Research, INFORMS, vol. 57(4), pages 878-892, August.
    5. Stephen E. Chick, 2001. "Input Distribution Selection for Simulation Experiments: Accounting for Input Uncertainty," Operations Research, INFORMS, vol. 49(5), pages 744-758, October.
    6. Hui Xiao & Fei Gao & Loo Hay Lee, 2020. "Optimal computing budget allocation for complete ranking with input uncertainty," IISE Transactions, Taylor & Francis Journals, vol. 52(5), pages 489-499, May.
    7. Aharon Ben-Tal & Dick den Hertog & Anja De Waegenaere & Bertrand Melenberg & Gijs Rennen, 2013. "Robust Solutions of Optimization Problems Affected by Uncertain Probabilities," Management Science, INFORMS, vol. 59(2), pages 341-357, April.
    8. Peter Frazier & Warren Powell & Savas Dayanik, 2009. "The Knowledge-Gradient Policy for Correlated Normal Beliefs," INFORMS Journal on Computing, INFORMS, vol. 21(4), pages 599-613, November.
    9. Erick Delage & Yinyu Ye, 2010. "Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems," Operations Research, INFORMS, vol. 58(3), pages 595-612, June.
    10. Alp Akcay & Canan G. Corlu, 2017. "Simulation of inventory systems with unknown input models: a data-driven approach," International Journal of Production Research, Taylor & Francis Journals, vol. 55(19), pages 5826-5840, October.
    11. Wolfram Wiesemann & Daniel Kuhn & Melvyn Sim, 2014. "Distributionally Robust Convex Optimization," Operations Research, INFORMS, vol. 62(6), pages 1358-1376, December.
    12. Bahar Biller & Canan G. Corlu, 2011. "Accounting for Parameter Uncertainty in Large-Scale Stochastic Simulations with Correlated Inputs," Operations Research, INFORMS, vol. 59(3), pages 661-673, June.
    13. Weiwei Fan & L. Jeff Hong & Xiaowei Zhang, 2020. "Distributionally Robust Selection of the Best," Management Science, INFORMS, vol. 66(1), pages 190-208, January.
    14. Jie Xu & Edward Huang & Chun-Hung Chen & Loo Hay Lee, 2015. "Simulation Optimization: A Review and Exploration in the New Era of Cloud Computing and Big Data," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 32(03), pages 1-34.
    15. Wei Xie & Barry L. Nelson & Russell R. Barton, 2014. "A Bayesian Framework for Quantifying Uncertainty in Stochastic Simulation," Operations Research, INFORMS, vol. 62(6), pages 1439-1452, December.
    16. Alp Akcay & Bahar Biller & Sridhar Tayur, 2011. "Improved Inventory Targets in the Presence of Limited Historical Demand Data," Manufacturing & Service Operations Management, INFORMS, vol. 13(3), pages 297-309, July.
    17. Eunhye Song & Barry L. Nelson, 2015. "Quickly Assessing Contributions to Input Uncertainty," IISE Transactions, Taylor & Francis Journals, vol. 47(9), pages 893-909, September.
    18. Zhongshun Shi & Siyang Gao & Hui Xiao & Weiwei Chen, 2019. "A worst‐case formulation for constrained ranking and selection with input uncertainty," Naval Research Logistics (NRL), John Wiley & Sons, vol. 66(8), pages 648-662, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Katarzyna Maciejowska, 2022. "A portfolio management of a small RES utility with a Structural Vector Autoregressive model of German electricity markets," Papers 2205.00975, arXiv.org.
    2. Xie, Wei & Barton, Russell R. & Nelson, Barry L. & Wang, Keqi, 2023. "Stochastic simulation uncertainty analysis to accelerate flexible biomanufacturing process development," European Journal of Operational Research, Elsevier, vol. 310(1), pages 238-248.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Soumyadip Ghosh & Henry Lam, 2019. "Robust Analysis in Stochastic Simulation: Computation and Performance Guarantees," Operations Research, INFORMS, vol. 67(1), pages 232-249, January.
    2. Weiwei Fan & L. Jeff Hong & Xiaowei Zhang, 2020. "Distributionally Robust Selection of the Best," Management Science, INFORMS, vol. 66(1), pages 190-208, January.
    3. Aleksandrina Goeva & Henry Lam & Huajie Qian & Bo Zhang, 2019. "Optimization-Based Calibration of Simulation Input Models," Operations Research, INFORMS, vol. 67(5), pages 1362-1382, September.
    4. Zhaolin Hu & L. Jeff Hong, 2022. "Robust Simulation with Likelihood-Ratio Constrained Input Uncertainty," INFORMS Journal on Computing, INFORMS, vol. 34(4), pages 2350-2367, July.
    5. Vishal Gupta, 2019. "Near-Optimal Bayesian Ambiguity Sets for Distributionally Robust Optimization," Management Science, INFORMS, vol. 65(9), pages 4242-4260, September.
    6. Jose Blanchet & Karthyek Murthy, 2019. "Quantifying Distributional Model Risk via Optimal Transport," Mathematics of Operations Research, INFORMS, vol. 44(2), pages 565-600, May.
    7. Helin Zhu & Tianyi Liu & Enlu Zhou, 2015. "Risk Quantification in Stochastic Simulation under Input Uncertainty," Papers 1507.06015, arXiv.org, revised Dec 2017.
    8. Henry Lam, 2019. "Recovering Best Statistical Guarantees via the Empirical Divergence-Based Distributionally Robust Optimization," Operations Research, INFORMS, vol. 67(4), pages 1090-1105, July.
    9. Zhi Chen & Melvyn Sim & Huan Xu, 2019. "Distributionally Robust Optimization with Infinitely Constrained Ambiguity Sets," Operations Research, INFORMS, vol. 67(5), pages 1328-1344, September.
    10. Jun-ya Gotoh & Michael Jong Kim & Andrew E. B. Lim, 2020. "Worst-case sensitivity," Papers 2010.10794, arXiv.org.
    11. Xuefei Lu & Alessandro Rudi & Emanuele Borgonovo & Lorenzo Rosasco, 2020. "Faster Kriging: Facing High-Dimensional Simulators," Operations Research, INFORMS, vol. 68(1), pages 233-249, January.
    12. Taozeng Zhu & Jingui Xie & Melvyn Sim, 2022. "Joint Estimation and Robustness Optimization," Management Science, INFORMS, vol. 68(3), pages 1659-1677, March.
    13. Shunichi Ohmori, 2021. "A Predictive Prescription Using Minimum Volume k -Nearest Neighbor Enclosing Ellipsoid and Robust Optimization," Mathematics, MDPI, vol. 9(2), pages 1-16, January.
    14. L. Jeff Hong & Zhiyuan Huang & Henry Lam, 2021. "Learning-Based Robust Optimization: Procedures and Statistical Guarantees," Management Science, INFORMS, vol. 67(6), pages 3447-3467, June.
    15. Pengyu Qian & Zizhuo Wang & Zaiwen Wen, 2015. "A Composite Risk Measure Framework for Decision Making under Uncertainty," Papers 1501.01126, arXiv.org.
    16. Antonio J. Conejo & Nicholas G. Hall & Daniel Zhuoyu Long & Runhao Zhang, 2021. "Robust Capacity Planning for Project Management," INFORMS Journal on Computing, INFORMS, vol. 33(4), pages 1533-1550, October.
    17. Ran Ji & Miguel A. Lejeune, 2021. "Data-Driven Optimization of Reward-Risk Ratio Measures," INFORMS Journal on Computing, INFORMS, vol. 33(3), pages 1120-1137, July.
    18. Shubhechyya Ghosal & Wolfram Wiesemann, 2020. "The Distributionally Robust Chance-Constrained Vehicle Routing Problem," Operations Research, INFORMS, vol. 68(3), pages 716-732, May.
    19. Steffen Rebennack, 2022. "Data-driven stochastic optimization for distributional ambiguity with integrated confidence region," Journal of Global Optimization, Springer, vol. 84(2), pages 255-293, October.
    20. Wang, Fan & Zhang, Chao & Zhang, Hui & Xu, Liang, 2021. "Short-term physician rescheduling model with feature-driven demand for mental disorders outpatients," Omega, Elsevier, vol. 105(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:oprepe:v:7:y:2020:i:c:s221471602030052x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/operations-research-perspectives .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.