IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i15p3359-d1207639.html
   My bibliography  Save this article

A Deficiency of the Predict-Then-Optimize Framework: Decreased Decision Quality with Increased Data Size

Author

Listed:
  • Shuaian Wang

    (Faculty of Business, The Hong Kong Polytechnic University, Hung Hom, Hong Kong 999077, China)

  • Xuecheng Tian

    (Faculty of Business, The Hong Kong Polytechnic University, Hung Hom, Hong Kong 999077, China)

Abstract

This paper presents an analysis of the decision quality of the predict-then-optimize (PO) framework, an extensively used prescriptive analytics framework in uncertain optimization problems. Our primary aim is to investigate whether an increase in data size invariably leads to better decisions within the PO framework. We focus our analysis on two contextual stochastic optimization problems—one with a non-linear objective function and the other with a linear objective function—under the PO framework. The novelty of our work lies in uncovering a previously unknown relationship: the decision quality can deteriorate with increasing data size in the non-linear case and exhibit non-monotonic behavior in the linear case. These findings highlight a potential pitfall of the PO framework and constitute our main contribution to the field, offering invaluable insights for both researchers and practitioners.

Suggested Citation

  • Shuaian Wang & Xuecheng Tian, 2023. "A Deficiency of the Predict-Then-Optimize Framework: Decreased Decision Quality with Increased Data Size," Mathematics, MDPI, vol. 11(15), pages 1-9, July.
    • Handle: RePEc:gam:jmathe:v:11:y:2023:i:15:p:3359-:d:1207639
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/15/3359/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/11/15/3359/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Retsef Levi & Georgia Perakis & Joline Uichanco, 2015. "The Data-Driven Newsvendor Problem: New Bounds and Insights," Operations Research, INFORMS, vol. 63(6), pages 1294-1306, December.
    2. Wang Chi Cheung & David Simchi-Levi, 2019. "Sampling-Based Approximation Schemes for Capacitated Stochastic Inventory Control Models," Mathematics of Operations Research, INFORMS, vol. 44(2), pages 668-692, May.
    3. Gah-Yi Ban & Cynthia Rudin, 2019. "The Big Data Newsvendor: Practical Insights from Machine Learning," Operations Research, INFORMS, vol. 67(1), pages 90-108, January.
    4. Martyn, Krzysztof & Kadziński, Miłosz, 2023. "Deep preference learning for multiple criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 305(2), pages 781-805.
    5. Tian, Xuecheng & Yan, Ran & Liu, Yannick & Wang, Shuaian, 2023. "A smart predict-then-optimize method for targeted and cost-effective maritime transportation," Transportation Research Part B: Methodological, Elsevier, vol. 172(C), pages 32-52.
    6. Nathan Kallus & Xiaojie Mao, 2023. "Stochastic Optimization Forests," Management Science, INFORMS, vol. 69(4), pages 1975-1994, April.
    7. Dimitris Bertsimas & Nathan Kallus, 2020. "From Predictive to Prescriptive Analytics," Management Science, INFORMS, vol. 66(3), pages 1025-1044, March.
    8. Erick Delage & Yinyu Ye, 2010. "Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems," Operations Research, INFORMS, vol. 58(3), pages 595-612, June.
    9. Pascal M. Notz & Richard Pibernik, 2022. "Prescriptive Analytics for Flexible Capacity Management," Management Science, INFORMS, vol. 68(3), pages 1756-1775, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Satya S. Malladi & Alan L. Erera & Chelsea C. White, 2023. "Inventory control with modulated demand and a partially observed modulation process," Annals of Operations Research, Springer, vol. 321(1), pages 343-369, February.
    2. Pascal M. Notz & Richard Pibernik, 2022. "Prescriptive Analytics for Flexible Capacity Management," Management Science, INFORMS, vol. 68(3), pages 1756-1775, March.
    3. Viet Anh Nguyen & Fan Zhang & Shanshan Wang & Jose Blanchet & Erick Delage & Yinyu Ye, 2021. "Robustifying Conditional Portfolio Decisions via Optimal Transport," Papers 2103.16451, arXiv.org, revised Apr 2024.
    4. Yang, Cheng-Hu & Wang, Hai-Tang & Ma, Xin & Talluri, Srinivas, 2023. "A data-driven newsvendor problem: A high-dimensional and mixed-frequency method," International Journal of Production Economics, Elsevier, vol. 266(C).
    5. Thais de Castro Moraes & Jiancheng Qin & Xue-Ming Yuan & Ek Peng Chew, 2023. "Evolving Hybrid Deep Neural Network Models for End-to-End Inventory Ordering Decisions," Logistics, MDPI, vol. 7(4), pages 1-18, November.
    6. Erkip, Nesim Kohen, 2023. "Can accessing much data reshape the theory? Inventory theory under the challenge of data-driven systems," European Journal of Operational Research, Elsevier, vol. 308(3), pages 949-959.
    7. Yinchu Zhu & Ilya O. Ryzhov, 2022. "Optimal data-driven hiring with equity for underrepresented groups," Papers 2206.09300, arXiv.org.
    8. Gah-Yi Ban, 2020. "Confidence Intervals for Data-Driven Inventory Policies with Demand Censoring," Operations Research, INFORMS, vol. 68(2), pages 309-326, March.
    9. van Eekelen, Wouter, 2023. "Distributionally robust views on queues and related stochastic models," Other publications TiSEM 9b99fc05-9d68-48eb-ae8c-9, Tilburg University, School of Economics and Management.
    10. Jun Li & Yizhe Huang & Yan‐Fu Li & Shuming Wang, 2023. "Redundancy allocation under state‐dependent distributional uncertainty of component lifetimes," Production and Operations Management, Production and Operations Management Society, vol. 32(3), pages 930-950, March.
    11. Jinzhi Bu & David Simchi-Levi & Li Wang, 2023. "Offline Pricing and Demand Learning with Censored Data," Management Science, INFORMS, vol. 69(2), pages 885-903, February.
    12. Qi Feng & J. George Shanthikumar, 2022. "Developing operations management data analytics," Production and Operations Management, Production and Operations Management Society, vol. 31(12), pages 4544-4557, December.
    13. Meng Qi & Ying Cao & Zuo-Jun (Max) Shen, 2022. "Distributionally Robust Conditional Quantile Prediction with Fixed Design," Management Science, INFORMS, vol. 68(3), pages 1639-1658, March.
    14. Jos'e-Manuel Pe~na & Fernando Su'arez & Omar Larr'e & Domingo Ram'irez & Arturo Cifuentes, 2023. "A Modified CTGAN-Plus-Features Based Method for Optimal Asset Allocation," Papers 2302.02269, arXiv.org, revised Feb 2023.
    15. Shunichi Ohmori, 2021. "A Predictive Prescription Using Minimum Volume k -Nearest Neighbor Enclosing Ellipsoid and Robust Optimization," Mathematics, MDPI, vol. 9(2), pages 1-16, January.
    16. Adam N. Elmachtoub & Paul Grigas, 2022. "Smart “Predict, then Optimize”," Management Science, INFORMS, vol. 68(1), pages 9-26, January.
    17. Christian Mandl & Selvaprabu Nadarajah & Stefan Minner & Srinagesh Gavirneni, 2022. "Data‐driven storage operations: Cross‐commodity backtest and structured policies," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2438-2456, June.
    18. Andrew Butler & Roy H. Kwon, 2021. "Integrating prediction in mean-variance portfolio optimization," Papers 2102.09287, arXiv.org, revised Nov 2022.
    19. Soham Ghosh & Sujay Mukhoti, 2023. "Non-parametric generalised newsvendor model," Annals of Operations Research, Springer, vol. 321(1), pages 241-266, February.
    20. Shaochong Lin & Youhua (Frank) Chen & Yanzhi Li & Zuo‐Jun Max Shen, 2022. "Data‐Driven Newsvendor Problems Regularized by a Profit Risk Constraint," Production and Operations Management, Production and Operations Management Society, vol. 31(4), pages 1630-1644, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:15:p:3359-:d:1207639. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.