IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v66y2020i3p1025-1044.html

From Predictive to Prescriptive Analytics

Author

Listed:
  • Dimitris Bertsimas

    (Operations Research Center, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139;)

  • Nathan Kallus

    (Cornell Tech and School of Operations Research and Information Engineering, Cornell University, New York, New York 10044)

Abstract

We combine ideas from machine learning (ML) and operations research and management science (OR/MS) in developing a framework, along with specific methods, for using data to prescribe optimal decisions in OR/MS problems. In a departure from other work on data-driven optimization, we consider data consisting, not only of observations of quantities with direct effect on costs/revenues, such as demand or returns, but also predominantly of observations of associated auxiliary quantities. The main problem of interest is a conditional stochastic optimization problem, given imperfect observations, where the joint probability distributions that specify the problem are unknown. We demonstrate how our proposed methods are generally applicable to a wide range of decision problems and prove that they are computationally tractable and asymptotically optimal under mild conditions, even when data are not independent and identically distributed and for censored observations. We extend these to the case in which some decision variables, such as price, may affect uncertainty and their causal effects are unknown. We develop the coefficient of prescriptiveness P to measure the prescriptive content of data and the efficacy of a policy from an operations perspective. We demonstrate our approach in an inventory management problem faced by the distribution arm of a large media company, shipping 1 billion units yearly. We leverage both internal data and public data harvested from IMDb, Rotten Tomatoes, and Google to prescribe operational decisions that outperform baseline measures. Specifically, the data we collect, leveraged by our methods, account for an 88% improvement as measured by our coefficient of prescriptiveness.

Suggested Citation

  • Dimitris Bertsimas & Nathan Kallus, 2020. "From Predictive to Prescriptive Analytics," Management Science, INFORMS, vol. 66(3), pages 1025-1044, March.
  • Handle: RePEc:inm:ormnsc:v:66:y:2020:i:3:p:1025-1044
    DOI: 10.1287/mnsc.2018.3253
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/mnsc.2018.3253
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2018.3253?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Bruce E., 2008. "Uniform Convergence Rates For Kernel Estimation With Dependent Data," Econometric Theory, Cambridge University Press, vol. 24(3), pages 726-748, June.
    2. Erick Delage & Yinyu Ye, 2010. "Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems," Operations Research, INFORMS, vol. 58(3), pages 595-612, June.
    3. Zhi Da & Joseph Engelberg & Pengjie Gao, 2011. "In Search of Attention," Journal of Finance, American Finance Association, vol. 66(5), pages 1461-1499, October.
    4. Hyunyoung Choi & Hal Varian, 2012. "Predicting the Present with Google Trends," The Economic Record, The Economic Society of Australia, vol. 88(s1), pages 2-9, June.
    5. Woonghee Tim Huh & Retsef Levi & Paat Rusmevichientong & James B. Orlin, 2011. "Adaptive Data-Driven Inventory Control with Censored Demand Based on Kaplan-Meier Estimator," Operations Research, INFORMS, vol. 59(4), pages 929-941, August.
    6. Omar Besbes & Assaf Zeevi, 2009. "Dynamic Pricing Without Knowing the Demand Function: Risk Bounds and Near-Optimal Algorithms," Operations Research, INFORMS, vol. 57(6), pages 1407-1420, December.
    7. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kučerová, Zuzana & Pakši, Daniel & Koňařík, Vojtěch, 2024. "Macroeconomic fundamentals and attention: What drives european consumers’ inflation expectations?," Economic Systems, Elsevier, vol. 48(1).
    2. Wohlfarth, Paul, 2018. "Measuring the impact of monetary policy attention on global asset volatility using search data," Economics Letters, Elsevier, vol. 173(C), pages 15-18.
    3. Reyes, Tomas & Batista, Julian A. & Chacon, Alvaro & Martinez, Diego & Kausel, Edgar E., 2023. "Attention-driven reaction to extreme earnings surprises," The Quarterly Review of Economics and Finance, Elsevier, vol. 92(C), pages 230-248.
    4. C. Douglas Swearingen & Joseph T. Ripberger, 2014. "Google Insights and U.S. Senate Elections: Does Search Traffic Provide a Valid Measure of Public Attention to Political Candidates?," Social Science Quarterly, Southwestern Social Science Association, vol. 95(3), pages 882-893, September.
    5. Chauvet, Marcelle & Gabriel, Stuart & Lutz, Chandler, 2016. "Mortgage default risk: New evidence from internet search queries," Journal of Urban Economics, Elsevier, vol. 96(C), pages 91-111.
    6. Nikoletta Poutachidou & Stephanos Papadamou, 2021. "The Effect of Quantitative Easing through Google Metrics on US Stock Indices," IJFS, MDPI, vol. 9(4), pages 1-19, October.
    7. Christopher Hansman & Harrison Hong & Áureo de Paula & Vishal Singh, 2020. "A Sticky-Price View of Hoarding," NBER Working Papers 27051, National Bureau of Economic Research, Inc.
    8. Soonhui Lee & Tito Homem-de-Mello & Anton Kleywegt, 2012. "Newsvendor-type models with decision-dependent uncertainty," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 76(2), pages 189-221, October.
    9. Borah, Abhishek & Rutz, Oliver, 2024. "Enhanced sales forecasting model using textual search data: Fusing dynamics with big data," International Journal of Research in Marketing, Elsevier, vol. 41(4), pages 632-647.
    10. Xu, Yongxin & Xuan, Yuhao & Zheng, Gaoping, 2021. "Internet searching and stock price crash risk: Evidence from a quasi-natural experiment," Journal of Financial Economics, Elsevier, vol. 141(1), pages 255-275.
    11. Takumi Ito & Motoki Masuda & Ayaka Naito & Fumiko Takeda, 2021. "Application of Google Trends‐based sentiment index in exchange rate prediction," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(7), pages 1154-1178, November.
    12. Monge, Manuel & Claudio-Quiroga, Gloria & Poza, Carlos, 2024. "Chinese economic behavior in times of covid-19. A new leading economic indicator based on Google trends," International Economics, Elsevier, vol. 177(C).
    13. Yanjian Zhu & Zhaoying Wu & Hua Zhang & Jing Yu, 2017. "Media sentiment, institutional investors and probability of stock price crash: evidence from Chinese stock markets," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 57(5), pages 1635-1670, December.
    14. Cebrián, Eduardo & Domenech, Josep, 2024. "Addressing Google Trends inconsistencies," Technological Forecasting and Social Change, Elsevier, vol. 202(C).
    15. Nakamura, Nobuyuki & Suzuki, Aya, 2021. "COVID-19 and the intentions to migrate from developing countries: Evidence from online search activities in Southeast Asia," Journal of Asian Economics, Elsevier, vol. 76(C).
    16. Ying Liu & Yibing Chen & Sheng Wu & Geng Peng & Benfu Lv, 2015. "Composite leading search index: a preprocessing method of internet search data for stock trends prediction," Annals of Operations Research, Springer, vol. 234(1), pages 77-94, November.
    17. Daniel Borup & Erik Christian Montes Schütte, 2022. "In Search of a Job: Forecasting Employment Growth Using Google Trends," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 40(1), pages 186-200, January.
    18. Boxiao Chen & Xiuli Chao & Cong Shi, 2021. "Nonparametric Learning Algorithms for Joint Pricing and Inventory Control with Lost Sales and Censored Demand," Mathematics of Operations Research, INFORMS, vol. 46(2), pages 726-756, May.
    19. Ronald MacDonald & Xuxin Mao, 2015. "An Alternative way of Predicting the Outcome of the Scottish Independence Referendum: The Information in the Ether," 2007 Annual Meeting, July 29-August 1, 2007, Portland, Oregon TN 2015-69, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    20. María José Ayala & Nicolás Gonzálvez-Gallego & Rocío Arteaga-Sánchez, 2024. "Google search volume index and investor attention in stock market: a systematic review," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-29, December.

    More about this item

    Keywords

    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:66:y:2020:i:3:p:1025-1044. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.