IDEAS home Printed from https://ideas.repec.org/a/bla/popmgt/v31y2022i6p2438-2456.html
   My bibliography  Save this article

Data‐driven storage operations: Cross‐commodity backtest and structured policies

Author

Listed:
  • Christian Mandl
  • Selvaprabu Nadarajah
  • Stefan Minner
  • Srinagesh Gavirneni

Abstract

Storage assets are critical for physical trading of commodities under volatile prices. State‐of‐the‐art methods for managing storage facilities such as the reoptimization heuristic (RH), which are part of commercial software, approximate a Markov Decision Process (MDP) assuming full information regarding the state and the stochastic commodity price process and hence suffer from informational inconsistencies with observed price data and structural inconsistencies with the true optimal policy, which are both components of generalization error. Focusing on spot trades, we find via an extensive backtest that this error can lead to significantly suboptimal RH policies. We develop a forward‐looking data‐driven approach (DDA) to learn policies and reduce generalization error. This approach extends standard (backward‐looking) DDA in two ways: (i) It represents historical and estimated future profits as functions of features in the training objective, which typically includes only past profits; and (ii) it enforces structural properties of the optimal policy. To elaborate, DDA trains parameters of bang‐bang and base‐stock policies, respectively, using linear‐ and mixed‐integer programs, thereby extending known DDAs that parameterize decisions as functions of features without policy structure. We backtest the performance of RH and DDA on six major commodities, employing feature selection across data from Reuters, Bloomberg, and other public data sets. DDA can improve RH on real data, with policy structure needed to realize this improvement. Our research advances the state‐of‐the‐art for storage operations and can be extended beyond spot trading to handle generalization error when also including forward trades.

Suggested Citation

  • Christian Mandl & Selvaprabu Nadarajah & Stefan Minner & Srinagesh Gavirneni, 2022. "Data‐driven storage operations: Cross‐commodity backtest and structured policies," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2438-2456, June.
    • Handle: RePEc:bla:popmgt:v:31:y:2022:i:6:p:2438-2456
    DOI: 10.1111/poms.13683
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/poms.13683
    Download Restriction: no
    File URL: https://libkey.io/10.1111/poms.13683?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Gah-Yi Ban & Cynthia Rudin, 2019. "The Big Data Newsvendor: Practical Insights from Machine Learning," Operations Research, INFORMS, vol. 67(1), pages 90-108, January.
    2. Ron Alquist & Lutz Kilian, 2010. "What do we learn from the price of crude oil futures?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 539-573.
    3. Owen Q. Wu & Derek D. Wang & Zhenwei Qin, 2012. "Seasonal Energy Storage Operations with Limited Flexibility: The Price-Adjusted Rolling Intrinsic Policy," Manufacturing & Service Operations Management, INFORMS, vol. 14(3), pages 455-471, July.
    4. Stuart E. Dreyfus, 1957. "An Analytic Solution of the Warehouse Problem," Management Science, INFORMS, vol. 4(1), pages 99-104, October.
    5. Williams,Jeffrey C. & Wright,Brian D., 2005. "Storage and Commodity Markets," Cambridge Books, Cambridge University Press, number 9780521023399.
    6. Dimitris Bertsimas & Nathan Kallus, 2020. "From Predictive to Prescriptive Analytics," Management Science, INFORMS, vol. 66(3), pages 1025-1044, March.
    7. Aharon Ben-Tal & Boaz Golany & Arkadi Nemirovski & Jean-Philippe Vial, 2005. "Retailer-Supplier Flexible Commitments Contracts: A Robust Optimization Approach," Manufacturing & Service Operations Management, INFORMS, vol. 7(3), pages 248-271, February.
    8. Kristoufek, Ladislav & Vosvrda, Miloslav, 2014. "Commodity futures and market efficiency," Energy Economics, Elsevier, vol. 42(C), pages 50-57.
    9. Nicola Secomandi, 2015. "Merchant Commodity Storage Practice Revisited," Operations Research, INFORMS, vol. 63(5), pages 1131-1143, October.
    10. Davidson Heath, 2019. "Macroeconomic Factors in Oil Futures Markets," Management Science, INFORMS, vol. 65(9), pages 4407-4421, September.
    11. Geman, Hélyette & Smith, William O., 2013. "Theory of storage, inventory and volatility in the LME base metals," Resources Policy, Elsevier, vol. 38(1), pages 18-28.
    12. David B. Brown & James E. Smith & Peng Sun, 2010. "Information Relaxations and Duality in Stochastic Dynamic Programs," Operations Research, INFORMS, vol. 58(4-part-1), pages 785-801, August.
    13. Paul R. Kleindorfer & Andrei Neboian & Alain Roset & Stefan Spinler, 2012. "Fleet Renewal with Electric Vehicles at La Poste," Interfaces, INFORMS, vol. 42(5), pages 465-477, October.
    14. Sripad K. Devalkar & Ravi Anupindi & Amitabh Sinha, 2011. "Integrated Optimization of Procurement, Processing, and Trade of Commodities," Operations Research, INFORMS, vol. 59(6), pages 1369-1381, December.
    15. Nick, Sebastian & Thoenes, Stefan, 2014. "What drives natural gas prices? — A structural VAR approach," Energy Economics, Elsevier, vol. 45(C), pages 517-527.
    16. Nicola Secomandi & Guoming Lai & François Margot & Alan Scheller-Wolf & Duane J. Seppi, 2015. "Merchant Commodity Storage and Term-Structure Model Error," Manufacturing & Service Operations Management, INFORMS, vol. 17(3), pages 302-320, July.
    17. Sripad K. Devalkar & Ravi Anupindi & Amitabh Sinha, 2018. "Dynamic Risk Management of Commodity Operations: Model and Analysis," Manufacturing & Service Operations Management, INFORMS, vol. 20(2), pages 317-332, May.
    18. Gah-Yi Ban & Noureddine El Karoui & Andrew E. B. Lim, 2018. "Machine Learning and Portfolio Optimization," Management Science, INFORMS, vol. 64(3), pages 1136-1154, March.
    19. Richard Bellman, 1956. "On the Theory of Dynamic Programming--A Warehousing Problem," Management Science, INFORMS, vol. 2(3), pages 272-275, April.
    20. James Cruise & Lisa Flatley & Richard Gibbens & Stan Zachary, 2019. "Control of Energy Storage with Market Impact: Lagrangian Approach and Horizons," Operations Research, INFORMS, vol. 67(1), pages 1-9, January.
    21. Selvaprabu Nadarajah & François Margot & Nicola Secomandi, 2015. "Relaxations of Approximate Linear Programs for the Real Option Management of Commodity Storage," Management Science, INFORMS, vol. 61(12), pages 3054-3076, December.
    22. Nicola Secomandi, 2010. "Optimal Commodity Trading with a Capacitated Storage Asset," Management Science, INFORMS, vol. 56(3), pages 449-467, March.
    23. Suresh Chand & Vernon Ning Hsu & Suresh Sethi, 2002. "Forecast, Solution, and Rolling Horizons in Operations Management Problems: A Classified Bibliography," Manufacturing & Service Operations Management, INFORMS, vol. 4(1), pages 25-43, September.
    24. Ankur Goel & Fehmi Tanrisever, 2017. "Financial Hedging and Optimal Procurement Policies under Correlated Price and Demand," Production and Operations Management, Production and Operations Management Society, vol. 26(10), pages 1924-1945, October.
    25. CHARNES, Abraham & DREZE, Jacques H. & MILLER, Merton, 1966. "Decision and horizon rules for stochastic planning problems: A linear example," LIDAM Reprints CORE 4, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    26. Guthrie, Graeme, 2009. "Real Options in Theory and Practice," OUP Catalogue, Oxford University Press, number 9780195380637, Decembrie.
    27. Onur Boyabatlı & Jason Nguyen & Tong Wang, 2017. "Capacity Management in Agricultural Commodity Processing and Application in the Palm Industry," Manufacturing & Service Operations Management, INFORMS, vol. 19(4), pages 551-567, October.
    28. Guoming Lai & François Margot & Nicola Secomandi, 2010. "An Approximate Dynamic Programming Approach to Benchmark Practice-Based Heuristics for Natural Gas Storage Valuation," Operations Research, INFORMS, vol. 58(3), pages 564-582, June.
    29. Chuen-Teck See & Melvyn Sim, 2010. "Robust Approximation to Multiperiod Inventory Management," Operations Research, INFORMS, vol. 58(3), pages 583-594, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sel, Burakhan & Minner, Stefan, 2022. "A hedging policy for seaborne forward freight markets based on probabilistic forecasts," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 166(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anna Maria Gambaro & Nicola Secomandi, 2021. "A Discussion of Non‐Gaussian Price Processes for Energy and Commodity Operations," Production and Operations Management, Production and Operations Management Society, vol. 30(1), pages 47-67, January.
    2. Yangfang (Helen) Zhou & Alan Scheller‐Wolf & Nicola Secomandi & Stephen Smith, 2019. "Managing Wind‐Based Electricity Generation in the Presence of Storage and Transmission Capacity," Production and Operations Management, Production and Operations Management Society, vol. 28(4), pages 970-989, April.
    3. Alessio Trivella & Selvaprabu Nadarajah & Stein-Erik Fleten & Denis Mazieres & David Pisinger, 2021. "Managing Shutdown Decisions in Merchant Commodity and Energy Production: A Social Commerce Perspective," Manufacturing & Service Operations Management, INFORMS, vol. 23(2), pages 311-330, March.
    4. Nadarajah, Selvaprabu & Margot, François & Secomandi, Nicola, 2017. "Comparison of least squares Monte Carlo methods with applications to energy real options," European Journal of Operational Research, Elsevier, vol. 256(1), pages 196-204.
    5. Nicola Secomandi, 2015. "Merchant Commodity Storage Practice Revisited," Operations Research, INFORMS, vol. 63(5), pages 1131-1143, October.
    6. Secomandi, Nicola & Seppi, Duane J., 2014. "Real Options and Merchant Operations of Energy and Other Commodities," Foundations and Trends(R) in Technology, Information and Operations Management, now publishers, vol. 6(3-4), pages 161-331, July.
    7. Jiao Wang & Lima Zhao & Arnd Huchzermeier, 2021. "Operations‐Finance Interface in Risk Management: Research Evolution and Opportunities," Production and Operations Management, Production and Operations Management Society, vol. 30(2), pages 355-389, February.
    8. Nadarajah, Selvaprabu & Secomandi, Nicola, 2023. "A review of the operations literature on real options in energy," European Journal of Operational Research, Elsevier, vol. 309(2), pages 469-487.
    9. Yangfang (Helen) Zhou & Alan Scheller-Wolf & Nicola Secomandi & Stephen Smith, 2016. "Electricity Trading and Negative Prices: Storage vs. Disposal," Management Science, INFORMS, vol. 62(3), pages 880-898, March.
    10. James Cruise & Lisa Flatley & Richard Gibbens & Stan Zachary, 2019. "Control of Energy Storage with Market Impact: Lagrangian Approach and Horizons," Operations Research, INFORMS, vol. 67(1), pages 1-9, January.
    11. Sripad K. Devalkar & Ravi Anupindi & Amitabh Sinha, 2011. "Integrated Optimization of Procurement, Processing, and Trade of Commodities," Operations Research, INFORMS, vol. 59(6), pages 1369-1381, December.
    12. Selvaprabu Nadarajah & François Margot & Nicola Secomandi, 2015. "Relaxations of Approximate Linear Programs for the Real Option Management of Commodity Storage," Management Science, INFORMS, vol. 61(12), pages 3054-3076, December.
    13. Alessio Trivella & Danial Mohseni-Taheri & Selvaprabu Nadarajah, 2023. "Meeting Corporate Renewable Power Targets," Management Science, INFORMS, vol. 69(1), pages 491-512, January.
    14. Majid Al‐Gwaiz & Xiuli Chao & H. Edwin Romeijn, 2016. "Capacity expansion and cost efficiency improvement in the warehouse problem," Naval Research Logistics (NRL), John Wiley & Sons, vol. 63(5), pages 367-373, August.
    15. Santiago R. Balseiro & David B. Brown, 2019. "Approximations to Stochastic Dynamic Programs via Information Relaxation Duality," Operations Research, INFORMS, vol. 67(2), pages 577-597, March.
    16. Secomandi, Nicola, 2016. "A tutorial on portfolio-based control algorithms for merchant energy trading operations," Journal of Commodity Markets, Elsevier, vol. 4(1), pages 1-13.
    17. Owen Q. Wu & Derek D. Wang & Zhenwei Qin, 2012. "Seasonal Energy Storage Operations with Limited Flexibility: The Price-Adjusted Rolling Intrinsic Policy," Manufacturing & Service Operations Management, INFORMS, vol. 14(3), pages 455-471, July.
    18. Alain Bensoussan & Benoit Chevalier-Roignant & Alejandro Rivera, 2022. "A model for wind farm management with option interactions," Post-Print hal-04325553, HAL.
    19. Meng Qi & Ying Cao & Zuo-Jun (Max) Shen, 2022. "Distributionally Robust Conditional Quantile Prediction with Fixed Design," Management Science, INFORMS, vol. 68(3), pages 1639-1658, March.
    20. John R. Birge, 2015. "OM Forum—Operations and Finance Interactions," Manufacturing & Service Operations Management, INFORMS, vol. 17(1), pages 4-15, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:popmgt:v:31:y:2022:i:6:p:2438-2456. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://onlinelibrary.wiley.com/journal/10.1111/(ISSN)1937-5956 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.