IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v286y2020i1d10.1007_s10479-018-2910-3.html
   My bibliography  Save this article

Efficient algorithms of pathwise dynamic programming for decision optimization in mining operations

Author

Listed:
  • Juri Hinz

    (University of Technology Sydney)

  • Tanya Tarnopolskaya

    (CSIRO)

  • Jeremy Yee

    (University of Technology Sydney
    CSIRO)

Abstract

Complexity and uncertainty associated with commodity resource valuation and extraction requires stochastic control methods suitable for high dimensional states. Recent progress in duality and trajectory-wise techniques has introduced a variety of fresh ideas to this field with surprising results. This paper presents a concept which implements this promising development and illustrates it on a selection of traditional commodity extraction problems. We describe efficient algorithms for obtaining approximate solutions along with a diagnostic technique, which provides a quantitative measure for solution performance in terms of the distance between the approximate and the optimal control policy. All quantitative tools are efficiently implemented and are publicly available within a user friendly package in the statistical language R, which can help practitioners in a broad range of decision optimization problems.

Suggested Citation

  • Juri Hinz & Tanya Tarnopolskaya & Jeremy Yee, 2020. "Efficient algorithms of pathwise dynamic programming for decision optimization in mining operations," Annals of Operations Research, Springer, vol. 286(1), pages 583-615, March.
    • Handle: RePEc:spr:annopr:v:286:y:2020:i:1:d:10.1007_s10479-018-2910-3
    DOI: 10.1007/s10479-018-2910-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-018-2910-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-018-2910-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Leif Andersen & Mark Broadie, 2004. "Primal-Dual Simulation Algorithm for Pricing Multidimensional American Options," Management Science, INFORMS, vol. 50(9), pages 1222-1234, September.
    2. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," The Review of Financial Studies, Society for Financial Studies, vol. 14(1), pages 113-147.
    3. Christian Bender & Nikolai Dokuchaev, 2017. "A First-Order Bspde For Swing Option Pricing: Classical Solutions," Mathematical Finance, Wiley Blackwell, vol. 27(3), pages 902-925, July.
    4. Juri Hinz & Jeremy Yee, 2017. "An Algorithmic Approach to Optimal Asset Liquidation Problems," Asia-Pacific Financial Markets, Springer;Japanese Association of Financial Economics and Engineering, vol. 24(2), pages 109-129, June.
    5. Ross, Stephen A, 1978. "A Simple Approach to the Valuation of Risky Streams," The Journal of Business, University of Chicago Press, vol. 51(3), pages 453-475, July.
    6. Sebastian Jaimungal & Max O. de Souza & Jorge P. Zubelli, 2013. "Real option pricing with mean-reverting investment and project value," The European Journal of Finance, Taylor & Francis Journals, vol. 19(7-8), pages 625-644, September.
    7. Avinash K. Dixit & Robert S. Pindyck, 1994. "Investment under Uncertainty," Economics Books, Princeton University Press, edition 1, number 5474.
    8. Carriere, Jacques F., 1996. "Valuation of the early-exercise price for options using simulations and nonparametric regression," Insurance: Mathematics and Economics, Elsevier, vol. 19(1), pages 19-30, December.
    9. Brennan, Michael J & Schwartz, Eduardo S, 1985. "Evaluating Natural Resource Investments," The Journal of Business, University of Chicago Press, vol. 58(2), pages 135-157, April.
    10. René Carmona & Nizar Touzi, 2008. "Optimal Multiple Stopping And Valuation Of Swing Options," Mathematical Finance, Wiley Blackwell, vol. 18(2), pages 239-268, April.
    11. Eduardo Schwartz & James E. Smith, 2000. "Short-Term Variations and Long-Term Dynamics in Commodity Prices," Management Science, INFORMS, vol. 46(7), pages 893-911, July.
    12. Juri Hinz & Nicholas Yap, 2015. "Algorithms for Optimal Control of Stochastic Switching Systems," Research Paper Series 352, Quantitative Finance Research Centre, University of Technology, Sydney.
    13. Jaime Casassus & Pierre Collin‐Dufresne, 2005. "Stochastic Convenience Yield Implied from Commodity Futures and Interest Rates," Journal of Finance, American Finance Association, vol. 60(5), pages 2283-2331, October.
    14. Cyril Grunspan & Ricardo Pérez-Marco, 2017. "Double spend races," Working Papers hal-01456773, HAL.
    15. Nicole Bäuerle & Jonathan Ott, 2011. "Markov Decision Processes with Average-Value-at-Risk criteria," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 74(3), pages 361-379, December.
    16. Trigeorgis, Lenos, 1993. "The Nature of Option Interactions and the Valuation of Investments with Multiple Real Options," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 28(1), pages 1-20, March.
    17. Juri Hinz & Lutz Von Grafenstein & Michel Verschuere & Martina Wilhelm, 2005. "Pricing electricity risk by interest rate methods," Quantitative Finance, Taylor & Francis Journals, vol. 5(1), pages 49-60.
    18. Lars Stentoft, 2004. "Convergence of the Least Squares Monte Carlo Approach to American Option Valuation," Management Science, INFORMS, vol. 50(9), pages 1193-1203, September.
    19. Luiz Brandão & James Dyer, 2005. "Decision Analysis and Real Options: A Discrete Time Approach to Real Option Valuation," Annals of Operations Research, Springer, vol. 135(1), pages 21-39, March.
    20. Tan, Ken Seng & Boyle, Phelim P., 2000. "Applications of randomized low discrepancy sequences to the valuation of complex securities," Journal of Economic Dynamics and Control, Elsevier, vol. 24(11-12), pages 1747-1782, October.
    21. David B. Brown & James E. Smith & Peng Sun, 2010. "Information Relaxations and Duality in Stochastic Dynamic Programs," Operations Research, INFORMS, vol. 58(4-part-1), pages 785-801, August.
    22. Sripad K. Devalkar & Ravi Anupindi & Amitabh Sinha, 2011. "Integrated Optimization of Procurement, Processing, and Trade of Commodities," Operations Research, INFORMS, vol. 59(6), pages 1369-1381, December.
    23. Andrianos E. Tsekrekos & Mark B. Shackleton & Rafał Wojakowski, 2012. "Evaluating Natural Resource Investments under Different Model Dynamics: Managerial Insights," European Financial Management, European Financial Management Association, vol. 18(4), pages 543-575, September.
    24. Tsekrekos, Andrianos E., 2010. "The effect of mean reversion on entry and exit decisions under uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 34(4), pages 725-742, April.
    25. Tsekrekos, Andrianos E. & Yannacopoulos, Athanasios N., 2016. "Optimal switching decisions under stochastic volatility with fast mean reversion," European Journal of Operational Research, Elsevier, vol. 251(1), pages 148-157.
    26. Boomsma, Trine Krogh & Meade, Nigel & Fleten, Stein-Erik, 2012. "Renewable energy investments under different support schemes: A real options approach," European Journal of Operational Research, Elsevier, vol. 220(1), pages 225-237.
    27. Nadarajah, Selvaprabu & Margot, François & Secomandi, Nicola, 2017. "Comparison of least squares Monte Carlo methods with applications to energy real options," European Journal of Operational Research, Elsevier, vol. 256(1), pages 196-204.
    28. Rene Carmona & Michael Ludkovski, 2010. "Valuation of energy storage: an optimal switching approach," Quantitative Finance, Taylor & Francis Journals, vol. 10(4), pages 359-374.
    29. Paschke, Raphael & Prokopczuk, Marcel, 2010. "Commodity derivatives valuation with autoregressive and moving average components in the price dynamics," Journal of Banking & Finance, Elsevier, vol. 34(11), pages 2742-2752, November.
    30. Schwartz, Eduardo S, 1997. "The Stochastic Behavior of Commodity Prices: Implications for Valuation and Hedging," Journal of Finance, American Finance Association, vol. 52(3), pages 923-973, July.
    31. N. Meinshausen & B. M. Hambly, 2004. "Monte Carlo Methods For The Valuation Of Multiple‐Exercise Options," Mathematical Finance, Wiley Blackwell, vol. 14(4), pages 557-583, October.
    32. Helyette Geman, 2005. "Commodities and Commodity Derivatives. Modeling and Pricing for Agriculturals, Metals and Energy," Post-Print halshs-00144182, HAL.
    33. Gibson, Rajna & Schwartz, Eduardo S, 1990. "Stochastic Convenience Yield and the Pricing of Oil Contingent Claims," Journal of Finance, American Finance Association, vol. 45(3), pages 959-976, July.
    34. Sarkar, Sudipto, 2003. "The effect of mean reversion on investment under uncertainty," Journal of Economic Dynamics and Control, Elsevier, vol. 28(2), pages 377-396, November.
    35. Broadie, Mark & Glasserman, Paul, 1997. "Pricing American-style securities using simulation," Journal of Economic Dynamics and Control, Elsevier, vol. 21(8-9), pages 1323-1352, June.
    36. Hilliard, Jimmy E. & Reis, Jorge, 1998. "Valuation of Commodity Futures and Options under Stochastic Convenience Yields, Interest Rates, and Jump Diffusions in the Spot," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 33(1), pages 61-86, March.
    37. McDonald, Robert L & Siegel, Daniel R, 1985. "Investment and the Valuation of Firms When There Is an Option to Shut Down," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 26(2), pages 331-349, June.
    38. Bhattacharya, Sudipto, 1978. "Project Valuation with Mean-Reverting Cash Flow Streams," Journal of Finance, American Finance Association, vol. 33(5), pages 1317-1331, December.
    39. Longstaff, Francis A & Schwartz, Eduardo S, 2001. "Valuing American Options by Simulation: A Simple Least-Squares Approach," University of California at Los Angeles, Anderson Graduate School of Management qt43n1k4jb, Anderson Graduate School of Management, UCLA.
    40. Erhan Bayraktar & Masahiko Egami, 2010. "On the One-Dimensional Optimal Switching Problem," Mathematics of Operations Research, INFORMS, vol. 35(1), pages 140-159, February.
    41. repec:dau:papers:123456789/607 is not listed on IDEAS
    42. Lars Stentoft, 2004. "Assessing the Least Squares Monte-Carlo Approach to American Option Valuation," Review of Derivatives Research, Springer, vol. 7(2), pages 129-168, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anna Maria Gambaro & Nicola Secomandi, 2021. "A Discussion of Non‐Gaussian Price Processes for Energy and Commodity Operations," Production and Operations Management, Production and Operations Management Society, vol. 30(1), pages 47-67, January.
    2. Sebastian Maier, 2021. "Re-evaluating natural resource investments under uncertainty: An alternative to limited traditional approaches," Annals of Operations Research, Springer, vol. 299(1), pages 907-937, April.
    3. Paolo Falbo & Juri Hinz & Piyachat Leelasilapasart & Cristian Pelizzari, 2021. "A Computational Approach to Sequential Decision Optimization in Energy Storage and Trading," JRFM, MDPI, vol. 14(6), pages 1-22, May.
    4. Juri Hinz, 2021. "On Approximate Solutions for Partially Observable Decision Problems," Research Paper Series 421, Quantitative Finance Research Centre, University of Technology, Sydney.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Secomandi, Nicola & Seppi, Duane J., 2014. "Real Options and Merchant Operations of Energy and Other Commodities," Foundations and Trends(R) in Technology, Information and Operations Management, now publishers, vol. 6(3-4), pages 161-331, July.
    2. Cortazar, Gonzalo & Naranjo, Lorenzo & Sainz, Felipe, 2021. "Optimal decision policy for real options under general Markovian dynamics," European Journal of Operational Research, Elsevier, vol. 288(2), pages 634-647.
    3. Max F. Schöne & Stefan Spinler, 2017. "A four-factor stochastic volatility model of commodity prices," Review of Derivatives Research, Springer, vol. 20(2), pages 135-165, July.
    4. Andrianos E. Tsekrekos & Mark B. Shackleton & Rafał Wojakowski, 2012. "Evaluating Natural Resource Investments under Different Model Dynamics: Managerial Insights," European Financial Management, European Financial Management Association, vol. 18(4), pages 543-575, September.
    5. Sebastian Maier, 2021. "Re-evaluating natural resource investments under uncertainty: An alternative to limited traditional approaches," Annals of Operations Research, Springer, vol. 299(1), pages 907-937, April.
    6. Alessio Trivella & Selvaprabu Nadarajah & Stein-Erik Fleten & Denis Mazieres & David Pisinger, 2021. "Managing Shutdown Decisions in Merchant Commodity and Energy Production: A Social Commerce Perspective," Manufacturing & Service Operations Management, INFORMS, vol. 23(2), pages 311-330, March.
    7. Ravi Kashyap, 2022. "Options as Silver Bullets: Valuation of Term Loans, Inventory Management, Emissions Trading and Insurance Risk Mitigation using Option Theory," Annals of Operations Research, Springer, vol. 315(2), pages 1175-1215, August.
    8. R. Mark Reesor & T. James Marshall, 2020. "Forest of Stochastic Trees: A Method for Valuing Multiple Exercise Options," JRFM, MDPI, vol. 13(5), pages 1-31, May.
    9. Abdullah Almansour and Margaret Insley, 2016. "The Impact of Stochastic Extraction Cost on the Value of an Exhaustible Resource: An Application to the Alberta Oil Sands," The Energy Journal, International Association for Energy Economics, vol. 0(Number 2).
    10. Ravi Kashyap, 2016. "Options as Silver Bullets: Valuation of Term Loans, Inventory Management, Emissions Trading and Insurance Risk Mitigation using Option Theory," Papers 1609.01274, arXiv.org, revised Mar 2022.
    11. Nadarajah, Selvaprabu & Margot, François & Secomandi, Nicola, 2017. "Comparison of least squares Monte Carlo methods with applications to energy real options," European Journal of Operational Research, Elsevier, vol. 256(1), pages 196-204.
    12. Savolainen, Jyrki, 2016. "Real options in metal mining project valuation: Review of literature," Resources Policy, Elsevier, vol. 50(C), pages 49-65.
    13. Seiji Harikae & James S. Dyer & Tianyang Wang, 2021. "Valuing Real Options in the Volatile Real World," Production and Operations Management, Production and Operations Management Society, vol. 30(1), pages 171-189, January.
    14. Luis M. Abadie & José M. Chamorro, 2009. "Monte Carlo valuation of natural gas investments," Review of Financial Economics, John Wiley & Sons, vol. 18(1), pages 10-22, January.
    15. Maier, Sebastian & Pflug, Georg C. & Polak, John W., 2020. "Valuing portfolios of interdependent real options under exogenous and endogenous uncertainties," European Journal of Operational Research, Elsevier, vol. 285(1), pages 133-147.
    16. Aleksandrov, Nikolay & Espinoza, Raphael & Gyurkó, Lajos, 2013. "Optimal oil production and the world supply of oil," Journal of Economic Dynamics and Control, Elsevier, vol. 37(7), pages 1248-1263.
    17. Alexander Boogert & Cyriel de Jong, 2007. "Gas Storage Valuation Using a Monte Carlo Method," Birkbeck Working Papers in Economics and Finance 0704, Birkbeck, Department of Economics, Mathematics & Statistics.
    18. Zhu, Lei & Zhang, ZhongXiang & Fan, Ying, 2015. "Overseas oil investment projects under uncertainty: How to make informed decisions?," Journal of Policy Modeling, Elsevier, vol. 37(5), pages 742-762.
    19. Jostein Tvedt, 2022. "Optimal Entry and Exit Decisions Under Uncertainty and the Impact of Mean Reversion," SN Operations Research Forum, Springer, vol. 3(4), pages 1-21, December.
    20. Jin, Xing & Yang, Cheng-Yu, 2016. "Efficient estimation of lower and upper bounds for pricing higher-dimensional American arithmetic average options by approximating their payoff functions," International Review of Financial Analysis, Elsevier, vol. 44(C), pages 65-77.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:286:y:2020:i:1:d:10.1007_s10479-018-2910-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.