IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v330y2023i1d10.1007_s10479-022-04574-x.html
   My bibliography  Save this article

Practice-relevant model validation: distributional parameter risk analysis in financial model risk management

Author

Listed:
  • Mark Cummins

    (Dublin City University)

  • Fabian Gogolin

    (Leeds University Business School, University of Leeds)

  • Fearghal Kearney

    (Queen’s University Belfast)

  • Greg Kiely

    (Gazprom Marketing and Trading Limited)

  • Bernard Murphy

    (University of Limerick)

Abstract

An objective of model validation within organisations is to provide guidance on model selection decisions that balance the operational effectiveness and structural complexity of competing models. We consider a practice-relevant model validation scenario where a financial quantitative analysis team seeks to decide between incumbent and alternative models on the basis of parameter risk. We devise a model risk management methodology that gives a meaningful distributional assessment of parameter risk in a setting where market calibration and historical estimation procedures must be jointly applied. Such a scenario is typically driven by data constraints that preclude market calibration only. We demonstrate our proposed methodology in a natural gas storage modelling context, where model usage is necessary to support profit and loss reporting, and to inform trading and hedging strategy. We leverage our distributional parameter risk approach to devise an accessible technique to support model selection decisions.

Suggested Citation

  • Mark Cummins & Fabian Gogolin & Fearghal Kearney & Greg Kiely & Bernard Murphy, 2023. "Practice-relevant model validation: distributional parameter risk analysis in financial model risk management," Annals of Operations Research, Springer, vol. 330(1), pages 431-455, November.
    • Handle: RePEc:spr:annopr:v:330:y:2023:i:1:d:10.1007_s10479-022-04574-x
    DOI: 10.1007/s10479-022-04574-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-022-04574-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-022-04574-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mats Kjaer, 2008. "Pricing of Swing Options in a Mean Reverting Model with Jumps," Applied Mathematical Finance, Taylor & Francis Journals, vol. 15(5-6), pages 479-502.
    2. Guillaume Coqueret & Bertrand Tavin, 2016. "An investigation of model risk in a market with jumps and stochastic volatility," Post-Print hal-02010659, HAL.
    3. Radu Tunaru, 2015. "Model Risk in Financial Markets:From Financial Engineering to Risk Management," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 9524.
    4. Patrick Hénaff & Ismail Laachir & Francesco Russo, 2018. "Gas Storage Valuation and Hedging: A Quantification of Model Risk," IJFS, MDPI, vol. 6(1), pages 1-27, March.
    5. repec:ipg:wpaper:2014-569 is not listed on IDEAS
    6. Atil, Ahmed & Lahiani, Amine & Nguyen, Duc Khuong, 2014. "Asymmetric and nonlinear pass-through of crude oil prices to gasoline and natural gas prices," Energy Policy, Elsevier, vol. 65(C), pages 567-573.
    7. E. E. Koks & M. Bočkarjova & H. de Moel & J. C. J. H. Aerts, 2015. "Integrated Direct and Indirect Flood Risk Modeling: Development and Sensitivity Analysis," Risk Analysis, John Wiley & Sons, vol. 35(5), pages 882-900, May.
    8. Julia Reis & Julie Shortridge, 2020. "Impact of Uncertainty Parameter Distribution on Robust Decision Making Outcomes for Climate Change Adaptation under Deep Uncertainty," Risk Analysis, John Wiley & Sons, vol. 40(3), pages 494-511, March.
    9. Aloui, Riadh & Aïssa, Mohamed Safouane Ben & Hammoudeh, Shawkat & Nguyen, Duc Khuong, 2014. "Dependence and extreme dependence of crude oil and natural gas prices with applications to risk management," Energy Economics, Elsevier, vol. 42(C), pages 332-342.
    10. Coqueret, Guillaume & Tavin, Bertrand, 2016. "An investigation of model risk in a market with jumps and stochastic volatility," European Journal of Operational Research, Elsevier, vol. 253(3), pages 648-658.
    11. Ilyes Abid & Stéphane Goutte & Farid Mkaouar & Khaled Guesmi, 2019. "Optimal strategy between extraction and storage of crude oil," Annals of Operations Research, Springer, vol. 281(1), pages 3-26, October.
    12. Elin Halvorsen-Weare & Kjetil Fagerholt, 2013. "Routing and scheduling in a liquefied natural gas shipping problem with inventory and berth constraints," Annals of Operations Research, Springer, vol. 203(1), pages 167-186, March.
    13. M’hamed Gaïgi & Stéphane Goutte & Idris Kharroubi & Thomas Lim, 2021. "Optimal risk management problem of natural resources: application to oil drilling," Annals of Operations Research, Springer, vol. 297(1), pages 147-166, February.
    14. Petter Bjerksund & Gunnar Stensland & Frank Vagstad, 2011. "Gas Storage Valuation: Price Modelling v. Optimization Methods," The Energy Journal, International Association for Energy Economics, vol. 0(Number 1), pages 203-228.
    15. Apostolos Serletis, 2007. "Maturity Effects in Energy Futures," World Scientific Book Chapters, in: Quantitative And Empirical Analysis Of Energy Markets, chapter 3, pages 23-37, World Scientific Publishing Co. Pte. Ltd..
    16. Morten Nalholm & Rolf Poulsen, 2006. "Static hedging and model risk for barrier options," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 26(5), pages 449-463, May.
    17. repec:hal:journl:hal-02313399 is not listed on IDEAS
    18. Barrieu, Pauline & Scandolo, Giacomo, 2015. "Assessing financial model risk," European Journal of Operational Research, Elsevier, vol. 242(2), pages 546-556.
    19. Martin Weibelzahl & Alexandra Märtz, 2020. "Optimal storage and transmission investments in a bilevel electricity market model," Annals of Operations Research, Springer, vol. 287(2), pages 911-940, April.
    20. Mensi, Walid & Sensoy, Ahmet & Vo, Xuan Vinh & Kang, Sang Hoon, 2020. "Impact of COVID-19 outbreak on asymmetric multifractality of gold and oil prices," Resources Policy, Elsevier, vol. 69(C).
    21. Cummins, Mark & Kiely, Greg & Murphy, Bernard, 2018. "Gas storage valuation under multifactor Lévy processes," Journal of Banking & Finance, Elsevier, vol. 95(C), pages 167-184.
    22. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    23. Huang, Dashan & Zhu, Shushang & Fabozzi, Frank J. & Fukushima, Masao, 2010. "Portfolio selection under distributional uncertainty: A relative robust CVaR approach," European Journal of Operational Research, Elsevier, vol. 203(1), pages 185-194, May.
    24. Petter Bjerksund & Gunnar Stensland & Frank Vagstad, 2011. "Gas Storage Valuation: Price Modelling v. Optimization Methods," The Energy Journal, , vol. 32(1), pages 203-228, January.
    25. Sebastien Choukroun & Stéphane Goutte & Armand Ngoupeyou, 2015. "Mean-variance hedging under multiple defaults risk," Post-Print hal-02879243, HAL.
    26. Denoyel, Victoire & Alfandari, Laurent & Thiele, Aurélie, 2017. "Optimizing healthcare network design under reference pricing and parameter uncertainty," European Journal of Operational Research, Elsevier, vol. 263(3), pages 996-1006.
    27. Rama Cont, 2006. "Model Uncertainty And Its Impact On The Pricing Of Derivative Instruments," Mathematical Finance, Wiley Blackwell, vol. 16(3), pages 519-547, July.
    28. Les Clewlow & Chris Strickland, 1999. "A Multi-Factor Model for Energy Derivatives," Research Paper Series 28, Quantitative Finance Research Centre, University of Technology, Sydney.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lazar, Emese & Qi, Shuyuan, 2022. "Model risk in the over-the-counter market," European Journal of Operational Research, Elsevier, vol. 298(2), pages 769-784.
    2. Cummins, Mark & Kiely, Greg & Murphy, Bernard, 2018. "Gas storage valuation under multifactor Lévy processes," Journal of Banking & Finance, Elsevier, vol. 95(C), pages 167-184.
    3. Baule, Rainer & Shkel, David, 2021. "Model risk and model choice in the case of barrier options and bonus certificates," Journal of Banking & Finance, Elsevier, vol. 133(C).
    4. Valeriane Jokhadze & Wolfgang M. Schmidt, 2020. "Measuring Model Risk In Financial Risk Management And Pricing," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 23(02), pages 1-37, April.
    5. Coqueret, Guillaume & Tavin, Bertrand, 2016. "An investigation of model risk in a market with jumps and stochastic volatility," European Journal of Operational Research, Elsevier, vol. 253(3), pages 648-658.
    6. Detering, Nils & Packham, Natalie, 2018. "Model risk of contingent claims," IRTG 1792 Discussion Papers 2018-036, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    7. Radu Tunaru, 2015. "Model Risk in Financial Markets:From Financial Engineering to Risk Management," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 9524.
    8. Kaeck, Andreas & Seeger, Norman J., 2020. "VIX derivatives, hedging and vol-of-vol risk," European Journal of Operational Research, Elsevier, vol. 283(2), pages 767-782.
    9. Tolulope Fadina & Ariel Neufeld & Thorsten Schmidt, 2018. "Affine processes under parameter uncertainty," Papers 1806.02912, arXiv.org, revised Mar 2019.
    10. Emese Lazar & Shuyuan Qi & Radu Tunaru, 2020. "Measures of Model Risk in Continuous-time Finance Models," Papers 2010.08113, arXiv.org, revised Oct 2020.
    11. Ben-zhang Yang & Jia Yue & Nan-jing Huang, 2017. "Variance swaps under L\'{e}vy process with stochastic volatility and stochastic interest rate in incomplete markets," Papers 1712.10105, arXiv.org, revised Mar 2018.
    12. Guillaume Coqueret & Romain Deguest, 2024. "Unexpected opportunities in misspecified predictive regressions," Post-Print hal-04595355, HAL.
    13. Ballotta, Laura & Deelstra, Griselda & Rayée, Grégory, 2017. "Multivariate FX models with jumps: Triangles, Quantos and implied correlation," European Journal of Operational Research, Elsevier, vol. 260(3), pages 1181-1199.
    14. Coqueret, Guillaume & Deguest, Romain, 2024. "Unexpected opportunities in misspecified predictive regressions," European Journal of Operational Research, Elsevier, vol. 318(2), pages 686-700.
    15. Ben-Zhang Yang & Jia Yue & Nan-Jing Huang, 2019. "Equilibrium Price Of Variance Swaps Under Stochastic Volatility With Lévy Jumps And Stochastic Interest Rate," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 22(04), pages 1-33, June.
    16. Patrick Hénaff & Ismail Laachir & Francesco Russo, 2018. "Gas Storage Valuation and Hedging: A Quantification of Model Risk," IJFS, MDPI, vol. 6(1), pages 1-27, March.
    17. Ballotta, Laura & Rayée, Grégory, 2022. "Smiles & smirks: Volatility and leverage by jumps," European Journal of Operational Research, Elsevier, vol. 298(3), pages 1145-1161.
    18. Patrick Henaff & Ismail Laachir & Francesco Russo, 2013. "Gas storage valuation and hedging. A quantification of the model risk," Papers 1312.3789, arXiv.org.
    19. Chiarella, Carl & Kang, Boda & Nikitopoulos, Christina Sklibosios & Tô, Thuy-Duong, 2013. "Humps in the volatility structure of the crude oil futures market: New evidence," Energy Economics, Elsevier, vol. 40(C), pages 989-1000.
    20. Seiji Harikae & James S. Dyer & Tianyang Wang, 2021. "Valuing Real Options in the Volatile Real World," Production and Operations Management, Production and Operations Management Society, vol. 30(1), pages 171-189, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:330:y:2023:i:1:d:10.1007_s10479-022-04574-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.