IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v59y2022i2d10.1007_s10614-021-10093-x.html
   My bibliography  Save this article

Deviation-Based Model Risk Measures

Author

Listed:
  • Mohammed Berkhouch

    (LISAD, ENSA, Ibn Zohr University)

  • Fernanda Maria Müller

    (Business School, Federal University of Rio Grande do Sul)

  • Ghizlane Lakhnati

    (LISAD, ENSA, Ibn Zohr University)

  • Marcelo Brutti Righi

    (Business School, Federal University of Rio Grande do Sul)

Abstract

In practice, risk forecasts are obtained by risk measures based on a given probability measure on a measurable space. In our study, we consider the probability measures as alternative scenarios, which refer to, for instance, different distribution assumptions, models, or economic situations. Using an improper probability measure can affect risk forecasting and lead to wrong financial decisions. In this context, we propose a Deviation-based approach for quantifying model risk associated with choosing an inappropriate probability measure for risk forecasting. This measuring approach provides us with information about how far our risk measurement process could be affected by model risk. We provide examples of Deviation-based model risk measures defined in the literature. Moreover, we are proposing new alternatives to quantify model risk, for example, Gini and Extended Gini-type model risk measures. We provide a practical example using Value-at-risk (VaR) and Expected Shortfall forecasting to illustrate our approach. Our results indicate that using an inadequate probability measure (distribution assumptions) can largely affect risk forecasting. We verify that model risk estimates present skewness and heavy tail, have significant auto-correlation and do increase in periods that coincide with the highest variability of returns.

Suggested Citation

  • Mohammed Berkhouch & Fernanda Maria Müller & Ghizlane Lakhnati & Marcelo Brutti Righi, 2022. "Deviation-Based Model Risk Measures," Computational Economics, Springer;Society for Computational Economics, vol. 59(2), pages 527-547, February.
  • Handle: RePEc:kap:compec:v:59:y:2022:i:2:d:10.1007_s10614-021-10093-x
    DOI: 10.1007/s10614-021-10093-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-021-10093-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-021-10093-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Degiannakis, Stavros & Floros, Christos & Dent, Pamela, 2013. "Forecasting value-at-risk and expected shortfall using fractionally integrated models of conditional volatility: International evidence," International Review of Financial Analysis, Elsevier, vol. 27(C), pages 21-33.
    2. Lidia Ceriani & Paolo Verme, 2012. "The origins of the Gini index: extracts from Variabilità e Mutabilità (1912) by Corrado Gini," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 10(3), pages 421-443, September.
    3. Righi, Marcelo Brutti & Ceretta, Paulo Sergio, 2015. "A comparison of Expected Shortfall estimation models," Journal of Economics and Business, Elsevier, vol. 78(C), pages 14-47.
    4. Danielsson, Jon & James, Kevin R. & Valenzuela, Marcela & Zer, Ilknur, 2016. "Model risk of risk models," Journal of Financial Stability, Elsevier, vol. 23(C), pages 79-91.
    5. Marcelo Brutti Righi, 2015. "A composition between risk and deviation measures," Papers 1511.06943, arXiv.org, revised May 2018.
    6. Jian Zhou & Randy Anderson, 2012. "Extreme Risk Measures for International REIT Markets," The Journal of Real Estate Finance and Economics, Springer, vol. 45(1), pages 152-170, June.
    7. Georg Ch Pflug & Werner Römisch, 2007. "Modeling, Measuring and Managing Risk," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 6478, January.
    8. Paul Glasserman & Xingbo Xu, 2014. "Robust risk measurement and model risk," Quantitative Finance, Taylor & Francis Journals, vol. 14(1), pages 29-58, January.
    9. Shalit, Haim & Yitzhaki, Shlomo, 1984. "Mean-Gini, Portfolio Theory, and the Pricing of Risky Assets," Journal of Finance, American Finance Association, vol. 39(5), pages 1449-1468, December.
    10. Laurent E. Calvet, 2004. "How to Forecast Long-Run Volatility: Regime Switching and the Estimation of Multifractal Processes," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 49-83.
    11. Acerbi, Carlo, 2002. "Spectral measures of risk: A coherent representation of subjective risk aversion," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1505-1518, July.
    12. Furman, Edward & Wang, Ruodu & Zitikis, Ričardas, 2017. "Gini-type measures of risk and variability: Gini shortfall, capital allocations, and heavy-tailed risks," Journal of Banking & Finance, Elsevier, vol. 83(C), pages 70-84.
    13. Yitzhaki, Shlomo, 1983. "On an Extension of the Gini Inequality Index," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 24(3), pages 617-628, October.
    14. Yuhong Xu, 2014. "Robust valuation and risk measurement under model uncertainty," Papers 1407.8024, arXiv.org.
    15. Mohammed Berkhouch & Ghizlane Lakhnati & Marcelo Brutti Righi, 2017. "Extended Gini-type measures of risk and variability," Papers 1707.07322, arXiv.org, revised Mar 2018.
    16. Valeria Bignozzi & Andreas Tsanakas, 2016. "Parameter Uncertainty and Residual Estimation Risk," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 83(4), pages 949-978, December.
    17. Nils Detering & Natalie Packham, 2016. "Model risk of contingent claims," Quantitative Finance, Taylor & Francis Journals, vol. 16(9), pages 1357-1374, September.
    18. Thomas Breuer & Imre Csiszár, 2016. "Measuring Distribution Model Risk," Mathematical Finance, Wiley Blackwell, vol. 26(2), pages 395-411, April.
    19. Barrieu, Pauline & Scandolo, Giacomo, 2015. "Assessing financial model risk," European Journal of Operational Research, Elsevier, vol. 242(2), pages 546-556.
    20. Susanne Emmer & Marie Kratz & Dirk Tasche, 2013. "What is the best risk measure in practice? A comparison of standard measures," Papers 1312.1645, arXiv.org, revised Apr 2015.
    21. Giovanni Maria Giorgi, 2005. "Bibliographic portrait of the Gini concentration ratio," Econometrics 0511004, University Library of Munich, Germany.
    22. Hans Föllmer & Alexander Schied, 2002. "Convex measures of risk and trading constraints," Finance and Stochastics, Springer, vol. 6(4), pages 429-447.
    23. Shlomo Yitzhaki & Edna Schechtman, 2005. "The properties of the extended Gini measures of variability and inequality," Metron - International Journal of Statistics, Dipartimento di Statistica, Probabilità e Statistiche Applicate - University of Rome, vol. 0(3), pages 401-433.
    24. R. Rockafellar & Stan Uryasev & Michael Zabarankin, 2006. "Generalized deviations in risk analysis," Finance and Stochastics, Springer, vol. 10(1), pages 51-74, January.
    25. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    26. Valeriane Jokhadze & Wolfgang M. Schmidt, 2020. "Measuring Model Risk In Financial Risk Management And Pricing," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 23(02), pages 1-37, April.
    27. Keith Kuester & Stefan Mittnik & Marc S. Paolella, 2006. "Value-at-Risk Prediction: A Comparison of Alternative Strategies," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 53-89.
    28. Johanna F. Ziegel, 2016. "Coherence And Elicitability," Mathematical Finance, Wiley Blackwell, vol. 26(4), pages 901-918, October.
    29. Mohammed Berkhouch & Ghizlane Lakhnati & Marcelo Brutti Righi, 2018. "Extended Gini-Type Measures of Risk and Variability," Applied Mathematical Finance, Taylor & Francis Journals, vol. 25(3), pages 295-314, May.
    30. Adam, Alexandre & Houkari, Mohamed & Laurent, Jean-Paul, 2008. "Spectral risk measures and portfolio selection," Journal of Banking & Finance, Elsevier, vol. 32(9), pages 1870-1882, September.
    31. Fernanda Maria Müller & Marcelo Brutti Righi, 2018. "Numerical comparison of multivariate models to forecasting risk measures," Risk Management, Palgrave Macmillan, vol. 20(1), pages 29-50, February.
    32. Kellner, Ralf & Rösch, Daniel, 2016. "Quantifying market risk with Value-at-Risk or Expected Shortfall? – Consequences for capital requirements and model risk," Journal of Economic Dynamics and Control, Elsevier, vol. 68(C), pages 45-63.
    33. Antonio Díaz & Gonzalo García-Donato & Andrés Mora-Valencia, 2017. "Risk quantification in turmoil markets," Risk Management, Palgrave Macmillan, vol. 19(3), pages 202-224, August.
    34. Marcelo Brutti Righi & Paulo Sergio Ceretta, 2015. "Shortfall Deviation Risk: An alternative to risk measurement," Papers 1501.02007, arXiv.org, revised May 2016.
    35. Kerkhof, Jeroen & Melenberg, Bertrand & Schumacher, Hans, 2010. "Model risk and capital reserves," Journal of Banking & Finance, Elsevier, vol. 34(1), pages 267-279, January.
    36. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    37. Alexander J. McNeil & Rüdiger Frey & Paul Embrechts, 2015. "Quantitative Risk Management: Concepts, Techniques and Tools Revised edition," Economics Books, Princeton University Press, edition 2, number 10496.
    38. Rama Cont, 2006. "Model Uncertainty And Its Impact On The Pricing Of Derivative Instruments," Mathematical Finance, Wiley Blackwell, vol. 16(3), pages 519-547, July.
    39. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    40. Michele Leonardo Bianchi & Alberto Maria Sorrentino, 2020. "Measuring CoVaR: An Empirical Comparison," Computational Economics, Springer;Society for Computational Economics, vol. 55(2), pages 511-528, February.
    41. Segnon, Mawuli & Lux, Thomas & Gupta, Rangan, 2017. "Modeling and forecasting the volatility of carbon dioxide emission allowance prices: A review and comparison of modern volatility models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 692-704.
    42. Rama Cont, 2006. "Model uncertainty and its impact on the pricing of derivative instruments," Post-Print halshs-00002695, HAL.
    43. Filippo Curti & Ibrahim Ergen & Minh Le & Marco Migueis & Rob T. Stewart, 2016. "Benchmarking Operational Risk Models," Finance and Economics Discussion Series 2016-070, Board of Governors of the Federal Reserve System (U.S.).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Müller, Fernanda Maria & Santos, Samuel Solgon & Gössling, Thalles Weber & Righi, Marcelo Brutti, 2022. "Comparison of risk forecasts for cryptocurrencies: A focus on Range Value at Risk," Finance Research Letters, Elsevier, vol. 48(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marcelo Brutti Righi & Fernanda Maria Muller & Marlon Ruoso Moresco, 2017. "On a robust risk measurement approach for capital determination errors minimization," Papers 1707.09829, arXiv.org, revised Oct 2020.
    2. Marcelo Brutti Righi, 2018. "A theory for combinations of risk measures," Papers 1807.01977, arXiv.org, revised May 2023.
    3. Marcelo Brutti Righi & Fernanda Maria Muller & Marlon Ruoso Moresco, 2022. "A risk measurement approach from risk-averse stochastic optimization of score functions," Papers 2208.14809, arXiv.org, revised May 2023.
    4. Berkhouch, Mohammed & Lakhnati, Ghizlane, 2017. "Extended Gini-type measures of risk and variability," MPRA Paper 80329, University Library of Munich, Germany.
    5. Valeriane Jokhadze & Wolfgang M. Schmidt, 2020. "Measuring Model Risk In Financial Risk Management And Pricing," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 23(02), pages 1-37, April.
    6. Mariano González-Sánchez & Eva M. Ibáñez Jiménez & Ana I. Segovia San Juan, 2022. "Market and model risks: a feasible joint estimate methodology," Risk Management, Palgrave Macmillan, vol. 24(3), pages 187-213, September.
    7. Righi, Marcelo Brutti & Müller, Fernanda Maria & Moresco, Marlon Ruoso, 2020. "On a robust risk measurement approach for capital determination errors minimization," Insurance: Mathematics and Economics, Elsevier, vol. 95(C), pages 199-211.
    8. James Ming Chen, 2018. "On Exactitude in Financial Regulation: Value-at-Risk, Expected Shortfall, and Expectiles," Risks, MDPI, vol. 6(2), pages 1-28, June.
    9. Pablo Cristini Guedes & Fernanda Maria Müller & Marcelo Brutti Righi, 2023. "Risk measures-based cluster methods for finance," Risk Management, Palgrave Macmillan, vol. 25(1), pages 1-56, March.
    10. Mohammed Berkhouch & Ghizlane Lakhnati & Marcelo Brutti Righi, 2017. "Extended Gini-type measures of risk and variability," Papers 1707.07322, arXiv.org, revised Mar 2018.
    11. Yu Feng, 2019. "Theory and Application of Model Risk Quantification," PhD Thesis, Finance Discipline Group, UTS Business School, University of Technology, Sydney, number 3-2019.
    12. Fernanda Maria Müller & Marcelo Brutti Righi, 2018. "Numerical comparison of multivariate models to forecasting risk measures," Risk Management, Palgrave Macmillan, vol. 20(1), pages 29-50, February.
    13. Righi, Marcelo Brutti & Borenstein, Denis, 2018. "A simulation comparison of risk measures for portfolio optimization," Finance Research Letters, Elsevier, vol. 24(C), pages 105-112.
    14. Farkas, Walter & Fringuellotti, Fulvia & Tunaru, Radu, 2020. "A cost-benefit analysis of capital requirements adjusted for model risk," Journal of Corporate Finance, Elsevier, vol. 65(C).
    15. Radu Tunaru, 2015. "Model Risk in Financial Markets:From Financial Engineering to Risk Management," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 9524, January.
    16. Yu Feng, 2019. "Non-Parametric Robust Model Risk Measurement with Path-Dependent Loss Functions," Papers 1903.00590, arXiv.org.
    17. Ruodu Wang & Ričardas Zitikis, 2021. "An Axiomatic Foundation for the Expected Shortfall," Management Science, INFORMS, vol. 67(3), pages 1413-1429, March.
    18. Detering, Nils & Packham, Natalie, 2018. "Model risk of contingent claims," IRTG 1792 Discussion Papers 2018-036, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    19. Del Brio, Esther B. & Mora-Valencia, Andrés & Perote, Javier, 2020. "Risk quantification for commodity ETFs: Backtesting value-at-risk and expected shortfall," International Review of Financial Analysis, Elsevier, vol. 70(C).
    20. Marcelo Brutti Righi, 2019. "A composition between risk and deviation measures," Annals of Operations Research, Springer, vol. 282(1), pages 299-313, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:59:y:2022:i:2:d:10.1007_s10614-021-10093-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.