IDEAS home Printed from https://ideas.repec.org/a/eee/ecosta/v17y2021icp1-22.html
   My bibliography  Save this article

Model risk management: Valuation and governance of pseudo-models

Author

Listed:
  • Gourieroux, C.
  • Monfort, A.

Abstract

The standard estimation approaches and their implementation generally assume well-specified models. What is feasible and unfeasible when the models are misspecified is discussed. An adjustment method is introduced for forecasts based on misspecified models. The key roles of the object of interest and of the management of validation samples are highlighted. The approach is used to derive forecast intervals robust to misspecification, to quantify the required capital for model risk in prudential supervision, to measure treatment effects with pseudo-models, or to jointly manage a set of pseudo-models.

Suggested Citation

  • Gourieroux, C. & Monfort, A., 2021. "Model risk management: Valuation and governance of pseudo-models," Econometrics and Statistics, Elsevier, vol. 17(C), pages 1-22.
    • Handle: RePEc:eee:ecosta:v:17:y:2021:i:c:p:1-22
    DOI: 10.1016/j.ecosta.2020.08.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2452306220300708
    Download Restriction: Full text for ScienceDirect subscribers only. Contains open access articles
    File URL: https://libkey.io/10.1016/j.ecosta.2020.08.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    2. Sin, Chor-Yiu & White, Halbert, 1996. "Information criteria for selecting possibly misspecified parametric models," Journal of Econometrics, Elsevier, vol. 71(1-2), pages 207-225.
    3. J.P. Florens & C. Gourieroux & A. Monfort, 2019. "Model Risk Management: Limits and Future of Bayesian Approaches," Annals of Economics and Statistics, GENES, issue 136, pages 1-26.
    4. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    5. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464, June.
    6. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    7. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    8. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    9. Chatfield, Chris, 1993. "Calculating Interval Forecasts: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 143-144, April.
    10. Chatfield, Chris, 1993. "Calculating Interval Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 11(2), pages 121-135, April.
    11. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    12. Guido W. Imbens, 2004. "Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 4-29, February.
    13. Nishii, R., 1988. "Maximum likelihood principle and model selection when the true model is unspecified," Journal of Multivariate Analysis, Elsevier, vol. 27(2), pages 392-403, November.
    14. Kiefer, Nicholas M., 2009. "Default estimation for low-default portfolios," Journal of Empirical Finance, Elsevier, vol. 16(1), pages 164-173, January.
    15. Gourieroux, Christian & Tiomo, Andre, 2019. "The Evaluation of Model Risk for Probability of Default and Expected Loss," MPRA Paper 95795, University Library of Munich, Germany.
    16. Kosuke Imai & Gary King & Elizabeth A. Stuart, 2008. "Misunderstandings between experimentalists and observationalists about causal inference," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 171(2), pages 481-502, April.
    17. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    18. Douglas Rivers & Quang Vuong, 2002. "Model selection tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 1-39, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tae-Hwy Lee & Yong Bao & Burak Saltoğlu, 2007. "Comparing density forecast models Previous versions of this paper have been circulated with the title, 'A Test for Density Forecast Comparison with Applications to Risk Management' since October 2003;," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 26(3), pages 203-225.
    2. Susanne M. Schennach & Daniel Wilhelm, 2017. "A Simple Parametric Model Selection Test," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1663-1674, October.
    3. Clements, Michael P. & Franses, Philip Hans & Swanson, Norman R., 2004. "Forecasting economic and financial time-series with non-linear models," International Journal of Forecasting, Elsevier, vol. 20(2), pages 169-183.
    4. Valentina Corradi & Norman R. Swanson, 2003. "A Test for Comparing Multiple Misspecified Conditional Distributions," Departmental Working Papers 200314, Rutgers University, Department of Economics.
    5. Valentina Corradi & Norman Swanson, 2013. "A Survey of Recent Advances in Forecast Accuracy Comparison Testing, with an Extension to Stochastic Dominance," Departmental Working Papers 201309, Rutgers University, Department of Economics.
    6. Granziera, Eleonora & Hubrich, Kirstin & Moon, Hyungsik Roger, 2014. "A predictability test for a small number of nested models," Journal of Econometrics, Elsevier, vol. 182(1), pages 174-185.
    7. Chen, Xiaohong & Hong, Han & Shum, Matthew, 2007. "Nonparametric likelihood ratio model selection tests between parametric likelihood and moment condition models," Journal of Econometrics, Elsevier, vol. 141(1), pages 109-140, November.
    8. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    9. Arie Preminger & David Wettstein, 2005. "Using the Penalized Likelihood Method for Model Selection with Nuisance Parameters Present only under the Alternative: An Application to Switching Regression Models," Journal of Time Series Analysis, Wiley Blackwell, vol. 26(5), pages 715-741, September.
    10. Li, Jia & Patton, Andrew J., 2018. "Asymptotic inference about predictive accuracy using high frequency data," Journal of Econometrics, Elsevier, vol. 203(2), pages 223-240.
    11. Chen, Xiaohong & Fan, Yanqin, 2006. "Estimation and model selection of semiparametric copula-based multivariate dynamic models under copula misspecification," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 125-154.
    12. Arie Preminger & Shinichi Sakata, 2007. "A model selection method for S-estimation," Econometrics Journal, Royal Economic Society, vol. 10(2), pages 294-319, July.
    13. Andrew J. Patton & Kevin Sheppard, 2008. "Evaluating Volatility and Correlation Forecasts," OFRC Working Papers Series 2008fe22, Oxford Financial Research Centre.
    14. Todd E. Clark & Michael W. McCracken, 2010. "Testing for unconditional predictive ability," Working Papers 2010-031, Federal Reserve Bank of St. Louis.
    15. Lee, Tae-Hwy & Long, Xiangdong, 2009. "Copula-based multivariate GARCH model with uncorrelated dependent errors," Journal of Econometrics, Elsevier, vol. 150(2), pages 207-218, June.
    16. Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
    17. In-Koo Cho & Kenneth Kasa, 2015. "Learning and Model Validation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 82(1), pages 45-82.
    18. Stefania D'Amico, 2004. "Density Estimation and Combination under Model Ambiguity," Computing in Economics and Finance 2004 273, Society for Computational Economics.
    19. Corradi, Valentina & Fosten, Jack & Gutknecht, Daniel, 2024. "Predictive ability tests with possibly overlapping models," Journal of Econometrics, Elsevier, vol. 241(1).
    20. Gospodinov, Nikolay & Kan, Raymond & Robotti, Cesare, 2013. "Chi-squared tests for evaluation and comparison of asset pricing models," Journal of Econometrics, Elsevier, vol. 173(1), pages 108-125.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ecosta:v:17:y:2021:i:c:p:1-22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/econometrics-and-statistics .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.