Estimation Risk in Financial Risk Management
Abstract
Value-at-Risk (VaR) and Expected Shortfall (ES) are increasingly used in portfolio risk measurement, risk capital allocation and performance attribution. Financial risk managers are therefore rightfully concerned with the precision of typical VaR and ES techniques. The purpose of this paper is exactly to assess the precision of common models and to quantify the magnitude of the estimation error by constructing confidence bands around the point VaR and ES forecasts. A key challenge in constructing proper confidence bands arises from the conditional variance dynamics typically found in speculative returns. Our paper suggests a resampling technique which accounts for parameter estimation error in dynamic models of portfolio variance. In a Monte Carlo study we find that commonly used practitioner methods such as Historical Simulation, which calculates the empirical quantile on a moving window of returns, implies 90% VaR confidence intervals that are too narrow and that contain as few as 20% of the true VaRs. Other methods which properly account for conditional variance dynamics, such as Filtered Historical Simulation instead imply 90% VaR confidence intervals that contain close to 90% of the true VaRs. ES measures are generally less accurate than VaR measures and the confidence bands around ES are also less reliable. La valeur-à-risque (VaR) et la mesure ES (Expected Shortfall) sont de plus en plus utilisées pour la mesure du risque d'un portefeuille, l'allocation de capital de risque et la détermination des performances. Les gestionnaires de risques financiers sont donc légitimement intéressés par la précision des techniques classiques de la valeur-à-risque et de la mesure ES. Le but de cet article est précisément d'évaluer la précision des modèles classiques et de mesurer l'importance de l'erreur d'estimation en construisant des intervalles de confiance autour des prévisions de la valeur-à-risque et de la mesure ES. Un des problèmes clés dans la construction d'intervalles de confiance appropriés provient de la dynamique de la variance conditionnelle typiquement observée pour les rendements spéculatifs. Notre article propose donc une technique de ré-échantillonnage qui tient compte de l'erreur d'estimation des paramètres des modèles dynamiques de la variance d'un portefeuille. Une analyse Monte Carlo nous montre que les méthodes généralement utilisées par les praticiens, telles que la simulation historique qui calcule le quantile empirique à l'aide d'une fenêtre mobile des rendements, génèrent des intervalles de confiance pour la valeur-à-risque à 90% qui sont trop étroits et qui contiennent seulement 20% des vraies valeurs-à-risque. D'autres méthodes qui tiennent compte correctement de la dynamique conditionnelle de la variance, telles que la simulation historique filtrée, génèrent quant à elles des intervalles de confiance de la valeur-à-risque à 90% qui contiennent près de 90% des vraies valeurs-à-risque. Les mesures ES sont généralement moins précises que les mesures de valeur-à-risque et les intervalles de confiance autour de la mesure ES sont également moins fiables.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.Bibliographic Info
Paper provided by CIRANO in its series CIRANO Working Papers with number 2004s-15.Length:
Date of creation: 01 Apr 2004
Date of revision:
Handle: RePEc:cir:cirwor:2004s-15
Contact details of provider:
Postal: 2020 rue University, 25e étage, Montréal, Quéc, H3A 2A5
Phone: (514) 985-4000
Fax: (514) 985-4039
Email:
Web page: http://www.cirano.qc.ca/
More information through EDIRC
Related research
Keywords: Risk management; boostrapping; GARCH; gestion des risques; Bootstrap; GARCH;Find related papers by JEL classification:
- G12 - Financial Economics - - General Financial Markets - - - Asset Pricing
This paper has been announced in the following NEP Reports:
- NEP-ALL-2004-05-02 (All new papers)
- NEP-CFN-2004-05-02 (Corporate Finance)
- NEP-FIN-2004-05-02 (Finance)
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Baillie, Richard T & Bollerslev, Tim, 2002.
"The Message in Daily Exchange Rates: A Conditional-Variance Tale,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 20(1), pages 60-68, January.
- Baillie, Richard T & Bollerslev, Tim, 1989. "The Message in Daily Exchange Rates: A Conditional-Variance Tale," Journal of Business & Economic Statistics, American Statistical Association, vol. 7(3), pages 297-305, July.
- Tom Doan, . "RATS program to replicate Baillie and Bollerslev GARCH models with day-of-week effects," Statistical Software Components RTZ00172, Boston College Department of Economics.
- Anderson, Torben G. & Bollerslev, Tim & Diebold, Francis X. & Labys, Paul, 2002.
"Modeling and Forecasting Realized Volatility,"
Working Papers
02-12, Duke University, Department of Economics.
- Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2003. "Modeling and Forecasting Realized Volatility," Econometrica, Econometric Society, vol. 71(2), pages 579-625, March.
- Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2001. "Modeling and Forecasting Realized Volatility," NBER Working Papers 8160, National Bureau of Economic Research, Inc.
- Torben G. Andersen & Tim Bollerslev & Francis X. Diebold & Paul Labys, 2001. "Modeling and Forecasting Realized Volatility," Center for Financial Institutions Working Papers 01-01, Wharton School Center for Financial Institutions, University of Pennsylvania.
- Bollerslev, Tim, 1987. "A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return," The Review of Economics and Statistics, MIT Press, vol. 69(3), pages 542-47, August.
- Panayiotis Theodossiou, 1998. "Financial Data and the Skewed Generalized T Distribution," Management Science, INFORMS, vol. 44(12-Part-1), pages 1650-1661, December.
- Baillie, Richard T. & Bollerslev, Tim, 1992.
"Prediction in dynamic models with time-dependent conditional variances,"
Journal of Econometrics,
Elsevier, vol. 52(1-2), pages 91-113.
- Baillie, R.T. & Bollerslev, R.T., 1990. "Prediction In Dynamic Models With Time Dependent Conditional Variances," Papers 8815, Michigan State - Econometrics and Economic Theory.
- Robert F. Engle & Simone Manganelli, 2004.
"CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 22, pages 367-381, October.
- Robert Engle & Simone Manganelli, 2000. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Econometric Society World Congress 2000 Contributed Papers 0841, Econometric Society.
- Engle, Robert F & Manganelli, Simone, 1999. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," University of California at San Diego, Economics Working Paper Series qt06m3d6nv, Department of Economics, UC San Diego.
- Paul Glasserman & Philip Heidelberger & Perwez Shahabuddin, 2000. "Variance Reduction Techniques for Estimating Value-at-Risk," Management Science, INFORMS, vol. 46(10), pages 1349-1364, October.
- David Backus & Silverio Foresi & Liuren Wu, 2002. "Accouting for Biases in Black-Scholes," Finance 0207008, EconWPA.
- Paul Glasserman & Philip Heidelberger & Perwez Shahabuddin, 2002. "Portfolio Value-at-Risk with Heavy-Tailed Risk Factors," Mathematical Finance, Wiley Blackwell, vol. 12(3), pages 239-269.
- Jin-Chuan Duan, 1994. "Maximum Likelihood Estimation Using Price Data Of The Derivative Contract," Mathematical Finance, Wiley Blackwell, vol. 4(2), pages 155-167.
- Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
- Matthew Pritsker, 2001. "The hidden dangers of historical simulation," Finance and Economics Discussion Series 2001-27, Board of Governors of the Federal Reserve System (U.S.).
- Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Bauwens, Luc, 2009.
"A component GARCH model with time varying weights,"
Open Access publications from Université catholique de Louvain
info:hdl:2078.1/28904, Université catholique de Louvain.
- Luc Bauwens & Giuseppe Storti, 2009. "A Component GARCH Model with Time Varying Weights," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 13(2), pages 1.
- Luc, BAUWENS & G., STORTI, 2007. "A Component GARCH Model with Time Varying Weights," Discussion Papers (ECON - Département des Sciences Economiques) 2007012, Université catholique de Louvain, Département des Sciences Economiques.
- Giuseppe Storti & Luc Bauwens, 2006. "A component GARCH model with time varying weights," Computing in Economics and Finance 2006 388, Society for Computational Economics.
- BAUWENS, Luc & STORTI, Giuseppe, 2007. "A component GARCH model with time varying weights," CORE Discussion Papers 2007019, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Maria Rosa Nieto & Esther Ruiz, 2008. "Measuring financial risk : comparison of alternative procedures to estimate VaR and ES," Statistics and Econometrics Working Papers ws087326, Universidad Carlos III, Departamento de Estadística y Econometría.
- Imola Driga, 2012. "Financial Risks Analysis For A Commercial Bank In The Romanian Banking System," Annales Universitatis Apulensis Series Oeconomica, Faculty of Sciences, "1 Decembrie 1918" University, Alba Iulia, vol. 1(14), pages 14.
- Henry Dannenberg, 2011. "The Importance of Estimation Uncertainty in a Multi-Rating Class Loan Portfolio," IWH Discussion Papers 11, Halle Institute for Economic Research.
- Loriano Mancini & Fabio Trojani, 2007.
"Robust Value at Risk Prediction,"
University of St. Gallen Department of Economics working paper series 2007
2007-36, Department of Economics, University of St. Gallen.
- Loriano Mancini & Fabio Trojani, 2005. "Robust Value at Risk Prediction," Swiss Finance Institute Research Paper Series 07-31, Swiss Finance Institute, revised Oct 2007.
- Peter Christoffersen & Jeremy Berkowitz & Denis Pelletier, 2008.
"Evaluating Value-at-Risk Models with Desk-Level Data,"
CREATES Research Papers
2009-35, School of Economics and Management, University of Aarhus.
- Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2011. "Evaluating Value-at-Risk Models with Desk-Level Data," Management Science, INFORMS, vol. 57(12), pages 2213-2227, December.
- Jeremy Berkowitz & Peter Christoffersen & Denis Pelletier, 2005. "Evaluating Value-at-Risk models with desk-level data," Working Paper Series 010, North Carolina State University, Department of Economics, revised Dec 2006.
- Christoph Hartz & Stefan Mittnik & Marc S. Paolella, 2006. "Accurate Value-at-Risk Forecast with the (good old) Normal-GARCH Model," CFS Working Paper Series 2006/23, Center for Financial Studies.
- Boudt, Kris & Peterson, B. & Croux, Christophe, 2008. "Estimation and Decomposition of Downside Risk for Portfolios with Non-normal Returns," Open Access publications from Katholieke Universiteit Leuven urn:hdl:123456789/200168, Katholieke Universiteit Leuven.
- Hartz, Christoph & Mittnik, Stefan & Paolella, Marc, 2006. "Accurate value-at-risk forecasting based on the normal-GARCH model," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2295-2312, December.
- Gaglianone, Wagner Piazza & Linton, Oliver & Lima, Luiz Renato Regis de Oliveira, 2008.
"Evaluating Value-at-Risk models via Quantile regressions,"
Economics Working Papers (Ensaios Economicos da EPGE)
679, Graduate School of Economics, Getulio Vargas Foundation (Brazil).
- Gaglianone, Wagner Piazza & Lima, Luiz Renato & Linton, Oliver & Smith, Daniel R., 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 150-160.
- Wagner P. Gaglianone & Luiz Renato Lima & Oliver Linton, 2008. "Evaluating Value-at-Risk Models via Quantile Regressions," Working Papers Series 161, Central Bank of Brazil, Research Department.
- Wagner Piazza Gaglianone & Luiz Renato Lima & Oliver Linton & Daniel Smith, 2010. "Evaluating Value-at-Risk Models via Quantile Regression," NCER Working Paper Series 67, National Centre for Econometric Research.
- Gaglianone, Wagner Piazza & Lima, Luiz Renato & Linton, Oliver & Smith, Daniel, . "Evaluating Value-at-Risk models via Quantile Regression," Open Access publications from Universidad Carlos III de Madrid info:hdl:10016/4883, Universidad Carlos III de Madrid.
- Wagner Piazza Gaglianone & Luiz Renato Lima & Oliver Linton & Daniel Smith, 2009. "Evaluating Value-at-Risk models via Quantile Regression," Economics Working Papers we094625, Universidad Carlos III, Departamento de Economía.
- María Rosa Nieto & Esther Ruiz, 2010. "Bootstrap prediction intervals for VaR and ES in the context of GARCH models," Statistics and Econometrics Working Papers ws102814, Universidad Carlos III, Departamento de Estadística y Econometría.
- Wasel Shadat, 2011. "On the Nonparametric Tests of Univariate GARCH Regression Models," The School of Economics Discussion Paper Series 1115, Economics, The University of Manchester.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2004s-15For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Webmaster).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

