A fast algorithm for finding the confidence set of large collections of models
The paper proposes a new algorithm for finding the confidence set of a collection of forecasts or prediction models. Existing numerical implementations for finding the confidence set use an elimination approach where one starts with the full collection of models and successively eliminates the worst performing until the null of equal predictive ability is no longer rejected at a given confidence level. The intuition behind the proposed implementation lies in reversing the process: one starts with a collection of two models and as models are successively added to the collection both the model rankings and p-values are updated. The first benefit of this updating approach is a reduction of one polynomial order in both the time complexity and memory cost of finding the confidence set of a collection of M models, falling respectively from O (M3) to O (M2) and from O (M2) to O (M). This theoretical prediction is confirmed by a Monte Carlo benchmarking analysis of the algorithms. The second key benefit of the updating approach is that it intuitively allows for further models to be added at a later point in time, thus enabling collaborative efforts using the model confidence set procedure.
|Date of creation:||Sep 2015|
|Contact details of provider:|| Postal: School of Economics, University of Kent, Canterbury, Kent, CT2 7NP|
Phone: +44 (0)1227 827497
Web page: http://www.kent.ac.uk/economics/
|Order Information:|| Email: |
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Sébastien Laurent & Jeroen V. K. Rombouts & Francesco Violante, 2012.
"On the forecasting accuracy of multivariate GARCH models,"
Journal of Applied Econometrics,
John Wiley & Sons, Ltd., vol. 27(6), pages 934-955, 09.
- LAURENT, Sébastien & ROMBOUTS, Jeroen V. K. & VIOLANTE, Francesco, 2010. "On the forecasting accuracy of multivariate GARCH models," CORE Discussion Papers 2010025, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
- Sébastien Laurent & Jeroen V.K. Rombouts & Francesco Violante, 2010. "On the Forecasting Accuracy of Multivariate GARCH Models," Cahiers de recherche 1021, CIRPEE.
- Zeynep Iltuzer & Oktay Tas, 2013. "The Forecasting Performances of Volatility Models in Emerging Stock Markets: Is a Generalization Really Possible?," Journal of Applied Finance & Banking, SCIENPRESS Ltd, vol. 3(2), pages 1-4.
- Caporin, Massimiliano & McAleer, Michael, 2014. "Robust ranking of multivariate GARCH models by problem dimension," Computational Statistics & Data Analysis, Elsevier, vol. 76(C), pages 172-185.
- Caporin, M. & McAleer, M.J., 2012. "Robust Ranking of Multivariate GARCH Models by Problem Dimension," Econometric Institute Research Papers EI2012-13, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
- Michael McAleer & Massimiliano Caporin, 2012. "Robust Ranking of Multivariate GARCH Models by Problem Dimension," KIER Working Papers 815, Kyoto University, Institute of Economic Research.
- Massimiliano Caporin & Michael McAleer, 2012. "Robust Ranking of Multivariate GARCH Models by Problem Dimension," Working Papers in Economics 12/06, University of Canterbury, Department of Economics and Finance.
- Massimiliano Caporin & Michael McAleer, 2012. "Robust Ranking of Multivariate GARCH Models by Problem Dimension," Documentos de Trabajo del ICAE 2012-06, Universidad Complutense de Madrid, Facultad de Ciencias Económicas y Empresariales, Instituto Complutense de Análisis Económico, revised Apr 2012.
- Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
- Mauro Bernardi & Leopoldo Catania, 2014. "The Model Confidence Set package for R," Papers 1410.8504, arXiv.org.
- Mauro Bernardi & Leopoldo Catania, 2015. "The Model Confidence Set package for R," CEIS Research Paper 362, Tor Vergata University, CEIS, revised 17 Nov 2015.
- Neumann, Michael & Skiadopoulos, George, 2013. "Predictable Dynamics in Higher-Order Risk-Neutral Moments: Evidence from the S&P 500 Options," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 48(03), pages 947-977, June.
- Liu, Lily Y. & Patton, Andrew J. & Sheppard, Kevin, 2015. "Does anything beat 5-minute RV? A comparison of realized measures across multiple asset classes," Journal of Econometrics, Elsevier, vol. 187(1), pages 293-311.
- Kevin Sheppard & Lily Liu & Andrew J. Patton, 2013. "Does Anything Beat 5-Minute RV? A Comparison of Realized Measures Across Multiple Asset Classes," Economics Series Working Papers 645, University of Oxford, Department of Economics.
When requesting a correction, please mention this item's handle: RePEc:ukc:ukcedp:1519. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Tracey Girling)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.