In-sample tests of predictability are superior to pseudo-out-of-sample tests, even when data mining
Author
Abstract
Suggested Citation
DOI: 10.1016/j.ijforecast.2021.05.006
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Peter Reinhard Hansen & Allan Timmermann, 2015.
"Equivalence Between Out‐of‐Sample Forecast Comparisons and Wald Statistics,"
Econometrica, Econometric Society, vol. 83, pages 2485-2505, November.
- Peter Reinhard Hansen & Allan Timmermann, 2012. "Equivalence Between Out-of-Sample Forecast Comparisons and Wald Statistics," CREATES Research Papers 2012-45, Department of Economics and Business Economics, Aarhus University.
- Peter Reinhard Hansen & Allan Timmermann, 2012. "Equivalence Between Out-of-Sample Forecast Comparisons and Wald Statistics," Economics Working Papers ECO2012/24, European University Institute.
- Francis X. Diebold, 2015.
"Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests,"
Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 1-1, January.
- Francis X. Diebold, 2012. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," PIER Working Paper Archive 12-035, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
- Francis X. Diebold, 2012. "Comparing Predictive Accuracy, Twenty Years Later: A Personal Perspective on the Use and Abuse of Diebold-Mariano Tests," NBER Working Papers 18391, National Bureau of Economic Research, Inc.
- Yoav Benjamini & Marina Bogomolov, 2014. "Selective inference on multiple families of hypotheses," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 297-318, January.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Jean-Yves Pitarakis, 2020. "A Novel Approach to Predictive Accuracy Testing in Nested Environments," Papers 2008.08387, arXiv.org, revised Oct 2023.
- Knut Are Aastveit & Claudia Foroni & Francesco Ravazzolo, 2017.
"Density Forecasts With Midas Models,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(4), pages 783-801, June.
- Knut Are Aastveit & Claudia Foroni & Francesco Ravazzolo, 2014. "Density forecasts with MIDAS models," Working Papers No 3/2014, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
- Knut Are Aastveit & Claudia Foroni & Francesco Ravazzolo, 2014. "Density forecasts with MIDAS models," Working Paper 2014/10, Norges Bank.
- Rui Liu, 2019. "Forecasting Bond Risk Premia with Unspanned Macroeconomic Information," Quarterly Journal of Finance (QJF), World Scientific Publishing Co. Pte. Ltd., vol. 9(01), pages 1-62, March.
- João C. Claudio & Katja Heinisch & Oliver Holtemöller, 2020.
"Nowcasting East German GDP growth: a MIDAS approach,"
Empirical Economics, Springer, vol. 58(1), pages 29-54, January.
- Claudio, João C. & Heinisch, Katja & Holtemöller, Oliver, 2019. "Nowcasting East German GDP growth: A MIDAS approach," IWH Discussion Papers 24/2019, Halle Institute for Economic Research (IWH).
- Florian Ziel & Rick Steinert & Sven Husmann, 2015. "Forecasting day ahead electricity spot prices: The impact of the EXAA to other European electricity markets," Papers 1501.00818, arXiv.org, revised Dec 2015.
- Seitz, Franz & Baumann, Ursel & Albuquerque, Bruno, 2015.
"The information content of money and credit for US activity,"
Working Paper Series
1803, European Central Bank.
- Seitz, Franz & Albuquerque, Bruno & Baumann, Ursel, 2015. "The Information Content Of Money And Credit For US Activity," VfS Annual Conference 2015 (Muenster): Economic Development - Theory and Policy 113066, Verein für Socialpolitik / German Economic Association.
- Barbara Rossi, 2013.
"Exchange Rate Predictability,"
Journal of Economic Literature, American Economic Association, vol. 51(4), pages 1063-1119, December.
- Barbara Rossi, 2013. "Exchange Rate Predictability," Working Papers 690, Barcelona School of Economics.
- Barbara Rossi, 2013. "Exchange rate predictability," Economics Working Papers 1369, Department of Economics and Business, Universitat Pompeu Fabra.
- Rossi, Barbara, 2013. "Exchange Rate Predictability," CEPR Discussion Papers 9575, C.E.P.R. Discussion Papers.
- Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022.
"How is machine learning useful for macroeconomic forecasting?,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
- Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2019. "How is Machine Learning Useful for Macroeconomic Forecasting?," CIRANO Working Papers 2019s-22, CIRANO.
- Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stephane Surprenant, 2020. "How is Machine Learning Useful for Macroeconomic Forecasting?," Working Papers 20-01, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management, revised Aug 2020.
- Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & St'ephane Surprenant, 2020. "How is Machine Learning Useful for Macroeconomic Forecasting?," Papers 2008.12477, arXiv.org.
- Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
- Joseph P. Byrne & Dimitris Korobilis & Pinho J. Ribeiro, 2018.
"On The Sources Of Uncertainty In Exchange Rate Predictability,"
International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 59(1), pages 329-357, February.
- Byrne, Joseph P. & Korobilis, Dimitris & Ribeiro, Pinho J., 2014. "On the Sources of Uncertainty in Exchange Rate Predictability," SIRE Discussion Papers 2015-24, Scottish Institute for Research in Economics (SIRE).
- Byrne, Joseph P & Korobilis, Dimitris & Ribeiro, Pinho J, 2014. "On the Sources of Uncertainty in Exchange Rate Predictability," MPRA Paper 58956, University Library of Munich, Germany.
- Joseph P. Byrne & Dimitris Korobilis & Pinho J. Ribeiro, 2014. "On the Sources of Uncertainty in Exchange Rate Predictability," Working Papers 2014_16, Business School - Economics, University of Glasgow.
- Christiane Baumeister & Lutz Kilian, 2015.
"Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach,"
Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 338-351, July.
- Christiane Baumeister & Lutz Kilian, 2013. "Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach," Staff Working Papers 13-28, Bank of Canada.
- Kilian, Lutz & Baumeister, Christiane, 2013. "Forecasting the Real Price of Oil in a Changing World: A Forecast Combination Approach," CEPR Discussion Papers 9569, C.E.P.R. Discussion Papers.
- Baumeister, Christiane & Kilian, Lutz, 2013. "Forecasting the real price of oil in a changing world: A forecast combination approach," CFS Working Paper Series 2013/11, Center for Financial Studies (CFS).
- Nowotarski, Jakub & Weron, Rafał, 2018.
"Recent advances in electricity price forecasting: A review of probabilistic forecasting,"
Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
- Jakub Nowotarski & Rafal Weron, 2016. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," HSC Research Reports HSC/16/07, Hugo Steinhaus Center, Wroclaw University of Technology.
- Gonçalves, Sílvia & McCracken, Michael W. & Perron, Benoit, 2017.
"Tests of equal accuracy for nested models with estimated factors,"
Journal of Econometrics, Elsevier, vol. 198(2), pages 231-252.
- Silvia Goncalves & Michael W. McCracken & Benoit Perron, 2015. "Tests of Equal Accuracy for Nested Models with Estimated Factors," Working Papers 2015-25, Federal Reserve Bank of St. Louis.
- Maciej Kostrzewski & Jadwiga Kostrzewska, 2021. "The Impact of Forecasting Jumps on Forecasting Electricity Prices," Energies, MDPI, vol. 14(2), pages 1-17, January.
- Tim Bollerslev & Benjamin Hood & John Huss & Lasse Heje Pedersen, 2018.
"Risk Everywhere: Modeling and Managing Volatility,"
Review of Financial Studies, Society for Financial Studies, vol. 31(7), pages 2729-2773.
- Pedersen, Lasse Heje & Bollerslev, Tim & Hood, Benjamin & Huss, John, 2018. "Risk Everywhere: Modeling and Managing Volatility," CEPR Discussion Papers 12687, C.E.P.R. Discussion Papers.
- Julien Chevallier & Benoît Sévi, 2013.
"A Fear Index to Predict Oil Futures Returns,"
Working Papers
2013.62, Fondazione Eni Enrico Mattei.
- Julien Chevallier & Benoit Sevi, 2014. "A fear index to predict oil futures returns," Working Papers 2014-333, Department of Research, Ipag Business School.
- Julien, Chevallier & Sévi, Benoît, 2013. "A Fear Index to Predict Oil Futures Returns," Energy: Resources and Markets 156489, Fondazione Eni Enrico Mattei (FEEM).
- Julien Chevallier & Benoît Sévi, 2014. "A fear index to predict oil futures returns," Post-Print hal-01463111, HAL.
- Florian Ziel & Kevin Berk, 2019. "Multivariate Forecasting Evaluation: On Sensitive and Strictly Proper Scoring Rules," Papers 1910.07325, arXiv.org.
- G. Cubadda & S. Grassi & B. Guardabascio, 2022.
"The Time-Varying Multivariate Autoregressive Index Model,"
Papers
2201.07069, arXiv.org.
- Gianluca Cubadda & Stefano Grassi & Barbara Guardabascio, 2024. "The Time-Varying Multivariate Autoregressive Index Model," CEIS Research Paper 571, Tor Vergata University, CEIS, revised 10 Jan 2024.
- Isabel Figuerola‐Ferretti & Alejandro Rodríguez & Eduardo Schwartz, 2021. "Oil price analysts' forecasts," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(9), pages 1351-1374, September.
- Matei Demetrescu & Christoph Hanck & Robinson Kruse, 2016. "Fixed-b Inference in the Presence of Time-Varying Volatility," CREATES Research Papers 2016-01, Department of Economics and Business Economics, Aarhus University.
More about this item
Keywords
Pseudo-out-of-sample tests; Over-fitting; Data mining; FWER; False discovery rate;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:38:y:2022:i:3:p:872-877. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.