IDEAS home Printed from https://ideas.repec.org/a/ioe/cuadec/v50y2013i1p133-161.html
   My bibliography  Save this article

How informative are in-sample information criteria to forecasting? The case of Chilean GDP

Author

Listed:
  • Carlos A. Medel

Abstract

This paper compares out-of-sample performance, using the Chilean GDP dataset, of a large number of autoregressive integrated moving average (ARIMA) models with some variations to identify how to achieve the smallest root mean squared forecast error with models based on information criteria--Akaike, Schwarz, and Hannan-Quinn. The analysis also addresses the role of seasonal adjustment and the Easter effect. The results show that Akaike and Schwarz are better criteria for forecasting when using actual series and Schwarz and Hannan-Quinn are better with seasonally adjusted data. Accounting for the Easter effect improves forecast accuracy for actual and seasonally adjusted data.

Suggested Citation

  • Carlos A. Medel, 2013. "How informative are in-sample information criteria to forecasting? The case of Chilean GDP," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 50(1), pages 133-161, May.
    • Handle: RePEc:ioe:cuadec:v:50:y:2013:i:1:p:133-161
    as

    Download full text from publisher

    File URL: http://www.economia.uc.cl/docs/107764_laje_501133.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    2. Clive W. J. Granger, 1979. "Seasonality: Causation, Interpretation, and Implications," NBER Chapters, in: Seasonal Analysis of Economic Time Series, pages 33-56, National Bureau of Economic Research, Inc.
    3. Todd E. Clark, 2004. "Can out-of-sample forecast comparisons help prevent overfitting?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 23(2), pages 115-139.
    4. Helmut Lütkepohl, 1985. "Comparison Of Criteria For Estimating The Order Of A Vector Autoregressive Process," Journal of Time Series Analysis, Wiley Blackwell, vol. 6(1), pages 35-52, January.
    5. Clive Granger & Yongil Jeon, 2004. "Forecasting Performance of Information Criteria with Many Macro Series," Journal of Applied Statistics, Taylor & Francis Journals, vol. 31(10), pages 1227-1240.
    6. Hyndman, Rob J. & Ahmed, Roman A. & Athanasopoulos, George & Shang, Han Lin, 2011. "Optimal combination forecasts for hierarchical time series," Computational Statistics & Data Analysis, Elsevier, vol. 55(9), pages 2579-2589, September.
    7. Hansen, Peter Reinhard, 2005. "A Test for Superior Predictive Ability," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 365-380, October.
    8. Findley, David F, et al, 1998. "New Capabilities and Methods of the X-12-ARIMA Seasonal-Adjustment Program," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 127-152, April.
    9. Capistrán, Carlos & Constandse, Christian & Ramos-Francia, Manuel, 2010. "Multi-horizon inflation forecasts using disaggregated data," Economic Modelling, Elsevier, vol. 27(3), pages 666-677, May.
    10. Melard, G. & Pasteels, J. -M., 2000. "Automatic ARIMA modeling including interventions, using time series expert software," International Journal of Forecasting, Elsevier, vol. 16(4), pages 497-508.
    11. Pablo Pincheira Brown & Álvaro García Marín, 2009. "Forecasting Inflation in Chile With an Accurate Benchmark," Working Papers Central Bank of Chile 514, Central Bank of Chile.
    12. Clements, Michael P. & Beatriz Galvao, Ana, 2010. "Real-time Forecasting of Inflation and Output Growth in the Presence of Data Revisions," Economic Research Papers 270771, University of Warwick - Department of Economics.
    13. Pincheira, Pablo, 2013. "A Bunch of Models, a Bunch of Nulls and Inference about Predictive Ability," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(3), pages 26-43, October.
    14. Marcus Cobb, 2009. "Forecasting Chilean Inflation From Disaggregate Components," Working Papers Central Bank of Chile 545, Central Bank of Chile.
    15. Anne B. Koehler & Emily S. Murphree, 1988. "A Comparison of the Akaike and Schwarz Criteria for Selecting Model Order," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 37(2), pages 187-195, June.
    16. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    17. Dickey, David A & Pantula, Sastry G, 1987. "Determining the Ordering of Differencing in Autoregressive Processes," Journal of Business & Economic Statistics, American Statistical Association, vol. 5(4), pages 455-461, October.
    18. Marcus Cobb C. & Carlos A. Medel V., 2010. "Una Estimación del Impacto del Efecto Calendario en Series Desestacionalizadas Chilenas de Actividad y Demanda," Notas de Investigación Journal Economía Chilena (The Chilean Economy), Central Bank of Chile, vol. 13(3), pages 95-103, December.
    19. Carlos Medel & Marcela Urrutia, 2010. "Proyección Agregada y Desagregada del PIB Chileno con Procedimientos Automatizados de Series de Tiempo," Working Papers Central Bank of Chile 577, Central Bank of Chile.
    20. Halbert White, 2000. "A Reality Check for Data Snooping," Econometrica, Econometric Society, vol. 68(5), pages 1097-1126, September.
    21. Ghysels, Eric & Osborn, Denise R. & Rodrigues, Paulo M.M., 2006. "Forecasting Seasonal Time Series," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 13, pages 659-711, Elsevier.
    22. Guy Melard & Jean-Michel Pasteels, 2000. "Automatic ARIMA modeling including interventions, using time series expert software," ULB Institutional Repository 2013/13744, ULB -- Universite Libre de Bruxelles.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Carlos Medel, 2012. "¿Akaike o Schwarz? ¿Cuál elegir para Predecir el PIB Chileno?," Working Papers Central Bank of Chile 658, Central Bank of Chile.
    2. Javier Pereda, 2011. "Estimación de la tasa natural de interés para Perú: un enfoque financiero," Monetaria, CEMLA, vol. 0(4), pages 429-459, octubre-d.
    3. Carlos A. Medel, 2018. "A Comparison Between Direct and Indirect Seasonal Adjustment of the Chilean GDP 1986–2009 with X-12-ARIMA," Journal of Business Cycle Research, Springer;Centre for International Research on Economic Tendency Surveys (CIRET), vol. 14(1), pages 47-87, April.
    4. Carlos A. Medel, 2015. "Probabilidad Clásica de Sobreajuste con Criterios de Información: Estimaciones con Series Macroeconómicas Chilenas," Revista de Analisis Economico – Economic Analysis Review, Universidad Alberto Hurtado/School of Economics and Business, vol. 30(1), pages 57-72, Abril.
    5. Carlos A. Medel Vera, 2011. "¿Akaike o Schwarz? ¿Cuál utilizar para predecir el PIB chileno?," Monetaria, CEMLA, vol. 0(4), pages 591-615, octubre-d.
    6. Daniel Fernández, 2011. "Suficiencia del capital y previsiones de la banca uruguaya por su exposición al sector industrial," Monetaria, CEMLA, vol. 0(4), pages 517-589, octubre-d.
    7. Massimiliano Giacalone & Raffaele Mattera & Eugenia Nissi, 2020. "Economic indicators forecasting in presence of seasonal patterns: time series revision and prediction accuracy," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(1), pages 67-84, February.
    8. Tamara Burdisso & Eduardo Ariel Corso, 2011. "Incertidumbre y dolarización de cartera: el caso argentino en el último medio siglo," Monetaria, CEMLA, vol. 0(4), pages 461-515, octubre-d.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlos Medel, 2012. "¿Akaike o Schwarz? ¿Cuál elegir para Predecir el PIB Chileno?," Working Papers Central Bank of Chile 658, Central Bank of Chile.
    2. Daniel Fernández, 2011. "Suficiencia del capital y previsiones de la banca uruguaya por su exposición al sector industrial," Monetaria, CEMLA, vol. 0(4), pages 517-589, octubre-d.
    3. Javier Pereda, 2011. "Estimación de la tasa natural de interés para Perú: un enfoque financiero," Monetaria, CEMLA, vol. 0(4), pages 429-459, octubre-d.
    4. Tamara Burdisso & Eduardo Ariel Corso, 2011. "Incertidumbre y dolarización de cartera: el caso argentino en el último medio siglo," Monetaria, CEMLA, vol. 0(4), pages 461-515, octubre-d.
    5. Carlos A. Medel Vera, 2011. "¿Akaike o Schwarz? ¿Cuál utilizar para predecir el PIB chileno?," Monetaria, CEMLA, vol. 0(4), pages 591-615, octubre-d.
    6. Carlos A. Medel & Sergio C. Salgado, 2013. "Does the Bic Estimate and Forecast Better than the Aic?," Revista de Analisis Economico – Economic Analysis Review, Universidad Alberto Hurtado/School of Economics and Business, vol. 28(1), pages 47-64, April.
    7. Carlos Medel, 2017. "Forecasting Chilean inflation with the hybrid new keynesian Phillips curve: globalisation, combination, and accuracy," Journal Economía Chilena (The Chilean Economy), Central Bank of Chile, vol. 20(3), pages 004-050, December.
    8. Carlos A. Medel, 2018. "Forecasting Inflation with the Hybrid New Keynesian Phillips Curve: A Compact-Scale Global VAR Approach," International Economic Journal, Taylor & Francis Journals, vol. 32(3), pages 331-371, July.
    9. Clark, Todd & McCracken, Michael, 2013. "Advances in Forecast Evaluation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1107-1201, Elsevier.
    10. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    11. Drechsel, Katja & Scheufele, Rolf, 2012. "The performance of short-term forecasts of the German economy before and during the 2008/2009 recession," International Journal of Forecasting, Elsevier, vol. 28(2), pages 428-445.
    12. Drechsel, Katja & Scheufele, Rolf, 2010. "Should We Trust in Leading Indicators? Evidence from the Recent Recession," IWH Discussion Papers 10/2010, Halle Institute for Economic Research (IWH).
    13. Carlos A. Medel, 2015. "Probabilidad Clásica de Sobreajuste con Criterios de Información: Estimaciones con Series Macroeconómicas Chilenas," Revista de Analisis Economico – Economic Analysis Review, Universidad Alberto Hurtado/School of Economics and Business, vol. 30(1), pages 57-72, Abril.
    14. Hubert Dichtl, 2020. "Investing in the S&P 500 index: Can anything beat the buy‐and‐hold strategy?," Review of Financial Economics, John Wiley & Sons, vol. 38(2), pages 352-378, April.
    15. Pablo M. Pincheira & Carlos A. Medel, 2015. "Forecasting Inflation with a Simple and Accurate Benchmark: The Case of the US and a Set of Inflation Targeting Countries," Czech Journal of Economics and Finance (Finance a uver), Charles University Prague, Faculty of Social Sciences, vol. 65(1), pages 2-29, January.
    16. Raffaella Giacomini & Barbara Rossi, 2013. "Forecasting in macroeconomics," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 17, pages 381-408, Edward Elgar Publishing.
    17. Busetti, Fabio & Marcucci, Juri, 2013. "Comparing forecast accuracy: A Monte Carlo investigation," International Journal of Forecasting, Elsevier, vol. 29(1), pages 13-27.
    18. Li, Jia & Patton, Andrew J., 2018. "Asymptotic inference about predictive accuracy using high frequency data," Journal of Econometrics, Elsevier, vol. 203(2), pages 223-240.
    19. Carlos Medel, 2021. "Forecasting Brazilian Inflation with the Hybrid New Keynesian Phillips Curve: Assessing the Predictive Role of Trading Partners," Working Papers Central Bank of Chile 900, Central Bank of Chile.
    20. Granziera, Eleonora & Hubrich, Kirstin & Moon, Hyungsik Roger, 2014. "A predictability test for a small number of nested models," Journal of Econometrics, Elsevier, vol. 182(1), pages 174-185.

    More about this item

    Keywords

    Data mining; forecasting; ARIMA; seasonal adjustment; Easter effect;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ioe:cuadec:v:50:y:2013:i:1:p:133-161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Jaime Casassus (email available below). General contact details of provider: https://edirc.repec.org/data/iepuccl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.