IDEAS home Printed from https://ideas.repec.org/p/bkr/wpaper/wps70.html
   My bibliography  Save this paper

Forecasting Russian Cpi With Data Vintages And Machine Learning Techniques

Author

Listed:
  • Denis Shibitov

    (Bank of Russia, Russian Federation)

  • Mariam Mamedli

    (Bank of Russia, Russian Federation)

Abstract

We show, how the forecasting performance of models varies, when certain inaccuracies in the pseudo real-time experiment take place. We consider the case of Russian CPI forecasting and estimate several models on not seasonally adjusted data vintages. Particular attention is paid to the availability of the variables at the moment of forecast: we take into account the release timing of the series and the corresponding release delays, in order to reconstruct the forecasting in real-time. In the series of experiments, we quantify how each of these issues affect the out-of-sample error. We illustrate, that the neglect of the release timing generally lowers the errors. The same is true for the use of seasonally adjusted data. The impact of the data vintages depends on the model and forecasting period. The overall effect of all three inaccuracies varies from 8% to 17% depending on the forecasting horizon. This means, that the actual forecasting error can be significantly underestimated, when inaccurate pseudo real-time experiment is run. We underline the need to take these aspects into account, when the real-time forecasting is considered.

Suggested Citation

  • Denis Shibitov & Mariam Mamedli, 2021. "Forecasting Russian Cpi With Data Vintages And Machine Learning Techniques," Bank of Russia Working Paper Series wps70, Bank of Russia.
  • Handle: RePEc:bkr:wpaper:wps70
    as

    Download full text from publisher

    File URL: http://cbr.ru/StaticHtml/File/120016/wp-apr21_e.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Orphanides, Athanasios & van Norden, Simon, 2005. "The Reliability of Inflation Forecasts Based on Output Gap Estimates in Real Time," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 583-601, June.
    2. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    3. Ivan Baybuza, 2018. "Inflation Forecasting Using Machine Learning Methods," Russian Journal of Money and Finance, Bank of Russia, vol. 77(4), pages 42-59, December.
    4. Blanchard, Olivier Jean & Quah, Danny, 1989. "The Dynamic Effects of Aggregate Demand and Supply Disturbances," American Economic Review, American Economic Association, vol. 79(4), pages 655-673, September.
    5. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    6. Hall, Robert E, 1978. "Stochastic Implications of the Life Cycle-Permanent Income Hypothesis: Theory and Evidence," Journal of Political Economy, University of Chicago Press, vol. 86(6), pages 971-987, December.
    7. Stephan Sauer & Jan‐Egbert Sturm, 2007. "Using Taylor Rules to Understand European Central Bank Monetary Policy," German Economic Review, Verein für Socialpolitik, vol. 8(3), pages 375-398, August.
    8. Evan F. Koenig & Sheila Dolmas & Jeremy Piger, 2003. "The Use and Abuse of Real-Time Data in Economic Forecasting," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 618-628, August.
    9. Mr. Andrew J Tiffin, 2016. "Seeing in the Dark: A Machine-Learning Approach to Nowcasting in Lebanon," IMF Working Papers 2016/056, International Monetary Fund.
    10. Chakraborty, Chiranjit & Joseph, Andreas, 2017. "Machine learning at central banks," Bank of England working papers 674, Bank of England.
    11. Rossi, Barbara & Sekhposyan, Tatevik, 2010. "Have economic models' forecasting performance for US output growth and inflation changed over time, and when?," International Journal of Forecasting, Elsevier, vol. 26(4), pages 808-835, October.
    12. Domenico Giannone & Jérôme Henry & Magdalena Lalik & Michele Modugno, 2012. "An Area-Wide Real-Time Database for the Euro Area," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1000-1013, November.
    13. Stark, Tom & Croushore, Dean, 2002. "Forecasting with a real-time data set for macroeconomists," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 507-531, December.
    14. Marcos Álvarez-Díaz & Rangan Gupta, 2015. "Forecasting the US CPI: Does Nonlinearity Matter?," Working Papers 201512, University of Pretoria, Department of Economics.
    15. Croushore, Dean & Stark, Tom, 2001. "A real-time data set for macroeconomists," Journal of Econometrics, Elsevier, vol. 105(1), pages 111-130, November.
    16. George Kapetanios & Fotis Papailias, 2018. "Big Data & Macroeconomic Nowcasting: Methodological Review," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2018-12, Economic Statistics Centre of Excellence (ESCoE).
    17. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    18. Dean Croushore, 2011. "Frontiers of Real-Time Data Analysis," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 72-100, March.
    19. Dean Croushore & Tom Stark, 2003. "A Real-Time Data Set for Macroeconomists: Does the Data Vintage Matter?," The Review of Economics and Statistics, MIT Press, vol. 85(3), pages 605-617, August.
    20. Muhammad Nadim Hanif & Khurrum S. Mughal & Javed Iqbal, 2018. "A Thick ANN Model for Forecasting Inflation," SBP Working Paper Series 99, State Bank of Pakistan, Research Department.
    21. M. Ali Choudhary & Adnan Haider, 2012. "Neural network models for inflation forecasting: an appraisal," Applied Economics, Taylor & Francis Journals, vol. 44(20), pages 2631-2635, July.
    22. Adriana Fernandez & Evan F. Koenig & Alex Nikolsko-Rzhevskyy, 2011. "A real-time historical database for the OECD," Globalization Institute Working Papers 96, Federal Reserve Bank of Dallas.
    23. McAdam, Peter & McNelis, Paul, 2005. "Forecasting inflation with thick models and neural networks," Economic Modelling, Elsevier, vol. 22(5), pages 848-867, September.
    24. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    25. Athanasios Orphanides, 2001. "Monetary Policy Rules Based on Real-Time Data," American Economic Review, American Economic Association, vol. 91(4), pages 964-985, September.
    26. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    27. Buchen, Teresa & Wohlrabe, Klaus, 2011. "Forecasting with many predictors: Is boosting a viable alternative?," Economics Letters, Elsevier, vol. 113(1), pages 16-18, October.
    28. Michael P. Clements & Ana Beatriz Galvao, 2009. "Forecasting US output growth using leading indicators: an appraisal using MIDAS models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(7), pages 1187-1206.
    29. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    30. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    31. Jens Richard Clausen & Carsten-Patrick Meier, 2005. "Did the Bundesbank Follow a Taylor Rule? An Analysis Based on Real-Time Data," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 141(II), pages 213-246, June.
    32. Tatevik Sekhposyan & Barbara Rossi, 2008. "Has modelsí forecasting performance for US output growth and inflation changed over time, and when?," Working Papers 09-02, Duke University, Department of Economics.
    33. Michael H. Breitner & Christian Dunis & Hans-Jörg Mettenheim & Christopher Neely & Georgios Sermpinis & Georgios Sermpinis & Charalampos Stasinakis & Konstantinos Theofilatos & Andreas Karathanasopoul, 2014. "Inflation and Unemployment Forecasting with Genetic Support Vector Regression," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(6), pages 471-487, September.
    34. Döpke, Jörg & Fritsche, Ulrich & Pierdzioch, Christian, 2017. "Predicting recessions with boosted regression trees," International Journal of Forecasting, Elsevier, vol. 33(4), pages 745-759.
    35. Finn E. Kydland & Edward C. Prescott, 1990. "Business cycles: real facts and a monetary myth," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 14(Spr), pages 3-18.
    36. Thomas R. Cook & Aaron Smalter Hall, 2017. "Macroeconomic Indicator Forecasting with Deep Neural Networks," Research Working Paper RWP 17-11, Federal Reserve Bank of Kansas City.
    37. Clements, Michael P. & Galvão, Ana Beatriz, 2013. "Forecasting with vector autoregressive models of data vintages: US output growth and inflation," International Journal of Forecasting, Elsevier, vol. 29(4), pages 698-714.
    38. James H. Stock & Mark W.Watson, 2003. "Forecasting Output and Inflation: The Role of Asset Prices," Journal of Economic Literature, American Economic Association, vol. 41(3), pages 788-829, September.
    39. Ramis Khbaibullin & Sergei Seleznev, 2020. "Stochastic Gradient Variational Bayes and Normalizing Flows for Estimating Macroeconomic Models," Bank of Russia Working Paper Series wps61, Bank of Russia.
    40. Stephan Sauer & Jan‐Egbert Sturm, 2007. "Using Taylor Rules to Understand European Central Bank Monetary Policy," German Economic Review, Verein für Socialpolitik, vol. 8(3), pages 375-398, August.
    41. repec:taf:jnlbes:v:30:y:2012:i:2:p:181-190 is not listed on IDEAS
    42. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    43. Konstantin Styrin, 2019. "Forecasting Inflation in Russia Using Dynamic Model Averaging," Russian Journal of Money and Finance, Bank of Russia, vol. 78(1), pages 3-18, March.
    44. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    45. Anders Bredahl Kock & Timo Teräsvirta, 2013. "Forecasting the Finnish Consumer Price Inflation Using Artificial Neural Network Models and Three Automated Model Selection Techniques," Finnish Economic Papers, Finnish Economic Association, vol. 26(1), pages 13-24, Spring.
    46. Andrew J. Filardo, 1999. "How reliable are recession prediction models?," Economic Review, Federal Reserve Bank of Kansas City, vol. 84(Q II), pages 35-55.
    47. Trivellato, Ugo & Rettore, Enrico, 1986. "Preliminary Data Errors and Their Impact on the Forecast Error of Simultaneous-Equations Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(4), pages 445-453, October.
    48. M. Ali Choudhary & Adnan Haider, 2012. "Neural network models for inflation forecasting: an appraisal," Applied Economics, Taylor & Francis Journals, vol. 44(20), pages 2631-2635, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rusnák, Marek, 2016. "Nowcasting Czech GDP in real time," Economic Modelling, Elsevier, vol. 54(C), pages 26-39.
    2. Andrejs Bessonovs, 2015. "Suite of Latvia's GDP forecasting models," Working Papers 2015/01, Latvijas Banka.
    3. Clements, Michael P. & Beatriz Galvão, Ana, 2010. "First announcements and real economic activity," European Economic Review, Elsevier, vol. 54(6), pages 803-817, August.
    4. Smeekes, Stephan & Wijler, Etienne, 2018. "Macroeconomic forecasting using penalized regression methods," International Journal of Forecasting, Elsevier, vol. 34(3), pages 408-430.
    5. Liebermann, Joelle, 2012. "Real-time forecasting in a data-rich environment," MPRA Paper 39452, University Library of Munich, Germany.
    6. Croushore, Dean & Evans, Charles L., 2006. "Data revisions and the identification of monetary policy shocks," Journal of Monetary Economics, Elsevier, vol. 53(6), pages 1135-1160, September.
    7. Aastveit, Knut Are & Trovik, Tørres, 2014. "Estimating the output gap in real time: A factor model approach," The Quarterly Review of Economics and Finance, Elsevier, vol. 54(2), pages 180-193.
    8. Adriana Fernandez & Evan F. Koenig & Alex Nikolsko-Rzhevskyy, 2011. "A real-time historical database for the OECD," Globalization Institute Working Papers 96, Federal Reserve Bank of Dallas.
    9. Dean Croushore, 2011. "Frontiers of Real-Time Data Analysis," Journal of Economic Literature, American Economic Association, vol. 49(1), pages 72-100, March.
    10. Barbara Rossi, 2019. "Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them," Economics Working Papers 1711, Department of Economics and Business, Universitat Pompeu Fabra.
    11. Michael P. Clements, 2017. "Assessing Macro Uncertainty in Real-Time When Data Are Subject To Revision," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(3), pages 420-433, July.
    12. Gregory E. Givens, 2017. "Do Data Revisions Matter for DSGE Estimation?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 49(6), pages 1385-1407, September.
    13. Dean Croushore & Tom Stark, 2002. "Is macroeconomic research robust to alternative data sets?," Working Papers 02-3, Federal Reserve Bank of Philadelphia.
    14. Clements, Michael P. & Galvao, Ana Beatriz, 2006. "Macroeconomic Forecasting with Mixed Frequency Data: Forecasting US output growth and inflation," Economic Research Papers 269743, University of Warwick - Department of Economics.
    15. Emilia Tomczyk, 2013. "End of sample vs. real time data: perspectives for analysis of expectations," Working Papers 68, Department of Applied Econometrics, Warsaw School of Economics.
    16. Rachidi Kotchoni & Maxime Leroux & Dalibor Stevanovic, 2019. "Macroeconomic forecast accuracy in a data‐rich environment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(7), pages 1050-1072, November.
    17. Clements, Michael P. & Beatriz Galvao, Ana, 2010. "Real-time Forecasting of Inflation and Output Growth in the Presence of Data Revisions," Economic Research Papers 270771, University of Warwick - Department of Economics.
    18. Gupta, Rangan & Kabundi, Alain & Miller, Stephen M., 2011. "Forecasting the US real house price index: Structural and non-structural models with and without fundamentals," Economic Modelling, Elsevier, vol. 28(4), pages 2013-2021, July.
    19. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2020. "Macroeconomic Data Transformations Matter," CIRANO Working Papers 2020s-42, CIRANO.
    20. Clements Michael P., 2012. "Forecasting U.S. Output Growth with Non-Linear Models in the Presence of Data Uncertainty," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 16(1), pages 1-27, January.

    More about this item

    Keywords

    inflation; pseudo real-time forecasting; data vintages; machine learning; neural networks.;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bkr:wpaper:wps70. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/cbrgvru.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: BoR Research (email available below). General contact details of provider: https://edirc.repec.org/data/cbrgvru.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.