IDEAS home Printed from https://ideas.repec.org/a/sae/niesru/v203y2008i1p109-115.html
   My bibliography  Save this article

A review of forecasting techniques for large datasets

Author

Listed:
  • Jana Eklund

    (Bank of England, jana.eklund@bankofengland.co.uk)

  • George Kapetanios

    (Queen Mary, University of London, g.kapetanios@qmul.ac.uk)

Abstract

This paper aims to provide a brief and relatively non-technical overview of state-of-the-art forecasting with large data sets. We classify existing methods into four groups depending on whether data sets are used wholly or partly, whether a single model or multiple models are used and whether a small subset or the whole data set is being forecast. In particular, we provide brief descriptions of the methods and short recommendations where appropriate, without going into detailed discussions of their merits or demerits.

Suggested Citation

  • Jana Eklund & George Kapetanios, 2008. "A review of forecasting techniques for large datasets," National Institute Economic Review, National Institute of Economic and Social Research, vol. 203(1), pages 109-115, January.
  • Handle: RePEc:sae:niesru:v:203:y:2008:i:1:p:109-115
    as

    Download full text from publisher

    File URL: http://ner.sagepub.com/content/203/1/109.abstract
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kevin D. Hoover & Stephen J. Perez, 1999. "Data mining reconsidered: encompassing and the general-to-specific approach to specification search," Econometrics Journal, Royal Economic Society, vol. 2(2), pages 167-191.
    2. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    3. Marta Bańbura, 2008. "Large Bayesian VARs," 2008 Meeting Papers 334, Society for Economic Dynamics.
    4. George Kapetanios & Massimiliano Marcellino, 2003. "A Comparison of Estimation Methods for Dynamic Factor Models of Large Dimensions," Working Papers 489, Queen Mary University of London, School of Economics and Finance.
    5. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    6. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    7. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2006. "Forecasting using a large number of predictors: is Bayesian regression a valid alternative to principal components?," Discussion Paper Series 1: Economic Studies 2006,32, Deutsche Bundesbank.
    8. Jana Eklund & Sune Karlsson, 2007. "Forecast Combination and Model Averaging Using Predictive Measures," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 329-363.
    9. Andrea Carriero & George Kapetanios & Massimiliano Marcellino, 2007. "Forecasting Large Datasets with Reduced Rank Multivariate Models," Working Papers 617, Queen Mary University of London, School of Economics and Finance.
    10. Fernandez, Carmen & Ley, Eduardo & Steel, Mark F. J., 2001. "Benchmark priors for Bayesian model averaging," Journal of Econometrics, Elsevier, vol. 100(2), pages 381-427, February.
    11. Kapetanios, George & Labhard, Vincent & Price, Simon, 2006. "Forecasting using predictive likelihood model averaging," Economics Letters, Elsevier, vol. 91(3), pages 373-379, June.
    12. Kapetanios, George & Labhard, Vincent & Price, Simon, 2008. "Forecasting Using Bayesian and Information-Theoretic Model Averaging: An Application to U.K. Inflation," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 33-41, January.
    13. Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2000. "The Generalized Dynamic-Factor Model: Identification And Estimation," The Review of Economics and Statistics, MIT Press, vol. 82(4), pages 540-554, November.
    14. Ralf BRUEGGEMANN & Hans-Martin KROLZIG & Helmut LUETKEPOHL, 2002. "Comparison of Model Reduction Methods for VAR Processes," Economics Working Papers ECO2002/19, European University Institute.
    15. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    16. Kapetanios, George, 2007. "Variable selection in regression models using nonstandard optimisation of information criteria," Computational Statistics & Data Analysis, Elsevier, vol. 52(1), pages 4-15, September.
    17. De Mol, Christine & Giannone, Domenico & Reichlin, Lucrezia, 2008. "Forecasting using a large number of predictors: Is Bayesian shrinkage a valid alternative to principal components?," Journal of Econometrics, Elsevier, vol. 146(2), pages 318-328, October.
    18. Hendry, David F., 1995. "Dynamic Econometrics," OUP Catalogue, Oxford University Press, number 9780198283164, Decembrie.
    19. Dorsey, Robert E & Mayer, Walter J, 1995. "Genetic Algorithms for Estimation Problems with Multiple Optima, Nondifferentiability, and Other Irregular Features," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(1), pages 53-66, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alexander Chudik & M. Hashem Pesaran, 2016. "Theory And Practice Of Gvar Modelling," Journal of Economic Surveys, Wiley Blackwell, vol. 30(1), pages 165-197, February.
    2. Klaus Wohlrabe & Teresa Buchen, 2014. "Assessing the Macroeconomic Forecasting Performance of Boosting: Evidence for the United States, the Euro Area and Germany," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(4), pages 231-242, July.
    3. Bell, Venetia & Co, Lai Wah & Stone, Sophie & Wallis, gavin`, 2014. "Nowcasting UK GDP growth," Bank of England Quarterly Bulletin, Bank of England, vol. 54(1), pages 58-68.
    4. Houcine Senoussi, 2021. "Inflation and Inflation Uncertainty in Growth Model of Barro: An Application of Random Forest Method," International Econometric Review (IER), Econometric Research Association, vol. 13(1), pages 4-23, March.
    5. Eirini Konstantinidi & Gkaren Papazian & George Skiadopoulos, 2015. "Modeling the Dynamics of Temperature with a View to Weather Derivatives," World Scientific Book Chapters, in: Anastasios G Malliaris & William T Ziemba (ed.), THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 17, pages 511-544, World Scientific Publishing Co. Pte. Ltd..
    6. Chudik, Alexander & Grossman, Valerie & Pesaran, M. Hashem, 2016. "A multi-country approach to forecasting output growth using PMIs," Journal of Econometrics, Elsevier, vol. 192(2), pages 349-365.
    7. Renbo Liu & Yuhui Ge & Peng Zuo, 2023. "Study on Economic Data Forecasting Based on Hybrid Intelligent Model of Artificial Neural Network Optimized by Harris Hawks Optimization," Mathematics, MDPI, vol. 11(21), pages 1-28, November.
    8. Liu, Philip & Matheson, Troy & Romeu, Rafael, 2012. "Real-time forecasts of economic activity for Latin American economies," Economic Modelling, Elsevier, vol. 29(4), pages 1090-1098.
    9. Karim Barhoumi & Olivier Darné & Laurent Ferrara, 2014. "Dynamic factor models: A review of the literature," OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2013(2), pages 73-107.
    10. Focardi, Sergio M. & Fabozzi, Frank J. & Mitov, Ivan K., 2016. "A new approach to statistical arbitrage: Strategies based on dynamic factor models of prices and their performance," Journal of Banking & Finance, Elsevier, vol. 65(C), pages 134-155.
    11. Wallis, Kenneth F., 2008. "Macroeconomic modelling in central banks in Latin America," Documentos de Proyectos 3627, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eklund, Jana & Kapetanios, George, 2008. "A review of forecasting techniques for large datasets," National Institute Economic Review, Cambridge University Press, vol. 203, pages 109-115, January.
    2. Luciani, Matteo, 2014. "Forecasting with approximate dynamic factor models: The role of non-pervasive shocks," International Journal of Forecasting, Elsevier, vol. 30(1), pages 20-29.
    3. Smeekes, Stephan & Wijler, Etienne, 2018. "Macroeconomic forecasting using penalized regression methods," International Journal of Forecasting, Elsevier, vol. 34(3), pages 408-430.
    4. Helmut Lütkepohl, 2014. "Structural Vector Autoregressive Analysis in a Data Rich Environment: A Survey," Discussion Papers of DIW Berlin 1351, DIW Berlin, German Institute for Economic Research.
    5. Kapetanios, George & Marcellino, Massimiliano & Papailias, Fotis, 2016. "Forecasting inflation and GDP growth using heuristic optimisation of information criteria and variable reduction methods," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 369-382.
    6. Gupta, Rangan & Kabundi, Alain & Miller, Stephen M., 2011. "Forecasting the US real house price index: Structural and non-structural models with and without fundamentals," Economic Modelling, Elsevier, vol. 28(4), pages 2013-2021, July.
    7. George Kapetanios & Massimiliano Marcellino & Fabrizio Venditti, 2019. "Large time‐varying parameter VARs: A nonparametric approach," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(7), pages 1027-1049, November.
    8. Cubadda, Gianluca & Guardabascio, Barbara, 2012. "A medium-N approach to macroeconomic forecasting," Economic Modelling, Elsevier, vol. 29(4), pages 1099-1105.
    9. Chris Bloor & Troy Matheson, 2010. "Analysing shock transmission in a data-rich environment: a large BVAR for New Zealand," Empirical Economics, Springer, vol. 39(2), pages 537-558, October.
    10. Pirschel, Inske & Wolters, Maik, 2014. "Forecasting German key macroeconomic variables using large dataset methods," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100587, Verein für Socialpolitik / German Economic Association.
    11. Henzel, Steffen R. & Mayr, Johannes, 2013. "The mechanics of VAR forecast pooling—A DSGE model based Monte Carlo study," The North American Journal of Economics and Finance, Elsevier, vol. 24(C), pages 1-24.
    12. Inske Pirschel & Maik H. Wolters, 2018. "Forecasting with large datasets: compressing information before, during or after the estimation?," Empirical Economics, Springer, vol. 55(2), pages 573-596, September.
    13. Groen, Jan J.J. & Kapetanios, George, 2016. "Revisiting useful approaches to data-rich macroeconomic forecasting," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 221-239.
    14. Kascha, Christian & Trenkler, Carsten, 2015. "Forecasting VARs, model selection, and shrinkage," Working Papers 15-07, University of Mannheim, Department of Economics.
    15. Bicu, A.C. & Lieb, L.M., 2015. "Cross-border effects of fiscal policy in the Eurozone," Research Memorandum 019, Maastricht University, Graduate School of Business and Economics (GSBE).
    16. Lombardi, Marco J. & Maier, Philipp, 2011. "Forecasting economic growth in the euro area during the Great Moderation and the Great Recession," Working Paper Series 1379, European Central Bank.
    17. George Kapetanios & Fotis Papailias, 2018. "Big Data & Macroeconomic Nowcasting: Methodological Review," Economic Statistics Centre of Excellence (ESCoE) Discussion Papers ESCoE DP-2018-12, Economic Statistics Centre of Excellence (ESCoE).
    18. Rusnák, Marek, 2016. "Nowcasting Czech GDP in real time," Economic Modelling, Elsevier, vol. 54(C), pages 26-39.
    19. Rachidi Kotchoni & Maxime Leroux & Dalibor Stevanovic, 2019. "Macroeconomic forecast accuracy in a data‐rich environment," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(7), pages 1050-1072, November.
    20. Liebermann, Joelle, 2012. "Real-time forecasting in a data-rich environment," MPRA Paper 39452, University Library of Munich, Germany.

    More about this item

    Keywords

    Large datasets; factors; forecast combinations;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:niesru:v:203:y:2008:i:1:p:109-115. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: https://edirc.repec.org/data/niesruk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.