IDEAS home Printed from https://ideas.repec.org/p/aah/create/2012-37.html
   My bibliography  Save this paper

Estimating High-Dimensional Time Series Models

Author

Listed:
  • Marcelo C. Medeiros

    (Pontifical Catholic University of Rio de Janeiro)

  • Eduardo F. Mendes

    (Pontifical Catholic University of Rio de Janeiro)

Abstract

We study the asymptotic properties of the Adaptive LASSO (adaLASSO) in sparse, high-dimensional, linear time-series models. We assume both the number of covariates in the model and candidate variables can increase with the number of observations and the number of candidate variables is, possibly, larger than the number of observations. We show the adaLASSO consistently chooses the relevant variables as the number of observations increases (model selection consistency), and has the oracle property, even when the errors are non-Gaussian and conditionally heteroskedastic. A simulation study shows the method performs well in very general settings. Finally, we consider two applications: in the first one the goal is to forecast quarterly US inflation one-step ahead, and in the second we are interested in the excess return of the S&P 500 index. The method used outperforms the usual benchmarks in the literature.

Suggested Citation

  • Marcelo C. Medeiros & Eduardo F. Mendes, 2012. "Estimating High-Dimensional Time Series Models," CREATES Research Papers 2012-37, Department of Economics and Business Economics, Aarhus University.
    • Handle: RePEc:aah:create:2012-37
    as

    Download full text from publisher

    File URL: https://repec.econ.au.dk/repec/creates/rp/12/rp12_37.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Rech, Gianluigi & Teräsvirta, Timo & Tschernig, Rolf, 1999. "A simple variable selection technique for nonlinear models," SSE/EFI Working Paper Series in Economics and Finance 296, Stockholm School of Economics, revised 06 Apr 2000.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    4. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    5. Issler, João Victor & Lima, Luiz Renato, 2009. "A panel data approach to economic forecasting: The bias-corrected average forecast," Journal of Econometrics, Elsevier, vol. 152(2), pages 153-164, October.
    6. Ferreira, Miguel A. & Santa-Clara, Pedro, 2011. "Forecasting stock market returns: The sum of the parts is more than the whole," Journal of Financial Economics, Elsevier, vol. 100(3), pages 514-537, June.
    7. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    8. Kock, Anders Bredahl & Callot, Laurent, 2015. "Oracle inequalities for high dimensional vector autoregressions," Journal of Econometrics, Elsevier, vol. 186(2), pages 325-344.
    9. Song Song & Peter J. Bickel, 2011. "Large Vector Auto Regressions," Papers 1106.3915, arXiv.org.
    10. Eric Hillebrand & Tae-Hwy Lee & Marcelo C. Medeiros, 2012. "Let's Do It Again: Bagging Equity Premium Predictors," CREATES Research Papers 2012-41, Department of Economics and Business Economics, Aarhus University.
    11. Nardi, Y. & Rinaldo, A., 2011. "Autoregressive process modeling via the Lasso procedure," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 528-549, March.
    12. Hsu, Nan-Jung & Hung, Hung-Lin & Chang, Ya-Mei, 2008. "Subset selection for vector autoregressive processes using Lasso," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3645-3657, March.
    13. Hansheng Wang & Guodong Li & Chih‐Ling Tsai, 2007. "Regression coefficient and autoregressive order shrinkage and selection via the lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(1), pages 63-78, February.
    14. Zhang, Yiyun & Li, Runze & Tsai, Chih-Ling, 2010. "Regularization Parameter Selections via Generalized Information Criterion," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 312-323.
    15. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ziel, Florian, 2016. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR–ARCH type processes," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 773-793.
    2. Matteo Barigozzi & Christian Brownlees, 2019. "NETS: Network estimation for time series," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(3), pages 347-364, April.
    3. Matteo Barigozzi & Marc Hallin, 2015. "Networks, Dynamic Factors, and the Volatility Analysis of High-Dimensional Financial Series," Papers 1510.05118, arXiv.org, revised Jul 2016.
    4. Baek, Changryong & Davis, Richard A. & Pipiras, Vladas, 2017. "Sparse seasonal and periodic vector autoregressive modeling," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 103-126.
    5. Kascha, Christian & Trenkler, Carsten, 2015. "Forecasting VARs, model selection, and shrinkage," Working Papers 15-07, University of Mannheim, Department of Economics.
    6. Camila Epprecht & Dominique Guegan & Álvaro Veiga & Joel Correa da Rosa, 2017. "Variable selection and forecasting via automated methods for linear models: LASSO/adaLASSO and Autometrics," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00917797, HAL.
    7. Francesco Audrino & Simon D. Knaus, 2016. "Lassoing the HAR Model: A Model Selection Perspective on Realized Volatility Dynamics," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1485-1521, December.
    8. Daniel Felix Ahelegbey & Monica Billio & Roberto Casarin, 2016. "Sparse Graphical Vector Autoregression: A Bayesian Approach," Annals of Economics and Statistics, GENES, issue 123-124, pages 333-361.
    9. Audrino, Francesco & Camponovo, Lorenzo & Roth, Constantin, 2015. "Testing the lag structure of assets’ realized volatility dynamics," Economics Working Paper Series 1501, University of St. Gallen, School of Economics and Political Science.
    10. Monbet, Valérie & Ailliot, Pierre, 2017. "Sparse vector Markov switching autoregressive models. Application to multivariate time series of temperature," Computational Statistics & Data Analysis, Elsevier, vol. 108(C), pages 40-51.
    11. Camila Epprecht & Dominique Guegan & Álvaro Veiga, 2013. "Comparing variable selection techniques for linear regression: LASSO and Autometrics," Documents de travail du Centre d'Economie de la Sorbonne 13080, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    12. Anders Bredahl Kock & Timo Teräsvirta, 2016. "Forecasting Macroeconomic Variables Using Neural Network Models and Three Automated Model Selection Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1753-1779, December.
    13. Simone Tonini & Francesca Chiaromonte & Alessandro Giovannelli, 2022. "On the impact of serial dependence on penalized regression methods," LEM Papers Series 2022/21, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    14. Audrino, Francesco & Camponovo, Lorenzo, 2013. "Oracle Properties and Finite Sample Inference of the Adaptive Lasso for Time Series Regression Models," Economics Working Paper Series 1327, University of St. Gallen, School of Economics and Political Science.
    15. Florian Ziel, 2015. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR-ARCH type processes," Papers 1502.06557, arXiv.org, revised Dec 2015.
    16. Hamed Haselimashhadi & Veronica Vinciotti, 2018. "Penalised inference for lagged dependent regression in the presence of autocorrelated residuals," METRON, Springer;Sapienza Università di Roma, vol. 76(1), pages 49-68, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Medeiros, Marcelo C. & Mendes, Eduardo F., 2016. "ℓ1-regularization of high-dimensional time-series models with non-Gaussian and heteroskedastic errors," Journal of Econometrics, Elsevier, vol. 191(1), pages 255-271.
    2. Marcelo C. Medeiros & Eduardo F. Mendes, 2015. "l1-Regularization of High-Dimensional Time-Series Models with Flexible Innovations," Textos para discussão 636, Department of Economics PUC-Rio (Brazil).
    3. Audrino, Francesco & Camponovo, Lorenzo, 2013. "Oracle Properties and Finite Sample Inference of the Adaptive Lasso for Time Series Regression Models," Economics Working Paper Series 1327, University of St. Gallen, School of Economics and Political Science.
    4. Marcelo C. Medeiros & Eduardo F. Mendes, 2017. "Adaptive LASSO estimation for ARDL models with GARCH innovations," Econometric Reviews, Taylor & Francis Journals, vol. 36(6-9), pages 622-637, October.
    5. Smeekes, Stephan & Wijler, Etienne, 2018. "Macroeconomic forecasting using penalized regression methods," International Journal of Forecasting, Elsevier, vol. 34(3), pages 408-430.
    6. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    7. Adamek, Robert & Smeekes, Stephan & Wilms, Ines, 2023. "Lasso inference for high-dimensional time series," Journal of Econometrics, Elsevier, vol. 235(2), pages 1114-1143.
    8. Kock, Anders Bredahl & Callot, Laurent, 2015. "Oracle inequalities for high dimensional vector autoregressions," Journal of Econometrics, Elsevier, vol. 186(2), pages 325-344.
    9. Kascha, Christian & Trenkler, Carsten, 2015. "Forecasting VARs, model selection, and shrinkage," Working Papers 15-07, University of Mannheim, Department of Economics.
    10. Li, Jiahan & Chen, Weiye, 2014. "Forecasting macroeconomic time series: LASSO-based approaches and their forecast combinations with dynamic factor models," International Journal of Forecasting, Elsevier, vol. 30(4), pages 996-1015.
    11. Lenka Zbonakova & Wolfgang Karl Härdle & Weining Wang, 2016. "Time Varying Quantile Lasso," SFB 649 Discussion Papers SFB649DP2016-047, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    12. repec:ipg:wpaper:2013-020 is not listed on IDEAS
    13. Lee, Ji Hyung & Shi, Zhentao & Gao, Zhan, 2022. "On LASSO for predictive regression," Journal of Econometrics, Elsevier, vol. 229(2), pages 322-349.
    14. Gupta, Rangan & Hammoudeh, Shawkat & Modise, Mampho P. & Nguyen, Duc Khuong, 2014. "Can economic uncertainty, financial stress and consumer sentiments predict U.S. equity premium?," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 33(C), pages 367-378.
    15. Florian Ziel, 2015. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR-ARCH type processes," Papers 1502.06557, arXiv.org, revised Dec 2015.
    16. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    17. Ziel, Florian, 2016. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR–ARCH type processes," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 773-793.
    18. Sander Barendse, 2023. "Expected Shortfall LASSO," Papers 2307.01033, arXiv.org, revised Jan 2024.
    19. Hamed Haselimashhadi & Veronica Vinciotti, 2018. "Penalised inference for lagged dependent regression in the presence of autocorrelated residuals," METRON, Springer;Sapienza Università di Roma, vol. 76(1), pages 49-68, April.
    20. repec:ipg:wpaper:20 is not listed on IDEAS
    21. Zbonakova, L. & Härdle, W.K. & Wang, W., 2016. "Time Varying Quantile Lasso," Working Papers 16/07, Department of Economics, City University London.
    22. Papapostolou, Nikos C. & Pouliasis, Panos K. & Nomikos, Nikos K. & Kyriakou, Ioannis, 2016. "Shipping investor sentiment and international stock return predictability," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 96(C), pages 81-94.

    More about this item

    Keywords

    sparse models; shrinkage; LASSO; adaLASSO; time series; forecasting.;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aah:create:2012-37. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: http://www.econ.au.dk/afn/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.