IDEAS home Printed from https://ideas.repec.org/p/rio/texdis/602.html
   My bibliography  Save this paper

Estimating High-Dimensional Time Series Models

Author

Listed:
  • MArcelo C. Medeiros

    () (Department of Economics PUC-Rio)

  • Eduardo F.Mendes

    () (NORTHWESTERN UNIVERSITY)

Abstract

We study the asymptotic properties of the Adaptive LASSO (adaLASSO) in sparse,high-dimensional, linear time-series models. We assume both the number of covariates in the model and candidate variables can increase with the number of observations and the number of candidate variables is, possibly, larger than the number of observations. We show the adaLASSO consistently chooses the relevant variables as the number of observations increases (model selection consistency), and has the oracle property, even when the errors are non-Gaussian and conditionally heteroskedastic. A simulation study shows the method performs well in very general settings. Finally, we consider two applications: in the first one the goal is to forecast quarterlyUS inflation one-step ahead, and in the second we are interested in the excess return of the S&P500 index. The method used outperforms the usual benchmarks in the literature.

Suggested Citation

  • MArcelo C. Medeiros & Eduardo F.Mendes, 2012. "Estimating High-Dimensional Time Series Models," Textos para discussão 602, Department of Economics PUC-Rio (Brazil).
  • Handle: RePEc:rio:texdis:602
    as

    Download full text from publisher

    File URL: http://www.econ.puc-rio.br/pdf/td602.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    2. Bai, Jushan & Ng, Serena, 2008. "Forecasting economic time series using targeted predictors," Journal of Econometrics, Elsevier, vol. 146(2), pages 304-317, October.
    3. Ferreira, Miguel A. & Santa-Clara, Pedro, 2011. "Forecasting stock market returns: The sum of the parts is more than the whole," Journal of Financial Economics, Elsevier, vol. 100(3), pages 514-537, June.
    4. Hsu, Nan-Jung & Hung, Hung-Lin & Chang, Ya-Mei, 2008. "Subset selection for vector autoregressive processes using Lasso," Computational Statistics & Data Analysis, Elsevier, vol. 52(7), pages 3645-3657, March.
    5. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    6. Erik Hillebrand & Tae-Hwy Lee & Marcelo Cunha Medeiros, 2012. "Let´s do it again: bagging equity premium predictors," Textos para discussão 604, Department of Economics PUC-Rio (Brazil).
    7. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    8. Hansheng Wang & Guodong Li & Chih-Ling Tsai, 2007. "Regression coefficient and autoregressive order shrinkage and selection via the lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(1), pages 63-78.
    9. Rech, Gianluigi & Teräsvirta, Timo & Tschernig, Rolf, 1999. "A simple variable selection technique for nonlinear models," SFB 373 Discussion Papers 1999,26, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    10. Kock, Anders Bredahl & Callot, Laurent, 2015. "Oracle inequalities for high dimensional vector autoregressions," Journal of Econometrics, Elsevier, vol. 186(2), pages 325-344.
    11. Issler, João Victor & Lima, Luiz Renato, 2009. "A panel data approach to economic forecasting: The bias-corrected average forecast," Journal of Econometrics, Elsevier, vol. 152(2), pages 153-164, October.
    12. Zhang, Yiyun & Li, Runze & Tsai, Chih-Ling, 2010. "Regularization Parameter Selections via Generalized Information Criterion," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 312-323.
    13. Nardi, Y. & Rinaldo, A., 2011. "Autoregressive process modeling via the Lasso procedure," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 528-549, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Francesco Audrino & Simon D. Knaus, 2016. "Lassoing the HAR Model: A Model Selection Perspective on Realized Volatility Dynamics," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1485-1521, December.
    2. Matteo Barigozzi & Christian Brownlees, 2013. "Nets: Network Estimation for Time Series," Working Papers 723, Barcelona Graduate School of Economics.
    3. Ziel, Florian, 2016. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR–ARCH type processes," Computational Statistics & Data Analysis, Elsevier, vol. 100(C), pages 773-793.
    4. Audrino, Francesco & Camponovo, Lorenzo, 2013. "Oracle Properties and Finite Sample Inference of the Adaptive Lasso for Time Series Regression Models," Economics Working Paper Series 1327, University of St. Gallen, School of Economics and Political Science.
    5. Camila Epprecht & Dominique Guegan & Álvaro Veiga, 2013. "Comparing variable selection techniques for linear regression: LASSO and Autometrics," Documents de travail du Centre d'Economie de la Sorbonne 13080, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    6. Audrino, Francesco & Camponovo, Lorenzo & Roth, Constantin, 2015. "Testing the lag structure of assets’ realized volatility dynamics," Economics Working Paper Series 1501, University of St. Gallen, School of Economics and Political Science.
    7. Camila Epprecht & Dominique Guegan & Álvaro Veiga & Joel Correa da Rosa, 2017. "Variable selection and forecasting via automated methods for linear models: LASSO/adaLASSO and Autometrics," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00917797, HAL.
    8. Anders Bredahl Kock & Timo Teräsvirta, 2016. "Forecasting Macroeconomic Variables Using Neural Network Models and Three Automated Model Selection Techniques," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1753-1779, December.
    9. Florian Ziel, 2015. "Iteratively reweighted adaptive lasso for conditional heteroscedastic time series with applications to AR-ARCH type processes," Papers 1502.06557, arXiv.org, revised Dec 2015.
    10. Baek, Changryong & Davis, Richard A. & Pipiras, Vladas, 2017. "Sparse seasonal and periodic vector autoregressive modeling," Computational Statistics & Data Analysis, Elsevier, vol. 106(C), pages 103-126.
    11. Kascha, Christian & Trenkler, Carsten, 2015. "Forecasting VARs, model selection, and shrinkage," Working Papers 15-07, University of Mannheim, Department of Economics.
    12. Monbet, Valérie & Ailliot, Pierre, 2017. "Sparse vector Markov switching autoregressive models. Application to multivariate time series of temperature," Computational Statistics & Data Analysis, Elsevier, vol. 108(C), pages 40-51.
    13. Matteo Barigozzi & Marc Hallin, 2015. "Networks, Dynamic Factors, and the Volatility Analysis of High-Dimensional Financial Series," Working Papers ECARES ECARES 2015-34, ULB -- Universite Libre de Bruxelles.
    14. Daniel Felix Ahelegbey & Monica Billio & Roberto Casarin, 2016. "Sparse Graphical Vector Autoregression: A Bayesian Approach," Annals of Economics and Statistics, GENES, issue 123-124, pages 333-361.

    More about this item

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:rio:texdis:602. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (). General contact details of provider: http://edirc.repec.org/data/dpucrbr.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.