IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v611y2023ics0378437122010019.html
   My bibliography  Save this article

A resampling approach for confidence intervals in linear time-series models after model selection

Author

Listed:
  • Dai, Wei
  • Tsang, Ka Wai

Abstract

Linear models are commonly used in econometrics to describe structural relations and draw inferences about underlying parameters. Although the theoretical and practical value of these models has been justified under ideal circumstances, empirical studies have shown that they did not well fit the observed data in reality, and their selection is therefore an important problem. In the big-data era, one approach is to consider a large set of covariates and apply model selection. However, many model selection methods can provide consistent coefficient estimators and confidence intervals, but perform poorly in practice due to an insufficient sample size. Especially for financial data, which have relatively small sample sizes and are usually correlated, classical methods to construct confidence intervals after model selection are usually inaccurate. We consider the problem of constructing confidence intervals for selected coefficients in linear time-series models. To overcome the difficulties of post-selection confidence intervals, we introduce consistent estimators of the selected parameters and work on a resampling approach for confidence interval construction. Theory, simulations, and empirical studies demonstrate the advantages of the proposed method.

Suggested Citation

  • Dai, Wei & Tsang, Ka Wai, 2023. "A resampling approach for confidence intervals in linear time-series models after model selection," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 611(C).
  • Handle: RePEc:eee:phsmap:v:611:y:2023:i:c:s0378437122010019
    DOI: 10.1016/j.physa.2022.128443
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437122010019
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2022.128443?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alexandre Belloni & Victor Chernozhukov, 2011. "High Dimensional Sparse Econometric Models: An Introduction," Papers 1106.5242, arXiv.org, revised Sep 2011.
    2. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    3. A. Belloni & V. Chernozhukov & K. Kato, 2015. "Uniform post-selection inference for least absolute deviation regression and other Z-estimation problems," Biometrika, Biometrika Trust, vol. 102(1), pages 77-94.
    4. S M S Lee & Y Wu, 2018. "A bootstrap recipe for post-model-selection inference under linear regression models," Biometrika, Biometrika Trust, vol. 105(4), pages 873-890.
    5. Mee Young Park & Trevor Hastie, 2007. "L1‐regularization path algorithm for generalized linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 659-677, September.
    6. Forni, Mario & Lippi, Marco, 1997. "Aggregation and the Microfoundations of Dynamic Macroeconomics," OUP Catalogue, Oxford University Press, number 9780198288008, Decembrie.
    7. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2011. "Inference for High-Dimensional Sparse Econometric Models," Papers 1201.0220, arXiv.org.
    8. Vendrame, Vasco & Tucker, Jon & Guermat, Cherif, 2016. "Some extensions of the CAPM for individual assets," International Review of Financial Analysis, Elsevier, vol. 44(C), pages 78-85.
    9. Fama, Eugene F & French, Kenneth R, 1996. "Multifactor Explanations of Asset Pricing Anomalies," Journal of Finance, American Finance Association, vol. 51(1), pages 55-84, March.
    10. James H. Stock & Mark W. Watson, 1989. "New Indexes of Coincident and Leading Economic Indicators," NBER Chapters, in: NBER Macroeconomics Annual 1989, Volume 4, pages 351-409, National Bureau of Economic Research, Inc.
    11. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    12. Stephen M. S. Lee & P. Y. Lai, 2009. "Double block bootstrap confidence intervals for dependent data," Biometrika, Biometrika Trust, vol. 96(2), pages 427-443.
    13. Cun-Hui Zhang & Stephanie S. Zhang, 2014. "Confidence intervals for low dimensional parameters in high dimensional linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 217-242, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alain Hecq & Luca Margaritella & Stephan Smeekes, 2023. "Granger Causality Testing in High-Dimensional VARs: A Post-Double-Selection Procedure," Journal of Financial Econometrics, Oxford University Press, vol. 21(3), pages 915-958.
    2. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney K. Newey, 2016. "Double machine learning for treatment and causal parameters," CeMMAP working papers 49/16, Institute for Fiscal Studies.
    3. Philipp Bach & Victor Chernozhukov & Malte S. Kurz & Martin Spindler & Sven Klaassen, 2021. "DoubleML -- An Object-Oriented Implementation of Double Machine Learning in R," Papers 2103.09603, arXiv.org, revised Feb 2024.
    4. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2018. "Double/debiased machine learning for treatment and structural parameters," Econometrics Journal, Royal Economic Society, vol. 21(1), pages 1-68, February.
    5. Kock, Anders Bredahl, 2016. "Oracle inequalities, variable selection and uniform inference in high-dimensional correlated random effects panel data models," Journal of Econometrics, Elsevier, vol. 195(1), pages 71-85.
    6. Victor Chernozhukov & Denis Chetverikov & Mert Demirer & Esther Duflo & Christian Hansen & Whitney Newey & James Robins, 2016. "Double/Debiased Machine Learning for Treatment and Causal Parameters," Papers 1608.00060, arXiv.org, revised Dec 2017.
    7. Mehmet Caner & Xu Han, 2014. "Selecting the Correct Number of Factors in Approximate Factor Models: The Large Panel Case With Group Bridge Estimators," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 32(3), pages 359-374, July.
    8. Victor Chernozhukov & Wolfgang Härdle & Chen Huang & Weining Wang, 2018. "LASSO-driven inference in time and space," CeMMAP working papers CWP36/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Ng, Serena, 2013. "Variable Selection in Predictive Regressions," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 752-789, Elsevier.
    10. Victor Chernozhukov & Whitney K. Newey & Rahul Singh, 2022. "Automatic Debiased Machine Learning of Causal and Structural Effects," Econometrica, Econometric Society, vol. 90(3), pages 967-1027, May.
    11. Caner, Mehmet & Kock, Anders Bredahl, 2018. "Asymptotically honest confidence regions for high dimensional parameters by the desparsified conservative Lasso," Journal of Econometrics, Elsevier, vol. 203(1), pages 143-168.
    12. Reichlin, Lucrezia, 2002. "Factor Models in Large Cross-Sections of Time Series," CEPR Discussion Papers 3285, C.E.P.R. Discussion Papers.
    13. Damian Kozbur, 2013. "Inference in additively separable models with a high-dimensional set of conditioning variables," ECON - Working Papers 284, Department of Economics - University of Zurich, revised Apr 2018.
    14. Alexandre Belloni & Mingli Chen & Victor Chernozhukov, 2016. "Quantile Graphical Models: Prediction and Conditional Independence with Applications to Systemic Risk," Papers 1607.00286, arXiv.org, revised Oct 2019.
    15. Gold, David & Lederer, Johannes & Tao, Jing, 2020. "Inference for high-dimensional instrumental variables regression," Journal of Econometrics, Elsevier, vol. 217(1), pages 79-111.
    16. Zhu, Ying, 2018. "Sparse linear models and l1-regularized 2SLS with high-dimensional endogenous regressors and instruments," Journal of Econometrics, Elsevier, vol. 202(2), pages 196-213.
    17. Liqian Cai & Arnab Bhattacharjee & Roger Calantone & Taps Maiti, 2019. "Variable Selection with Spatially Autoregressive Errors: A Generalized Moments LASSO Estimator," Sankhya B: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 81(1), pages 146-200, September.
    18. De La Maza, Cristóbal & Davis, Alex & Azevedo, Inês, 2021. "Welfare analysis of the ecological impacts of electricity production in Chile using the sparse multinomial logit model," Ecological Economics, Elsevier, vol. 184(C).
    19. Awijen, Haithem & Ben Zaied, Younes & Ben Lahouel, Béchir & Khlifi, Foued, 2023. "Machine learning for US cross-industry return predictability under information uncertainty," Research in International Business and Finance, Elsevier, vol. 64(C).
    20. Catherine Doz & Domenico Giannone & Lucrezia Reichlin, 2012. "A Quasi–Maximum Likelihood Approach for Large, Approximate Dynamic Factor Models," The Review of Economics and Statistics, MIT Press, vol. 94(4), pages 1014-1024, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:611:y:2023:i:c:s0378437122010019. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.