IDEAS home Printed from https://ideas.repec.org/p/zbw/irtgdp/2018039.html
   My bibliography  Save this paper

Penalized Adaptive Forecasting with Large Information Sets and Structural Changes

Author

Listed:
  • Zbonakova, Lenka
  • Li, Xinjue
  • Härdle, Wolfgang Karl

Abstract

In the present paper we propose a new method, the Penalized Adaptive Method (PAM), for a data driven detection of structural changes in sparse linear models. The method is able to allocate the longest homogeneous intervals over the data sample and simultaneously choose the most proper variables with the help of penalized regression models. The method is simple yet exible and can be safely applied in high-dimensional cases with dierent sources of parameter changes. Comparing with the adaptive method in linear models, its combination with dimension reduction yields a method which properly selects signicant variables and detects structural breaks while steadily reduces the forecast error in high-dimensional data.

Suggested Citation

  • Zbonakova, Lenka & Li, Xinjue & Härdle, Wolfgang Karl, 2018. "Penalized Adaptive Forecasting with Large Information Sets and Structural Changes," IRTG 1792 Discussion Papers 2018-039, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    • Handle: RePEc:zbw:irtgdp:2018039
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/230750/1/irtg1792dp2018-039.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Paolo Pagnottoni & Thomas Dimpfl, 2019. "Price discovery on Bitcoin markets," Digital Finance, Springer, vol. 1(1), pages 139-161, November.
    2. Packham, Natalie & Kalkbrener, Michael & Overbeck, Ludger, 2014. "Default probabilities and default correlations under stress," Frankfurt School - Working Paper Series 211, Frankfurt School of Finance and Management.
    3. Vomfell, Lara & Härdle, Wolfgang Karl & Lessmann, Stefan, 2018. "Improving Crime Count Forecasts Using Twitter and Taxi Data," IRTG 1792 Discussion Papers 2018-013, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    4. Victor Chernozhukov & Wolfgang K. Hardle & Chen Huang & Weining Wang, 2018. "LASSO-Driven Inference in Time and Space," Papers 1806.05081, arXiv.org, revised May 2020.
    5. Almosova, Anna, 2018. "A Note on Cryptocurrencies and Currency Competition," IRTG 1792 Discussion Papers 2018-006, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    6. Feng, Zheng-Hui & Lin, Lu & Zhu, Ruo-Qing & Zhu, Li-Xing, 2018. "Nonparametric Variable Selection and Its Application to Additive Models," IRTG 1792 Discussion Papers 2018-002, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    7. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    8. Christian M Hafner, 2020. "Testing for Bubbles in Cryptocurrencies with Time-Varying Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 18(2), pages 233-249.
    9. Bachoc, Francois & Suvorikova, Alexandra & Loubes, Jean-Michel & Spokoiny, Vladimir, 2018. "Gaussian Process Forecast with multidimensional distributional entries," IRTG 1792 Discussion Papers 2018-030, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    10. Yang, Zihui & Zhou, Yinggang, 2018. "Systemic Risk in Global Volatility Spillover Networks: Evidence from Option-implied Volatility Indices," IRTG 1792 Discussion Papers 2018-003, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    11. Klein, Tony & Pham Thu, Hien & Walther, Thomas, 2018. "Bitcoin is not the New Gold – A comparison of volatility, correlation, and portfolio performance," International Review of Financial Analysis, Elsevier, vol. 59(C), pages 105-116.
    12. Guo, Li & Tao, Yubo & Härdle, Wolfgang Karl, 2018. "Understanding Latent Group Structure of Cryptocurrencies Market: A Dynamic Network Perspective," IRTG 1792 Discussion Papers 2018-032, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    13. Efimov, Kirill & Adamyan, Larisa & Spokoiny, Vladimir, 2018. "Adaptive Nonparametric Clustering," IRTG 1792 Discussion Papers 2018-018, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    14. Tryphonides, Andreas, 2018. "Learning from Errors: The case of monetary and fiscal policy regimes," IRTG 1792 Discussion Papers 2018-022, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    15. Chen, Haiqiang & Li, Yingxing & Lin, Ming & Zhu, Yanli, 2018. "A Regime Shift Model with Nonparametric Switching Mechanism," IRTG 1792 Discussion Papers 2018-020, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    16. Härdle, Wolfgang Karl & Chen, Shi & Liang, Chong & Schienle, Melanie, 2018. "Time-varying Limit Order Book Networks," IRTG 1792 Discussion Papers 2018-016, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    17. Koziuk, Andzhey & Spokoiny, Vladimir, 2018. "Instrumental variables regression," IRTG 1792 Discussion Papers 2018-031, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    18. Almosova, Anna, 2018. "A Monetary Model of Blockchain," IRTG 1792 Discussion Papers 2018-008, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    19. Kalkbrener, Michael & Packham, Natalie, 2018. "Correlation Under Stress In Normal Variance Mixture Models," IRTG 1792 Discussion Papers 2018-035, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    20. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    21. Yi-Hsuan Chen, Cathy & Fengler, Matthias & Härdle, Wolfgang Karl & Liu, Yanchu, 2018. "Textual Sentiment, Option Characteristics, and Stock Return Predictability," Economics Working Paper Series 1808, University of St. Gallen, School of Economics and Political Science.
    22. Davies, Laurie, 2018. "Lasso, knockoff and Gaussian covariates: a comparison," IRTG 1792 Discussion Papers 2018-019, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    23. Packham, Natalie & Kalkbrener, Michael & Overbeck, Ludger, 2018. "Default probabilities and default correlations under stress," IRTG 1792 Discussion Papers 2018-037, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    24. Stefan Wagner & Martin C. Goossen, 2018. "Knowing me, knowing you: Inventor mobility and the formation of technology-oriented alliances," ESMT Research Working Papers ESMT-18-01, ESMT European School of Management and Technology.
    25. Götze, Friedrich & Naumov, Alexey & Spokoiny, Vladimir & Ulyanov, Vladimir, 2018. "Large ball probabilities, Gaussian comparison and anti-concentration," IRTG 1792 Discussion Papers 2018-026, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    26. Silin, Igor & Spokoiny, Vladimir, 2018. "Bayesian inference for spectral projectors of covariance matrix," IRTG 1792 Discussion Papers 2018-027, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    27. Lessmann, Stefan & Coussement, Kristof & De Bock, Koen W. & Haupt, Johannes, 2018. "Targeting customers for profit: An ensemble learning framework to support marketing decision making," IRTG 1792 Discussion Papers 2018-012, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    28. Ebert, Johannes & Spokoiny, Vladimir & Suvorikova, Alexandra, 2018. "Construction of Non-asymptotic Confidence Sets in 2 -Wasserstein Space," IRTG 1792 Discussion Papers 2018-025, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    29. Naumov, A. & Spokoiny, V. & Ulyanovk, V., 2018. "Bootstrap Confidence Sets for Spectral Projectors of Sample Covariance," IRTG 1792 Discussion Papers 2018-024, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    30. Detering, Nils & Packham, Natalie, 2018. "Model risk of contingent claims," IRTG 1792 Discussion Papers 2018-036, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    31. Koziuk, Andzhey & Spokoiny, Vladimir, 2018. "Toolbox: Gaussian comparison on Eucledian balls," IRTG 1792 Discussion Papers 2018-028, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    32. Almosova, Anna, 2018. "A Monetary Model of Blockchain," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181502, Verein für Socialpolitik / German Economic Association.
    33. Hryshchuk, Antanina & Lessmann, Stefan, 2018. "Deregulated day-ahead electricity markets in Southeast Europe: Price forecasting and comparative structural analysis," IRTG 1792 Discussion Papers 2018-009, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    34. Fama, Eugene F & Bliss, Robert R, 1987. "The Information in Long-Maturity Forward Rates," American Economic Review, American Economic Association, vol. 77(4), pages 680-692, September.
    35. Chen, Haiqiang & Li, Yingxing & Lin, Ming & Zhu, Yanli, 2018. "A Regime Shift Model with Nonparametric Switching Mechanism," IRTG 1792 Discussion Papers 2018-048, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Klochkov, Yegor & Härdle, Wolfgang Karl & Xu, Xiu, 2019. "Localizing Multivariate CAViaR," IRTG 1792 Discussion Papers 2019-007, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kuczmaszewska, Anna & Yan, Ji Gao, 2018. "On complete convergence in Marcinkiewicz-Zygmund type SLLN for random variables," IRTG 1792 Discussion Papers 2018-041, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    2. Zhong, Wei & Liu, Xi & Ma, Shuangge, 2018. "Variable selection and direction estimation for single-index models via DC-TGDR method," IRTG 1792 Discussion Papers 2018-050, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    3. Guo, Shaojun & Li, Dong & Li, Muyi, 2018. "Strict Stationarity Testing and GLAD Estimation of Double Autoregressive Models," IRTG 1792 Discussion Papers 2018-049, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    4. Cai, Zongwu & Fang, Ying & Lin, Ming & Su, Jia, 2018. "Inferences for a Partially Varying Coefficient Model With Endogenous Regressors," IRTG 1792 Discussion Papers 2018-047, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    5. Xiaojia Bao & Qingliang Fan, 2020. "The impact of temperature on gaming productivity: evidence from online games," Empirical Economics, Springer, vol. 58(2), pages 835-867, February.
    6. Yatracos, Yannis G., 2018. "Residual'S Influence Index (Rinfin), Bad Leverage And Unmasking In High Dimensional L2-Regression," IRTG 1792 Discussion Papers 2018-060, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    7. Yan, Ji Gao, 2018. "Complete Convergence and Complete Moment Convergence for Maximal Weighted Sums of Extended Negatively Dependent Random Variables," IRTG 1792 Discussion Papers 2018-040, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    8. Wang, Honglin & Yu, Fan & Zhou, Yinggang, 2018. "Property Investment and Rental Rate under Housing Price Uncertainty: A Real Options Approach," IRTG 1792 Discussion Papers 2018-051, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    9. Qingliang Fan & Wei Zhong, 2018. "Nonparametric Additive Instrumental Variable Estimator: A Group Shrinkage Estimation Perspective," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(3), pages 388-399, July.
    10. Chiu, Hsin-Yu & Chiang, Mi-Hsiu & Kuo, Wei-Yu, 2018. "Predicative Ability of Similarity-based Futures Trading Strategies," IRTG 1792 Discussion Papers 2018-045, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    11. Chen, Haiqiang & Li, Yingxing & Lin, Ming & Zhu, Yanli, 2018. "A Regime Shift Model with Nonparametric Switching Mechanism," IRTG 1792 Discussion Papers 2018-048, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    12. Packham, Natalie & Kalkbrener, Michael & Overbeck, Ludger, 2018. "Default probabilities and default correlations under stress," IRTG 1792 Discussion Papers 2018-037, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    13. Packham, Natalie, 2018. "Optimal contracts under competition when uncertainty from adverse selection and moral hazard are present," IRTG 1792 Discussion Papers 2018-033, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    14. Packham, Natalie & Woebbeking, Fabian, 2018. "A factor-model approach for correlation scenarios and correlation stress-testing," IRTG 1792 Discussion Papers 2018-034, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    15. Kalkbrener, Michael & Packham, Natalie, 2018. "Correlation Under Stress In Normal Variance Mixture Models," IRTG 1792 Discussion Papers 2018-035, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    16. Guo, Li & Tao, Yubo & Härdle, Wolfgang Karl, 2018. "Understanding Latent Group Structure of Cryptocurrencies Market: A Dynamic Network Perspective," IRTG 1792 Discussion Papers 2018-032, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    17. Koziuk, Andzhey & Spokoiny, Vladimir, 2018. "Toolbox: Gaussian comparison on Eucledian balls," IRTG 1792 Discussion Papers 2018-028, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    18. Victor Chernozhukov & Wolfgang Härdle & Chen Huang & Weining Wang, 2018. "LASSO-driven inference in time and space," CeMMAP working papers CWP36/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Nasekin, Sergey & Chen, Cathy Yi-Hsuan, 2018. "Deep learning-based cryptocurrency sentiment construction," IRTG 1792 Discussion Papers 2018-066, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    20. Li, Xinjue & Zboňáková, Lenka & Wang, Weining & Härdle, Wolfgang Karl, 2019. "Combining Penalization and Adaption in High Dimension with Application in Bond Risk Premia Forecasting," IRTG 1792 Discussion Papers 2019-030, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".

    More about this item

    Keywords

    SCAD penalty; propagation-separation; adaptive window choice; multiplier bootstrap;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C50 - Mathematical and Quantitative Methods - - Econometric Modeling - - - General
    • E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications
    • G12 - Financial Economics - - General Financial Markets - - - Asset Pricing; Trading Volume; Bond Interest Rates

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:irtgdp:2018039. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/wfhubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.