IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v35y2019i4p1485-1498.html
   My bibliography  Save this article

Online adaptive lasso estimation in vector autoregressive models for high dimensional wind power forecasting

Author

Listed:
  • Messner, Jakob W.
  • Pinson, Pierre

Abstract

Wind power forecasts with lead times of up to a few hours are essential to the optimal and economical operation of power systems and markets. Vector autoregression (VAR) is a framework that has been shown to be well suited to predicting for several wind farms simultaneously by considering the spatio-temporal dependencies in their time series. Lasso penalisation yields sparse models and can avoid overfitting the large numbers of coefficients in higher dimensional settings. However, estimation in VAR models usually does not account for changes in the spatio-temporal wind power dynamics that are related to factors such as seasons or wind farm setup changes, for example. This paper tackles this problem by proposing a time-adaptive lasso estimator and an efficient coordinate descent algorithm for updating the VAR model parameters recursively online. The approach shows good abilities to track changes in the multivariate time series dynamics on simulated data. Furthermore, in two case studies it shows clearly better predictive performances than the non-adaptive lasso VAR and univariate autoregression.

Suggested Citation

  • Messner, Jakob W. & Pinson, Pierre, 2019. "Online adaptive lasso estimation in vector autoregressive models for high dimensional wind power forecasting," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1485-1498.
  • Handle: RePEc:eee:intfor:v:35:y:2019:i:4:p:1485-1498
    DOI: 10.1016/j.ijforecast.2018.02.001
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207018300347
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2018.02.001?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    2. Gneiting, Tilmann & Larson, Kristin & Westrick, Kenneth & Genton, Marc G. & Aldrich, Eric, 2006. "Calibrated Probabilistic Forecasting at the Stateline Wind Energy Center: The Regime-Switching SpaceTime Method," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 968-979, September.
    3. Kou, Peng & Gao, Feng & Guan, Xiaohong, 2013. "Sparse online warped Gaussian process for wind power probabilistic forecasting," Applied Energy, Elsevier, vol. 108(C), pages 410-428.
    4. Ricardo J. Bessa & Corinna Möhrlen & Vanessa Fundel & Malte Siefert & Jethro Browell & Sebastian Haglund El Gaidi & Bri-Mathias Hodge & Umit Cali & George Kariniotakis, 2017. "Towards Improved Understanding of the Applicability of Uncertainty Forecasts in the Electric Power Industry," Energies, MDPI, vol. 10(9), pages 1-48, September.
    5. P. Pinson, 2012. "Very-short-term probabilistic forecasting of wind power with generalized logit–normal distributions," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 61(4), pages 555-576, August.
    6. Pierre Pinson & Henrik Madsen, 2012. "Adaptive modelling and forecasting of offshore wind power fluctuations with Markov‐switching autoregressive models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 31(4), pages 281-313, July.
    7. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    8. Hering, Amanda S. & Genton, Marc G., 2010. "Powering Up With Space-Time Wind Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 105(489), pages 92-104.
    9. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    10. Moller, Jan Kloppenborg & Nielsen, Henrik Aalborg & Madsen, Henrik, 2008. "Time-adaptive quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1292-1303, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tesi Aliaj & Milos Ciganovic & Massimiliano Tancioni, 2023. "Nowcasting inflation with Lasso‐regularized vector autoregressions and mixed frequency data," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(3), pages 464-480, April.
    2. Bingchun Liu & Shijie Zhao & Xiaogang Yu & Lei Zhang & Qingshan Wang, 2020. "A Novel Deep Learning Approach for Wind Power Forecasting Based on WD-LSTM Model," Energies, MDPI, vol. 13(18), pages 1-17, September.
    3. Billé, Anna Gloria & Gianfreda, Angelica & Del Grosso, Filippo & Ravazzolo, Francesco, 2023. "Forecasting electricity prices with expert, linear, and nonlinear models," International Journal of Forecasting, Elsevier, vol. 39(2), pages 570-586.
    4. Jonathan Berrisch & Florian Ziel, 2023. "Multivariate Probabilistic CRPS Learning with an Application to Day-Ahead Electricity Prices," Papers 2303.10019, arXiv.org, revised Feb 2024.
    5. Camehl, Annika, 2023. "Penalized estimation of panel vector autoregressive models: A panel LASSO approach," International Journal of Forecasting, Elsevier, vol. 39(3), pages 1185-1204.
    6. Jia, Yanyan & Fang, Yi & Jing, Zhongbo & Lin, Faqin, 2022. "Price connectedness and input–output linkages: Evidence from China," Economic Modelling, Elsevier, vol. 116(C).
    7. Rafati, Amir & Joorabian, Mahmood & Mashhour, Elaheh & Shaker, Hamid Reza, 2021. "High dimensional very short-term solar power forecasting based on a data-driven heuristic method," Energy, Elsevier, vol. 219(C).
    8. Pierre Pinson & Liyang Han & Jalal Kazempour, 2022. "Regression markets and application to energy forecasting," TOP: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(3), pages 533-573, October.
    9. Dong, Yingchao & Zhang, Hongli & Wang, Cong & Zhou, Xiaojun, 2021. "A novel hybrid model based on Bernstein polynomial with mixture of Gaussians for wind power forecasting," Applied Energy, Elsevier, vol. 286(C).
    10. Tawn, R. & Browell, J., 2022. "A review of very short-term wind and solar power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 153(C).
    11. Sommer, Benedikt & Pinson, Pierre & Messner, Jakob W. & Obst, David, 2021. "Online distributed learning in wind power forecasting," International Journal of Forecasting, Elsevier, vol. 37(1), pages 205-223.
    12. Ali Javaid & Umer Javaid & Muhammad Sajid & Muhammad Rashid & Emad Uddin & Yasar Ayaz & Adeel Waqas, 2022. "Forecasting Hydrogen Production from Wind Energy in a Suburban Environment Using Machine Learning," Energies, MDPI, vol. 15(23), pages 1-13, November.
    13. González-Sopeña, J.M. & Pakrashi, V. & Ghosh, B., 2021. "An overview of performance evaluation metrics for short-term statistical wind power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 138(C).
    14. Aitazaz Ali Raja & Pierre Pinson & Jalal Kazempour & Sergio Grammatico, 2022. "A Market for Trading Forecasts: A Wagering Mechanism," Papers 2205.02668, arXiv.org, revised Oct 2022.
    15. Lv, Jiaqing & Zheng, Xiaodong & Pawlak, Mirosław & Mo, Weike & Miśkowicz, Marek, 2021. "Very short-term probabilistic wind power prediction using sparse machine learning and nonparametric density estimation algorithms," Renewable Energy, Elsevier, vol. 177(C), pages 181-192.
    16. Lagomarsino-Oneto, Daniele & Meanti, Giacomo & Pagliana, Nicolò & Verri, Alessandro & Mazzino, Andrea & Rosasco, Lorenzo & Seminara, Agnese, 2023. "Physics informed machine learning for wind speed prediction," Energy, Elsevier, vol. 268(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Yao & Wang, Jianxue & Wang, Xifan, 2014. "Review on probabilistic forecasting of wind power generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 32(C), pages 255-270.
    2. Ines Würth & Laura Valldecabres & Elliot Simon & Corinna Möhrlen & Bahri Uzunoğlu & Ciaran Gilbert & Gregor Giebel & David Schlipf & Anton Kaifel, 2019. "Minute-Scale Forecasting of Wind Power—Results from the Collaborative Workshop of IEA Wind Task 32 and 36," Energies, MDPI, vol. 12(4), pages 1-30, February.
    3. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    4. Sommer, Benedikt & Pinson, Pierre & Messner, Jakob W. & Obst, David, 2021. "Online distributed learning in wind power forecasting," International Journal of Forecasting, Elsevier, vol. 37(1), pages 205-223.
    5. Tutz, Gerhard & Pößnecker, Wolfgang & Uhlmann, Lorenz, 2015. "Variable selection in general multinomial logit models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 207-222.
    6. Mkhadri, Abdallah & Ouhourane, Mohamed, 2013. "An extended variable inclusion and shrinkage algorithm for correlated variables," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 631-644.
    7. Christopher J Greenwood & George J Youssef & Primrose Letcher & Jacqui A Macdonald & Lauryn J Hagg & Ann Sanson & Jenn Mcintosh & Delyse M Hutchinson & John W Toumbourou & Matthew Fuller-Tyszkiewicz &, 2020. "A comparison of penalised regression methods for informing the selection of predictive markers," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-14, November.
    8. Gustavo A. Alonso-Silverio & Víctor Francisco-García & Iris P. Guzmán-Guzmán & Elías Ventura-Molina & Antonio Alarcón-Paredes, 2021. "Toward Non-Invasive Estimation of Blood Glucose Concentration: A Comparative Performance," Mathematics, MDPI, vol. 9(20), pages 1-13, October.
    9. Christopher Kath & Florian Ziel, 2018. "The value of forecasts: Quantifying the economic gains of accurate quarter-hourly electricity price forecasts," Papers 1811.08604, arXiv.org.
    10. Gurgul Henryk & Machno Artur, 2017. "Trade Pattern on Warsaw Stock Exchange and Prediction of Number of Trades," Statistics in Transition New Series, Polish Statistical Association, vol. 18(1), pages 91-114, March.
    11. Michael Funke & Kadri Männasoo & Helery Tasane, 2023. "Regional Economic Impacts of the Øresund Cross-Border Fixed Link: Cui Bono?," CESifo Working Paper Series 10557, CESifo.
    12. Zichen Zhang & Ye Eun Bae & Jonathan R. Bradley & Lang Wu & Chong Wu, 2022. "SUMMIT: An integrative approach for better transcriptomic data imputation improves causal gene identification," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    13. Štefan Lyócsa & Petra Vašaničová & Branka Hadji Misheva & Marko Dávid Vateha, 2022. "Default or profit scoring credit systems? Evidence from European and US peer-to-peer lending markets," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-21, December.
    14. Peter Bühlmann & Jacopo Mandozzi, 2014. "High-dimensional variable screening and bias in subsequent inference, with an empirical comparison," Computational Statistics, Springer, vol. 29(3), pages 407-430, June.
    15. Capanu, Marinela & Giurcanu, Mihai & Begg, Colin B. & Gönen, Mithat, 2023. "Subsampling based variable selection for generalized linear models," Computational Statistics & Data Analysis, Elsevier, vol. 184(C).
    16. Abhinav Kaushik & Diane Dunham & Xiaorui Han & Evan Do & Sandra Andorf & Sheena Gupta & Andrea Fernandes & Laurie Elizabeth Kost & Sayantani B. Sindher & Wong Yu & Mindy Tsai & Robert Tibshirani & Sco, 2022. "CD8+ T cell differentiation status correlates with the feasibility of sustained unresponsiveness following oral immunotherapy," Nature Communications, Nature, vol. 13(1), pages 1-12, December.
    17. Tomáš Plíhal, 2021. "Scheduled macroeconomic news announcements and Forex volatility forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 40(8), pages 1379-1397, December.
    18. Michele Lalla & Patrizio Frederic, 2020. "Tertiary education decisions of immigrants and non-immigrants in Italy: an empirical approach," Department of Economics 0168, University of Modena and Reggio E., Faculty of Economics "Marco Biagi".
    19. Loann David Denis Desboulets, 2018. "A Review on Variable Selection in Regression Analysis," Econometrics, MDPI, vol. 6(4), pages 1-27, November.
    20. Wolfgang Karl Härdle & Dedy Dwi Prastyo, 2013. "Default Risk Calculation based on Predictor Selection for the Southeast Asian Industry," SFB 649 Discussion Papers SFB649DP2013-037, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:35:y:2019:i:4:p:1485-1498. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.