IDEAS home Printed from https://ideas.repec.org/p/inn/wpaper/2016-04.html
   My bibliography  Save this paper

Non-homogeneous boosting for predictor selection in ensemble post-processing

Author

Listed:
  • Jakob W. Messner
  • Georg J. Mayr
  • Achim Zeileis

Abstract

Non-homogeneous regression is often used to statistically post-process ensemble forecasts. Usually only ensemble forecasts of the predictand variable are used as input but other potentially useful information sources are ignored. Although it is straightforward to add further input variables, overfitting can easily deteriorate the forecast performance for increasing numbers of input variables. This paper proposes a boosting algorithm to estimate the regression coefficients while automatically selecting the most relevant input variables by restricting the coefficients of less important variables to zero. A case study with ensemble forecasts from the European Centre for Medium-Range Weather Forecasts (ECMWF) shows that this approach effectively selects important input variables to clearly improve minimum and maximum temperature predictions at 5 central European stations.

Suggested Citation

  • Jakob W. Messner & Georg J. Mayr & Achim Zeileis, 2016. "Non-homogeneous boosting for predictor selection in ensemble post-processing," Working Papers 2016-04, Faculty of Economics and Statistics, Universität Innsbruck.
  • Handle: RePEc:inn:wpaper:2016-04
    as

    Download full text from publisher

    File URL: https://www2.uibk.ac.at/downloads/c4041030/wpaper/2016-04.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Thordis L. Thorarinsdottir & Tilmann Gneiting, 2010. "Probabilistic forecasts of wind speed: ensemble model output statistics by using heteroscedastic censored regression," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(2), pages 371-388, April.
    2. Michael Scheuerer & Luca Büermann, 2014. "Spatially adaptive post-processing of ensemble forecasts for temperature," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 63(3), pages 405-422, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Reto Stauffer & Jakob W. Messner & Georg J. Mayr & Nikolaus Umlauf & Achim Zeileis, 2016. "Ensemble Post-Processing of Daily Precipitation Sums over Complex Terrain Using Censored High-Resolution Standardized Anomalies," Working Papers 2016-21, Faculty of Economics and Statistics, Universität Innsbruck.
    2. Sebastian Lerch & Sándor Baran, 2017. "Similarity-based semilocal estimation of post-processing models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(1), pages 29-51, January.
    3. Michaël Zamo & Liliane Bel & Olivier Mestre, 2021. "Sequential aggregation of probabilistic forecasts—Application to wind speed ensemble forecasts," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(1), pages 202-225, January.
    4. Iversen, Emil B. & Morales, Juan M. & Møller, Jan K. & Madsen, Henrik, 2016. "Short-term probabilistic forecasting of wind speed using stochastic differential equations," International Journal of Forecasting, Elsevier, vol. 32(3), pages 981-990.
    5. Pierre-Julien Trombe & Pierre Pinson & Henrik Madsen, 2012. "A General Probabilistic Forecasting Framework for Offshore Wind Power Fluctuations," Energies, MDPI, vol. 5(3), pages 1-37, March.
    6. Markus Dabernig & Georg J. Mayr & Jakob W. Messner & Achim Zeileis, 2016. "Spatial Ensemble Post-Processing with Standardized Anomalies," Working Papers 2016-08, Faculty of Economics and Statistics, Universität Innsbruck.
    7. Mário Fernando De Sousa & Helton Saulo & Víctor Leiva & Paulo Scalco, 2018. "On Some Properties Of A New Asymmetry-Based Tobit Model," Anais do XLIV Encontro Nacional de Economia [Proceedings of the 44th Brazilian Economics Meeting] 129, ANPEC - Associação Nacional dos Centros de Pós-Graduação em Economia [Brazilian Association of Graduate Programs in Economics].
    8. Jakob W. Messner & Georg J. Mayr & Daniel S. Wilks & Achim Zeileis, 2013. "Extending Extended Logistic Regression for Ensemble Post-Processing: Extended vs. Separate vs. Ordered vs. Censored," Working Papers 2013-32, Faculty of Economics and Statistics, Universität Innsbruck.
    9. Adel Ghazikhani & Iman Babaeian & Mohammad Gheibi & Mostafa Hajiaghaei-Keshteli & Amir M. Fathollahi-Fard, 2022. "A Smart Post-Processing System for Forecasting the Climate Precipitation Based on Machine Learning Computations," Sustainability, MDPI, vol. 14(11), pages 1-27, May.
    10. Baran, Sándor, 2014. "Probabilistic wind speed forecasting using Bayesian model averaging with truncated normal components," Computational Statistics & Data Analysis, Elsevier, vol. 75(C), pages 227-238.
    11. Manuel Gebetsberger & Jakob W. Messner & Georg J. Mayr & Achim Zeileis, 2016. "Tricks for improving non-homogeneous regression for probabilistic precipitation forecasts: Perfect predictions, heavy tails, and link functions," Working Papers 2016-28, Faculty of Economics and Statistics, Universität Innsbruck.
    12. Moritz N. Lang & Lisa Schlosser & Torsten Hothorn & Georg J. Mayr & Reto Stauffer & Achim Zeileis, 2020. "Circular regression trees and forests with an application to probabilistic wind direction forecasting," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(5), pages 1357-1374, November.
    13. Marie Courbariaux & Pierre Barbillon & Luc Perreault & Éric Parent, 2019. "Post-processing Multiensemble Temperature and Precipitation Forecasts Through an Exchangeable Normal-Gamma Model and Its Tobit Extension," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 24(2), pages 309-345, June.
    14. Manuel Gebetsberger & Jakob W. Messner & Georg J. Mayr & Achim Zeileis, 2017. "Estimation methods for non-homogeneous regression models: Minimum continuous ranked probability score vs. maximum likelihood," Working Papers 2017-23, Faculty of Economics and Statistics, Universität Innsbruck.
    15. Zhao, Jing & Guo, Zhen-Hai & Su, Zhong-Yue & Zhao, Zhi-Yuan & Xiao, Xia & Liu, Feng, 2016. "An improved multi-step forecasting model based on WRF ensembles and creative fuzzy systems for wind speed," Applied Energy, Elsevier, vol. 162(C), pages 808-826.
    16. Mayer, David G. & Chandra, Kerri A. & Burnett, Jolyon R., 2019. "Improved crop forecasts for the Australian macadamia industry from ensemble models," Agricultural Systems, Elsevier, vol. 173(C), pages 519-523.
    17. Sándor Baran & Patrícia Szokol & Marianna Szabó, 2021. "Truncated generalized extreme value distribution‐based ensemble model output statistics model for calibration of wind speed ensemble forecasts," Environmetrics, John Wiley & Sons, Ltd., vol. 32(6), September.
    18. Jakob W. Messner & Achim Zeileis & Jochen Broecker & Georg J. Mayr, 2013. "Improved Probabilistic Wind Power Forecasts with an Inverse Power Curve Transformation and Censored Regression," Working Papers 2013-01, Faculty of Economics and Statistics, Universität Innsbruck.
    19. Heinermann, Justin & Kramer, Oliver, 2016. "Machine learning ensembles for wind power prediction," Renewable Energy, Elsevier, vol. 89(C), pages 671-679.
    20. Lei Zhang & Lun Xie & Qinkai Han & Zhiliang Wang & Chen Huang, 2020. "Probability Density Forecasting of Wind Speed Based on Quantile Regression and Kernel Density Estimation," Energies, MDPI, vol. 13(22), pages 1-24, November.

    More about this item

    Keywords

    non-homogeneous regression; variable selection; boosting; statistical ensemble post-processing;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inn:wpaper:2016-04. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Janette Walde (email available below). General contact details of provider: https://edirc.repec.org/data/fuibkat.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.