IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v90y2018icp728-741.html
   My bibliography  Save this article

Feature selection in machine learning prediction systems for renewable energy applications

Author

Listed:
  • Salcedo-Sanz, S.
  • Cornejo-Bueno, L.
  • Prieto, L.
  • Paredes, D.
  • García-Herrera, R.

Abstract

This paper focuses on feature selection problems that arise in renewable energy applications. Feature selection is an important problem in machine learning, both in classification and regression problems. In renewable energy systems, feature selection appears related to prediction systems in the most important sources such as wind, solar and marine resources. The objective of the paper is twofold: first, a review of the most important prediction systems for renewable energy applications involving feature selection is carried out. Analysis and discussion of different feature selection problems in prediction systems are considered. We show that wrapper FSP approaches are those mostly used due to their higher performance. They include a diversity of algorithms, prevailing fast-training approaches. The lack of an uniform framework for FSP and the diversity of tackled problems impede a systematic assessment of the performance and properties of the applied methods. Thus, the simultaneously use of several global search mechanisms should be the preferred option. In a second part of the paper, we explore this possibility, by introducing a novel approach for feature selection based on a novel meta-heuristic, the Coral Reefs Optimization algorithm with Substrate Layer. This approach is able to combine different search mechanisms into a single algorithm, providing a global search procedure of high quality. We use an Extreme Learning Machine for prediction within this novel approach. The performance of the system is evaluated in a problem of wind speed prediction from numerical models input, using real data from a wind farm in Spain, where comparison with alternative regression algorithms is carried out. Improvements up to 20% in hourly and daily wind speed prediction are obtained with the proposed system versus the algorithms without the feature selection process considered.

Suggested Citation

  • Salcedo-Sanz, S. & Cornejo-Bueno, L. & Prieto, L. & Paredes, D. & García-Herrera, R., 2018. "Feature selection in machine learning prediction systems for renewable energy applications," Renewable and Sustainable Energy Reviews, Elsevier, vol. 90(C), pages 728-741.
  • Handle: RePEc:eee:rensus:v:90:y:2018:i:c:p:728-741
    DOI: 10.1016/j.rser.2018.04.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032118302168
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.rser.2018.04.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hu, Zhongyi & Bao, Yukun & Chiong, Raymond & Xiong, Tao, 2015. "Mid-term interval load forecasting using multi-output support vector regression with a memetic algorithm for feature selection," Energy, Elsevier, vol. 84(C), pages 419-431.
    2. Cornejo-Bueno, L. & Nieto-Borge, J.C. & García-Díaz, P. & Rodríguez, G. & Salcedo-Sanz, S., 2016. "Significant wave height and energy flux prediction for marine energy applications: A grouping genetic algorithm – Extreme Learning Machine approach," Renewable Energy, Elsevier, vol. 97(C), pages 380-389.
    3. María Pérez-Ortiz & Silvia Jiménez-Fernández & Pedro A. Gutiérrez & Enrique Alexandre & César Hervás-Martínez & Sancho Salcedo-Sanz, 2016. "A Review of Classification Problems and Algorithms in Renewable Energy Applications," Energies, MDPI, vol. 9(8), pages 1-27, August.
    4. Cuadra, L. & Salcedo-Sanz, S. & Nieto-Borge, J.C. & Alexandre, E. & Rodríguez, G., 2016. "Computational intelligence in wave energy: Comprehensive review and case study," Renewable and Sustainable Energy Reviews, Elsevier, vol. 58(C), pages 1223-1246.
    5. Jurado, Sergio & Nebot, Àngela & Mugica, Fransisco & Avellana, Narcís, 2015. "Hybrid methodologies for electricity load forecasting: Entropy-based feature selection with machine learning and soft computing techniques," Energy, Elsevier, vol. 86(C), pages 276-291.
    6. Yadav, Amit Kumar & Malik, Hasmat & Chandel, S.S., 2014. "Selection of most relevant input parameters using WEKA for artificial neural network based solar radiation prediction models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 31(C), pages 509-519.
    7. Hashim, Roslan & Roy, Chandrabhushan & Motamedi, Shervin & Shamshirband, Shahaboddin & Petković, Dalibor, 2016. "Selection of climatic parameters affecting wave height prediction using an enhanced Takagi-Sugeno-based fuzzy methodology," Renewable and Sustainable Energy Reviews, Elsevier, vol. 60(C), pages 246-257.
    8. Mohammadi, Kasra & Shamshirband, Shahaboddin & Petković, Dalibor & Khorasanizadeh, Hossein, 2016. "Determining the most important variables for diffuse solar radiation prediction using adaptive neuro-fuzzy methodology; case study: City of Kerman, Iran," Renewable and Sustainable Energy Reviews, Elsevier, vol. 53(C), pages 1570-1579.
    9. Salcedo-Sanz, S. & Jiménez-Fernández, S. & Aybar-Ruiz, A. & Casanova-Mateo, C. & Sanz-Justo, J. & García-Herrera, R., 2017. "A CRO-species optimization scheme for robust global solar radiation statistical downscaling," Renewable Energy, Elsevier, vol. 111(C), pages 63-76.
    10. Thapar, Sapan & Sharma, Seema & Verma, Ashu, 2016. "Economic and environmental effectiveness of renewable energy policy instruments: Best practices from India," Renewable and Sustainable Energy Reviews, Elsevier, vol. 66(C), pages 487-498.
    11. Jung, Jaesung & Villaran, Michael, 2017. "Optimal planning and design of hybrid renewable energy systems for microgrids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 180-191.
    12. Dvořák, Petr & Martinát, Stanislav & der Horst, Dan Van & Frantál, Bohumil & Turečková, Kamila, 2017. "Renewable energy investment and job creation; a cross-sectoral assessment for the Czech Republic with reference to EU benchmarks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 69(C), pages 360-368.
    13. Huda, Shamsul & Abdollahian, Mali & Mammadov, Musa & Yearwood, John & Ahmed, Shafiq & Sultan, Ibrahim, 2014. "A hybrid wrapper–filter approach to detect the source(s) of out-of-control signals in multivariate manufacturing process," European Journal of Operational Research, Elsevier, vol. 237(3), pages 857-870.
    14. Jiang, Yonghua & Tang, Baoping & Qin, Yi & Liu, Wenyi, 2011. "Feature extraction method of wind turbine based on adaptive Morlet wavelet and SVD," Renewable Energy, Elsevier, vol. 36(8), pages 2146-2153.
    15. Rafindadi, Abdulkadir Abdulrashid & Ozturk, Ilhan, 2017. "Impacts of renewable energy consumption on the German economic growth: Evidence from combined cointegration test," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 1130-1141.
    16. Zhang, Chi & Wei, Haikun & Zhao, Junsheng & Liu, Tianhong & Zhu, Tingting & Zhang, Kanjian, 2016. "Short-term wind speed forecasting using empirical mode decomposition and feature selection," Renewable Energy, Elsevier, vol. 96(PA), pages 727-737.
    17. Carta, José A. & Cabrera, Pedro & Matías, José M. & Castellano, Fernando, 2015. "Comparison of feature selection methods using ANNs in MCP-wind speed methods. A case study," Applied Energy, Elsevier, vol. 158(C), pages 490-507.
    18. Feng, Cong & Cui, Mingjian & Hodge, Bri-Mathias & Zhang, Jie, 2017. "A data-driven multi-model methodology with deep feature selection for short-term wind forecasting," Applied Energy, Elsevier, vol. 190(C), pages 1245-1257.
    19. Costa, Alexandre & Crespo, Antonio & Navarro, Jorge & Lizcano, Gil & Madsen, Henrik & Feitosa, Everaldo, 2008. "A review on the young history of the wind power short-term prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 12(6), pages 1725-1744, August.
    20. Salcedo-Sanz, S. & Pastor-Sánchez, A. & Del Ser, J. & Prieto, L. & Geem, Z.W., 2015. "A Coral Reefs Optimization algorithm with Harmony Search operators for accurate wind speed prediction," Renewable Energy, Elsevier, vol. 75(C), pages 93-101.
    21. Jursa, René & Rohrig, Kurt, 2008. "Short-term wind power forecasting using evolutionary algorithms for the automated specification of artificial intelligence models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 694-709.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fan, Cheng & Wang, Jiayuan & Gang, Wenjie & Li, Shenghan, 2019. "Assessment of deep recurrent neural network-based strategies for short-term building energy predictions," Applied Energy, Elsevier, vol. 236(C), pages 700-710.
    2. Sharifzadeh, Mahdi & Sikinioti-Lock, Alexandra & Shah, Nilay, 2019. "Machine-learning methods for integrated renewable power generation: A comparative study of artificial neural networks, support vector regression, and Gaussian Process Regression," Renewable and Sustainable Energy Reviews, Elsevier, vol. 108(C), pages 513-538.
    3. Ghimire, Sujan & Deo, Ravinesh C. & Casillas-Pérez, David & Salcedo-Sanz, Sancho, 2022. "Boosting solar radiation predictions with global climate models, observational predictors and hybrid deep-machine learning algorithms," Applied Energy, Elsevier, vol. 316(C).
    4. Dhiman, Harsh S. & Deb, Dipankar & Foley, Aoife M., 2020. "Bilateral Gaussian Wake Model Formulation for Wind Farms: A Forecasting based approach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 127(C).
    5. Li, Jie & Pan, Lanjia & Suvarna, Manu & Tong, Yen Wah & Wang, Xiaonan, 2020. "Fuel properties of hydrochar and pyrochar: Prediction and exploration with machine learning," Applied Energy, Elsevier, vol. 269(C).
    6. Liu, Da & Sun, Kun, 2019. "Random forest solar power forecast based on classification optimization," Energy, Elsevier, vol. 187(C).
    7. Zhang, Xiaohai & Ramírez-Mendiola, José Luis & Li, Mingtao & Guo, Liejin, 2022. "Electricity consumption pattern analysis beyond traditional clustering methods: A novel self-adapting semi-supervised clustering method and application case study," Applied Energy, Elsevier, vol. 308(C).
    8. Wang, Jujie & Li, Yaning, 2018. "Multi-step ahead wind speed prediction based on optimal feature extraction, long short term memory neural network and error correction strategy," Applied Energy, Elsevier, vol. 230(C), pages 429-443.
    9. Pirhooshyaran, Mohammad & Scheinberg, Katya & Snyder, Lawrence V., 2020. "Feature engineering and forecasting via derivative-free optimization and ensemble of sequence-to-sequence networks with applications in renewable energy," Energy, Elsevier, vol. 196(C).
    10. Lu, Xuefei & Baraldi, Piero & Zio, Enrico, 2020. "A data-driven framework for identifying important components in complex systems," Reliability Engineering and System Safety, Elsevier, vol. 204(C).
    11. Ruan, Zhaohui & Sun, Weiwei & Yuan, Yuan & Tan, Heping, 2023. "Accurately forecasting solar radiation distribution at both spatial and temporal dimensions simultaneously with fully-convolutional deep neural network model," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    12. Prince Waqas Khan & Yongjun Kim & Yung-Cheol Byun & Sang-Joon Lee, 2021. "Influencing Factors Evaluation of Machine Learning-Based Energy Consumption Prediction," Energies, MDPI, vol. 14(21), pages 1-22, November.
    13. Ahmad, Tanveer & Zhang, Hongcai, 2020. "Novel deep supervised ML models with feature selection approach for large-scale utilities and buildings short and medium-term load requirement forecasts," Energy, Elsevier, vol. 209(C).
    14. Izanloo, Milad & Aslani, Alireza & Zahedi, Rahim, 2022. "Development of a Machine learning assessment method for renewable energy investment decision making," Applied Energy, Elsevier, vol. 327(C).
    15. Hossein Moayedi & Amir Mosavi, 2021. "An Innovative Metaheuristic Strategy for Solar Energy Management through a Neural Networks Framework," Energies, MDPI, vol. 14(4), pages 1-18, February.
    16. Manzano, J.M. & Salvador, J.R. & Romaine, J.B. & Alvarado-Barrios, L., 2022. "Economic predictive control for isolated microgrids based on real world demand/renewable energy data and forecast errors," Renewable Energy, Elsevier, vol. 194(C), pages 647-658.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gómez-Orellana, A.M. & Guijo-Rubio, D. & Gutiérrez, P.A. & Hervás-Martínez, C., 2022. "Simultaneous short-term significant wave height and energy flux prediction using zonal multi-task evolutionary artificial neural networks," Renewable Energy, Elsevier, vol. 184(C), pages 975-989.
    2. Feng, Cong & Sun, Mucun & Cui, Mingjian & Chartan, Erol Kevin & Hodge, Bri-Mathias & Zhang, Jie, 2019. "Characterizing forecastability of wind sites in the United States," Renewable Energy, Elsevier, vol. 133(C), pages 1352-1365.
    3. Zheng, Chong Wei & Wang, Qing & Li, Chong Yin, 2017. "An overview of medium- to long-term predictions of global wave energy resources," Renewable and Sustainable Energy Reviews, Elsevier, vol. 79(C), pages 1492-1502.
    4. Laura Cornejo-Bueno & Lucas Cuadra & Silvia Jiménez-Fernández & Javier Acevedo-Rodríguez & Luis Prieto & Sancho Salcedo-Sanz, 2017. "Wind Power Ramp Events Prediction with Hybrid Machine Learning Regression Techniques and Reanalysis Data," Energies, MDPI, vol. 10(11), pages 1-27, November.
    5. Sen Guo & Haoran Zhao & Huiru Zhao, 2017. "A New Hybrid Wind Power Forecaster Using the Beveridge-Nelson Decomposition Method and a Relevance Vector Machine Optimized by the Ant Lion Optimizer," Energies, MDPI, vol. 10(7), pages 1-20, July.
    6. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    7. Catalão, J.P.S. & Pousinho, H.M.I. & Mendes, V.M.F., 2011. "Short-term wind power forecasting in Portugal by neural networks and wavelet transform," Renewable Energy, Elsevier, vol. 36(4), pages 1245-1251.
    8. Croonenbroeck, Carsten & Møller Dahl, Christian, 2014. "Accurate medium-term wind power forecasting in a censored classification framework," Discussion Papers 351, European University Viadrina Frankfurt (Oder), Department of Business Administration and Economics.
    9. Sizhou Sun & Jingqi Fu & Ang Li, 2019. "A Compound Wind Power Forecasting Strategy Based on Clustering, Two-Stage Decomposition, Parameter Optimization, and Optimal Combination of Multiple Machine Learning Approaches," Energies, MDPI, vol. 12(18), pages 1-22, September.
    10. He, Yaoyao & Xu, Qifa & Wan, Jinhong & Yang, Shanlin, 2016. "Short-term power load probability density forecasting based on quantile regression neural network and triangle kernel function," Energy, Elsevier, vol. 114(C), pages 498-512.
    11. Ma, Weiwu & Fang, Song & Liu, Gang & Zhou, Ruoyu, 2017. "Modeling of district load forecasting for distributed energy system," Applied Energy, Elsevier, vol. 204(C), pages 181-205.
    12. Gao, Ruobin & Li, Ruilin & Hu, Minghui & Suganthan, Ponnuthurai Nagaratnam & Yuen, Kum Fai, 2023. "Dynamic ensemble deep echo state network for significant wave height forecasting," Applied Energy, Elsevier, vol. 329(C).
    13. Ali, Mumtaz & Prasad, Ramendra & Xiang, Yong & Jamei, Mehdi & Yaseen, Zaher Mundher, 2023. "Ensemble robust local mean decomposition integrated with random forest for short-term significant wave height forecasting," Renewable Energy, Elsevier, vol. 205(C), pages 731-746.
    14. Sameer Al-Dahidi & Piero Baraldi & Enrico Zio & Lorenzo Montelatici, 2021. "Bootstrapped Ensemble of Artificial Neural Networks Technique for Quantifying Uncertainty in Prediction of Wind Energy Production," Sustainability, MDPI, vol. 13(11), pages 1-19, June.
    15. Salcedo-Sanz, S. & Pastor-Sánchez, A. & Del Ser, J. & Prieto, L. & Geem, Z.W., 2015. "A Coral Reefs Optimization algorithm with Harmony Search operators for accurate wind speed prediction," Renewable Energy, Elsevier, vol. 75(C), pages 93-101.
    16. Rodrigues, Eugénio & Gomes, Álvaro & Gaspar, Adélio Rodrigues & Henggeler Antunes, Carlos, 2018. "Estimation of renewable energy and built environment-related variables using neural networks – A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 94(C), pages 959-988.
    17. Samuel Atuahene & Yukun Bao & Yao Yevenyo Ziggah & Patricia Semwaah Gyan & Feng Li, 2018. "Short-Term Electric Power Forecasting Using Dual-Stage Hierarchical Wavelet- Particle Swarm Optimization- Adaptive Neuro-Fuzzy Inference System PSO-ANFIS Approach Based On Climate Change," Energies, MDPI, vol. 11(10), pages 1-19, October.
    18. Yu, Jie & Chen, Kuilin & Mori, Junichi & Rashid, Mudassir M., 2013. "A Gaussian mixture copula model based localized Gaussian process regression approach for long-term wind speed prediction," Energy, Elsevier, vol. 61(C), pages 673-686.
    19. Croonenbroeck, Carsten & Ambach, Daniel, 2015. "Censored spatial wind power prediction with random effects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 51(C), pages 613-622.
    20. Huang, Weinan & Dong, Sheng, 2021. "Improved short-term prediction of significant wave height by decomposing deterministic and stochastic components," Renewable Energy, Elsevier, vol. 177(C), pages 743-758.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:90:y:2018:i:c:p:728-741. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.