IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v292y2021ics0306261921003743.html
   My bibliography  Save this article

A systematic comparison of machine learning methods for modeling of dynamic processes applied to combustion emission rate modeling

Author

Listed:
  • Tuttle, Jacob F.
  • Blackburn, Landen D.
  • Andersson, Klas
  • Powell, Kody M.

Abstract

Ten established, data-driven dynamic algorithms are surveyed and a practical guide for understanding these methods generated. Existing Python programming packages for implementing each algorithm are acknowledged, and the model equations necessary for prediction are presented. A case study on a coal-fired power plant’s NOx emission rates is performed, directly comparing each modeling method’s performance on a mutual system. Each model is evaluated by its root mean squared error (RMSE) on out-of-sample future horizon predictions. Optimal hyperparameters are identified using either an exhaustive search or genetic algorithm. The top five model structures of each method are used to recursively predict future NOx emission rates over a 60-step time horizon. The RMSE at each future timestep is determined, and the recursive output prediction trends compared against measurements in time. The GRU neural network is identified as the best candidate for representing the system, demonstrating accurate and stable predictions across the future horizon by all considered models, while satisfactory performance was observed in several of the ARX/NARX formulations. These efforts have contributed 1) a concise resource of multiple proven dynamic machine learning methods, 2) a practical guide explaining the use of these methods, effectively lowering the “barrier-to-entry” of deploying such models in control systems, 3) a comparison study evaluating each method’s performance on a mutual system, 4) demonstration of accurate multi-timestep emissions modeling suitable for systems-level control, and 5) generalizable results demonstrating the suitability of each method for prediction over a multi-step future horizon to other complex dynamic systems.

Suggested Citation

  • Tuttle, Jacob F. & Blackburn, Landen D. & Andersson, Klas & Powell, Kody M., 2021. "A systematic comparison of machine learning methods for modeling of dynamic processes applied to combustion emission rate modeling," Applied Energy, Elsevier, vol. 292(C).
  • Handle: RePEc:eee:appene:v:292:y:2021:i:c:s0306261921003743
    DOI: 10.1016/j.apenergy.2021.116886
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261921003743
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2021.116886?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cheung, Yin-Wong & Lai, Kon S, 1995. "Lag Order and Critical Values of a Modified Dickey-Fuller Test," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 57(3), pages 411-419, August.
    2. Cheung, Yin-Wong & Lai, Kon S, 1995. "Lag Order and Critical Values of the Augmented Dickey-Fuller Test," Journal of Business & Economic Statistics, American Statistical Association, vol. 13(3), pages 277-280, July.
    3. Smrekar, J. & Potočnik, P. & Senegačnik, A., 2013. "Multi-step-ahead prediction of NOx emissions for a coal-based boiler," Applied Energy, Elsevier, vol. 106(C), pages 89-99.
    4. Chris Tofallis, 2015. "A better measure of relative prediction accuracy for model selection and model estimation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(8), pages 1352-1362, August.
    5. K. Gnana Sheela & S. N. Deepa, 2013. "Review on Methods to Fix Number of Hidden Neurons in Neural Networks," Mathematical Problems in Engineering, Hindawi, vol. 2013, pages 1-11, June.
    6. Tang, Zhenhao & Zhang, Zijun, 2019. "The multi-objective optimization of combustion system operations based on deep data-driven models," Energy, Elsevier, vol. 182(C), pages 37-47.
    7. Tan, Peng & He, Biao & Zhang, Cheng & Rao, Debei & Li, Shengnan & Fang, Qingyan & Chen, Gang, 2019. "Dynamic modeling of NOX emission in a 660 MW coal-fired boiler with long short-term memory," Energy, Elsevier, vol. 176(C), pages 429-436.
    8. Tan, Peng & Xia, Ji & Zhang, Cheng & Fang, Qingyan & Chen, Gang, 2016. "Modeling and reduction of NOX emissions for a 700 MW coal-fired boiler with the advanced machine learning method," Energy, Elsevier, vol. 94(C), pages 672-679.
    9. Adamczyk, Wojciech P. & Isaac, Benjamin & Parra-Alvarez, John & Smith, Sean T. & Harris, Derek & Thornock, Jeremy N. & Zhou, Minmin & Smith, Philip J. & Żmuda, Robert, 2018. "Application of LES-CFD for predicting pulverized-coal working conditions after installation of NOx control system," Energy, Elsevier, vol. 160(C), pages 693-709.
    10. Yaxiong Zeng & Diego Klabjan, 2017. "Online Adaptive Machine Learning Based Algorithm for Implied Volatility Surface Modeling," Papers 1706.01833, arXiv.org, revised Jun 2018.
    11. Wang, H.Z. & Wang, G.B. & Li, G.Q. & Peng, J.C. & Liu, Y.T., 2016. "Deep belief network based deterministic and probabilistic wind speed forecasting approach," Applied Energy, Elsevier, vol. 182(C), pages 80-93.
    12. Wang, Chunlin & Liu, Yang & Zheng, Song & Jiang, Aipeng, 2018. "Optimizing combustion of coal fired boilers for reducing NOx emission using Gaussian Process," Energy, Elsevier, vol. 153(C), pages 149-158.
    13. Lin, Boqiang & Xu, Bin, 2018. "Growth of industrial CO2 emissions in Shanghai city: Evidence from a dynamic vector autoregression analysis," Energy, Elsevier, vol. 151(C), pages 167-177.
    14. Jiang, Xuguang & Chen, Dandan & Ma, Zengyi & Yan, Jianhua, 2017. "Models for the combustion of single solid fuel particles in fluidized beds: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 68(P1), pages 410-431.
    15. Zhou, Hao & Cen, Kefa & Fan, Jianren, 2004. "Modeling and optimization of the NOx emission characteristics of a tangentially fired boiler with artificial neural networks," Energy, Elsevier, vol. 29(1), pages 167-183.
    16. Luis A. Aguirre & Christophe Letellier, 2009. "Modeling Nonlinear Dynamics and Chaos: A Review," Mathematical Problems in Engineering, Hindawi, vol. 2009, pages 1-35, June.
    17. Lv, You & Liu, Jizhen & Yang, Tingting & Zeng, Deliang, 2013. "A novel least squares support vector machine ensemble model for NOx emission prediction of a coal-fired boiler," Energy, Elsevier, vol. 55(C), pages 319-329.
    18. Chris Tofallis, 2015. "A better measure of relative prediction accuracy for model selection and model estimation," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 66(3), pages 524-524, March.
    19. Bana Abuzayed & Nedal Al-Fayoumi & Lanouar Charfeddine, 2018. "Long range dependence in an emerging stock market’s sectors: volatility modelling and VaR forecasting," Applied Economics, Taylor & Francis Journals, vol. 50(23), pages 2569-2599, May.
    20. Yang, Guotian & Wang, Yingnan & Li, Xinli, 2020. "Prediction of the NOx emissions from thermal power plant using long-short term memory neural network," Energy, Elsevier, vol. 192(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Shicheng & Ma, Suxia & Wang, Fang, 2023. "A combined NOx emission prediction model based on semi-empirical model and black box models," Energy, Elsevier, vol. 264(C).
    2. Cesar de Lima Nogueira, Silvio & Och, Stephan Hennings & Moura, Luis Mauro & Domingues, Eric & Coelho, Leandro dos Santos & Mariani, Viviana Cocco, 2023. "Prediction of the NOx and CO2 emissions from an experimental dual fuel engine using optimized random forest combined with feature engineering," Energy, Elsevier, vol. 280(C).
    3. Alejandro Garcia-Basurto & Angel Perez-Cruz & Aurelio Dominguez-Gonzalez & Juan J. Saucedo-Dorantes, 2024. "Modeling and Prediction of Carbon Monoxide during the Start-Up in ICE through VARX Regression," Energies, MDPI, vol. 17(11), pages 1-21, May.
    4. Lv, Zhihan & Wang, Nana & Lou, Ranran & Tian, Yajun & Guizani, Mohsen, 2023. "Towards carbon Neutrality: Prediction of wave energy based on improved GRU in Maritime transportation," Applied Energy, Elsevier, vol. 331(C).
    5. Han, Zhezhe & Tang, Xiaoyu & Xie, Yue & Liang, Ruiyu & Bao, Yongqiang, 2024. "Prediction of heavy-oil combustion emissions with a semi-supervised learning model considering variable operation conditions," Energy, Elsevier, vol. 288(C).
    6. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    7. Liu, Chunming & Wang, Chunling & Yin, Yujun & Yang, Peihong & Jiang, Hui, 2022. "Bi-level dispatch and control strategy based on model predictive control for community integrated energy system considering dynamic response performance," Applied Energy, Elsevier, vol. 310(C).
    8. Wu, Zheng & Zhang, Yue & Dong, Ze, 2023. "Prediction of NOx emission concentration from coal-fired power plant based on joint knowledge and data driven," Energy, Elsevier, vol. 271(C).
    9. Ruomiao Yang & Tianfang Xie & Zhentao Liu, 2022. "The Application of Machine Learning Methods to Predict the Power Output of Internal Combustion Engines," Energies, MDPI, vol. 15(9), pages 1-16, April.
    10. Wang, Zhimin & Huang, Qian & Liu, Guanqing & Wang, Kexuan & Lyu, Junfu & Li, Shuiqing, 2024. "Knowledge-inspired data-driven prediction of overheating risks in flexible thermal-power plants," Applied Energy, Elsevier, vol. 364(C).
    11. Wang, Zhi & Peng, Xianyong & Zhou, Huaichun & Cao, Shengxian & Huang, Wenbo & Yan, Weijie & Li, Kuangyu & Fan, Siyuan, 2024. "A dynamic modeling method using channel-selection convolutional neural network: A case study of NOx emission," Energy, Elsevier, vol. 290(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wen, Xiaoqiang & Li, Kaichuang & Wang, Jianguo, 2023. "NOx emission predicting for coal-fired boilers based on ensemble learning methods and optimized base learners," Energy, Elsevier, vol. 264(C).
    2. Ding, Xiaosong & Feng, Chong & Yu, Peiling & Li, Kaiwen & Chen, Xi, 2023. "Gradient boosting decision tree in the prediction of NOx emission of waste incineration," Energy, Elsevier, vol. 264(C).
    3. Lv, You & Lv, Xuguang & Fang, Fang & Yang, Tingting & Romero, Carlos E., 2020. "Adaptive selective catalytic reduction model development using typical operating data in coal-fired power plants," Energy, Elsevier, vol. 192(C).
    4. Tan, Peng & He, Biao & Zhang, Cheng & Rao, Debei & Li, Shengnan & Fang, Qingyan & Chen, Gang, 2019. "Dynamic modeling of NOX emission in a 660 MW coal-fired boiler with long short-term memory," Energy, Elsevier, vol. 176(C), pages 429-436.
    5. Li, Ruilian & Zeng, Deliang & Li, Tingting & Ti, Baozhong & Hu, Yong, 2023. "Real-time prediction of SO2 emission concentration under wide range of variable loads by convolution-LSTM VE-transformer," Energy, Elsevier, vol. 269(C).
    6. Wang, Zhi & Peng, Xianyong & Zhou, Huaichun & Cao, Shengxian & Huang, Wenbo & Yan, Weijie & Li, Kuangyu & Fan, Siyuan, 2024. "A dynamic modeling method using channel-selection convolutional neural network: A case study of NOx emission," Energy, Elsevier, vol. 290(C).
    7. Fan, Yuchen & Liu, Xin & Zhang, Chaoqun & Li, Chi & Li, Xinying & Wang, Heyang, 2024. "Dynamic prediction of boiler NOx emission with graph convolutional gated recurrent unit model optimized by genetic algorithm," Energy, Elsevier, vol. 294(C).
    8. Li, Qingwei & Yao, Guihuan, 2017. "Improved coal combustion optimization model based on load balance and coal qualities," Energy, Elsevier, vol. 132(C), pages 204-212.
    9. Nan Li & You Lv & Yong Hu, 2022. "Prediction of NOx Emissions from a Coal-Fired Boiler Based on Convolutional Neural Networks with a Channel Attention Mechanism," Energies, MDPI, vol. 16(1), pages 1-11, December.
    10. Li, Xinli & Wang, Yingnan & Zhu, Yun & Yang, Guotian & Liu, He, 2021. "Temperature prediction of combustion level of ultra-supercritical unit through data mining and modelling," Energy, Elsevier, vol. 231(C).
    11. Tan, Peng & Xia, Ji & Zhang, Cheng & Fang, Qingyan & Chen, Gang, 2016. "Modeling and reduction of NOX emissions for a 700 MW coal-fired boiler with the advanced machine learning method," Energy, Elsevier, vol. 94(C), pages 672-679.
    12. Yang, Guotian & Wang, Yingnan & Li, Xinli, 2020. "Prediction of the NOx emissions from thermal power plant using long-short term memory neural network," Energy, Elsevier, vol. 192(C).
    13. Tang, Zhenhao & Wang, Shikui & Chai, Xiangying & Cao, Shengxian & Ouyang, Tinghui & Li, Yang, 2022. "Auto-encoder-extreme learning machine model for boiler NOx emission concentration prediction," Energy, Elsevier, vol. 256(C).
    14. Li, Shicheng & Ma, Suxia & Wang, Fang, 2023. "A combined NOx emission prediction model based on semi-empirical model and black box models," Energy, Elsevier, vol. 264(C).
    15. Darbandi, Masoud & Fatin, Ali & Bordbar, Hadi, 2020. "Numerical study on NOx reduction in a large-scale heavy fuel oil-fired boiler using suitable burner adjustments," Energy, Elsevier, vol. 199(C).
    16. Xie, Peiran & Gao, Mingming & Zhang, Hongfu & Niu, Yuguang & Wang, Xiaowen, 2020. "Dynamic modeling for NOx emission sequence prediction of SCR system outlet based on sequence to sequence long short-term memory network," Energy, Elsevier, vol. 190(C).
    17. Chuanpeng Zhu & Pu Huang & Yiguo Li, 2022. "Closed-Loop Combustion Optimization Based on Dynamic and Adaptive Models with Application to a Coal-Fired Boiler," Energies, MDPI, vol. 15(14), pages 1-16, July.
    18. Mark J Holmes & Jesús Otero & Theodore Panagiotidis, 2018. "Climbing the property ladder: An analysis of market integration in London property prices," Urban Studies, Urban Studies Journal Limited, vol. 55(12), pages 2660-2681, September.
    19. Keen Meng Choy & Hwee Kwan Chow, 2004. "Forecasting the Global Electronics Cycle with Leading Indicators: A VAR Approach," Econometric Society 2004 Australasian Meetings 223, Econometric Society.
    20. Pawel Milobedzki, 2010. "The Term Structure of the Polish Interbank Rates. A Note on the Symmetry of their Reversion to the Mean," Dynamic Econometric Models, Uniwersytet Mikolaja Kopernika, vol. 10, pages 81-95.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:292:y:2021:i:c:s0306261921003743. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.