IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0157551.html
   My bibliography  Save this article

Big Data: A Parallel Particle Swarm Optimization-Back-Propagation Neural Network Algorithm Based on MapReduce

Author

Listed:
  • Jianfang Cao
  • Hongyan Cui
  • Hao Shi
  • Lijuan Jiao

Abstract

A back-propagation (BP) neural network can solve complicated random nonlinear mapping problems; therefore, it can be applied to a wide range of problems. However, as the sample size increases, the time required to train BP neural networks becomes lengthy. Moreover, the classification accuracy decreases as well. To improve the classification accuracy and runtime efficiency of the BP neural network algorithm, we proposed a parallel design and realization method for a particle swarm optimization (PSO)-optimized BP neural network based on MapReduce on the Hadoop platform using both the PSO algorithm and a parallel design. The PSO algorithm was used to optimize the BP neural network’s initial weights and thresholds and improve the accuracy of the classification algorithm. The MapReduce parallel programming model was utilized to achieve parallel processing of the BP algorithm, thereby solving the problems of hardware and communication overhead when the BP neural network addresses big data. Datasets on 5 different scales were constructed using the scene image library from the SUN Database. The classification accuracy of the parallel PSO-BP neural network algorithm is approximately 92%, and the system efficiency is approximately 0.85, which presents obvious advantages when processing big data. The algorithm proposed in this study demonstrated both higher classification accuracy and improved time efficiency, which represents a significant improvement obtained from applying parallel processing to an intelligent algorithm on big data.

Suggested Citation

  • Jianfang Cao & Hongyan Cui & Hao Shi & Lijuan Jiao, 2016. "Big Data: A Parallel Particle Swarm Optimization-Back-Propagation Neural Network Algorithm Based on MapReduce," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-17, June.
    • Handle: RePEc:plo:pone00:0157551
    DOI: 10.1371/journal.pone.0157551
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0157551
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0157551&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0157551?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Yu, Feng & Xu, Xiaozhong, 2014. "A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network," Applied Energy, Elsevier, vol. 134(C), pages 102-113.
    2. Chiroma, Haruna & Abdulkareem, Sameem & Herawan, Tutut, 2015. "Evolutionary Neural Network model for West Texas Intermediate crude oil price prediction," Applied Energy, Elsevier, vol. 142(C), pages 266-273.
    3. Haruna Chiroma & Sameem Abdul-kareem & Abdullah Khan & Nazri Mohd Nawi & Abdulsalam Ya’u Gital & Liyana Shuib & Adamu I Abubakar & Muhammad Zubair Rahman & Tutut Herawan, 2015. "Global Warming: Predicting OPEC Carbon Dioxide Emissions from Petroleum Consumption Using Neural Network and Hybrid Cuckoo Search Algorithm," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-21, August.
    4. Younes Saadi & Iwan Tri Riyadi Yanto & Tutut Herawan & Vimala Balakrishnan & Haruna Chiroma & Anhar Risnumawan, 2016. "Ringed Seal Search for Global Optimization via a Sensitive Search Model," PLOS ONE, Public Library of Science, vol. 11(1), pages 1-31, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Shikha Agarwal & Prabhat Ranjan, 2018. "MR-TP-QFPSO: map reduce two phases quantum fuzzy PSO for feature selection," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 9(4), pages 888-900, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Krzysztof Drachal & Michał Pawłowski, 2021. "A Review of the Applications of Genetic Algorithms to Forecasting Prices of Commodities," Economies, MDPI, vol. 9(1), pages 1-22, January.
    2. Wei Sun & Chongchong Zhang, 2018. "A Hybrid BA-ELM Model Based on Factor Analysis and Similar-Day Approach for Short-Term Load Forecasting," Energies, MDPI, vol. 11(5), pages 1-18, May.
    3. Wang, Xin & Sun, Mei, 2021. "A novel prediction model of multi-layer symbolic pattern network: Based on causation entropy," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 575(C).
    4. Xiao, Liye & Shao, Wei & Liang, Tulu & Wang, Chen, 2016. "A combined model based on multiple seasonal patterns and modified firefly algorithm for electrical load forecasting," Applied Energy, Elsevier, vol. 167(C), pages 135-153.
    5. Donghua Wang & Tianhui Fang, 2022. "Forecasting Crude Oil Prices with a WT-FNN Model," Energies, MDPI, vol. 15(6), pages 1-21, March.
    6. Karasu, Seçkin & Altan, Aytaç, 2022. "Crude oil time series prediction model based on LSTM network with chaotic Henry gas solubility optimization," Energy, Elsevier, vol. 242(C).
    7. Radosław Puka & Bartosz Łamasz & Marek Michalski, 2021. "Effectiveness of Artificial Neural Networks in Hedging against WTI Crude Oil Price Risk," Energies, MDPI, vol. 14(11), pages 1-26, June.
    8. Ding, Song & Tao, Zui & Zhang, Huahan & Li, Yao, 2022. "Forecasting nuclear energy consumption in China and America: An optimized structure-adaptative grey model," Energy, Elsevier, vol. 239(PA).
    9. Zhang, Yue & Farnoosh, Arash, 2019. "Analyzing the dynamic impact of electricity futures on revenue and risk of renewable energy in China," Energy Policy, Elsevier, vol. 132(C), pages 678-690.
    10. Wei, Nan & Li, Changjun & Peng, Xiaolong & Li, Yang & Zeng, Fanhua, 2019. "Daily natural gas consumption forecasting via the application of a novel hybrid model," Applied Energy, Elsevier, vol. 250(C), pages 358-368.
    11. Ahmad, Tanveer & Chen, Huanxin, 2019. "Deep learning for multi-scale smart energy forecasting," Energy, Elsevier, vol. 175(C), pages 98-112.
    12. Zuzanna Karolak, 2021. "Energy prices forecasting using nonlinear univariate models," Bank i Kredyt, Narodowy Bank Polski, vol. 52(6), pages 577-598.
    13. Su, Chi-Wei & Wang, Dan & Mirza, Nawazish & Zhong, Yifan & Umar, Muhammad, 2023. "The impact of consumer confidence on oil prices," Energy Economics, Elsevier, vol. 124(C).
    14. Di Luan & Mingjing Zhao & Qianru Zhao & Nan Wang, 2021. "Modelling of integrated scheduling problem of capacitated equipment systems with a multi-lane road network," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-38, June.
    15. Cen, Zhongpei & Wang, Jun, 2019. "Crude oil price prediction model with long short term memory deep learning based on prior knowledge data transfer," Energy, Elsevier, vol. 169(C), pages 160-171.
    16. Zhen-Yao Chen & R. J. Kuo, 2019. "Combining SOM and evolutionary computation algorithms for RBF neural network training," Journal of Intelligent Manufacturing, Springer, vol. 30(3), pages 1137-1154, March.
    17. Szoplik, Jolanta, 2015. "Forecasting of natural gas consumption with artificial neural networks," Energy, Elsevier, vol. 85(C), pages 208-220.
    18. Ma, Teng & Li, Ming-Jia & Xu, Jin-Liang & Cao, Feng, 2019. "Thermodynamic analysis and performance prediction on dynamic response characteristic of PCHE in 1000 MW S-CO2 coal fired power plant," Energy, Elsevier, vol. 175(C), pages 123-138.
    19. Beyca, Omer Faruk & Ervural, Beyzanur Cayir & Tatoglu, Ekrem & Ozuyar, Pinar Gokcin & Zaim, Selim, 2019. "Using machine learning tools for forecasting natural gas consumption in the province of Istanbul," Energy Economics, Elsevier, vol. 80(C), pages 937-949.
    20. Hongxia Ge & Siteng Li & Rongjun Cheng & Zhenlei Chen, 2022. "Self-Attention ConvLSTM for Spatiotemporal Forecasting of Short-Term Online Car-Hailing Demand," Sustainability, MDPI, vol. 14(12), pages 1-16, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0157551. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.