IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/jrc58.html
   My bibliography  Save this paper

Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics

Author

Listed:
  • Mosavi, Amir
  • Faghan, Yaser
  • Ghamisi, Pedram
  • Duan, Puhong
  • Ardabili, Sina Faizollahzadeh
  • Hassan, Salwana
  • Band, Shahab S.

Abstract

The popularity of deep reinforcement learning (DRL) applications in economics has increased exponentially. DRL, through a wide range of capabilities from reinforcement learning (RL) to deep learning (DL), offers vast opportunities for handling sophisticated dynamic economics systems. DRL is characterized by scalability with the potential to be applied to high-dimensional problems in conjunction with noisy and nonlinear patterns of economic data. In this paper, we initially consider a brief review of DL, RL, and deep RL methods in diverse applications in economics, providing an in-depth insight into the state-of-the-art. Furthermore, the architecture of DRL applied to economic applications is investigated in order to highlight the complexity, robustness, accuracy, performance, computational tasks, risk constraints, and profitability. The survey results indicate that DRL can provide better performance and higher efficiency as compared to the traditional algorithms while facing real economic problems in the presence of risk parameters and the ever-increasing uncertainties.

Suggested Citation

  • Mosavi, Amir & Faghan, Yaser & Ghamisi, Pedram & Duan, Puhong & Ardabili, Sina Faizollahzadeh & Hassan, Salwana & Band, Shahab S., 2020. "Comprehensive Review of Deep Reinforcement Learning Methods and Applications in Economics," OSF Preprints jrc58, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:jrc58
    DOI: 10.31219/osf.io/jrc58
    as

    Download full text from publisher

    File URL: https://osf.io/download/5f6684f39e9a3d004f6e35aa/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/jrc58?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Li, Danny H.W. & Lou, Siwei & Lam, Joseph C. & Wu, Ronald H.T., 2016. "Determining solar irradiance on inclined planes from classified CIE (International Commission on Illumination) standard skies," Energy, Elsevier, vol. 101(C), pages 462-470.
    2. Jamil, Basharat & Akhtar, Naiem, 2017. "Estimation of diffuse solar radiation in humid-subtropical climatic region of India: Comparison of diffuse fraction and diffusion coefficient models," Energy, Elsevier, vol. 131(C), pages 149-164.
    3. Martin Hofmann & Gunther Seckmeyer, 2017. "A New Model for Estimating the Diffuse Fraction of Solar Irradiance for Photovoltaic System Simulations," Energies, MDPI, vol. 10(2), pages 1-21, February.
    4. Kontoleon, K.J., 2015. "Glazing solar heat gain analysis and optimization at varying orientations and placements in aspect of distributed radiation at the interior surfaces," Applied Energy, Elsevier, vol. 144(C), pages 152-164.
    5. Li, Danny H.W. & Yang, Liu & Lam, Joseph C., 2013. "Zero energy buildings and sustainable development implications – A review," Energy, Elsevier, vol. 54(C), pages 1-10.
    6. Majid Dehghani & Hossein Riahi-Madvar & Farhad Hooshyaripor & Amir Mosavi & Shahaboddin Shamshirband & Edmundas Kazimieras Zavadskas & Kwok-wing Chau, 2019. "Prediction of Hydropower Generation Using Grey Wolf Optimization Adaptive Neuro-Fuzzy Inference System," Energies, MDPI, vol. 12(2), pages 1-20, January.
    7. Rojas, Redlich García & Alvarado, Natalia & Boland, John & Escobar, Rodrigo & Castillejo-Cuberos, Armando, 2019. "Diffuse fraction estimation using the BRL model and relationship of predictors under Chilean, Costa Rican and Australian climatic conditions," Renewable Energy, Elsevier, vol. 136(C), pages 1091-1106.
    8. Qing, Xiangyun & Niu, Yugang, 2018. "Hourly day-ahead solar irradiance prediction using weather forecasts by LSTM," Energy, Elsevier, vol. 148(C), pages 461-468.
    9. Kong, Chengdong & Xu, Zilin & Yao, Qiang, 2013. "Outdoor performance of a low-concentrated photovoltaic–thermal hybrid system with crystalline silicon solar cells," Applied Energy, Elsevier, vol. 112(C), pages 618-625.
    10. Li, Danny H.W. & Cheung, K.L. & Lam, Tony N.T. & Chan, Wilco W.H., 2012. "A study of grid-connected photovoltaic (PV) system in Hong Kong," Applied Energy, Elsevier, vol. 90(1), pages 122-127.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ben Hambly & Renyuan Xu & Huining Yang, 2021. "Recent Advances in Reinforcement Learning in Finance," Papers 2112.04553, arXiv.org, revised Feb 2023.
    2. Valentin Kuleto & Milena Ilić & Mihail Dumangiu & Marko Ranković & Oliva M. D. Martins & Dan Păun & Larisa Mihoreanu, 2021. "Exploring Opportunities and Challenges of Artificial Intelligence and Machine Learning in Higher Education Institutions," Sustainability, MDPI, vol. 13(18), pages 1-16, September.
    3. Petr Suler & Zuzana Rowland & Tomas Krulicky, 2021. "Evaluation of the Accuracy of Machine Learning Predictions of the Czech Republic’s Exports to the China," JRFM, MDPI, vol. 14(2), pages 1-30, February.
    4. Fatemehsadat Mirshafiee & Emad Shahbazi & Mohadeseh Safi & Rituraj Rituraj, 2023. "Predicting Power and Hydrogen Generation of a Renewable Energy Converter Utilizing Data-Driven Methods: A Sustainable Smart Grid Case Study," Energies, MDPI, vol. 16(1), pages 1-20, January.
    5. Chien-Liang Chiu & Paoyu Huang & Min-Yuh Day & Yensen Ni & Yuhsin Chen, 2024. "Mastery of “Monthly Effects”: Big Data Insights into Contrarian Strategies for DJI 30 and NDX 100 Stocks over a Two-Decade Period," Mathematics, MDPI, vol. 12(2), pages 1-22, January.
    6. Rui (Aruhan) Shi, 2021. "Learning from Zero: How to Make Consumption-Saving Decisions in a Stochastic Environment with an AI Algorithm," CESifo Working Paper Series 9255, CESifo.
    7. Reilly Pickard & Yuri Lawryshyn, 2023. "Deep Reinforcement Learning for Dynamic Stock Option Hedging: A Review," Mathematics, MDPI, vol. 11(24), pages 1-19, December.
    8. Rui & Shi, 2021. "Learning from zero: how to make consumption-saving decisions in a stochastic environment with an AI algorithm," Papers 2105.10099, arXiv.org, revised Feb 2022.
    9. Brini, Alessio & Tedeschi, Gabriele & Tantari, Daniele, 2023. "Reinforcement learning policy recommendation for interbank network stability," Journal of Financial Stability, Elsevier, vol. 67(C).
    10. Charl Maree & Christian W. Omlin, 2022. "Balancing Profit, Risk, and Sustainability for Portfolio Management," Papers 2207.02134, arXiv.org.
    11. Bruno Gašperov & Stjepan Begušić & Petra Posedel Šimović & Zvonko Kostanjčar, 2021. "Reinforcement Learning Approaches to Optimal Market Making," Mathematics, MDPI, vol. 9(21), pages 1-22, October.
    12. Mei-Li Shen & Cheng-Feng Lee & Hsiou-Hsiang Liu & Po-Yin Chang & Cheng-Hong Yang, 2021. "An Effective Hybrid Approach for Forecasting Currency Exchange Rates," Sustainability, MDPI, vol. 13(5), pages 1-29, March.
    13. Jan Niederreiter, 2023. "Broadening Economics in the Era of Artificial Intelligence and Experimental Evidence," Italian Economic Journal: A Continuation of Rivista Italiana degli Economisti and Giornale degli Economisti, Springer;Società Italiana degli Economisti (Italian Economic Association), vol. 9(1), pages 265-294, March.
    14. Amir Masoud Rahmani & Efat Yousefpoor & Mohammad Sadegh Yousefpoor & Zahid Mehmood & Amir Haider & Mehdi Hosseinzadeh & Rizwan Ali Naqvi, 2021. "Machine Learning (ML) in Medicine: Review, Applications, and Challenges," Mathematics, MDPI, vol. 9(22), pages 1-52, November.
    15. Ben Hambly & Renyuan Xu & Huining Yang, 2023. "Recent advances in reinforcement learning in finance," Mathematical Finance, Wiley Blackwell, vol. 33(3), pages 437-503, July.
    16. Adrian Millea, 2021. "Deep Reinforcement Learning for Trading—A Critical Survey," Data, MDPI, vol. 6(11), pages 1-25, November.
    17. Tian Zhu & Wei Zhu, 2022. "Quantitative Trading through Random Perturbation Q-Network with Nonlinear Transaction Costs," Stats, MDPI, vol. 5(2), pages 1-15, June.
    18. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    19. Callum Rhys Tilbury, 2022. "Reinforcement Learning for Economic Policy: A New Frontier?," Papers 2206.08781, arXiv.org, revised Feb 2023.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lou, Siwei & Li, Danny H.W. & Lam, Joseph C. & Chan, Wilco W.H., 2016. "Prediction of diffuse solar irradiance using machine learning and multivariable regression," Applied Energy, Elsevier, vol. 181(C), pages 367-374.
    2. Li, Danny H.W. & Lou, Siwei, 2018. "Review of solar irradiance and daylight illuminance modeling and sky classification," Renewable Energy, Elsevier, vol. 126(C), pages 445-453.
    3. Yang, Liu & Cao, Qimeng & Yu, Ying & Liu, Yan, 2020. "Comparison of daily diffuse radiation models in regions of China without solar radiation measurement," Energy, Elsevier, vol. 191(C).
    4. Makade, Rahul G. & Chakrabarti, Siddharth & Jamil, Basharat & Sakhale, C.N., 2020. "Estimation of global solar radiation for the tropical wet climatic region of India: A theory of experimentation approach," Renewable Energy, Elsevier, vol. 146(C), pages 2044-2059.
    5. Jiaxin Yu & Jun Wang, 2020. "Optimization Design of a Rain-Power Utilization System Based on a Siphon and Its Application in a High-Rise Building," Energies, MDPI, vol. 13(18), pages 1-18, September.
    6. Ahmed, R. & Sreeram, V. & Mishra, Y. & Arif, M.D., 2020. "A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization," Renewable and Sustainable Energy Reviews, Elsevier, vol. 124(C).
    7. Karathanassis, I.K. & Papanicolaou, E. & Belessiotis, V. & Bergeles, G.C., 2017. "Design and experimental evaluation of a parabolic-trough concentrating photovoltaic/thermal (CPVT) system with high-efficiency cooling," Renewable Energy, Elsevier, vol. 101(C), pages 467-483.
    8. Gao, Yuan & Miyata, Shohei & Akashi, Yasunori, 2022. "Interpretable deep learning models for hourly solar radiation prediction based on graph neural network and attention," Applied Energy, Elsevier, vol. 321(C).
    9. Deng, S. & Wang, R.Z. & Dai, Y.J., 2014. "How to evaluate performance of net zero energy building – A literature research," Energy, Elsevier, vol. 71(C), pages 1-16.
    10. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    11. Zheng, Lingwei & Su, Ran & Sun, Xinyu & Guo, Siqi, 2023. "Historical PV-output characteristic extraction based weather-type classification strategy and its forecasting method for the day-ahead prediction of PV output," Energy, Elsevier, vol. 271(C).
    12. Wei, Nan & Li, Changjun & Peng, Xiaolong & Li, Yang & Zeng, Fanhua, 2019. "Daily natural gas consumption forecasting via the application of a novel hybrid model," Applied Energy, Elsevier, vol. 250(C), pages 358-368.
    13. Gao, Jiajia & Li, Anbang & Xu, Xinhua & Gang, Wenjie & Yan, Tian, 2018. "Ground heat exchangers: Applications, technology integration and potentials for zero energy buildings," Renewable Energy, Elsevier, vol. 128(PA), pages 337-349.
    14. Xiao, Zenan & Huang, Xiaoqiao & Liu, Jun & Li, Chengli & Tai, Yonghang, 2023. "A novel method based on time series ensemble model for hourly photovoltaic power prediction," Energy, Elsevier, vol. 276(C).
    15. Jia, Shuning & Sheng, Kai & Huang, Dehai & Hu, Kai & Xu, Yizhe & Yan, Chengchu, 2023. "Design optimization of energy systems for zero energy buildings based on grid-friendly interaction with smart grid," Energy, Elsevier, vol. 284(C).
    16. Jovanović, Marina & Vučićević, Biljana & Turanjanin, Valentina & Živković, Marija & Spasojević, Vuk, 2014. "Investigation of indoor and outdoor air quality of the classrooms at a school in Serbia," Energy, Elsevier, vol. 77(C), pages 42-48.
    17. Wang, Xiaoyang & Sun, Yunlin & Luo, Duo & Peng, Jinqing, 2022. "Comparative study of machine learning approaches for predicting short-term photovoltaic power output based on weather type classification," Energy, Elsevier, vol. 240(C).
    18. Ajith, Meenu & Martínez-Ramón, Manel, 2023. "Deep learning algorithms for very short term solar irradiance forecasting: A survey," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    19. Younes Zahraoui & Ibrahim Alhamrouni & Saad Mekhilef & M. Reyasudin Basir Khan & Mehdi Seyedmahmoudian & Alex Stojcevski & Ben Horan, 2021. "Energy Management System in Microgrids: A Comprehensive Review," Sustainability, MDPI, vol. 13(19), pages 1-33, September.
    20. Kaloop, Mosbeh R. & Bardhan, Abidhan & Kardani, Navid & Samui, Pijush & Hu, Jong Wan & Ramzy, Ahmed, 2021. "Novel application of adaptive swarm intelligence techniques coupled with adaptive network-based fuzzy inference system in predicting photovoltaic power," Renewable and Sustainable Energy Reviews, Elsevier, vol. 148(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:jrc58. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.