IDEAS home Printed from https://ideas.repec.org/a/eee/apmaco/v393y2021ics0096300320307505.html
   My bibliography  Save this article

A quasi fractional order gradient descent method with adaptive stepsize and its application in system identification

Author

Listed:
  • Liu, Jianjun
  • Zhai, Rui
  • Liu, Yuhan
  • Li, Wenliang
  • Wang, Bingzhe
  • Huang, Liyuan

Abstract

In this paper, the fractional order gradient method (FOGM) is extended to the solution of high-dimensional function optimization problems. A quasi fractional order gradient descent method (QFOGDM) is proposed and then introduce an adaptive stepsize into QFOGDM. The theoretic analysis for convergence of QFOGDM is be done by three theorems. The numerical experiments for solving 15 unconstrained optimization benchmarks are compared to show its’ better performance. Meanwhile, the proposed algorithm is utilized to identify the parameters in the linear discrete deterministic systems and achieves a better convergence rate and accuracy.

Suggested Citation

  • Liu, Jianjun & Zhai, Rui & Liu, Yuhan & Li, Wenliang & Wang, Bingzhe & Huang, Liyuan, 2021. "A quasi fractional order gradient descent method with adaptive stepsize and its application in system identification," Applied Mathematics and Computation, Elsevier, vol. 393(C).
    • Handle: RePEc:eee:apmaco:v:393:y:2021:i:c:s0096300320307505
    DOI: 10.1016/j.amc.2020.125797
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0096300320307505
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.amc.2020.125797?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jianjun Liu & Xiangmin Xu & Xuehui Cui, 2018. "An accelerated nonmonotone trust region method with adaptive trust region for unconstrained optimization," Computational Optimization and Applications, Springer, vol. 69(1), pages 77-97, January.
    2. Jing Bai & Guoguang Wen & Ahmed Rahmani & Yongguang Yu, 2015. "Distributed formation control of fractional-order multi-agent systems with absolute damping and communication delay," International Journal of Systems Science, Taylor & Francis Journals, vol. 46(13), pages 2380-2392, October.
    3. Wenyu Sun & Ya-Xiang Yuan, 2006. "Optimization Theory and Methods," Springer Optimization and Its Applications, Springer, number 978-0-387-24976-6, September.
    4. Žecová, Monika & Terpák, Ján, 2015. "Heat conduction modeling by using fractional-order derivatives," Applied Mathematics and Computation, Elsevier, vol. 257(C), pages 365-373.
    5. Jiaxun Liu & Zuoxun Wang & Minglei Shu & Fangfang Zhang & Sen Leng & Xiaohui Sun, 2019. "Secure Communication of Fractional Complex Chaotic Systems Based on Fractional Difference Function Synchronization," Complexity, Hindawi, vol. 2019, pages 1-10, August.
    6. Chen, Yuquan & Gao, Qing & Wei, Yiheng & Wang, Yong, 2017. "Study on fractional order gradient methods," Applied Mathematics and Computation, Elsevier, vol. 314(C), pages 310-321.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chaudhary, Naveed Ishtiaq & Khan, Zeshan Aslam & Kiani, Adiqa Kausar & Raja, Muhammad Asif Zahoor & Chaudhary, Iqra Ishtiaq & Pinto, Carla M.A., 2022. "Design of auxiliary model based normalized fractional gradient algorithm for nonlinear output-error systems," Chaos, Solitons & Fractals, Elsevier, vol. 163(C).
    2. Mei-Qi, Wang & Wen-Li, Ma & En-Li, Chen & Yu-Jian, Chang & Cui-Yan, Wang, 2022. "Principal resonance analysis of piecewise nonlinear oscillator with fractional calculus," Chaos, Solitons & Fractals, Elsevier, vol. 154(C).
    3. Han, Xiaohui & Dong, Jianping, 2023. "Applications of fractional gradient descent method with adaptive momentum in BP neural networks," Applied Mathematics and Computation, Elsevier, vol. 448(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yasushi Narushima & Shummin Nakayama & Masashi Takemura & Hiroshi Yabe, 2023. "Memoryless Quasi-Newton Methods Based on the Spectral-Scaling Broyden Family for Riemannian Optimization," Journal of Optimization Theory and Applications, Springer, vol. 197(2), pages 639-664, May.
    2. Saha, Tanay & Rakshit, Suman & Khare, Swanand R., 2023. "Linearly structured quadratic model updating using partial incomplete eigendata," Applied Mathematics and Computation, Elsevier, vol. 446(C).
    3. Guang Li & Paat Rusmevichientong & Huseyin Topaloglu, 2015. "The d -Level Nested Logit Model: Assortment and Price Optimization Problems," Operations Research, INFORMS, vol. 63(2), pages 325-342, April.
    4. Zheng, Sanpeng & Feng, Renzhong, 2023. "A variable projection method for the general radial basis function neural network," Applied Mathematics and Computation, Elsevier, vol. 451(C).
    5. Jörg Fliege & Andrey Tin & Alain Zemkoho, 2021. "Gauss–Newton-type methods for bilevel optimization," Computational Optimization and Applications, Springer, vol. 78(3), pages 793-824, April.
    6. Naveed Ishtiaq Chaudhary & Muhammad Asif Zahoor Raja & Zeshan Aslam Khan & Khalid Mehmood Cheema & Ahmad H. Milyani, 2021. "Hierarchical Quasi-Fractional Gradient Descent Method for Parameter Estimation of Nonlinear ARX Systems Using Key Term Separation Principle," Mathematics, MDPI, vol. 9(24), pages 1-14, December.
    7. Hai-Jun Wang & Qin Ni, 2010. "A Convex Approximation Method For Large Scale Linear Inequality Constrained Minimization," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 27(01), pages 85-101.
    8. Chih-Hsueh Lin & Chia-Wei Ho & Guo-Hsin Hu & Baswanth Sreeramaneni & Jun-Juh Yan, 2021. "Secure Data Transmission Based on Adaptive Chattering-Free Sliding Mode Synchronization of Unified Chaotic Systems," Mathematics, MDPI, vol. 9(21), pages 1-11, October.
    9. Chen, Liang, 2016. "A high-order modified Levenberg–Marquardt method for systems of nonlinear equations with fourth-order convergence," Applied Mathematics and Computation, Elsevier, vol. 285(C), pages 79-93.
    10. Ji, Li-Qun, 2015. "An assessment of agricultural residue resources for liquid biofuel production in China," Renewable and Sustainable Energy Reviews, Elsevier, vol. 44(C), pages 561-575.
    11. Babaie-Kafaki, Saman & Ghanbari, Reza, 2014. "The Dai–Liao nonlinear conjugate gradient method with optimal parameter choices," European Journal of Operational Research, Elsevier, vol. 234(3), pages 625-630.
    12. Marko Miladinović & Predrag Stanimirović & Sladjana Miljković, 2011. "Scalar Correction Method for Solving Large Scale Unconstrained Minimization Problems," Journal of Optimization Theory and Applications, Springer, vol. 151(2), pages 304-320, November.
    13. Wei Bian & Xiaojun Chen, 2017. "Optimality and Complexity for Constrained Optimization Problems with Nonconvex Regularization," Mathematics of Operations Research, INFORMS, vol. 42(4), pages 1063-1084, November.
    14. Yutao Zheng & Bing Zheng, 2017. "Two New Dai–Liao-Type Conjugate Gradient Methods for Unconstrained Optimization Problems," Journal of Optimization Theory and Applications, Springer, vol. 175(2), pages 502-509, November.
    15. Chaudhary, Naveed Ishtiaq & Raja, Muhammad Asif Zahoor & Khan, Zeshan Aslam & Mehmood, Ammara & Shah, Syed Muslim, 2022. "Design of fractional hierarchical gradient descent algorithm for parameter estimation of nonlinear control autoregressive systems," Chaos, Solitons & Fractals, Elsevier, vol. 157(C).
    16. Han, Xiaohui & Dong, Jianping, 2023. "Applications of fractional gradient descent method with adaptive momentum in BP neural networks," Applied Mathematics and Computation, Elsevier, vol. 448(C).
    17. Xiaojing Zhu & Hiroyuki Sato, 2020. "Riemannian conjugate gradient methods with inverse retraction," Computational Optimization and Applications, Springer, vol. 77(3), pages 779-810, December.
    18. Jing Bai & Yongguang Yu, 2018. "Neural Networks Based Adaptive Consensus for a Class of Fractional-Order Uncertain Nonlinear Multiagent Systems," Complexity, Hindawi, vol. 2018, pages 1-10, November.
    19. Li, Jinqing & Ma, Jun, 2019. "Maximum penalized likelihood estimation of additive hazards models with partly interval censoring," Computational Statistics & Data Analysis, Elsevier, vol. 137(C), pages 170-180.
    20. Yuan, Xiaolin & Mo, Lipo & Yu, Yongguang, 2019. "Agreement coordination of fractional-order multi-agent systems with reaction–diffusion and persistent disturbances," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 525(C), pages 680-693.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:apmaco:v:393:y:2021:i:c:s0096300320307505. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/applied-mathematics-and-computation .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.