IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v400y2025ics0306261925012656.html

Wind power prediction using foundation large time series models enhanced by time series prompt in exogenous and tuning forms

Author

Listed:
  • Fan, Yuwei
  • Song, Tao
  • Feng, Chenlong
  • Liu, Chao
  • Jiang, Dongxiang

Abstract

Large Time Series Models (LTSMs) hold broad application prospects in the field of energy, where time series analysis plays an important role in various practical downstream tasks such as power forecasting. However, the neglect of exogenous variables and limitations of full fine-tuning have hindered their adaptation to downstream tasks. Proposing the concept of Time Series Prompt (TSP), this work develops a TSP-based scheme to integrate exogenous variables into foundation LTSMs together with Parameter-Efficient Fine-Tuning (PEFT) method, enabling more flexible and effective adaptation. Firstly, this work proposes a TSP construction method that embeds exogenous variables as prompts to guide model generation without altering the model’s backbone. Secondly, a prompt-based PEFT method is introduced, known as prompt tuning (PT). By augmenting the input with artificial prompts optimized for downstream tasks, PT allows for the training of approximately only 10 % of the model’s parameters while the model’s backbone remains frozen. The presented scheme significantly enhances the flexibility of foundation LTSMs in adapting to downstream tasks. The proposed methods are validated in wind power prediction by ablation study, using Timer as an example of foundation LTSMs and adopting accurate or noisy future wind speed as exogenous variables. The results demonstrate that introducing exogenous variables via prompts can reduce the prediction MSE by approximately 50 %, and subsequent PT can further reduce the MSE by up to an additional 50 %. The results confirm the effectiveness of the TSP in foundation LTSMs, providing a reference for efficient and flexible adaptation of foundation LTSMs to wind power prediction.

Suggested Citation

  • Fan, Yuwei & Song, Tao & Feng, Chenlong & Liu, Chao & Jiang, Dongxiang, 2025. "Wind power prediction using foundation large time series models enhanced by time series prompt in exogenous and tuning forms," Applied Energy, Elsevier, vol. 400(C).
  • Handle: RePEc:eee:appene:v:400:y:2025:i:c:s0306261925012656
    DOI: 10.1016/j.apenergy.2025.126535
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925012656
    Download Restriction: Full text may be restricted for ScienceDirect subscribers

    File URL: https://libkey.io/10.1016/j.apenergy.2025.126535?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Jian & Zhang, Chaobo & Lu, Jie & Zhao, Yang, 2025. "Domain-specific large language models for fault diagnosis of heating, ventilation, and air conditioning systems by labeled-data-supervised fine-tuning," Applied Energy, Elsevier, vol. 377(PA).
    2. Wu, Tangjie & Ling, Qiang, 2024. "STELLM: Spatio-temporal enhanced pre-trained large language model for wind speed forecasting," Applied Energy, Elsevier, vol. 375(C).
    3. Feng, Chenlong & Liu, Chao & Jiang, Dongxiang, 2023. "Unsupervised anomaly detection using graph neural networks integrated with physical-statistical feature fusion and local-global learning," Renewable Energy, Elsevier, vol. 206(C), pages 309-323.
    4. Zhu, Yongchao & Zhu, Caichao & Tan, Jianjun & Wang, Yili & Tao, Jianquan, 2022. "Operational state assessment of wind turbine gearbox based on long short-term memory networks and fuzzy synthesis," Renewable Energy, Elsevier, vol. 181(C), pages 1167-1176.
    5. Zheng, Shuwen & Pan, Kai & Liu, Jie & Chen, Yunxia, 2024. "Empirical study on fine-tuning pre-trained large language models for fault diagnosis of complex systems," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    6. Liao, Wenlong & Wang, Shouxiang & Yang, Dechang & Yang, Zhe & Fang, Jiannong & Rehtanz, Christian & Porté-Agel, Fernando, 2025. "TimeGPT in load forecasting: A large time series model perspective," Applied Energy, Elsevier, vol. 379(C).
    7. Xu, Shiwei & Wang, Yongjun & Xu, Xinglei & Shi, Guang & Zheng, Yingya & Huang, He & Hong, Chengqiu, 2024. "A multi-step wind power group forecasting seq2seq architecture with spatial–temporal feature fusion and numerical weather prediction correction," Energy, Elsevier, vol. 291(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chang, Ling & Yu, Haibo & Yang, Minghan & Zhang, Ziheng & Chen, Shuai & Wang, Jianye, 2026. "NPP-GPT: Forecasting nuclear power plants operating parameters using pre-trained large language model," Applied Energy, Elsevier, vol. 409(C).
    2. Wei, Jiangxia & Zhang, Weiqiang & Zhang, Wenjie & Ren, Mifeng & Xu, Xinying & Cheng, Lan, 2025. "DBSTN: A dual-branch spatio-temporal network for wind power prediction using multi-modal fusion," Energy, Elsevier, vol. 341(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhang, Chaobo & Zhang, Jian & Lu, Jie & Zhao, Yang, 2026. "Large Language Models Meet Energy Systems: Opportunities, Challenges, and Future Perspectives," Applied Energy, Elsevier, vol. 403(PA).
    2. Yao, Jiachi & Han, Te, 2026. "Utilizing large-scale foundation models for prognostics and health management in wind turbines: Techniques, challenges, and future directions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 227(C).
    3. Antonesi, Gabriel & Cioara, Tudor & Anghel, Ionut & Michalakopoulos, Vasilis & Sarmas, Elissaios & Toderean, Liana, 2025. "A systematic review of transformers and large language models in the energy sector: towards agentic digital twins," Applied Energy, Elsevier, vol. 401(PA).
    4. Chang, Ling & Yu, Haibo & Yang, Minghan & Zhang, Ziheng & Chen, Shuai & Wang, Jianye, 2026. "NPP-GPT: Forecasting nuclear power plants operating parameters using pre-trained large language model," Applied Energy, Elsevier, vol. 409(C).
    5. Hu, Haowen & Chen, Fengxiang & Ye, Guoyun & Mo, Tiande & Li, Yu & Zhang, Xinfeng & Ye, Huan & Hou, Zhipeng & Zhang, Bo, 2026. "Renewable energy generation and load forecasting: Technologies, applications in hydrogen energy storage systems and future prospects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 235(C).
    6. Wang, Shun & Vidal, Yolanda & Pozo, Francesc, 2026. "Recent advances in wind turbine condition monitoring using SCADA data: A state-of-the-art review," Reliability Engineering and System Safety, Elsevier, vol. 267(PA).
    7. Aleassa, Omar & Bekhit, Mahmoud & Hussain, Walayat & Fattah, I.M.R., 2026. "Harnessing AI-driven large language models (LLMs) for enhanced forecasting and optimisation of wind and solar energy generation and load demand profiles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 239(C).
    8. Zhu, Yunyi & Xie, Bin & Wang, Anqi & Qian, Zheng, 2025. "Wind turbine fault detection and identification via self-attention-based dynamic graph representation learning and variable-level normalizing flow," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    9. Zhang, Chaobo & Zhang, Jian & Zhao, Yang & Lu, Jie, 2025. "Automated data-driven building energy load prediction method based on generative pre-trained transformers (GPT)," Energy, Elsevier, vol. 318(C).
    10. Cui, Jiawei & Zhai, Changhai & Wang, Yong & Li, Yuhao, 2026. "Large language models and AI agents in disaster-resilient infrastructure: concepts, applications, pathways, and challenges," Reliability Engineering and System Safety, Elsevier, vol. 272(P1).
    11. Liang, Jiali & Meng, Huixing & Mu, Yu, 2026. "Domain-specific large language model-driven risk analysis of battery energy storage systems," Reliability Engineering and System Safety, Elsevier, vol. 274(C).
    12. Li, Jianfang & Jia, Li & Zhou, Chengyu, 2024. "Probability density function based adaptive ensemble learning with global convergence for wind power prediction," Energy, Elsevier, vol. 312(C).
    13. Zhao, Shuaiyu & Yang, Haoyu & Kareck, Tylee L. & Khan, Faisal & Wang, Qingsheng, 2026. "Data-driven fault detection and diagnosis in industrial process systems: A systematic review and perspective," Reliability Engineering and System Safety, Elsevier, vol. 270(C).
    14. Chen, Siliang & Liang, Xinbin & Liu, Ying & Li, Xilin & Jin, Xinqiao & Du, Zhimin, 2025. "Customized large-scale model for human-AI collaborative operation and maintenance management of building energy systems," Applied Energy, Elsevier, vol. 393(C).
    15. Chen, Qingbin & Zhu, Lin & Yang, Dechang, 2026. "An explainable photovoltaic power forecasting method for output based on multi-dimensional similarity game fusion and ISCSO- XGBoost," Applied Energy, Elsevier, vol. 415(C).
    16. Li, Yanbin & Hu, Weikun & Zhang, Feng & Li, Yun, 2025. "Multi-objective collaborative operation optimization of park-level integrated energy system clusters considering green power forecasting and trading," Energy, Elsevier, vol. 319(C).
    17. Zhang, Xiangyu & Glaws, Andrew & Cortiella, Alexandre & Emami, Patrick & King, Ryan N., 2025. "Deep generative models in energy system applications: Review, challenges, and future directions," Applied Energy, Elsevier, vol. 380(C).
    18. Zhao, Juanru & Li, Ning, 2026. "Enhancing adversarial robustness of industrial fault diagnosis systems via causal inference-guided detection and purification," Reliability Engineering and System Safety, Elsevier, vol. 269(C).
    19. Ma, Changxi & Zhao, Mingxi, 2025. "Urban rail transit passenger flow prediction using large language model under multi-source spatiotemporal data fusion," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 675(C).
    20. Li, Jiteng & Koo, Jabeom & Lee, Jeyoon & Wang, Peng & Zhao, Tianyi & Yoon, Sungmin, 2025. "AI agent-driven virtual in-situ calibration for intelligent building digital twins," Energy, Elsevier, vol. 339(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:400:y:2025:i:c:s0306261925012656. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.