IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v400y2025ics0306261925012656.html

Wind power prediction using foundation large time series models enhanced by time series prompt in exogenous and tuning forms

Author

Listed:
  • Fan, Yuwei
  • Song, Tao
  • Feng, Chenlong
  • Liu, Chao
  • Jiang, Dongxiang

Abstract

Large Time Series Models (LTSMs) hold broad application prospects in the field of energy, where time series analysis plays an important role in various practical downstream tasks such as power forecasting. However, the neglect of exogenous variables and limitations of full fine-tuning have hindered their adaptation to downstream tasks. Proposing the concept of Time Series Prompt (TSP), this work develops a TSP-based scheme to integrate exogenous variables into foundation LTSMs together with Parameter-Efficient Fine-Tuning (PEFT) method, enabling more flexible and effective adaptation. Firstly, this work proposes a TSP construction method that embeds exogenous variables as prompts to guide model generation without altering the model’s backbone. Secondly, a prompt-based PEFT method is introduced, known as prompt tuning (PT). By augmenting the input with artificial prompts optimized for downstream tasks, PT allows for the training of approximately only 10 % of the model’s parameters while the model’s backbone remains frozen. The presented scheme significantly enhances the flexibility of foundation LTSMs in adapting to downstream tasks. The proposed methods are validated in wind power prediction by ablation study, using Timer as an example of foundation LTSMs and adopting accurate or noisy future wind speed as exogenous variables. The results demonstrate that introducing exogenous variables via prompts can reduce the prediction MSE by approximately 50 %, and subsequent PT can further reduce the MSE by up to an additional 50 %. The results confirm the effectiveness of the TSP in foundation LTSMs, providing a reference for efficient and flexible adaptation of foundation LTSMs to wind power prediction.

Suggested Citation

  • Fan, Yuwei & Song, Tao & Feng, Chenlong & Liu, Chao & Jiang, Dongxiang, 2025. "Wind power prediction using foundation large time series models enhanced by time series prompt in exogenous and tuning forms," Applied Energy, Elsevier, vol. 400(C).
  • Handle: RePEc:eee:appene:v:400:y:2025:i:c:s0306261925012656
    DOI: 10.1016/j.apenergy.2025.126535
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925012656
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.126535?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Zhang, Jian & Zhang, Chaobo & Lu, Jie & Zhao, Yang, 2025. "Domain-specific large language models for fault diagnosis of heating, ventilation, and air conditioning systems by labeled-data-supervised fine-tuning," Applied Energy, Elsevier, vol. 377(PA).
    2. Wu, Tangjie & Ling, Qiang, 2024. "STELLM: Spatio-temporal enhanced pre-trained large language model for wind speed forecasting," Applied Energy, Elsevier, vol. 375(C).
    3. Feng, Chenlong & Liu, Chao & Jiang, Dongxiang, 2023. "Unsupervised anomaly detection using graph neural networks integrated with physical-statistical feature fusion and local-global learning," Renewable Energy, Elsevier, vol. 206(C), pages 309-323.
    4. Zhu, Yongchao & Zhu, Caichao & Tan, Jianjun & Wang, Yili & Tao, Jianquan, 2022. "Operational state assessment of wind turbine gearbox based on long short-term memory networks and fuzzy synthesis," Renewable Energy, Elsevier, vol. 181(C), pages 1167-1176.
    5. Zheng, Shuwen & Pan, Kai & Liu, Jie & Chen, Yunxia, 2024. "Empirical study on fine-tuning pre-trained large language models for fault diagnosis of complex systems," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    6. Liao, Wenlong & Wang, Shouxiang & Yang, Dechang & Yang, Zhe & Fang, Jiannong & Rehtanz, Christian & Porté-Agel, Fernando, 2025. "TimeGPT in load forecasting: A large time series model perspective," Applied Energy, Elsevier, vol. 379(C).
    7. Xu, Shiwei & Wang, Yongjun & Xu, Xinglei & Shi, Guang & Zheng, Yingya & Huang, He & Hong, Chengqiu, 2024. "A multi-step wind power group forecasting seq2seq architecture with spatial–temporal feature fusion and numerical weather prediction correction," Energy, Elsevier, vol. 291(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wei, Jiangxia & Zhang, Weiqiang & Zhang, Wenjie & Ren, Mifeng & Xu, Xinying & Cheng, Lan, 2025. "DBSTN: A dual-branch spatio-temporal network for wind power prediction using multi-modal fusion," Energy, Elsevier, vol. 341(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antonesi, Gabriel & Cioara, Tudor & Anghel, Ionut & Michalakopoulos, Vasilis & Sarmas, Elissaios & Toderean, Liana, 2025. "A systematic review of transformers and large language models in the energy sector: towards agentic digital twins," Applied Energy, Elsevier, vol. 401(PA).
    2. Zhu, Yunyi & Xie, Bin & Wang, Anqi & Qian, Zheng, 2025. "Wind turbine fault detection and identification via self-attention-based dynamic graph representation learning and variable-level normalizing flow," Reliability Engineering and System Safety, Elsevier, vol. 253(C).
    3. Zhang, Chaobo & Zhang, Jian & Zhao, Yang & Lu, Jie, 2025. "Automated data-driven building energy load prediction method based on generative pre-trained transformers (GPT)," Energy, Elsevier, vol. 318(C).
    4. Li, Jianfang & Jia, Li & Zhou, Chengyu, 2024. "Probability density function based adaptive ensemble learning with global convergence for wind power prediction," Energy, Elsevier, vol. 312(C).
    5. Chen, Siliang & Liang, Xinbin & Liu, Ying & Li, Xilin & Jin, Xinqiao & Du, Zhimin, 2025. "Customized large-scale model for human-AI collaborative operation and maintenance management of building energy systems," Applied Energy, Elsevier, vol. 393(C).
    6. Li, Yanbin & Hu, Weikun & Zhang, Feng & Li, Yun, 2025. "Multi-objective collaborative operation optimization of park-level integrated energy system clusters considering green power forecasting and trading," Energy, Elsevier, vol. 319(C).
    7. Zhang, Xiangyu & Glaws, Andrew & Cortiella, Alexandre & Emami, Patrick & King, Ryan N., 2025. "Deep generative models in energy system applications: Review, challenges, and future directions," Applied Energy, Elsevier, vol. 380(C).
    8. Ma, Changxi & Zhao, Mingxi, 2025. "Urban rail transit passenger flow prediction using large language model under multi-source spatiotemporal data fusion," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 675(C).
    9. Li, Jiteng & Koo, Jabeom & Lee, Jeyoon & Wang, Peng & Zhao, Tianyi & Yoon, Sungmin, 2025. "AI agent-driven virtual in-situ calibration for intelligent building digital twins," Energy, Elsevier, vol. 339(C).
    10. Gursel, Ezgi & Madadi, Mahboubeh & Coble, Jamie Baalis & Agarwal, Vivek & Yadav, Vaibhav & Boring, Ronald L. & Khojandi, Anahita, 2025. "The role of AI in detecting and mitigating human errors in safety-critical industries: A review," Reliability Engineering and System Safety, Elsevier, vol. 256(C).
    11. Zhang, Fengqi & Si, Guojin & Chen, Zhen & Zheng, Meimei & Xia, Tangbin & Xi, Lifeng, 2025. "A multi-faceted opportunistic-based maintenance optimization in offshore wind farms using long-term wind speed forecasting," Renewable Energy, Elsevier, vol. 255(C).
    12. Zeng, Huanze & Wu, Binrong & Fang, Haoyu & Lin, Jiacheng, 2025. "Interpretable wind speed forecasting through two-stage decomposition with comprehensive relative importance analysis," Applied Energy, Elsevier, vol. 392(C).
    13. Valcamonico, Dario & Baraldi, Piero & Macêdo, July Bias & Moura, Márcio Das Chagas & Brown, Jonathan & Gauthier, Stéphane & Zio, Enrico, 2025. "A systematic procedure for the analysis of maintenance reports based on a taxonomy and BERT attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 257(PA).
    14. Yang, Mao & Guo, Yunfeng & Fan, Fulin & Huang, Tao, 2024. "Two-stage correction prediction of wind power based on numerical weather prediction wind speed superposition correction and improved clustering," Energy, Elsevier, vol. 302(C).
    15. Dong, Chenchen & Yang, Yu, 2025. "Dynamic risk-informed verification prioritization for Complex Product Systems: A tri-metric approach using a Multi-State Hierarchical Bayesian Network," Reliability Engineering and System Safety, Elsevier, vol. 262(C).
    16. Bian, Chong & Duan, Zhiyu & Li, Daoyi & Yang, Shunkun & Feng, Junlan, 2026. "Joint state-of-charge and state-of-health estimation of lithium-ion batteries across varying operational stages on differing timescales with large language model: a multi-task prompting method," Reliability Engineering and System Safety, Elsevier, vol. 267(PB).
    17. Chen, Yuejiang & He, Yingjing & Xiao, Jiang-Wen & Wang, Yan-Wu & Li, Yuanzheng, 2024. "Hybrid model based on similar power extraction and improved temporal convolutional network for probabilistic wind power forecasting," Energy, Elsevier, vol. 304(C).
    18. Gao, JiaJing & Xing, HongMei & Wang, YongSheng & Liu, GuangChen & Cheng, Bo & Zhang, DeLong, 2025. "Ultra-short-term wind power prediction based on hybrid denoising with improved CEEMD decomposition," Renewable Energy, Elsevier, vol. 251(C).
    19. Zhu, Yongchao & Zhu, Caichao & Tan, Jianjun & Song, Chaosheng & Chen, Dingliang & Zheng, Jie, 2022. "Fault detection of offshore wind turbine gearboxes based on deep adaptive networks via considering Spatio-temporal fusion," Renewable Energy, Elsevier, vol. 200(C), pages 1023-1036.
    20. Junshuai Yan & Yongqian Liu & Xiaoying Ren & Li Li, 2023. "Wind Turbine Gearbox Condition Monitoring Using Hybrid Attentions and Spatio-Temporal BiConvLSTM Network," Energies, MDPI, vol. 16(19), pages 1-22, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:400:y:2025:i:c:s0306261925012656. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.