Attention-Based Load Forecasting with Bidirectional Finetuning (With Fulltext)

Date

2024-09

Journal Title

Journal ISSN

Volume Title

Publisher

Multidisciplinary Digital Publishing Institute (MDPI)

Abstract

Accurate load forecasting is essential for the efficient and reliable operation of power systems. Traditional models primarily utilize unidirectional data reading, capturing dependencies from past to future. This paper proposes a novel approach that enhances load forecasting accuracy by fine tuning an attention-based model with a bidirectional reading of time-series data. By incorporating both forward and backward temporal dependencies, the model gains a more comprehensive understanding of consumption patterns, leading to improved performance. We present a mathematical framework supporting this approach, demonstrating its potential to reduce forecasting errors and improve robustness. Experimental results on real-world load datasets indicate that our bidirectional model outperforms state-of-the-art conventional unidirectional models, providing a more reliable tool for short and medium-term load forecasting. This research highlights the importance of bidirectional context in time-series forecasting and its practical implications for grid stability, economic efficiency, and resource planning. © 2024 by the authors.

Description

Keywords

Attention-based models, Bidirectional fine tuning, Deep learning, Energy demand prediction, Load forecasting, Machine learning, Power systems, Time-series forecasting

Citation

Kamalov, F., Zicmane, I., Safaraliev, M., Smail, L., Senyuk, M., & Matrenin, P. (2024). Attention-based load forecasting with bidirectional finetuning. Energies, 17(18), 4699. https://doi.org/10.3390/en17184699

DOI