Research on the Influence of Genetic Algorithm Parameters on XGBoost in Load Forecasting
Received: 30 August 2024 | Revised: 12 October 2024 | Accepted: 16 October 2024 | Online: 2 December 2024
Corresponding author: Thanh-Ngoc Tran
Abstract
Electric load forecasting is crucial in a power system comprising electricity generation, transmission, distribution, and retail. Due to its high accuracy, the ensemble learning method XGBoost has been widely applied in load forecasting. XGBoost's performance depends on its hyperparameters and the Genetic Algorithm (GA) is a commonly used algorithm in determining the optimal hyperparameters for this model. In this study, we propose a flowchart algorithm to investigate the impact of GA parameters on the accuracy of XGBoost models over the hyperparameter grid for load forecasting. The maximum load data of Queensland, Australia, are used for the research. The analysis of the results indicates that the accuracy of the XGBoost model significantly depends on the values of its hyperparameters. Using default hyperparameter values may lead to substantial errors in load forecasts, while selecting appropriate values for the GA to determine the optimal hyperparameters for the XGBoost model can significantly improve its accuracy.
Keywords:
load forecasting, XGBoost, genetic algorithmDownloads
References
M. Q. Raza and A. Khosravi, "A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings," Renewable and Sustainable Energy Reviews, vol. 50, pp. 1352–1372, Oct. 2015.
J. Walther, D. Spanier, N. Panten, and E. Abele, "Very short-term load forecasting on factory level – A machine learning approach," Procedia CIRP, vol. 80, pp. 705–710, Jan. 2019.
J. Kim, S. Cho, K. Ko, and R. R. Rao, "Short-term Electric Load Prediction Using Multiple Linear Regression Method," in IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, Aalborg, Denmark, Oct. 2018, pp. 1–6.
N. A. A. Jalil, M. H. Ahmad, and N. Mohamed, "Electricity Load Demand Forecasting Using Exponential Smoothing Methods," World Applied Sciences Journal, vol. 22, no. 11, pp. 1540–1543, 2013.
R. K. Jagait, M. N. Fekri, K. Grolinger, and S. Mir, "Load Forecasting Under Concept Drift: Online Ensemble Learning With Recurrent Neural Network and ARIMA," IEEE Access, vol. 9, pp. 98992–99008, Jan. 2021.
A. I. Arvanitidis, D. Bargiotas, A. Daskalopulu, V. M. Laitsos, and L. H. Tsoukalas, "Enhanced Short-Term Load Forecasting Using Artificial Neural Networks," Energies, vol. 14, no. 22, Jan. 2021, Art. no. 7788.
N.-H. Duong, M.-T. Nguyen, T.-H. Nguyen, and T.-P. Tran, "Application of Seasonal Trend Decomposition using Loess and Long Short-Term Memory in Peak Load Forecasting Model in Tien Giang," Engineering, Technology & Applied Science Research, vol. 13, no. 5, pp. 11628–11634, Oct. 2023.
M. Bhatnagar, V. Dwivedi, D. Singh, and G. Rozinaj, "Comprehensive Electric load forecasting using ensemble machine learning methods," in 29th International Conference on Systems, Signals and Image Processing, Sofia, Bulgaria, Jun. 2022, vol. CFP2255E-ART, pp. 1–4.
R. A. Abbasi, N. Javaid, M. N. J. Ghuman, Z. A. Khan, S. Ur Rehman, and Amanullah, "Short Term Load Forecasting Using XGBoost," in Web, Artificial Intelligence and Network Applications, L. Barolli, M. Takizawa, F. Xhafa, and T. Enokido, Eds. New York, NY, USA: Springer, 2019, pp. 1120–1131.
Y. Liu, H. Luo, B. Zhao, X. Zhao, and Z. Han, "Short-Term Power Load Forecasting Based on Clustering and XGBoost Method," in 9th International Conference on Software Engineering and Service Science, Beijing, China, Nov. 2018, pp. 536–539.
L. Yang and A. Shami, "On hyperparameter optimization of machine learning algorithms: Theory and practice," Neurocomputing, vol. 415, pp. 295–316, Nov. 2020.
A. Avci, M. Kocakulak, N. Acir, E. Gunes, and S. Turan, "A study on the monitoring of weld quality using XGBoost with Particle Swarm Optimization," Ain Shams Engineering Journal, vol. 15, no. 4, Apr. 2024, Art. no. 102651.
N. Ghatasheh, I. Altaharwa, and K. Aldebei, "Modified Genetic Algorithm for Feature Selection and Hyper Parameter Optimization: Case of XGBoost in Spam Prediction," IEEE Access, vol. 10, pp. 84365–84383, Jan. 2022.
Y. Jiang, G. Tong, H. Yin, and N. Xiong, "A Pedestrian Detection Method Based on Genetic Algorithm for Optimize XGBoost Training Parameters," IEEE Access, vol. 7, pp. 118310–118321, 2019.
V. H. Masand et al., "GA-XGBoost, an explainable AI technique, for analysis of thrombin inhibitory activity of diverse pool of molecules and supported by X-ray," Chemometrics and Intelligent Laboratory Systems, vol. 253, Oct. 2024, Art. no. 105197.
J. Deng, Y. Fu, Q. Liu, L. Chang, H. Li, and S. Liu, "Automatic Cardiopulmonary Endurance Assessment: A Machine Learning Approach Based on GA-XGBOOST," Diagnostics, vol. 12, no. 10, Oct. 2022, Art. no. 2538.
Y. Qu, Z. Lin, H. Li, and X. Zhang, "Feature Recognition of Urban Road Traffic Accidents Based on GA-XGBoost in the Context of Big Data," IEEE Access, vol. 7, pp. 170106–170115, Jan. 2019.
N. Thi Thuy Linh et al., "Flood susceptibility modeling based on new hybrid intelligence model: Optimization of XGboost model using GA metaheuristic algorithm," Advances in Space Research, vol. 69, no. 9, pp. 3301–3318, May 2022.
N. T. Tran, T. T. G. Tran, T. A. Nguyen, and M. B. Lam, "A new grid search algorithm based on XGBoost model for load forecasting," Bulletin of Electrical Engineering and Informatics, vol. 12, no. 4, pp. 1857–1866, Aug. 2023.
L. Jovanovic et al., "Improving Phishing Website Detection using a Hybrid Two-level Framework for Feature Selection and XGBoost Tuning," Journal of Web Engineering, vol. 22, no. 3, pp. 543–574, Feb. 2023.
S.-E. Ryu, D.-H. Shin, and K. Chung, "Prediction Model of Dementia Risk Based on XGBoost Using Derived Variable Extraction and Hyper Parameter Optimization," IEEE Access, vol. 8, pp. 177708–177720, Jan. 2020.
M. A. El-Shorbagy and A. M. El-Refaey, "Hybridization of Grasshopper Optimization Algorithm With Genetic Algorithm for Solving System of Non-Linear Equations," IEEE Access, vol. 8, pp. 220944–220961, Jan. 2020.
K. Ni, J. Wang, G. Tang, and D. Wei, "Research and Application of a Novel Hybrid Model Based on a Deep Neural Network for Electricity Load Forecasting: A Case Study in Australia," Energies, vol. 12, no. 13, Jan. 2019, Art. no. 2467.
J.-S. Chou, D.-N. Truong, and T.-L. Le, "Interval Forecasting of Financial Time Series by Accelerated Particle Swarm-Optimized Multi-Output Machine Learning System," IEEE Access, vol. 8, pp. 14798–14808, Jan. 2020.
R. S. Olson and J. H. Moore, "TPOT: A Tree-based Pipeline Optimization Tool for Automating Machine Learning," in Automatic Machine Learning: Methods, Systems, Challenges, Springer, 2019, pp. 151–160.
Downloads
How to Cite
License
Copyright (c) 2024 Thanh-Ngoc Tran, Quoc-Dai Nguyen
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
