Customer Churn Prediction for Telecommunication Companies using Machine Learning and Ensemble Methods
Received: 14 April 2024 | Revised: 23 April 2024 | Accepted: 25 April 2024 | Online: 1 June 2024
Corresponding author: Mohd Anul Haq
Abstract
This study investigates customer churn, which is a challenge in the telecommunications sector. Using a dataset of telecom customer churn, multiple classifiers were employed, including Random Forest, LGBM, XGBoost, Logistic Regression, Decision Trees, and a custom ANN model. A rigorous evaluation was conducted deploying cross-validation techniques to capture nuanced customer behavior. The models were optimized by hyperparameter tuning, improving their customer churn prediction results. An ensemble averaging method was also adopted, achieving an accuracy of 0.79 and a recall of 0.72 in the test data, which was slightly lower than that of the LGBM, XGBoost, and Logistic Regression. These findings contribute to the development of more reliable churn prediction models to ameliorate the customer retention rates and the operational performance of the service providers.
Keywords:
customer churn, XG-Boost, ensemble method, logistic regression, deep learningDownloads
References
W. Verbeke, D. Martens, C. Mues, and B. Baesens, "Building comprehensible customer churn prediction models with advanced rule induction techniques," Expert Systems with Applications, vol. 38, no. 3, pp. 2354–2364, Mar. 2011.
W. Verbeke, D. Martens, C. Mues, and B. Baesens, "Building comprehensible customer churn prediction models with advanced rule induction techniques," Expert Systems with Applications, vol. 38, no. 3, pp. 2354–2364, Mar. 2011.
A. Amin et al., "Customer churn prediction in the telecommunication sector using a rough set approach," Neurocomputing, vol. 237, pp. 242–254, May 2017.
C. Kirui, L. Hong, W. Cheruiyot, and H. Kirui, "Predicting Customer Churn in Mobile Telephony Industry Using Probabilistic Classifiers in Data Mining," International Journal of Computer Science Issues, vol. 10, no. 2, pp. 165–172, Mar. 2013.
M. H. Dunham, Data mining: Introductory and advanced topics. Upper Saddle River, NJ, USA: Prentice Hall, 2006.
F. Thabtah, "A review of associative classification mining," The Knowledge Engineering Review, vol. 22, no. 1, pp. 37–65, Mar. 2007.
J. Han, J. Pei, and H. Tong, Data Mining: Concepts and Techniques. Cambridge, MA, USA: Morgan Kaufmann, 2022.
K. Coussement and K. W. De Bock, "Customer churn prediction in the online gambling industry: The beneficial effect of ensemble learning," Journal of Business Research, vol. 66, no. 9, pp. 1629–1636, Sep. 2013.
S. Lessmann, B. Baesens, H. V. Seow, and L. C. Thomas, "Benchmarking state-of-the-art classification algorithms for credit scoring: An update of research," European Journal of Operational Research, vol. 247, no. 1, pp. 124–136, Nov. 2015.
T. Verbraken, W. Verbeke, and B. Baesens, "A Novel Profit Maximizing Metric for Measuring Classification Performance of Customer Churn Prediction Models," IEEE Transactions on Knowledge and Data Engineering, vol. 25, no. 5, pp. 961–973, Feb. 2013.
C. L. Huang, M. C. Chen, and C. J. Wang, "Credit scoring with a data mining approach based on support vector machines," Expert Systems with Applications, vol. 33, no. 4, pp. 847–856, Nov. 2007.
Y. Xie, X. Li, E. W. T. Ngai, and W. Ying, "Customer churn prediction using improved balanced random forests," Expert Systems with Applications, vol. 36, no. 3, pp. 5445–5449, Apr. 2009.
A. K. Ahmad, A. Jafar, and K. Aljoumaa, "Customer churn prediction in telecom using machine learning in big data platform," Journal of Big Data, vol. 6, no. 1, Mar. 2019, Art. no. 28.
K. Peng and Y. Peng, "Research on Telecom Customer Churn Prediction Based on GA-XGBoost and SHAP," Journal of Computer and Communications, vol. 10, no. 11, pp. 107–120, Nov. 2022.
T. Xu, Y. Ma, and K. Kim, "Telecom Churn Prediction System Based on Ensemble Learning Using Feature Grouping," Applied Sciences, vol. 11, no. 11, Jan. 2021, Art. no. 4742.
A. A. Q. Ahmed and D. Maheswari, "Churn prediction on huge telecom data using hybrid firefly based classification," Egyptian Informatics Journal, vol. 18, no. 3, pp. 215–220, Nov. 2017.
A. Sharma and D. P. K. Panigrahi, "A Neural Network based Approach for Predicting Customer Churn in Cellular Network Services," International Journal of Computer Applications, vol. 27, no. 11, pp. 26–31, Aug. 2011.
B. Huang, M. T. Kechadi, and B. Buckley, "Customer churn prediction in telecommunications," Expert Systems with Applications, vol. 39, no. 1, pp. 1414–1425, Jan. 2012.
A. T. Jahromi, M. Moeini, I. Akbari, and A. Akbarzadeh, "A Dual-Step Multi-Algorithm Approach for Churn Prediction in Pre-Paid Telecommunications Service Providers," Journal on Innovation and Sustainability RISUS, vol. 1, no. 2, 2010.
B. Q. Huang, M. T. Kechadi, and B. Buckley, "Customer Churn Prediction for Broadband Internet Services," in Data Warehousing and Knowledge Discovery, Penang, Malaysia, 2009, pp. 229–243.
R. M. Wahul, A. P. Kale, and P. N. Kota, "An Ensemble Learning Approach to Enhance Customer Churn Prediction in Telecom Industry," International Journal of Intelligent Systems and Applications in Engineering, vol. 11, no. 9s, pp. 258–266, Jul. 2023.
M. Bogaert and L. Delaere, "Ensemble Methods in Customer Churn Prediction: A Comparative Analysis of the State-of-the-Art," Mathematics, vol. 11, no. 5, Jan. 2023, Art. no. 1137.
K. W. De Bock and D. Van den Poel, "Reconciling performance and interpretability in customer churn prediction using ensemble learning based on generalized additive models," Expert Systems with Applications, vol. 39, no. 8, pp. 6816–6826, Jun. 2012.
T. Kimura, "Customer Churn Predition with Hybrid Resampling and Ensemble Learning," Journal of Management Information and Decision Sciences, vol. 25, no. 1, 2022.
A. Dhini and M. Fauzan, "Predicting Customer Churn using ensemble learning: Case Study of a Fixed Broadband Company," International Journal of Technology, vol. 12, no. 5, pp. 1030–1037, Dec. 2021.
A. Rahman and M. N. A. Khan, "A Classification Based Model to Assess Customer Behavior in Banking Sector," Engineering, Technology & Applied Science Research, vol. 8, no. 3, pp. 2949–2953, Jun. 2018.
E. Jamalian and R. Foukerdi, "A Hybrid Data Mining Method for Customer Churn Prediction," Engineering, Technology & Applied Science Research, vol. 8, no. 3, pp. 2991–2997, Jun. 2018.
M. A. Haq, "DBoTPM: A Deep Neural Network-Based Botnet Prediction Model," Electronics, vol. 12, no. 5, Jan. 2023, Art. no. 1159.
J. Gyani, M. A. Haq, and A. Ahmed, "Analyzing the Impact of Lockdown on COVID-19 Pandemic in Saudi Arabia," International Journal of Computer Science & Network Security, vol. 22, no. 4, pp. 39–46, 2022.
M. A. Haq and A. Ahmed, "On Interesting Correlation between Meteorological Parameters and COVID-19 Pandemic in Saudi Arabia," International Journal of Computer Science & Network Security, vol. 22, no. 4, pp. 159–168, 2022.
M. A. Haq, M. A. R. Khan, and M. Alshehri, "Insider Threat Detection Based on NLP Word Embedding and Machine Learning," Intelligent Automation and Soft Computing, vol. 33, no. 1, pp. 619–635, 2022.
S. Kumar et al., "Multilayer Neural Network Based Speech Emotion Recognition for Smart Assistance," Computers, Materials & Continua, vol. 74, no. 1, pp. 1523–1540, 2022.
A. Alabdulwahab, M. A. Haq, and M. Alshehri, "Cyberbullying Detection using Machine Learning and Deep Learning," International Journal of Advanced Computer Science and Applications, vol. 14, no. 10, pp. 424–432, 2023.
J. Gyani, A. Ahmed, and M. A. Haq, "MCDM and Various Prioritization Methods in AHP for CSS: A Comprehensive Review," IEEE Access, vol. 10, pp. 33492–33511, 2022.
G. Revathy, S. A. Alghamdi, S. M. Alahmari, S. R. Yonbawi, A. Kumar, and M. Anul Haq, "Sentiment analysis using machine learning: Progress in the machine intelligence for data science," Sustainable Energy Technologies and Assessments, vol. 53, Oct. 2022, Art. no. 102557.
M. Suresh, A. S. Shaik, B. Premalatha, V. A. Narayana, and G. Ghinea, "Intelligent & Smart Navigation System for Visually Impaired Friends," in Advanced Computing, Kolhapur, India, 2023, pp. 374–383.
S. Merugu, K. Jain, A. Mittal, and B. Raman, "Sub-scene Target Detection and Recognition Using Deep Learning Convolution Neural Networks," in ICDSMLA 2019, pp. 1082–1101.
A. Bathula, S. K. Gupta, S. Merugu, and S. S. Skandha, "Academic Projects on Certification Management Using Blockchain- A Review," in 2022 International Conference on Recent Trends in Microelectronics, Automation, Computing and Communications Systems (ICMACC), Hyderabad, India, Dec. 2022, pp. 1–6.
A. Bathula, S. Muhuri, S. K. Gupta, and S. Merugu, "Secure certificate sharing based on Blockchain framework for online education," Multimedia Tools and Applications, vol. 82, no. 11, pp. 16479–16500, May 2023.
Downloads
How to Cite
License
Copyright (c) 2024 Muteb Zarraq Alotaibi, Mohd Anul Haq
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
