Effective Feature Prediction Models for Student Performance
Received: 30 August 2023 | Revised: 15 September 2023 | Accepted: 18 September 2023 | Online: 13 October 2023
Corresponding author: Nahla Aljojo
Abstract
The ability to accurately predict how students will perform has a significant impact on the teaching and learning process, as it can inform the instructor to devote extra attention to a particular student or group of students, which in turn prevents those students from failing a certain course. When it comes to educational data mining, the accuracy and explainability of predictions are of equal importance. Accuracy refers to the degree to which the predicted value was accurate, and explainability refers to the degree to which the predicted value could be understood. This study used machine learning to predict the features that best contribute to the performance of a student, using a dataset collected from a public university in Jeddah, Saudi Arabia. Experimental analysis was carried out with Black-Box (BB) and White-Box (WB) machine-learning classification models. In BB classification models, a decision (or class) is often predicted with limited explainability on why this decision was made, while in WB classification models decisions made are fully interpretable to the stakeholders. The results showed that these BB models performed similarly in terms of accuracy and recall whether the classifiers attempted to predict an A or an F grade. When comparing the classifiers' accuracy in making predictions on B grade, the Support Vector Machine (SVM) was found to be superior to Naïve Bayes (NB). However, the recall results were quite similar except for the K-Nearest Neighbor (KNN) classifier. When predicting grades C and D, RF had the best accuracy and NB the worst. RF had the best recall when predicting a C grade, while NB had the lowest. When predicting a D grade, SVM had the best recall performance, while NB had the lowest.
Keywords:
student performance, Artificial Neural Networks, support vector machine, Naïve Bayes, K-nearest neighbors classifierDownloads
References
H. A. Mengash, "Using Data Mining Techniques to Predict Student Performance to Support Decision Making in University Admission Systems," IEEE Access, vol. 8, pp. 55462–55470, 2020.
S. E. Sorour, S. A. El Rahman, S. A. Kahouf, and T. Mine, "Understandable Prediction Models of Student Performance Using an Attribute Dictionary," in Advances in Web-Based Learning–ICWL 2016: 15th International Conference, Rome, Italy, Oct. 2016, pp. 161–171.
A. Tarik, H. Aissa, and F. Yousef, "Artificial Intelligence and Machine Learning to Predict Student Performance during the COVID-19," Procedia Computer Science, vol. 184, pp. 835–840, Jan. 2021.
P. Dabhade, R. Agarwal, K. P. Alameen, A. T. Fathima, R. Sridharan, and G. Gopakumar, "Educational data mining for predicting students’ academic performance using machine learning algorithms," Materials Today: Proceedings, vol. 47, pp. 5260–5267, Jan. 2021.
I. Đ. Babić, "Machine learning methods in predicting the student academic motivation," Croatian Operational Research Review, pp. 443–461, Dec. 2017.
A. Cano and J. D. Leonard, "Interpretable Multiview Early Warning System Adapted to Underrepresented Student Populations," IEEE Transactions on Learning Technologies, vol. 12, no. 2, pp. 198–211, Apr. 2019.
M. Tsiakmaki, G. Kostopoulos, S. Kotsiantis, and O. Ragos, "Fuzzy-based Active Learning for Predicting Student Academic Performance," in Proceedings of the 6th International Conference on Engineering & MIS 2020, New York, NY, USA, Jun. 2020, Art. no. 87.
F. D. Pereira et al., "Explaining Individual and Collective Programming Students’ Behavior by Interpreting a Black-Box Predictive Model," IEEE Access, vol. 9, pp. 117097–117119, 2021.
R. Alamri and B. Alharbi, "Explainable Student Performance Prediction Models: A Systematic Review," IEEE Access, vol. 9, pp. 33132–33143, 2021.
W. Xing, R. Guo, E. Petakovic, and S. Goggins, "Participation-based student final performance prediction model through interpretable Genetic Programming: Integrating learning analytics, educational data mining and theory," Computers in Human Behavior, vol. 47, pp. 168–181, Jun. 2015.
J. Bravo-Agapito, S. J. Romero, and S. Pamplona, "Early prediction of undergraduate Student’s academic performance in completely online learning: A five-year study," Computers in Human Behavior, vol. 115, Feb. 2021, Art. no. 106595.
W. Zhang, Y. Zhou, and B. Yi, "An Interpretable Online Learner’s Performance Prediction Model Based on Learning Analytics," in Proceedings of the 11th International Conference on Education Technology and Computers, New York, NY, USA, Jan. 2020, pp. 148–154.
J. Xu, K. H. Moon, and M. van der Schaar, "A Machine Learning Approach for Tracking and Predicting Student Performance in Degree Programs," IEEE Journal of Selected Topics in Signal Processing, vol. 11, no. 5, pp. 742–753, Dec. 2017.
A. Cano, A. Zafra, and S. Ventura, "An interpretable classification rule mining algorithm," Information Sciences, vol. 240, pp. 1–20, Aug. 2013.
J. Gu and V. Tresp, "Semantics for Global and Local Interpretation of Deep Neural Networks." arXiv, Oct. 20, 2019.
E. Angelino, N. Larus-Stone, D. Alabi, M. Seltzer, and C. Rudin, "Learning Certifiably Optimal Rule Lists," in Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA, May 2017, pp. 35–44.
L. Calvet Liñán and Á. A. Juan Pérez, "Educational Data Mining and Learning Analytics: differences, similarities, and time evolution," RUSC. Universities and Knowledge Society Journal, vol. 12, no. 3, Jul. 2015, Art. no. 98.
M. Langer et al., "What do we want from Explainable Artificial Intelligence (XAI)? – A stakeholder perspective on XAI and a conceptual model guiding interdisciplinary XAI research," Artificial Intelligence, vol. 296, Jul. 2021, Art. no. 103473.
C. B. Azodi, J. Tang, and S.-H. Shiu, "Opening the Black Box: Interpretable Machine Learning for Geneticists," Trends in Genetics, vol. 36, no. 6, pp. 442–455, Jun. 2020.
C. Romero and S. Ventura, "Educational Data Mining: A Review of the State of the Art," IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 40, no. 6, pp. 601–618, Aug. 2010.
"Statement on Algorithmic Transparency and Accountability," ACM US Public Policy Office, New York, NY, USA, Jan. 2017.
C. Rudin, "Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead," Nature Machine Intelligence, vol. 1, no. 5, pp. 206–215, May 2019.
T. P. Minh, H. B. Duc, and V. D. Quoc, "Analysis of Leakage Inductances in Shunt Reactors: Application to High Voltage Transmission Lines," Engineering, Technology & Applied Science Research, vol. 12, no. 3, pp. 8488–8491, Jun. 2022.
N. L. Tran and T. H. Nguyen, "Reliability Assessment of Steel Plane Frame’s Buckling Strength Considering Semi-rigid Connections," Engineering, Technology & Applied Science Research, vol. 10, no. 1, pp. 5099–5103, Feb. 2020.
H. Basarudin et al., "Evaluation of Climate Change Effects on Rain Rate Distribution in Malaysia using Hydro-Estimator for 5G and Microwave Links," Engineering, Technology & Applied Science Research, vol. 13, no. 4, pp. 11064–11069, Aug. 2023.
N. N. Long, N. H. Quyet, N. X. Tung, B. T. Thanh, and T. N. Hoa, "Damage Identification of Suspension Footbridge Structures using New Hunting-based Algorithms," Engineering, Technology & Applied Science Research, vol. 13, no. 4, pp. 11085–11090, Aug. 2023.
Downloads
How to Cite
License
Copyright (c) 2023 Bashayer Alsubhi, Basma Alharbi, Nahla Aljojo, Ameen Banjar, Araek Tashkandi, Abdullah Alghoson, Anas Al-Tirawi
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
