Using the Delone and McLean Success Model to Evaluate Moodle's Information System Success
Received: 19 March 2024 | Revised: 5 May 2024 | Accepted: 11 May 2024 | Online: 2 August 2024
Corresponding author: Mariam A. Alterkait
Abstract
This study evaluated the Moodle Professional Learning Management System (PLMS), based on user experience during the global pandemic of COVID-19, to explore the impact of system, service, information, education, learner, and instructor qualities on user satisfaction (SAT), perceived ease of use (PEOU), and perceived usefulness (PU). Data were collected using previously validated scales. Using SmartPLS structural equation modeling, data from 403 college students were analyzed to test 22 hypotheses. The results show that system and information quality positively affect PEOU. Although service quality had a partially significant impact on PU, it negatively affected SAT and PEOU. The quality of the education system had a partially positive impact on PU but a negative impact on PEOU and SAT. Learner quality positively affected PEOU, PU, and SAT. Although PU and PEOU significantly and positively affected benefits (BEN), SAT had only a partially significant impact. The results support the need for continued integration of e-learning with traditional learning schemas. This comprehensive analysis demonstrates how quality dimensions affect user experiences and outcomes in a unique cultural and emergency context, thus contributing to the e-learning body of knowledge.
Keywords:
e-learning, Moodle, Delone & McLean information system success model, professional learning management system (PLMS), system qualitiesDownloads
References
S. K. Basak, M. Wotto, and P. Bélanger, "E-learning, M-learning and D-learning: Conceptual definition and comparative analysis," E-Learning and Digital Media, Jul. 2018.
A. Al-Hunaiyyan, R. A. Alhajri, and S. Al-Sharhan, "Perceptions and challenges of mobile learning in Kuwait," Journal of King Saud University - Computer and Information Sciences, vol. 30, no. 2, pp. 279–289, Apr. 2018.
M. K. Ali and H. Maksum, "Utilization of E-Learning-Based ICT Learning Using the Google Classroom Application During the COVID-19 Pandemic," Journal of Education Research and Evaluation, vol. 4, no. 4, pp. 373–379, Dec. 2020.
H. U. N. Nguyen and L. N. T. Duong, "The Challenges of E-learning Through Microsoft Teams for EFL Students at Van Lang University in COVID-19," AsiaCALL Online Journal, vol. 12, no. 4, pp. 18–29, Jul. 2021.
S. A. Raza, Z. Qazi, W. Qazi, and M. Ahmed, "E-learning in higher education during COVID-19: evidence from blackboard learning system," Journal of Applied Research in Higher Education, vol. 14, no. 4, pp. 1603–1622, Jan. 2021.
G. Alkhaldi, A. Alotaibi, R. Alkasabi, N. Alsadhan, and S. Alageel, "Perceptions of Arabian Gulf Residents and Citizens about Physical Activity and Social Media Awareness Campaigns: A Qualitative Study," Behavioral Sciences, vol. 14, no. 3, Mar. 2024, Art, no. 174.
D. Al-Fraihat, M. Joy, R. Masa’deh, and J. Sinclair, "Evaluating E-learning systems success: An empirical study," Computers in Human Behavior, vol. 102, pp. 67–86, Jan. 2020.
B. Al-shargabi, O. Sabri, and S. Aljawarneh, "The adoption of an e-learning system using information systems success model: a case study of Jazan University," PeerJ Computer Science, vol. 7, Oct. 2021, Art. no. e723.
Y. M. Wang, C. L. Wei, W. J. Chen, and Y. S. Wang, "Revisiting the E-Learning Systems Success Model in the Post-COVID-19 Age: The Role of Monitoring Quality," International Journal of Human–Computer Interaction, Aug. 2023.
A. M. Sayaf, "Adoption of E-learning systems: An integration of ISSM and constructivism theories in higher education," Heliyon, vol. 9, no. 2, Feb. 2023, Art. no. e13014.
S. Candra and F. S. Jeselin, "Students’ perspectives on using e-learning applications and technology during the COVID-19 pandemic in Indonesian higher education," Journal of Science and Technology Policy Management, vol. 15, no. 2, pp. 226–243, Jan. 2022.
Y. Li, S. H. Halili, and R. A. Razak, "Factors Influencing the Online Learning Success of Adults in Open and Distance Education in Southwest China," International Journal of Information and Education Technology, vol. 13, no. 10, pp. 1615–1624, 2023.
M. Piotrowski, "What is an E-Learning Platform?," in Learning Management System Technologies and Software Solutions for Online Teaching: Tools and Applications, IGI Global, 2010, pp. 20–36.
V. Maphosa, "Factors Influencing Student’s Perceptions Towards E-Learning Adoption During COVID-19 Pandemic: A Developing Country Context," European Journal of Interactive Multimedia and Education, vol. 2, no. 2, Jun. 2021, Art. no. e02109.
D. Turnbull, R. Chugh, and J. Luck, "Transitioning to E-Learning during the COVID-19 pandemic: How have Higher Education Institutions responded to the challenge?," Education and Information Technologies, vol. 26, no. 5, pp. 6401–6419, Sep. 2021.
H. R. Alzuabi, M. Abdulhadi, J. H. Alotaibi, and F. Shuweihdi, "Investigating the acceptance of Moodle by LIS students in Kuwait based on UTAUT and WQ," The Arab Journal of Informatics and Information Security, vol. 3, no. 7, pp. 85–130, Apr. 2022.
A. A. D. Al-Anzi, "Moodle Platform Evaluation in the Light of E-Learning Sites Standards from the Point of View of College of Basic Education Students in The Public Authority for Applied Education and Training in Kuwait," International Journal of Learning and Development, vol. 11, no. 1, pp. 89–120, 2021.
D. A. Alfailakawi, "Investigating The Role Of E-Learning Management Systems In The Learning Process From The Point Of View Of The Faculty At The Faculty Of Basic Education In Kuwait," Journal of Positive School Psychology, pp. 1445–1467, Dec. 2022.
A. S. Al-Adwan, N. A. Albelbisi, O. Hujran, W. M. Al-Rahmi, and A. Alkhalifah, "Developing a Holistic Success Model for Sustainable E-Learning: A Structural Equation Modeling Approach," Sustainability, vol. 13, no. 16, Jan. 2021, Art. no. 9453.
A. S. Al-Adwan, H. Yaseen, A. Alsoud, F. Abousweilem, and W. M. Al-Rahmi, "Novel extension of the UTAUT model to understand continued usage intention of learning management systems: the role of learning tradition," Education and Information Technologies, vol. 27, no. 3, pp. 3567–3593, Apr. 2022.
J. Alameri, R. Masadeh, E. Hamadallah, H. B. Ismail, and H. N. Fakhouri, "Students’ Perceptions of E-learning platforms (Moodle, Microsoft Teams and Zoom platforms) in The University of Jordan Education and its Relation to self-study and Academic Achievement During COVID-19 pandemic.," Advanced Research & Studies Journal, vol. 11, no. 5, pp. 21–33, 2020.
L. R. Octaberlina and A. I. Muslimin, "EFL Students Perspective towards Online Learning Barriers and Alternatives Using Moodle/Google Classroom during COVID-19 Pandemic," International Journal of Higher Education, vol. 9, no. 6, 2020.
M.-D. Dascalu et al., "Before and during COVID-19: A Cohesion Network Analysis of students' online participation in moodle courses," Computers in Human Behavior, vol. 121, Aug. 2021, Art. no. 106780.
N. Ghounane, "Moodle or Social Networks: What Alternative Refuge Is Appropriate to Algerian EFL Students to Learn during COVID-19 Pandemic," Arab World English Journal, vol. 11, no. 3, pp. 21–41, Sep. 2020.
W. A. Cidral, T. Oliveira, M. Di Felice, and M. Aparicio, "E-learning success determinants: Brazilian empirical study," Computers & Education, vol. 122, pp. 273–290, Jul. 2018.
W. H. Delone and E. R. McLean, "The DeLone and McLean Model of Information Systems Success: A Ten-Year Update," Journal of Management Information Systems, Apr. 2003.
N. Urbach, S. Smolnik, and G. Riempp, "An empirical investigation of employee portal success," The Journal of Strategic Information Systems, vol. 19, no. 3, pp. 184–206, Sep. 2010.
C. M. Chiu, S. Y. Sun, P. C. Sun, and T. L. Ju, "An empirical analysis of the antecedents of web-based learning continuance," Computers & Education, vol. 49, no. 4, pp. 1224–1245, Dec. 2007.
J. M. Choe, "The Relationships among Performance of Accounting Information Systems, Influence Factors, and Evolution Level of Information Systems," Journal of Management Information Systems, vol. 12, no. 4, pp. 215–239, Mar. 1996.
M. Aparicio, F. Bacao, and T. Oliveira, "Grit in the path to e-learning success," Computers in Human Behavior, vol. 66, pp. 388–399, Jan. 2017.
F. N. Machado-da-sılva, F. D. S. Meırelles, D. Fılenga, and M. B. Fılho, "Student Satisfaction Process In Virtual Learning System: Considerations Based In Information And Service Quality From Brazil’s Experience," Turkish Online Journal of Distance Education, vol. 15, no. 3, pp. 122–142, Sep. 2014.
P. E. Ramírez-Correa, F. J. Rondan-Cataluña, J. Arenas-Gaitán, and J. L. Alfaro-Perez, "Moderating effect of learning styles on a learning management system’s success," Telematics and Informatics, vol. 34, no. 1, pp. 272–286, Feb. 2017.
A. Hassanzadeh, F. Kanaani, and S. Elahi, "A model for measuring e-learning systems success in universities," Expert Systems with Applications, vol. 39, no. 12, pp. 10959–10966, Sep. 2012.
W. H. DeLone and E. R. McLean, "Information Systems Success: The Quest for the Dependent Variable," Information Systems Research, vol. 3, no. 1, pp. 60–95, Mar. 1992.
F. D. Davis, "Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology," MIS Quarterly, vol. 13, no. 3, pp. 319–340, 1989.
S. Mardiana, J. H. Tjakraatmadja, and A. Aprianingsih, "DeLone–McLean Information System Success Model Revisited: The Separation of Intention to Use-Use and the Integration of Technology Acceptance Models," International Journal of Economics and Financial Issues, vol. 5, no. 1, pp. 172–182, Mar. 2015.
H. N. Sabeh, M. H. Husin, D. M. H. Kee, A. S. Baharudin, and R. Abdullah, "A Systematic Review of the DeLone and McLean Model of Information Systems Success in an E-Learning Context (2010–2020)," IEEE Access, vol. 9, pp. 81210–81235, 2021.
A. Alhabeeb and J. Rowley, "Critical success factors for eLearning in Saudi Arabian universities," International Journal of Educational Management, vol. 31, no. 2, pp. 131–147, Jan. 2017.
A. Alhabeeb and J. Rowley, "E-learning critical success factors: Comparing perspectives from academic staff and students," Computers & Education, vol. 127, pp. 1–12, Dec. 2018.
Y. C. Liu, Y. A. Huang, and C. Lin, "Organizational factors’ effects on the success of e-learning systems and organizational benefits: An empirical study in Taiwan," The International Review of Research in Open and Distributed Learning, vol. 13, no. 4, pp. 130–151, Aug. 2012.
P. C. Sun, R. J. Tsai, G. Finger, Y. Y. Chen, and D. Yeh, "What drives a successful e-Learning? An empirical investigation of the critical factors influencing learner satisfaction," Computers & Education, vol. 50, no. 4, pp. 1183–1202, May 2008.
J. A. Gliem and R. R. Gliem, "Calculating, Interpreting, and Reporting Cronbach’s Alpha Reliability Coefficient for Likert-Type Scales," presented at the 2003 Midwest Research to Practice Conference in Adult, Continuing, and Community Education, Colombus, OH, USA, 2003.
J. Collier, Applied Structural Equation Modeling using AMOS: Basic to Advanced Techniques. New York, NY, USA: Routledge, 2020.
C. Fornell and D. F. Larcker, "Structural Equation Models with Unobservable Variables and Measurement Error: Algebra and Statistics," Journal of Marketing Research, vol. 18, no. 3, pp. 382–388, Aug. 1981.
J. F. Hair Jr., G. T. M. Hult, C. M. Ringle, M. Sarstedt, N. P. Danks, and S. Ray, Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R: A Workbook. Springer Nature, 2021.
S. S. T. Alatawi et al., "A New Model for Enhancing Student Portal Usage in Saudi Arabia Universities," Engineering, Technology & Applied Science Research, vol. 11, no. 3, pp. 7158–7171, Jun. 2021.
H. Chatti and S. Hadoussa, "Factors Affecting the Adoption of E-Learning Technology by Students during the COVID-19 Quarantine Period: The Application of the UTAUT Model," Engineering, Technology & Applied Science Research, vol. 11, no. 2, pp. 6993–7000, Apr. 2021.
F. Kanwal, M. Rehman, K. Bashir, and U. Qureshi, "Critical Factors of E-Learning Adoption and Acceptance in Pakistan: A Literature Review," Engineering, Technology & Applied Science Research, vol. 7, no. 4, pp. 1888–1893, Aug. 2017.
Downloads
How to Cite
License
Copyright (c) 2024 Manal Y. Alduaij, Mariam A. Alterkait, Shaikhah Alainati
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
