Reconnoitering Students' Satisfaction of an Online Based Assessment System to Improve Usability using PSO: An Examination into a Problem Solving and Programming Course
Abstract
End users’ computing environment has been consistently changing in recent years due to the major advancements of Information Technology. This work aimed to measure the level of users’ satisfaction and provide feedbacks for continuous improvement of a course offered in an academic institution. End users here were the students enrolled for the course and the faculty members who offered the same and also acted as an assessor for the assessments. All assessments were scheduled and conducted online. This study was conducted to focus on two different aspects: Measuring User satisfaction and investigating information systems measures to improve usability using nature inspired computing. For user satisfaction analysis, the study employed the Multicriteria Satisfaction Analysis. The course considered was a problem solving and programming course offered to the fresh students enrolled in the first year of the undergraduate degree program in the academic institution during 2015-2016. To identify the factors for improved usability, PSO was employed in this work.
Keywords:
user satisfaction, multi-criteria user satisfaction analysis, web portal, information systemsDownloads
References
W. H. Delone, E. R. McLean, “The DeLone and McLean model of information systems success: a ten-year update,” J. Manag. Inf. Syst., Vol. 19, No. 4, pp. 9–30, 2003 DOI: https://doi.org/10.1080/07421222.2003.11045748
A. Tatnall, Web portals: the new gateways to Internet information and services, IGI Global, 2005 DOI: https://doi.org/10.4018/978-1-59140-438-5
M. B. O. Ajoye, W. E. Nwagwu, “Information Systems User Satisfaction: A Survey of The Postgraduate School Portal, University of Ibadan, Nigeria,” Libr. Philos. Pract., p. 0_1, 2014
B. Myers, J. Hollan, I. Cruz, S. Bryson, D. Bulterman, T. Catarci, W. Citrin, E. Glinert, J. Grudin, Y. Ioannidis, “Strategic directions in human-computer interaction,” ACM Comput. Surv., Vol. 28, No. 4, pp. 794–809, 1996 DOI: https://doi.org/10.1145/242223.246855
C. Ardito, M. F. Costabile, M. De Marsico, R. Lanzilotti, S. Levialdi, T. Roselli, V. Rossano, “An approach to usability evaluation of e-learning applications”, Univers. Access Inf. Soc., Vol. 4, No. 3, pp. 270–283, 2006 DOI: https://doi.org/10.1007/s10209-005-0008-6
C. E. Downing, C. Liu, “Does web site usability correlate with web site usage?,” J. Int. Technol. Inf. Manag., Vol. 18, No. 3–4, pp. 443–455, 2009
P. N. Sindhuja, S. G. Dastidar, “Impact of the factors influencing website usability on user satisfaction”, IUP J. Manag. Res., Vol. 8, No. 12, p. 54, 2009
R. S. Pressman, Software engineering: a practitioner’s approach. Palgrave Macmillan, 2005
M. Tarafdar, J. Zhang, “Analyzing the influence of web site design parameters on web site usability”, Inf. Resour. Manag. J., Vol. 18, No. 4, p. 62, 2005 DOI: https://doi.org/10.4018/irmj.2005100104
J. J. Cappel, Z. Huang, “A usability analysis of company websites,” J. Comput. Inf. Syst., Vol. 48, No. 1, pp. 117–123, 2007
P. Géczy, N. Izumi, K. Hasida, “Foundations for effective portal service management,” Glob. J. Bus. Res., Vol. 5, No. 2, pp. 131–141, 2010
J. M. Pearson, A. M. Pearson, “An exploratory study into determining the relative importance of key criteria in web usability: a multi-criteria approach”, J. Comput. Inf. Syst., Vol. 48, No. 4, pp. 115–127, 2008
A. Granić, “Experience with usability evaluation of e-learning systems”, Univers. Access Inf. Soc., Vol. 7, No. 4, pp. 209–221, 2008 DOI: https://doi.org/10.1007/s10209-008-0118-z
S. H. Mustafa, L. F. Al-Zoua'bi, “Usability of the academic websites of Jordan’s universities: an evaluation study,” 9th International Arab Conference for Information Technology, pp. 31–40, 2008
M. Manzoor, W. Hussain, “A web usability evaluation model for higher education providing Universities of Asia,” Sci., Tech. Dev., Vol. 31, No. 2, pp. 183–192, 2012
S. A. Mentes, A. H. Turan, “Assessing the usability of university websites: an empirical study on Namik Kemal University,” TOJET Turkish Online J. Educ. Technol., Vol. 11, No. 3, 2012 DOI: https://doi.org/10.1504/IJBIS.2012.048340
E. Grigoroudis, Y. Siskos, “Preference disaggregation for measuring and analysing customer satisfaction: The MUSA method,” Eur. J. Oper. Res., Vol. 143, No. 1, pp. 148–170, 2002 DOI: https://doi.org/10.1016/S0377-2217(01)00332-0
L. A. Daher, I. Elkabani, “Usability evaluation of some Lebanese Universities Web Portals,” 13th international Arab conference on information technology ACIT, pp. 10–13, 2012
B. Shneiderman, C. Plaisant, M. Cohen, S. Jacobs, N. Elmqvist, N. Diakopoulos, Designing the user interface, Pearson, USA, 2017
M. Alvesson, Knowledge work and knowledge-intensive firms, Oxford University Press, 2004
T. H. Davenport, Thinking for a living: how to get better performances and results from knowledge workers, Harvard Business Press, 2013
W. Albert, T. Tullis, Measuring the user experience: collecting, analyzing, and presenting usability metrics, Newnes, 2013
A. V Bosov, “Modeling and optimization of functioning of the information web portal,” Program. Comput. Softw., Vol. 35, No. 6, pp. 340–350, 2009 DOI: https://doi.org/10.1134/S0361768809060048
A. Burton-Jones, M. J. Gallivan, “Toward a deeper understanding of system usage in organizations: a multilevel perspective”, MIS Quarterly, pp. 657–679, 2007 DOI: https://doi.org/10.2307/25148815
T. H. Davenport, J. G. Harris, Competing on analytics: The new science of winning, Harvard Business Press, 2007
G. Hamel, B. Breen, The future of management, Harvard Business Press, 2013
S. Petter, W. DeLone, E. McLean, “Measuring information systems success: models, dimensions, measures, and interrelationships,” Eur. J. Inf. Syst., Vol. 17, No. 3, pp. 236–263, 2008 DOI: https://doi.org/10.1057/ejis.2008.15
U. R. Kulkarni, S. Ravindran, R. Freeze, “A knowledge management success model: Theoretical development and empirical validation”, J. Manag. Inf. Syst., Vol. 23, No. 3, pp. 309–347, 2006 DOI: https://doi.org/10.2753/MIS0742-1222230311
J. Wu, Y. Wang, “Measuring KMS success: A respecification of the DeLone and McLean’s model”, Inf. Manag., Vol. 43, no. 6, pp. 728–739, 2006 DOI: https://doi.org/10.1016/j.im.2006.05.002
L. A. Halawi, R. V McCarthy, J. E. Aronson, “An empirical investigation of knowledge management systems’ success”, J. Comput. Inf. Syst., Vol. 48, No. 2, pp. 121–135, 2008
Downloads
How to Cite
Metrics
Abstract Views: 630PDF Downloads: 358 Data Collected for Usability Survey Downloads: 0
Metrics Information
License
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
