Reconnoitering Students' Satisfaction of an Online Based Assessment System to Improve Usability using PSO: An Examination into a Problem Solving and Programming Course

S. Vairamuthu, S. Margret Anouncia

Abstract


End users’ computing environment has been consistently changing in recent years due to the major advancements of Information Technology. This work aimed to measure the level of users’ satisfaction and provide feedbacks for continuous improvement of a course offered in an academic institution. End users here were the students enrolled for the course and the faculty members who offered the same and also acted as an assessor for the assessments. All assessments were scheduled and conducted online. This study was conducted to focus on two different aspects: Measuring User satisfaction and investigating information systems measures to improve usability using nature inspired computing. For user satisfaction analysis, the study employed the Multicriteria Satisfaction Analysis. The course considered was a problem solving and programming course offered to the fresh students enrolled in the first year of the undergraduate degree program in the academic institution during 2015-2016. To identify the factors for improved usability, PSO was employed in this work.


Keywords


user satisfaction; multi-criteria user satisfaction analysis; web portal; information systems

Full Text:

PDF

References


W. H. Delone, E. R. McLean, “The DeLone and McLean model of information systems success: a ten-year update,” J. Manag. Inf. Syst., Vol. 19, No. 4, pp. 9–30, 2003

A. Tatnall, Web portals: the new gateways to Internet information and services, IGI Global, 2005

M. B. O. Ajoye, W. E. Nwagwu, “Information Systems User Satisfaction: A Survey of The Postgraduate School Portal, University of Ibadan, Nigeria,” Libr. Philos. Pract., p. 0_1, 2014

B. Myers, J. Hollan, I. Cruz, S. Bryson, D. Bulterman, T. Catarci, W. Citrin, E. Glinert, J. Grudin, Y. Ioannidis, “Strategic directions in human-computer interaction,” ACM Comput. Surv., Vol. 28, No. 4, pp. 794–809, 1996

C. Ardito, M. F. Costabile, M. De Marsico, R. Lanzilotti, S. Levialdi, T. Roselli, V. Rossano, “An approach to usability evaluation of e-learning applications”, Univers. Access Inf. Soc., Vol. 4, No. 3, pp. 270–283, 2006

C. E. Downing, C. Liu, “Does web site usability correlate with web site usage?,” J. Int. Technol. Inf. Manag., Vol. 18, No. 3–4, pp. 443–455, 2009

P. N. Sindhuja, S. G. Dastidar, “Impact of the factors influencing website usability on user satisfaction”, IUP J. Manag. Res., Vol. 8, No. 12, p. 54, 2009

R. S. Pressman, Software engineering: a practitioner’s approach. Palgrave Macmillan, 2005

M. Tarafdar, J. Zhang, “Analyzing the influence of web site design parameters on web site usability”, Inf. Resour. Manag. J., Vol. 18, No. 4, p. 62, 2005

J. J. Cappel, Z. Huang, “A usability analysis of company websites,” J. Comput. Inf. Syst., Vol. 48, No. 1, pp. 117–123, 2007

P. Géczy, N. Izumi, K. Hasida, “Foundations for effective portal service management,” Glob. J. Bus. Res., Vol. 5, No. 2, pp. 131–141, 2010

J. M. Pearson, A. M. Pearson, “An exploratory study into determining the relative importance of key criteria in web usability: a multi-criteria approach”, J. Comput. Inf. Syst., Vol. 48, No. 4, pp. 115–127, 2008

A. Granić, “Experience with usability evaluation of e-learning systems”, Univers. Access Inf. Soc., Vol. 7, No. 4, pp. 209–221, 2008

S. H. Mustafa, L. F. Al-Zoua'bi, “Usability of the academic websites of Jordan’s universities: an evaluation study,” 9th International Arab Conference for Information Technology, pp. 31–40, 2008

M. Manzoor, W. Hussain, “A web usability evaluation model for higher education providing Universities of Asia,” Sci., Tech. Dev., Vol. 31, No. 2, pp. 183–192, 2012

S. A. Mentes, A. H. Turan, “Assessing the usability of university websites: an empirical study on Namik Kemal University,” TOJET Turkish Online J. Educ. Technol., Vol. 11, No. 3, 2012

E. Grigoroudis, Y. Siskos, “Preference disaggregation for measuring and analysing customer satisfaction: The MUSA method,” Eur. J. Oper. Res., Vol. 143, No. 1, pp. 148–170, 2002

L. A. Daher, I. Elkabani, “Usability evaluation of some Lebanese Universities Web Portals,” 13th international Arab conference on information technology ACIT, pp. 10–13, 2012

B. Shneiderman, C. Plaisant, M. Cohen, S. Jacobs, N. Elmqvist, N. Diakopoulos, Designing the user interface, Pearson, USA, 2017

M. Alvesson, Knowledge work and knowledge-intensive firms, Oxford University Press, 2004

T. H. Davenport, Thinking for a living: how to get better performances and results from knowledge workers, Harvard Business Press, 2013

W. Albert, T. Tullis, Measuring the user experience: collecting, analyzing, and presenting usability metrics, Newnes, 2013

A. V Bosov, “Modeling and optimization of functioning of the information web portal,” Program. Comput. Softw., Vol. 35, No. 6, pp. 340–350, 2009

A. Burton-Jones, M. J. Gallivan, “Toward a deeper understanding of system usage in organizations: a multilevel perspective”, MIS Quarterly, pp. 657–679, 2007

T. H. Davenport, J. G. Harris, Competing on analytics: The new science of winning, Harvard Business Press, 2007

G. Hamel, B. Breen, The future of management, Harvard Business Press, 2013

S. Petter, W. DeLone, E. McLean, “Measuring information systems success: models, dimensions, measures, and interrelationships,” Eur. J. Inf. Syst., Vol. 17, No. 3, pp. 236–263, 2008

U. R. Kulkarni, S. Ravindran, R. Freeze, “A knowledge management success model: Theoretical development and empirical validation”, J. Manag. Inf. Syst., Vol. 23, No. 3, pp. 309–347, 2006

J. Wu, Y. Wang, “Measuring KMS success: A respecification of the DeLone and McLean’s model”, Inf. Manag., Vol. 43, no. 6, pp. 728–739, 2006

L. A. Halawi, R. V McCarthy, J. E. Aronson, “An empirical investigation of knowledge management systems’ success”, J. Comput. Inf. Syst., Vol. 48, No. 2, pp. 121–135, 2008




eISSN: 1792-8036     pISSN: 2241-4487