User-Centered Design for Custom Workflow Configuration in Video Analytics Systems: A Usability and McCall Quality Evaluation

Andhik Ampuh Yunanto; Nimas Ayu Christanti Dwiningtyas; Desy Intan Permatasari; Willy Achmat Fauzi; Adam Shidqul Aziz; Nailussa'ada; Fadilah Fahrul Hardiansyah; Umi Sa'adah

doi:10.48084/etasr.18601

Authors

Andhik Ampuh Yunanto Informatics and Computer Engineering Department, Politeknik Elektronika Negeri Surabaya, Indonesia
Nimas Ayu Christanti Dwiningtyas Informatics and Computer Engineering Department, Politeknik Elektronika Negeri Surabaya, Indonesia
Desy Intan Permatasari Informatics and Computer Engineering Department, Politeknik Elektronika Negeri Surabaya, Indonesia
Willy Achmat Fauzi PT Sinergi Dimensi Informatika, Surabaya, Indonesia
Adam Shidqul Aziz Informatics and Computer Engineering Department, Politeknik Elektronika Negeri Surabaya, Indonesia
Nailussa'ada Informatics and Computer Engineering Department, Politeknik Elektronika Negeri Surabaya, Indonesia
Fadilah Fahrul Hardiansyah Informatics and Computer Engineering Department, Politeknik Elektronika Negeri Surabaya, Indonesia
Umi Sa'adah Informatics and Computer Engineering Department, Politeknik Elektronika Negeri Surabaya, Indonesia

Volume: 16 | Issue: 3 | Pages: 36233-36241 | June 2026 | https://doi.org/10.48084/etasr.18601

Received: 8 March 2026 | Revised: 3 April 2026 | Accepted: 17 April 2026 | Online: 12 May 2026

Corresponding author: Andhik Ampuh Yunanto

Abstract

Artificial intelligence (AI)-based video analytics systems increasingly rely on configurable workflows to manage data processing and model inference; however, many existing visual workflow and low-code approaches remain difficult for operational users due to complex interfaces and technical terminology. This study investigates how a User-Centered Design (UCD) approach can improve the usability of custom workflow configuration in video analytics environments. A node-based workflow interface was developed following a UCD process that includes context-of-use analysis, user requirement specification, iterative design, and evaluation. The usability of the proposed interface was assessed through a formative usability study using the System Usability Scale (SUS), complemented by observational findings from task-based evaluations, whereas system behavior was examined through structured functional testing interpreted using selected attributes of the McCall quality model, focusing on usability, reliability, and correctness. The evaluation involved operational users of an industrial video analytics platform performing representative workflow configuration tasks, resulting in an average SUS score of 64, indicating acceptable but improvable usability. Further analysis shows that the proposed design supports better workflow comprehension, reduces configuration errors during task execution, and assists users in verifying workflow correctness through validation and preview mechanisms. This study contributes an evaluative perspective that connects user-centered interface design with both perceived usability and functional system behavior in configurable AI workflow systems.

Keywords:

custom workflow configuration, User-Centered Design (UCD), System Usability Scale (SUS), McCall quality model, video analytics systems

Downloads

Download data is not yet available.

References

G. Rinaldi, K. Theodorakos, F. Crema Garcia, O. M. Agudelo, and B. De Moor, "DSS4EX: A Decision Support System framework to explore Artificial Intelligence pipelines with an application in time series forecasting," Expert Systems with Applications, vol. 269, Apr. 2025, Art. no. 126421.

Z. Shojaee Rad and M. Ghobaei-Arani, "Data pipeline approaches in serverless computing: a taxonomy, review, and research trends," Journal of Big Data, vol. 11, no. 1, June 2024, Art. no. 82.

R. Khankhoje, "Beyond Coding: A Comprehensive Study of Low-Code, No-Code and Traditional Automation," Journal of Artificial Intelligence & Cloud Computing, vol. 1, no. 4, pp. 1–5, Dec. 2022.

P. Venkiteela, "n8n: An Open-Source Workflow Automation Platform for Enterprise Integration and AI-Driven Orchestration," International Journal of Computer Applications, vol. 187, no. 63, pp. 1–11, Dec. 2025.

S. Perumal and K. Kathirvelu, "Enhancing the Quality of Service in Video Game Live Streaming Using Big Data Analytics with DNN Classification and BERT-Based Sentiment Analysis," Engineering, Technology & Applied Science Research, vol. 15, no. 4, pp. 25426–25431, Aug. 2025.

M. Hertzum and K. Hornbæk, "Frustration: Still a Common User Experience," ACM Transactions on Computer-Human Interaction, vol. 30, no. 3, June 2023, Art. no. 42.

T. A. Bach, A. Khan, H. Hallock, G. Beltrão, and S. Sousa, "A Systematic Literature Review of User Trust in AI-Enabled Systems: An HCI Perspective," International Journal of Human–Computer Interaction, vol. 40, no. 5, pp. 1251–1266, Mar. 2024.

M. E. Salwei et al., "Workflow integration analysis of a human factors-based clinical decision support in the emergency department," Applied Ergonomics, vol. 97, Nov. 2021, Art. no. 103498.

Claudia and D. P. Lestari, "User-Centered Interaction Design for Indonesia’s E-Government Passport Application: The M-Paspor Indonesia Case Study," in 2024 IEEE International Conference on Data and Software Engineering, Gorontalo, Indonesia, 2024, pp. 235–240.

S. Fatima et al., "Impact of Software Metrics on Software Quality using McCall Quality Model: In-Depth Analysis," University of Sindh Journal of Information and Communication Technology, vol. 6, no. 2, pp. 66–76, July 2022.

M. T. Ramadhan, Y. Gunawan, K. Manaf, H. Purwanto, R. S. Perdana, and B. Subaeki, "Testing the Autxhentication Platform System Using the Mccall Model," CoreID Journal, vol. 2, no. 1, pp. 20–26, Mar. 2024.

A. Subiyakto, D. P. Utami, E. Nurmiati, D. Yuniarto, A. Sopandi, and F. M. Kaffah, "Adopting Five Planes Framework for Developing User Interface based on User Experience Aspects," in 2023 11th International Conference on Cyber and IT Service Management, Makassar, Indonesia, 2023, pp. 1–6.

D. Fathiyyah, M. D. Sulthon Diani, Z. Ayuning Saputri, and Sunardi, "Usability Evaluation on Life Insurance Application Using System Usability Scale and ISO 9241-11," in 2022 8th International HCI and UX Conference in Indonesia, Bali, Indonesia, 2022, pp. 94–99.

R. Adilla, M. Jazman, T. K. Ahsyar, and M. L. Hamzah, "Evaluation Usability of Mobile Banking Applications Using Usability Testing (UT) Method and System Usability Scale (SUS)," in 2022 IEEE International Conference on Sustainable Engineering and Creative Computing, Kabupaten Bekasi, Indonesia, 2022, pp. 78–83.