Detection of Unsafe Behavior in conveying Vehicle Parts using Computer Vision
Received: 17 April 2024 | Revised: 17 May 2024 | Accepted: 19 May 2024 | Online: 24 May 2024
Corresponding author: Leonor Adriana Cárdenas-Robledo
Abstract
Deep Learning (DL) has experienced notable growth in various applications, which highlights its use in vision systems for object detection. The present work proposes a proof of concept for detecting unsafe acts in a vehicle assembly plant. The employment of Convolutional Neural Networks (CNNs) for either object or event detection was studied, and a vision system specifically trained for real-time detection of unsafe acts carried out by personnel while conveying car body parts was implemented. The intention of this research is to prevent workplace accidents and promote safety in the production environment by creating a personalized dataset composed of images that capture some incorrect ways of loading the car body doors, labeled as unsafe acts. For this purpose, a YOLOv8 DL model was trained to recognize unsafe behaviors, and after the test execution, the system efficiently identified safe and unsafe acts. Therefore, the proposal is feasible to be deployed to improve surveillance in daily operations, deliver automated reports for decision-making, and establish countermeasure actions.
Keywords:
deep learning, object detection, unsafe acts, safety, YOLOv8Downloads
References
A. Mobaraki, R. Mirzaei, and H. Ansari, "A Survey of Health, Safety and Environment (HSE) Management and Safety Climate in Construction Sites," Engineering, Technology & Applied Science Research, vol. 7, no. 1, pp. 1334–1337, Feb. 2017.
G. Baldissone, L. Comberti, S. Bosca, and S. Mure, "The analysis and management of unsafe acts and unsafe conditions. Data collection and analysis," Safety Science, vol. 119, pp. 240–251, Nov. 2019.
A. Vanichchinchai, "Contextual factors on Toyota Way and Agile Manufacturing: an empirical investigation," Operations Management Research, vol. 16, no. 3, pp. 1290–1301, Sep. 2023.
M. H. A. Soliman, "The Toyota Way to Effective Strategy Deployment: How Organizations Can Focus Energy on Key Priorities Through Hoshin Kanri to Achieve the Business Goals," Journal of Operations and Strategic Planning, vol. 3, no. 2, pp. 132–158, Dec. 2020.
A. A. Joshi, "A Review on Seven S (7S) as a tool of Workplace Organization," International Journal of Innovations in Engineering and Technology, vol. 6, no. 2, pp. 19–26, 2015.
A. Akinsemoyin, I. Awolusi, D. Chakraborty, A. J. Al-Bayati, and A. Akanmu, "Unmanned Aerial Systems and Deep Learning for Safety and Health Activity Monitoring on Construction Sites," Sensors, vol. 23, no. 15, Jan. 2023, Art. no. 6690.
F. Zhafran, E. S. Ningrum, M. N. Tamara, and E. Kusumawati, "Computer Vision System Based for Personal Protective Equipment Detection, by Using Convolutional Neural Network," in International Electronics Symposium, Surabaya, Indonesia, Sep. 2019, pp. 516–521.
X. Liu, F. Xu, Z. Zhang, and K. Sun, "Fall-portent detection for construction sites based on computer vision and machine learning," Engineering, Construction and Architectural Management, Jan. 2023.
R. M. Reyes, J. de la Riva, A. Maldonado, A. Woocay, and R. de la O, "Association between Human Error and Occupational Accidents’ Contributing Factors for Hand Injuries in the Automotive Manufacturing Industry," Procedia Manufacturing, vol. 3, pp. 6498–6504, Jan. 2015.
Q. Ji, "Computer vision applications," in Probabilistic Graphical Models for Computer Vision, London, UK: Academic Press, 2020, pp. 191–297.
W. Fang, P. E. D. Love, H. Luo, and L. Ding, "Computer vision for behaviour-based safety in construction: A review and future directions," Advanced Engineering Informatics, vol. 43, Jan. 2020, Art. no. 100980.
L. Ding, W. Fang, H. Luo, P. E. D. Love, B. Zhong, and X. Ouyang, "A deep hybrid learning model to detect unsafe behavior: Integrating convolution neural networks and long short-term memory," Automation in Construction, vol. 86, pp. 118–124, Feb. 2018.
M. M. Alateeq, P. P. F. Rajeena, and M. A. S. Ali, "Construction Site Hazards Identification Using Deep Learning and Computer Vision," Sustainability, vol. 15, no. 3, Jan. 2023, Art. no. 2358.
Y. Alassaf and Y. Said, "DPPNet: A Deformable-Perspective-Perception network for Safety Helmet Violation Detection," Engineering, Technology & Applied Science Research, vol. 14, no. 1, pp. 12659–12669, Feb. 2024.
Y. Li, H. Wei, Z. Han, N. Jiang, W. Wang, and J. Huang, "Computer Vision-Based Hazard Identification of Construction Site Using Visual Relationship Detection and Ontology," Buildings, vol. 12, no. 6, Jun. 2022, Art. no. 857.
M. Massiris, J. A. Fernandez, J. Bajo, and C. Delrieux, "Sistema automatizado para monitorear el uso de equipos de proteccion personal en la industria de la construccion," Revista Iberoamericana de Automatica e Informatica industrial, vol. 18, no. 1, pp. 68–74, 2021.
N. Raote, M. S. Khan, Z. Siddique, A. K. Tripathy, and P. Shaikh, "Campus Safety and Hygiene Detection System using Computer Vision," in International Conference on Advances in Computing, Communication, and Control, Mumbai, India, Dec. 2021, pp. 1–7.
N. Gupta and B. B. Agarwal, "Suspicious Activity Classification in Classrooms using Deep Learning," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12226–12230, Dec. 2023.
"Roboflow: Computer vision tools for developers and enterprises." https://roboflow.com/.
Ultralytics, "YOLO: A Brief History." https://docs.ultralytics.com/.
J. Terven, D.-M. Cordova-Esparza, and J.-A. Romero-Gonzalez, "A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS," Machine Learning and Knowledge Extraction, vol. 5, no. 4, pp. 1680–1716, Dec. 2023.
T. Diwan, G. Anirudh, and J. V. Tembhurne, "Object detection using YOLO: challenges, architectural successors, datasets and applications," Multimedia Tools and Applications, vol. 82, no. 6, pp. 9243–9275, Mar. 2023.
R. Rajamohanan and B. C. Latha, "An Optimized YOLO v5 Model for Tomato Leaf Disease Classification with Field Dataset," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12033–12038, Dec. 2023.
G. Jocher, A. Chaurasia, and J. Qiu, "Ultralytics YOLO." Jan. 2023, [Online]. Available: https://github.com/ultralytics/ultralytics.
Ultralytics, "Model Training with Ultralytics YOLO." https://docs.ultralytics.com/modes/train.
Downloads
How to Cite
License
Copyright (c) 2024 Carlos Eduardo Vazquez-Monjaras, Leonor Adriana Cárdenas-Robledo, Carolina Reta
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
