Real-Time Inspection of Fire Safety Equipment using Computer Vision and Deep Learning
Received: 15 December 2023 | Revised: 6 January 2024 and 27 January 2024 | Accepted: 5 February 2024 | Online: 2 April 2024
Corresponding author: Asmaa Alayed
Abstract
The number of accidental fires in buildings has been significantly increased in recent years in Saudi Arabia. Fire Safety Equipment (FSE) plays a crucial role in reducing fire risks. However, this equipment is prone to defects and requires periodic checks and maintenance. Fire safety inspectors are responsible for visual inspection of safety equipment and reporting defects. As the traditional approach of manually checking each piece of equipment can be time-consuming and inaccurate, this study aims to improve the inspection processes of safety equipment. Using computer vision and deep learning techniques, a detection model was trained to visually inspect fire extinguishers and identify defects. Fire extinguisher images were collected, annotated, and augmented to create a dataset of 7,633 images with 16,092 labeled instances. Then, experiments were carried out using YOLOv5, YOLOv7, YOLOv8, and RT-DETR. Pre-trained models were used for transfer learning. A comparative analysis was performed to evaluate these models in terms of accuracy, speed, and model size. The results of YOLOv5n, YOLOv7, YOLOv8n, YOLOv8m, and RT-DETR indicated satisfactory accuracy, ranging between 83.1% and 87.2%. YOLOv8n was chosen as the most suitable due to its fastest inference time of 2.7 ms, its highest mAP0.5 of 87.2%, and its compact model size, making it ideal for real-time mobile applications.
Keywords:
Fire Safety Equipment (FSE), fire safety inspection, visual inspection, deep learning, computer vision, object detection, You-Only-Look-Once (YOLO)Downloads
References
"Annual Statistical Report," Civil Defense Directorate, Saudi Arabia, 2020.
"Why is Fire Safety Important? | Alsco." https://alsco.com/resources/why-is-fire-safety-important/.
"Saudi Fire Protection Code Fire Protection Requirements," Saudi Building Code National Committee, SBC 801, 2018.
V. Kodur, P. Kumar, and M. M. Rafi, "Fire hazard in buildings: review, assessment and strategies for improving fire safety," PSU Research Review, vol. 4, no. 1, pp. 1–23, Jan. 2019.
D. E. Della-Giustina, Fire Safety Management Handbook, 3rd ed. Boca Ration, FL, USA: CRC Press, 2014.
D. Dieken, "Inspection, testing and maintenance of fire protection systems at industrial plants," Process Safety Progress, vol. 18, no. 3, pp. 151–155, 1999.
Y. J. Chen, Y. S. Lai, and Y. H. Lin, "BIM-based augmented reality inspection and maintenance of fire safety equipment," Automation in Construction, vol. 110, Feb. 2020, Art. no. 103041.
Y. C. How, A. F. A. Nasir, K. F. Muhammad, A. P. P. A. Majeed, M. A. M. Razman, and M. A. Zakaria, "Glove Defect Detection Via YOLO V5," MEKATRONIKA, vol. 3, no. 2, pp. 25–30, 2021.
S. H. Hsu, H. T. Hung, Y. Q. Lin, and C. M. Chang, "Defect inspection of indoor components in buildings using deep learning object detection and augmented reality," Earthquake Engineering and Engineering Vibration, vol. 22, no. 1, pp. 41–54, Jan. 2023.
"Madani Application," AppStore. https://apps.apple.com/sa/app/%D9%85%D8%AF%D9%86%D9%8A/id1596908770.
"Salamti Application - Saudi Civil Defense," 2017, https://my.998.gov.sa/app/salamati.
M. Anul Haq, "CNN Based Automated Weed Detection System Using UAV Imagery," Computer Systems Science and Engineering, vol. 42, no. 2, pp. 837–849, 2022.
M. Anul Haq, "Planetscope Nanosatellites Image Classification Using Machine Learning," Computer Systems Science and Engineering, vol. 42, no. 3, pp. 1031–1046, 2022.
F. M. Talaat and H. ZainEldin, "An improved fire detection approach based on YOLO-v8 for smart cities," Neural Computing and Applications, vol. 35, no. 28, pp. 20939–20954, Oct. 2023.
A. Jawaharlalnehru et al., "Target Object Detection from Unmanned Aerial Vehicle (UAV) Images Based on Improved YOLO Algorithm," Electronics, vol. 11, no. 15, Jan. 2022, Art. no. 2343.
M. A. Haq, G. Rahaman, P. Baral, and A. Ghosh, "Deep Learning Based Supervised Image Classification Using UAV Images for Forest Areas Classification," Journal of the Indian Society of Remote Sensing, vol. 49, no. 3, pp. 601–606, Mar. 2021.
B. Xiao, M. Nguyen, and W. Q. Yan, "Fruit ripeness identification using YOLOv8 model," Multimedia Tools and Applications, Aug. 2023.
A. Corneli, B. Naticchia, M. Vaccarini, F. Bosché, and A. Carbonari, "Training of YOLO Neural Network for the Detection of Fire Emergency Assets," ISARC Proceedings, pp. 836–843, Oct. 2020.
R. Kostoeva, R. Upadhyay, Y. Sapar, and A. Zakhor, "Indoor 3D Interactive Asset Detection Using a Smartphone," The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-2-W13, pp. 811–817, Jun. 2019.
H. Bayer and A. Aziz, "Object Detection of Fire Safety Equipment in Images and Videos Using Yolov5 Neural Network," in Forum Bauinformatik, Munich, Germany, 2022, pp. 62–69.
J. H. Heinbach and A. Aziz, "Visual partial inspection of fire safety equipment using machine learning," presented at the 34th Forum Bauinformatik, Bochum, Germany, Sep. 2023.
B. G. Ferreira, B. G. Lima, and T. F. Vieira, "Visual Inspection of Collective Protection Equipment Conditions with Mobile Deep Learning Models," presented at the 1st International Conference on Deep Learning Theory and Applications, Feb. 2024, pp. 76–83.
H. Bichri, A. Chergui, and M. Hain, "Image Classification with Transfer Learning Using a Custom Dataset: Comparative Study," Procedia Computer Science, vol. 220, pp. 48–54, Jan. 2023.
R. Szeliski, Computer Vision: Algorithms and Applications. Cham, Switzerland: Springer International Publishing, 2022.
"Roboflow: Give your software the power to see objects in images and video." https://roboflow.com/.
A. Gholamy, V. Kreinovich, and O. Kosheleva, "Why 70/30 or 80/20 Relation Between Training and Testing Sets: A Pedagogical Explanation," The Unicersity of Texas at El Paso, UTEP-CS-18-09, Feb. 2018. [Online]. Available: https://scholarworks.utep.edu/cs_techrep/1209.
L. Petricca, T. Moss, G. Figueroa, and S. Broen, "Corrosion Detection Using A.I : A Comparison of Standard Computer Vision Techniques and Deep Learning Model," in CS & IT Conference Proceedings, May 2016, vol. 6.
R. Rajamohanan and B. C. Latha, "An Optimized YOLO v5 Model for Tomato Leaf Disease Classification with Field Dataset," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12033–12038, Dec. 2023.
M. Salemdeeb and S. Erturk, "Multi-national and Multi-language License Plate Detection using Convolutional Neural Networks," Engineering, Technology & Applied Science Research, vol. 10, no. 4, pp. 5979–5985, Aug. 2020.
J. Du, "Understanding of Object Detection Based on CNN Family and YOLO," Journal of Physics: Conference Series, vol. 1004, no. 1, Dec. 2018, Art. no. 012029.
J. Terven and D. Cordova-Esparza, "A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS," Machine Learning and Knowledge Extraction, vol. 5, no. 4, pp. 1680–1716, Nov. 2023.
T. Saidani, "Deep Learning Approach: YOLOv5-based Custom Object Detection," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12158–12163, Dec. 2023.
H. Gong et al., "Swin-Transformer-Enabled YOLOv5 with Attention Mechanism for Small Object Detection on Satellite Images," Remote Sensing, vol. 14, no. 12, Jan. 2022, Art. no. 2861.
C. Y. Wang, A. Bochkovskiy, and H. Y. M. Liao, "YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors," presented at the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 7464–7475.
J. Solawetz, F. JAN 11, and 2023 12 Min Read, "What is YOLOv8? The Ultimate Guide.," Roboflow Blog, Jan. 11, 2023. https://blog.roboflow.com/whats-new-in-yolov8/.
W. Lv et al., "DETRs Beat YOLOs on Real-time Object Detection." arXiv, Jul. 06, 2023.
T. Y. Lin et al., "Microsoft COCO: Common Objects in Context," in Computer Vision – ECCV 2014, Zurich, Switzerland, 2014, pp. 740–755.
Downloads
How to Cite
License
Copyright (c) 2024 Asmaa Alayed, Rehab Alidrisi, Ekram Feras, Shahad Aboukozzana, Alaa Alomayri
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
