Real-Time Inspection of Fire Safety Equipment using Computer Vision and Deep Learning

Authors

  • Asmaa Alayed College of Computing, Umm Al-Qura University, Saudi Arabia https://orcid.org/0009-0008-9952-3560
  • Rehab Alidrisi College of Computing, Umm Al-Qura University, Saudi Arabia
  • Ekram Feras College of Computing, Umm Al-Qura University, Saudi Arabia
  • Shahad Aboukozzana College of Computing, Umm Al-Qura University, Saudi Arabia
  • Alaa Alomayri College of Computing, Umm Al-Qura University, Saudi Arabia
Volume: 14 | Issue: 2 | Pages: 13290-13298 | April 2024 | https://doi.org/10.48084/etasr.6753

Abstract

The number of accidental fires in buildings has been significantly increased in recent years in Saudi Arabia. Fire Safety Equipment (FSE) plays a crucial role in reducing fire risks. However, this equipment is prone to defects and requires periodic checks and maintenance. Fire safety inspectors are responsible for visual inspection of safety equipment and reporting defects. As the traditional approach of manually checking each piece of equipment can be time-consuming and inaccurate, this study aims to improve the inspection processes of safety equipment. Using computer vision and deep learning techniques, a detection model was trained to visually inspect fire extinguishers and identify defects. Fire extinguisher images were collected, annotated, and augmented to create a dataset of 7,633 images with 16,092 labeled instances. Then, experiments were carried out using YOLOv5, YOLOv7, YOLOv8, and RT-DETR. Pre-trained models were used for transfer learning. A comparative analysis was performed to evaluate these models in terms of accuracy, speed, and model size. The results of YOLOv5n, YOLOv7, YOLOv8n, YOLOv8m, and RT-DETR indicated satisfactory accuracy, ranging between 83.1% and 87.2%. YOLOv8n was chosen as the most suitable due to its fastest inference time of 2.7 ms, its highest mAP0.5 of 87.2%, and its compact model size, making it ideal for real-time mobile applications.

Keywords:

Fire Safety Equipment (FSE), fire safety inspection, visual inspection, deep learning, computer vision, object detection, You-Only-Look-Once (YOLO)

Downloads

Download data is not yet available.

References

"Annual Statistical Report," Civil Defense Directorate, Saudi Arabia, 2020.

"Why is Fire Safety Important? | Alsco." https://alsco.com/resources/why-is-fire-safety-important/.

"Saudi Fire Protection Code Fire Protection Requirements," Saudi Building Code National Committee, SBC 801, 2018.

V. Kodur, P. Kumar, and M. M. Rafi, "Fire hazard in buildings: review, assessment and strategies for improving fire safety," PSU Research Review, vol. 4, no. 1, pp. 1–23, Jan. 2019.

D. E. Della-Giustina, Fire Safety Management Handbook, 3rd ed. Boca Ration, FL, USA: CRC Press, 2014.

D. Dieken, "Inspection, testing and maintenance of fire protection systems at industrial plants," Process Safety Progress, vol. 18, no. 3, pp. 151–155, 1999.

Y. J. Chen, Y. S. Lai, and Y. H. Lin, "BIM-based augmented reality inspection and maintenance of fire safety equipment," Automation in Construction, vol. 110, Feb. 2020, Art. no. 103041.

Y. C. How, A. F. A. Nasir, K. F. Muhammad, A. P. P. A. Majeed, M. A. M. Razman, and M. A. Zakaria, "Glove Defect Detection Via YOLO V5," MEKATRONIKA, vol. 3, no. 2, pp. 25–30, 2021.

S. H. Hsu, H. T. Hung, Y. Q. Lin, and C. M. Chang, "Defect inspection of indoor components in buildings using deep learning object detection and augmented reality," Earthquake Engineering and Engineering Vibration, vol. 22, no. 1, pp. 41–54, Jan. 2023.

"Madani Application," AppStore. https://apps.apple.com/sa/app/%D9%85%D8%AF%D9%86%D9%8A/id1596908770.

"Salamti Application - Saudi Civil Defense," 2017, https://my.998.gov.sa/app/salamati.

M. Anul Haq, "CNN Based Automated Weed Detection System Using UAV Imagery," Computer Systems Science and Engineering, vol. 42, no. 2, pp. 837–849, 2022.

M. Anul Haq, "Planetscope Nanosatellites Image Classification Using Machine Learning," Computer Systems Science and Engineering, vol. 42, no. 3, pp. 1031–1046, 2022.

F. M. Talaat and H. ZainEldin, "An improved fire detection approach based on YOLO-v8 for smart cities," Neural Computing and Applications, vol. 35, no. 28, pp. 20939–20954, Oct. 2023.

A. Jawaharlalnehru et al., "Target Object Detection from Unmanned Aerial Vehicle (UAV) Images Based on Improved YOLO Algorithm," Electronics, vol. 11, no. 15, Jan. 2022, Art. no. 2343.

M. A. Haq, G. Rahaman, P. Baral, and A. Ghosh, "Deep Learning Based Supervised Image Classification Using UAV Images for Forest Areas Classification," Journal of the Indian Society of Remote Sensing, vol. 49, no. 3, pp. 601–606, Mar. 2021.

B. Xiao, M. Nguyen, and W. Q. Yan, "Fruit ripeness identification using YOLOv8 model," Multimedia Tools and Applications, Aug. 2023.

A. Corneli, B. Naticchia, M. Vaccarini, F. Bosché, and A. Carbonari, "Training of YOLO Neural Network for the Detection of Fire Emergency Assets," ISARC Proceedings, pp. 836–843, Oct. 2020.

R. Kostoeva, R. Upadhyay, Y. Sapar, and A. Zakhor, "Indoor 3D Interactive Asset Detection Using a Smartphone," The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-2-W13, pp. 811–817, Jun. 2019.

H. Bayer and A. Aziz, "Object Detection of Fire Safety Equipment in Images and Videos Using Yolov5 Neural Network," in Forum Bauinformatik, Munich, Germany, 2022, pp. 62–69.

J. H. Heinbach and A. Aziz, "Visual partial inspection of fire safety equipment using machine learning," presented at the 34th Forum Bauinformatik, Bochum, Germany, Sep. 2023.

B. G. Ferreira, B. G. Lima, and T. F. Vieira, "Visual Inspection of Collective Protection Equipment Conditions with Mobile Deep Learning Models," presented at the 1st International Conference on Deep Learning Theory and Applications, Feb. 2024, pp. 76–83.

H. Bichri, A. Chergui, and M. Hain, "Image Classification with Transfer Learning Using a Custom Dataset: Comparative Study," Procedia Computer Science, vol. 220, pp. 48–54, Jan. 2023.

R. Szeliski, Computer Vision: Algorithms and Applications. Cham, Switzerland: Springer International Publishing, 2022.

"Roboflow: Give your software the power to see objects in images and video." https://roboflow.com/.

A. Gholamy, V. Kreinovich, and O. Kosheleva, "Why 70/30 or 80/20 Relation Between Training and Testing Sets: A Pedagogical Explanation," The Unicersity of Texas at El Paso, UTEP-CS-18-09, Feb. 2018. [Online]. Available: https://scholarworks.utep.edu/cs_techrep/1209.

L. Petricca, T. Moss, G. Figueroa, and S. Broen, "Corrosion Detection Using A.I : A Comparison of Standard Computer Vision Techniques and Deep Learning Model," in CS & IT Conference Proceedings, May 2016, vol. 6.

R. Rajamohanan and B. C. Latha, "An Optimized YOLO v5 Model for Tomato Leaf Disease Classification with Field Dataset," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12033–12038, Dec. 2023.

M. Salemdeeb and S. Erturk, "Multi-national and Multi-language License Plate Detection using Convolutional Neural Networks," Engineering, Technology & Applied Science Research, vol. 10, no. 4, pp. 5979–5985, Aug. 2020.

J. Du, "Understanding of Object Detection Based on CNN Family and YOLO," Journal of Physics: Conference Series, vol. 1004, no. 1, Dec. 2018, Art. no. 012029.

J. Terven and D. Cordova-Esparza, "A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS," Machine Learning and Knowledge Extraction, vol. 5, no. 4, pp. 1680–1716, Nov. 2023.

T. Saidani, "Deep Learning Approach: YOLOv5-based Custom Object Detection," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12158–12163, Dec. 2023.

H. Gong et al., "Swin-Transformer-Enabled YOLOv5 with Attention Mechanism for Small Object Detection on Satellite Images," Remote Sensing, vol. 14, no. 12, Jan. 2022, Art. no. 2861.

C. Y. Wang, A. Bochkovskiy, and H. Y. M. Liao, "YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors," presented at the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 7464–7475.

J. Solawetz, F. JAN 11, and 2023 12 Min Read, "What is YOLOv8? The Ultimate Guide.," Roboflow Blog, Jan. 11, 2023. https://blog.roboflow.com/whats-new-in-yolov8/.

W. Lv et al., "DETRs Beat YOLOs on Real-time Object Detection." arXiv, Jul. 06, 2023.

T. Y. Lin et al., "Microsoft COCO: Common Objects in Context," in Computer Vision – ECCV 2014, Zurich, Switzerland, 2014, pp. 740–755.

Downloads

How to Cite

[1]
A. Alayed, R. Alidrisi, E. Feras, S. Aboukozzana, and A. Alomayri, “Real-Time Inspection of Fire Safety Equipment using Computer Vision and Deep Learning”, Eng. Technol. Appl. Sci. Res., vol. 14, no. 2, pp. 13290–13298, Apr. 2024.

Metrics

Abstract Views: 128
PDF Downloads: 251

Metrics Information