Enhancing Surveillance Systems leveraging AIoT for Advanced Object Detection in Real-Time Security Applications
Received: 12 December 2024 | Revised: 28 January 2025 and 19 February 2025 | Accepted: 21 February 2025 | Online: 27 March 2025
Corresponding author: Monish Sai Krishna Namana
Abstract
Surveillance systems are integral for modern security frameworks, ensuring safety in public areas, traffic monitoring, and infrastructure protection. The rising demand for surveillance necessitates advanced technologies capable of accurately identifying objects such as vehicles and pedestrians in real time. A promising solution is the use of AI technologies that has proven their ability in object detection with exceptional accuracy. This study proposes an optimized object detection model using YOLOv8, incorporating comprehensive hyperparameter tuning through the Optuna framework, significantly enhancing object detection accuracy and response time in dynamic environments. The model was trained on the PASCAL VOC 2012 dataset. Our results highlight a robust model performance, achieving a precision of 86.2%, a recall of 78.9%, a mean Average Precision (mAP) of 84.7%, and an F1-score of 81%, which surpasses previous benchmarks for this dataset, particularly in challenging crowded scenarios. Integrating the Internet of Things (IoT) with AI forms Artificial Intelligence of Things (AIoT), a revolutionary step that leverages interconnected devices for real-time, automated data processing and rapid response in complex scenarios, addressing scalability and responsiveness in security applications. Our model detection results are transmitted to the ThingSpeak IoT platform, enabling efficient real-time monitoring and analysis, demonstrates the feasibility of using AIoT to develop scalable, high-accuracy surveillance systems with potential applications across urban safety, traffic management, and infrastructure security.
Keywords:
surveillance, YOLOv8, IoT, AI, object detectionDownloads
References
Z. Zou, K. Chen, Z. Shi, Y. Guo, and J. Ye, "Object Detection in 20 Years: A Survey," Proceedings of the IEEE, vol. 111, no. 3, pp. 257–276, Mar. 2023.
F. M. Talaat and H. ZainEldin, "An improved fire detection approach based on YOLO-v8 for smart cities," Neural Computing and Applications, vol. 35, no. 28, pp. 20939–20954, Oct. 2023.
A. Gautam and S. Singh, "Deep Learning Based Object Detection Combined with Internet of Things for Remote Surveillance," Wireless Personal Communications, vol. 118, no. 4, pp. 2121–2140, Jun. 2021.
S. Panigrahi and U. S. N. Raju, "InceptionDepth-wiseYOLOv2: improved implementation of YOLO framework for pedestrian detection," International Journal of Multimedia Information Retrieval, vol. 11, no. 3, pp. 409–430, Sep. 2022.
S. Bose, M. H. Kolekar, S. Nawale, and D. Khut, "LoLTV: A Low Light Two-Wheeler Violation Dataset With Anomaly Detection Technique," IEEE Access, vol. 11, pp. 124951–124961, 2023.
T. Ahmad, Y. Ma, M. Yahya, B. Ahmad, S. Nazir, and A. U. Haq, "Object Detection through Modified YOLO Neural Network," Scientific Programming, vol. 2020, pp. 1–10, Jun. 2020.
A. A. Alsuwaylimi, R. Alanazi, S. M. Alanazi, S. M. Alenezi, T. Saidani, and R. Ghodhbani, "Improved and Efficient Object Detection Algorithm based on YOLOv5," Engineering, Technology & Applied Science Research, vol. 14, no. 3, pp. 14380–14386, Jun. 2024.
H. Gao, "A Yolo-based Violence Detection Method in IoT Surveillance Systems," International Journal of Advanced Computer Science and Applications, vol. 14, no. 8, 2023.
S.-Y. Jhong, Y.-Y. Chen, C.-H. Hsia, S.-C. Lin, K.-H. Hsu, and C.-F. Lai, "Nighttime object detection system with lightweight deep network for internet of vehicles," Journal of Real-Time Image Processing, vol. 18, no. 4, pp. 1141–1155, Aug. 2021.
X. Zhou, X. Xu, W. Liang, Z. Zeng, and Z. Yan, "Deep-Learning-Enhanced Multitarget Detection for End–Edge–Cloud Surveillance in Smart IoT," IEEE Internet of Things Journal, vol. 8, no. 16, pp. 12588–12596, Aug. 2021.
A. Rehman, T. Saba, M. Z. Khan, R. Damaševičius, and S. A. Bahaj, "Internet-of-Things-Based Suspicious Activity Recognition Using Multimodalities of Computer Vision for Smart City Security," Security and Communication Networks, vol. 2022, pp. 1–12, Oct. 2022.
Z. Wang and Y. Ma, "Detection and recognition of stationary vehicles and seat belts in intelligent Internet of Things traffic management system," Neural Computing and Applications, vol. 34, no. 5, pp. 3513–3522, Mar. 2022.
C. Li et al., "Fast Forest Fire Detection and Segmentation Application for UAV-Assisted Mobile Edge Computing System," IEEE Internet of Things Journal, vol. 11, no. 16, pp. 26690–26699, Aug. 2024.
J. Wu et al., "A Lightweight Small Object Detection Method Based on Multilayer Coordination Federated Intelligence for Coal Mine IoVT," IEEE Internet of Things Journal, vol. 11, no. 11, pp. 20072–20087, Jun. 2024.
P. Gao, "Development of YOLO-based Model for Fall Detection in IoT Smart Home Applications," International Journal of Advanced Computer Science and Applications, vol. 14, no. 10, 2023.
Z. Zhi-Xian and F. Zhang, "Image Real-Time Detection Using LSE-Yolo Neural Network in Artificial Intelligence-Based Internet of Things for Smart Cities and Smart Homes," Wireless Communications and Mobile Computing, vol. 2022, pp. 1–8, Mar. 2022.
D. Liu, Z. Wang, and X. Meng, "Fast intensive crowd counting model of Internet of Things based on multi‐scale attention mechanism," IET Image Processing, vol. 19, no. 1, Jan. 2025, Art. no. e12686.
M. Saini, H. Singh, E. Sengupta, A. Aggarwal, H. Singh, and N. Kumar, "An intelligent machine learning-enabled cattle reclining risk mitigation technique using surveillance videos," Neural Computing and Applications, vol. 36, no. 4, pp. 2029–2047, Feb. 2024.
T. Saidani, "Deep Learning Approach: YOLOv5-based Custom Object Detection," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12158–12163, Dec. 2023.
S. Dalal et al., "Improving smart home surveillance through YOLO model with transfer learning and quantization for enhanced accuracy and efficiency," PeerJ Computer Science, vol. 10, Jun. 2024, Art. no. e1939.
Y. Zhao, Y. Yin, and G. Gui, "Lightweight Deep Learning Based Intelligent Edge Surveillance Techniques," IEEE Transactions on Cognitive Communications and Networking, vol. 6, no. 4, pp. 1146–1154, Dec. 2020.
C. Dong, C. Pang, Z. Li, X. Zeng, and X. Hu, "PG-YOLO: A Novel Lightweight Object Detection Method for Edge Devices in Industrial Internet of Things," IEEE Access, vol. 10, pp. 123736–123745, 2022.
S. Liang et al., "Edge YOLO: Real-Time Intelligent Object Detection System Based on Edge-Cloud Cooperation in Autonomous Vehicles," IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 12, pp. 25345–25360, Dec. 2022.
Z. Xu, J. Li, and M. Zhang, "A Surveillance Video Real-Time Analysis System Based on Edge-Cloud and FL-YOLO Cooperation in Coal Mine," IEEE Access, vol. 9, pp. 68482–68497, 2021.
S. Wang and X. Hao, “YOLO-SK: A lightweight multiscale object detection algorithm,” Heliyon, vol. 10, no. 2, Jan. 2024, Art. no. e24143.
X. Zheng, J. Zou, S. Du, and P. Zhong, "Small Target Detection in Refractive Panorama Surveillance Based on Improved YOLOv8," Sensors, vol. 24, no. 3, Jan. 2024, Art. no. 819.
Sandhya and A. Kashyap, "Real‐time object‐removal tampering localization in surveillance videos by employing YOLO‐V8," Journal of Forensic Sciences, vol. 69, no. 4, pp. 1304–1319, Jul. 2024.
M. Bakirci, "Utilizing YOLOv8 for enhanced traffic monitoring in intelligent transportation systems (ITS) applications," Digital Signal Processing, vol. 152, Sep. 2024, Art. no. 104594.
G. Cheng, P. Chao, J. Yang, and H. Ding, "SGST-YOLOv8: An Improved Lightweight YOLOv8 for Real-Time Target Detection for Campus Surveillance," Applied Sciences, vol. 14, no. 12, Jun. 2024, Art. no. 5341.
Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., and Zisserman, A. (2012). PASCAL Visual Object Classes Challenge 2012 (VOC2012) Dataset.
A. Geiger, P. Lenz, C. Stiller, and R. Urtasun, “Vision meets robotics: The KITTI dataset,” The International Journal of Robotics Research, vol. 32, no. 11, pp. 1231–1237, Sep. 2013.
Downloads
How to Cite
License
Copyright (c) 2025 Monish Sai Krishna Namana, B. Udaya Kumar
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
