Suspicious Activity Classification in Classrooms using Deep Learning
Received: 26 July 2023 | Revised: 10 August 2023 | Accepted: 19 August 2023 | Online: 4 November 2023
Corresponding author: Neha Gupta
Abstract
Video processing is attracting the attention of both research and industry. The existence of intelligent surveillance cameras with high processing power has paved the way for designing intelligent visual surveillance systems. Along with analyzing video for information recovery, it is nowadays used to analyze live surveillance video to detect activities. These systems are implemented in real time. The proposed work's goal is to create a method that can examine and discover suspicious behaviors in the lecture room environment. Video analytics offers the most efficient answer because it enables pointing an occasion and retrieves applicable statistics from the video recorded. The method aims to identify suspicious activities like fighting, sleeping, looking elsewhere, eating, etc. that the students might be doing. The proposed method involves breaking a video input into frames and converting it into image data because the model has been trained on images collected from the internet. Several models were tested and experimented with, including efficientnet_b2, spnasnet_100, efficientnet_b3, and mobilenetv3_large_100. Parameters such as the Learning Rate were optimized to find out the best method and create a system with the best results.
Keywords:
classroom surveillance, suspicious activity, video processing, anomalous activity detectionDownloads
References
C. Sujatha and U. Mudenagudi, "A Study on Keyframe Extraction Methods for Video Summary," in 2011 International Conference on Computational Intelligence and Communication Networks, Jul. 2011, pp. 73–77.
T. Senthilkumar and G. Narmatha, "Suspicious Human Activity Detection in Classroom Examination," in Computational Intelligence, Cyber Security and Computational Models, Singapore, 2016, pp. 99–108.
G. S. Devi, G. S. Kumar, and S. Chandini, "Automated Video Surveillance System for Detection of Suspicious Activities during Academic Offline Examination," International Journal of Computer and Information Engineering, vol. 11, no. 12, pp. 1265–1271, Oct. 2017.
A. Katiyar, A. Singh, M. Parvez, N. Rajora, L. K. Sharma, and G. Singal, "Thresholding based Smart Home Automation System using K-means," in 2023 13th International Conference on Cloud Computing, Data Science & Engineering (Confluence), Noida, India, Jan. 2023, pp. 47–52.
M. D. Genemo, "Suspicious activity recognition for monitoring cheating in exams," Proceedings of the Indian National Science Academy, vol. 88, no. 1, pp. 1–10, Mar. 2022.
A. G. Howard et al., "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications." arXiv, Apr. 16, 2017.
T. Mamalis, D. Stipanovic, and P. Voulgaris, "Stochastic Learning Rate Optimization in the Stochastic Approximation and Online Learning Settings." arXiv, Mar. 21, 2022.
M. Shaha and M. Pawar, "Transfer Learning for Image Classification," in 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA), Coimbatore, India, Mar. 2018, pp. 656–660.
P. Deraiya, J. Pandya, and P. G. Student, "A Survey for Abnormal Activity Detection in Classroom," International Journal of Innovative Research in Science, Engineering and Technology, vol. 5, no. 12, pp. 20511–20516, 2007.
G. Wang, A. El Saddik, X. Lai, G. Martinez Perez, and K.-K. R. Choo, Eds., Smart City and Informatization: 7th International Conference, iSCI 2019, Guangzhou, China, November 12–15, 2019, Proceedings, Springer, 2019.
A. Paszke et al., "PyTorch: An Imperative Style, High-Performance Deep Learning Library," in Advances in Neural Information Processing Systems, 2019.
A. Sharma et al., "Heart rate and blood pressure measurement based on photoplethysmogram signal using fast Fourier transform," Computers and Electrical Engineering, vol. 101, Jul. 2022, Art. no. 108057.
R. Ribani and M. Marengoni, "A Survey of Transfer Learning for Convolutional Neural Networks," in 2019 32nd SIBGRAPI Conference on Graphics, Patterns and Images Tutorials (SIBGRAPI-T), Rio de Janeiro, Brazil, Jul. 2019, pp. 47–57.
M. Tan and Q. V. Le, "EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks." arXiv, Sep. 11, 2020.
K. Chaudhuri, S. Jegelka, L. Song, C. Szepesvari, G. Niu, and S. Sabato, International Conference on Machine Learning, 17-23 July 2022, Baltimore, Maryland, USA, 2022.
N. Kumar, A. Hashmi, M. Gupta, and A. Kundu, "Automatic Diagnosis of Covid-19 Related Pneumonia from CXR and CT-Scan Images," Engineering, Technology & Applied Science Research, vol. 12, no. 1, pp. 7993–7997, Feb. 2022.
N. Gupta and B. B. Agarwal, "Recognition of Suspicious Human Activity in Video Surveillance: A Review," Engineering, Technology & Applied Science Research, vol. 13, no. 2, pp. 10529–10534, Apr. 2023.
M. B. Ayed, S. Elkosantini, and M. Abid, "An Automated Surveillance System Based on Multi-Processor and GPU Architecture," Engineering, Technology & Applied Science Research, vol. 7, no. 6, pp. 2319–2323, Dec. 2017.
N. Kumar and D. Aggarwal, "LEARNING-based Focused WEB Crawler," IETE Journal of Research, vol. 69, no. 4, pp. 2037–2045, May 2023.
M. Kaur, V. Kumar, V. Yadav, D. Singh, N. Kumar, and N. N. Das, "Metaheuristic-based Deep COVID-19 Screening Model from Chest X-Ray Images," Journal of Healthcare Engineering, vol. 2021, Mar. 2021, Art. no. e8829829.
N. Kumar, N. Narayan Das, D. Gupta, K. Gupta, and J. Bindra, "Efficient Automated Disease Diagnosis Using Machine Learning Models," Journal of Healthcare Engineering, vol. 2021, May 2021, Art. no. e9983652.
N. Kumar, M. Gupta, D. Gupta, and S. Tiwari, "Novel deep transfer learning model for COVID-19 patient detection using X-ray chest images," Journal of Ambient Intelligence and Humanized Computing, vol. 14, no. 1, pp. 469–478, Jan. 2023.
M. Gupta, N. Kumar, B. K. Singh, and N. Gupta, "NSGA-III-Based Deep-Learning Model for Biomedical Search Engines," Mathematical Problems in Engineering, vol. 2021, May 2021, Art. no. e9935862.
N. Kumar, M. Gupta, D. Sharma, and I. Ofori, "Technical Job Recommendation System Using APIs and Web Crawling," Computational Intelligence and Neuroscience, vol. 2022, Jun. 2022, Art. no. e7797548.
M. Gupta, N. Kumar, N. Gupta, and A. Zaguia, "Fusion of multimodality biomedical images using deep neural networks," Soft Computing, vol. 26, no. 16, pp. 8025–8036, Aug. 2022.
A. Hashmi et al., "Contrast Enhancement in Mammograms Using Convolution Neural Networks for Edge Computing Systems," Scientific Programming, vol. 2022, Apr. 2022, Art. no. e1882464.
K. R. Kodepogu et al., "A Novel Deep Convolutional Neural Network for Diagnosis of Skin Disease," Traitement du Signal, vol. 39, no. 5, pp. 1873–1877, Nov. 2022.
Downloads
How to Cite
License
Copyright (c) 2023 Neha Gupta, Bharat Bhushan Agarwal
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
