Enhancing Traffic Counting in Rainy Conditions: A Deep Learning Super Sampling and Multi-ROI Pixel Area Approach
Received: 6 November 2024 | Revised: 12 December 2024 | Accepted: 22 December 2024 | Online: 2 February 2025
Corresponding author: Elly Warni
Abstract
In Intelligent Transportation Systems (ITS), adaptive traffic control relies heavily on precise, real-time traffic data. Controllers use information such as vehicle count, vehicle density, traffic congestion, and intersection wait times to optimize traffic flow and improve efficiency. Traffic cameras collect and process this data, but environmental factors like rain can degrade the performance of data retrieval systems. We propose a vehicle detection method that integrates pixel area analysis with Deep Learning Super Sampling (DLSS) to enhance performance under rainy conditions. Our method achieved an accuracy of 80.95% under rainy conditions, outperforming traditional methods, and performing comparably to specialized methods such as DCGAN (93.57%) and DarkNet53 (87.54%). However, under extreme conditions such as thunderstorms, the method's accuracy dropped to 36.58%, highlighting the need for further improvements. These results, evaluated using the AAU RainSnow Traffic Surveillance Dataset, demonstrate that our method improves traffic data collection in diverse and challenging weather conditions while identifying areas for future research.
Keywords:
deep learning super sampling, digital image processing, intelligent transportation system, pixel area, traffic counterDownloads
References
Q. Zhu, Y. Liu, M. Liu, S. Zhang, G. Chen, and H. Meng, "Intelligent Planning and Research on Urban Traffic Congestion," Future Internet, vol. 13, no. 11, Nov. 2021, Art. no. 284.
M. Alam, J. Ferreira, and J. Fonseca, "Introduction to Intelligent Transportation Systems," in Intelligent Transportation Systems: Dependable Vehicular Communications for Improved Road Safety, M. Alam, J. Ferreira, and J. Fonseca, Eds. Cham, Switzerland: Springer International Publishing, 2016, pp. 1–17.
J. Lin, Y. Huang, X. Su, Z. Su, and P. Zhao, "An In-vehicle Camera Based Traffic Estimation in Smart Transportation," in 2019 IEEE 5th International Conference on Computer and Communications, Chengdu, China, 2019, pp. 2186–2192.
C. H. Bahnsen and T. B. Moeslund, "Rain Removal in Traffic Surveillance: Does it Matter?," IEEE Transactions on Intelligent Transportation Systems, vol. 20, no. 8, pp. 2802–2819, Aug. 2019.
N. K. Jain, R. K. Saini, and P. Mittal, "A Review on Traffic Monitoring System Techniques," in Soft Computing: Theories and Applications, Proceedings of SoCTA 2017, Jhansi, India, 2019, pp. 569–577.
T. Pamula, "Road Traffic Conditions Classification Based on Multilevel Filtering of Image Content Using Convolutional Neural Networks," IEEE Intelligent Transportation Systems Magazine, vol. 10, no. 3, pp. 11–21, 2018.
I. C. Amitha and N. K. Narayanan, "Object Detection Using YOLO Framework for Intelligent Traffic Monitoring," in Machine Vision and Augmented Intelligence—Theory and Applications: Select Proceedings of MAI 2021, Jabalpur, India, 2021, pp. 405–412.
K. Yan and Z. Zhang, "Automated Asphalt Highway Pavement Crack Detection Based on Deformable Single Shot Multi-Box Detector Under a Complex Environment," IEEE Access, vol. 9, pp. 150925–150938, 2021.
D. Biswas, H. Su, C. Wang, A. Stevanovic, and W. Wang, "An automatic traffic density estimation using Single Shot Detection (SSD) and MobileNet-SSD," Physics and Chemistry of the Earth, Parts A/B/C, vol. 110, pp. 176–184, Apr. 2019.
S. Zhang, Y. Guo, P. Zhao, C. Zheng, and X. Chen, "A Graph-Based Temporal Attention Framework for Multi-Sensor Traffic Flow Forecasting," IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 7, pp. 7743–7758, Jul. 2022.
C. Hu, L. Xu, Y. Guo, X. Jing, X. Lu, and P. Liu, "HSV-3S and 2D-GDA for High-Saturation Low-Light Image Enhancement in Night Traffic Monitoring," IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 12, pp. 15190–15206, Dec. 2023.
W. Zhang, X. Sui, G. Gu, Q. Chen, and H. Cao, "Infrared Thermal Imaging Super-Resolution via Multiscale Spatio-Temporal Feature Fusion Network," IEEE Sensors Journal, vol. 21, no. 17, pp. 19176–19185, Sep. 2021.
J. Shi and K. Yang, "An Improved Histogram Equalization Method in the Traffic Monitoring Image Processing Field," Journal of Computer and Communications, vol. 3, no. 11, pp. 25–32, Nov. 2015.
C.-H. Hu et al., "Joint Image-to-Image Translation for Traffic Monitoring Driver Face Image Enhancement," IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 8, pp. 7961–7973, Aug. 2023.
X. Ji, J. Cheng, J. Bai, T. Zhang, and M. Wang, "Real-time enhancement of the image clarity for traffic video monitoring systems in haze," in 2014 7th International Congress on Image and Signal Processing, Dalian, China, 2014, pp. 11–15.
K. Mondal, R. Rabidas, and R. Dasgupta, "Single image haze removal using contrast limited adaptive histogram equalization based multiscale fusion technique," Multimedia Tools and Applications, vol. 83, no. 5, pp. 15413–15438, Feb. 2024.
S. Basak and S. Suresh, "Vehicle detection and type classification in low resolution congested traffic scenes using image super resolution," Multimedia Tools and Applications, vol. 83, no. 8, pp. 21825–21847, Mar. 2024.
K. Guo et al., "Video Super-Resolution Based on Inter-Frame Information Utilization for Intelligent Transportation," IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 11, pp. 13409–13421, Nov. 2023.
Y. Jin, Y. Zhang, Y. Cen, Y. Li, V. Mladenovic, and V. Voronin, "Pedestrian detection with super-resolution reconstruction for low-quality image," Pattern Recognition, vol. 115, Jul. 2021, Art. no. 107846.
S. Nousheen and S. P. Kumar, "Novel Fog-Removing Method For The Traffic Monitoring Image," International Journal of Innovative Technology and Research, vol. 4, no. 5, pp. 4159–4162, Aug. 2016.
S. Markidis, S. W. D. Chien, E. Laure, I. B. Peng, and J. S. Vetter, "NVIDIA Tensor Core Programmability, Performance & Precision," in 2018 IEEE International Parallel and Distributed Processing Symposium Workshops, Vancouver, Canada, 2018, pp. 522–531.
R. Chowdhury, F. Silvestri, and F. Vella, "A Computational Model for Tensor Core Units," in Proceedings of the 32nd ACM Symposium on Parallelism in Algorithms and Architectures, Virtual Event, USA, 2020, pp. 519–521.
C. M. Bautista, C. A. Dy, M. I. Mañalac, R. A. Orbe, and M. Cordel, "Convolutional neural network for vehicle detection in low resolution traffic videos," in 2016 IEEE Region 10 Symposium, Bali, Indonesia, 2016, pp. 277–281.
F. Zhang, C. Li, and F. Yang, "Vehicle Detection in Urban Traffic Surveillance Images Based on Convolutional Neural Networks with Feature Concatenation," Sensors, vol. 19, no. 3, Jan. 2019, Art. no. 594.
L. Ge, D. Dan, and H. Li, "An accurate and robust monitoring method of full-bridge traffic load distribution based on YOLO-v3 machine vision," Structural Control and Health Monitoring, vol. 27, no. 12, Dec. 2020, Art. no. e2636.
C.-Y. Cao, J.-C. Zheng, Y.-Q. Huang, J. Liu, and C.-F. Yang, "Investigation of a Promoted You Only Look Once Algorithm and Its Application in Traffic Flow Monitoring," Applied Sciences, vol. 9, no. 17, Sep. 2019, Art. no. 3619.
M. Hassaballah, M. A. Kenk, K. Muhammad, and S. Minaee, "Vehicle Detection and Tracking in Adverse Weather Using a Deep Learning Framework," IEEE Transactions on Intelligent Transportation Systems, vol. 22, no. 7, pp. 4230–4242, Jul. 2021.
Downloads
How to Cite
License
Copyright (c) 2024 Elly Warni, A. Ais Prayogi Alimuddin, A. Ejah Umraeni Salam, Moch Fachri, Muhammad Rizal H.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
