Application of Advanced Deep Convolutional Neural Networks for the Recognition of Road Surface Anomalies
Received: 28 March 2023 | Revised: 8 April 2023 | Accepted: 14 April 2023 | Online: 3 May 2023
Corresponding author: Dong Doan Van
Abstract
The detection of road surface anomalies is a crucial task for modern traffic monitoring systems. In this paper, we used the YOLOv8 network,- a state-of-the-art convolutional neural network architecture, for real-time object recognition and to automatically identify potholes, cracks, and patches on the road surface. We created a custom dataset of 1044 road surface images in Vietnam, each of which was annotated with pavement anomalies, and the YOLOv8 network was trained with this dataset. The results show that the model achieved an accuracy of 0.56 mAP at a threshold of 0.5, indicating its potential for practical application.
Keywords:
road surface anomalies, digital image processing, transportation, convolutional neural networksDownloads
References
V. Pereira, S. Tamura, S. Hayamizu, and H. Fukai, "A Deep Learning-Based Approach for Road Pothole Detection in Timor Leste," in 2018 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI), Singapore, Jul. 2018, pp. 279–284. DOI: https://doi.org/10.1109/SOLI.2018.8476795
K. E. An, S. W. Lee, S.-K. Ryu, and D. Seo, "Detecting a pothole using deep convolutional neural network models for an adaptive shock observing in a vehicle driving," in 2018 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, Jan. 2018.
J. M. Celaya-Padilla et al., "Speed Bump Detection Using Accelerometric Features: A Genetic Algorithm Approach," Sensors, vol. 18, no. 2, Feb. 2018, Art. no. 443. DOI: https://doi.org/10.3390/s18020443
F. Seraj, B. J. van der Zwaag, A. Dilo, T. Luarasi, and P. Havinga, "RoADS: A Road Pavement Monitoring System for Anomaly Detection Using Smart Phones," in Big Data Analytics in the Social and Ubiquitous Context, 2016, pp. 128–146. DOI: https://doi.org/10.1007/978-3-319-29009-6_7
A. Basavaraju, J. Du, F. Zhou, and J. Ji, "A Machine Learning Approach to Road Surface Anomaly Assessment Using Smartphone Sensors," IEEE Sensors Journal, vol. 20, no. 5, pp. 2635–2647, Mar. 2020019.2952857. DOI: https://doi.org/10.1109/JSEN.2019.2952857
Y.-M. Kim, Y.-G. Kim, S.-Y. Son, S.-Y. Lim, B.-Y. Choi, and D.-H. Choi, "Review of Recent Automated Pothole-Detection Methods," Applied Sciences, vol. 12, no. 11, Jan. 2022, Art. no. 5320. DOI: https://doi.org/10.3390/app12115320
J. Menegazzo and A. von Wangenheim, "Road surface type classification based on inertial sensors and machine learning," Computing, vol. 103, no. 10, pp. 2143–2170, Oct. 2021. DOI: https://doi.org/10.1007/s00607-021-00914-0
S. Sattar, S. Li, and M. Chapman, "Developing a near real-time road surface anomaly detection approach for road surface monitoring," Measurement, vol. 185, Nov. 2021, Art. no. 109990. DOI: https://doi.org/10.1016/j.measurement.2021.109990
J. Guan, X. Yang, L. Ding, X. Cheng, V. C. S. Lee, and C. Jin, "Automated pixel-level pavement distress detection based on stereo vision and deep learning," Automation in Construction, vol. 129, Sep. 2021, Art. no. 103788. DOI: https://doi.org/10.1016/j.autcon.2021.103788
A. Tedeschi and F. Benedetto, "A real-time automatic pavement crack and pothole recognition system for mobile Android-based devices," Advanced Engineering Informatics, vol. 32, pp. 11–25, Apr. 2017. DOI: https://doi.org/10.1016/j.aei.2016.12.004
H. D. Quy, N. N. Son, and H. P. H. Anh, "DeYOLOv3: An Optimal Mass Detector for Advanced Breast Cancer Diagnostics," in Computational Intelligence Methods for Green Technology and Sustainable Development, 2023, pp. 325–335. DOI: https://doi.org/10.1007/978-3-031-19694-2_29
V. T. H. Tuyet, N. T. Binh, and D. T. Tin, "Improving the Curvelet Saliency and Deep Convolutional Neural Networks for Diabetic Retinopathy Classification in Fundus Images," Engineering, Technology & Applied Science Research, vol. 12, no. 1, pp. 8204–8209, Feb. 2022. DOI: https://doi.org/10.48084/etasr.4679
D. Patil and S. Jadhav, "Road Segmentation in High-Resolution Images Using Deep Residual Networks," Engineering, Technology & Applied Science Research, vol. 12, no. 6, pp. 9654–9660, Dec. 2022. DOI: https://doi.org/10.48084/etasr.5247
N. C. Kundur and P. B. Mallikarjuna, "Deep Convolutional Neural Network Architecture for Plant Seedling Classification," Engineering, Technology & Applied Science Research, vol. 12, no. 6, pp. 9464–9470, Dec. 2022. DOI: https://doi.org/10.48084/etasr.5282
J. Redmon and A. Farhadi, "YOLO9000: Better, Faster, Stronger," in 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, Jul. 2017, pp. 6517–6525. DOI: https://doi.org/10.1109/CVPR.2017.690
G. Doğan and B. Ergen, "A new mobile convolutional neural network-based approach for pixel-wise road surface crack detection," Measurement, vol. 195, May 2022, Art. no. 111119. DOI: https://doi.org/10.1016/j.measurement.2022.111119
M. Sandler, A. Howard, M. Zhu, A. Zhmoginov, and L.-C. Chen, "MobileNetV2: Inverted Residuals and Linear Bottlenecks." arXiv, Mar. 21, 2019. DOI: https://doi.org/10.1109/CVPR.2018.00474
G. Jocher, A. Chaurasia, and J. Qiu, "YOLO by Ultralytics." Jan. 2023, [Online]. Available: https://github.com/ultralytics/ultralytics.
G. Jocher et al., "ultralytics/yolov5: v7.0 - YOLOv5 SOTA Realtime Instance Segmentation." Zenodo, Aug. 22, 2022.
Z. Ge, S. Liu, F. Wang, Z. Li, and J. Sun, "YOLOX: Exceeding YOLO Series in 2021." arXiv, Aug. 05, 2021.
Downloads
How to Cite
License
Copyright (c) 2023 Doan Van Dong
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
