Underwater Image Enhancement using Convolution Denoising Network and Blind Convolution
Received: 22 September 2024 | Revised: 22 October 2024 | Accepted: 28 November 2024 | Online: 9 December 2024
Corresponding author: Shubhangi Adagale-Vairagar
Abstract
Underwater Image Enhancement (UWIE) is essential for improving the quality of Underwater Images (UWIs). However, recent UWIE methods face challenges due to low lighting conditions, contrast issues, color distortion, lower visibility, stability and buoyancy, pressure and temperature, and white balancing problems. Traditional techniques cannot capture the fine changes in UWI texture and cannot learn complex patterns. This study presents a UWIE Network (UWIE-Net) based on a parallel combination of a denoising Deep Convolution Neural Network (DCNN) and blind convolution to improve the overall visual quality of UWIs. The DCNN is used to depict the UWI complex pattern features and focuses on enhancing the image's contrast, color, and texture. Blind convolution is employed in parallel to minimize noise and irregularities in the image texture. Finally, the images obtained at the two parallel layers are fused using wavelet fusion to preserve the edge and texture information of the final enhanced UWI. The effectiveness of UWIE-Net was evaluated on the Underwater Image Enhancement Benchmark Dataset (UIEB), achieving MSE of 23.5, PSNR of 34.42, AG of 13.56, PCQI of 1.23, and UCIQE of 0.83. The UWIE-Net shows notable improvement in the overall visual and structural quality of UWIs compared to existing state-of-the-art methods.
Keywords:
blind convolution, deep convolutional neural network, image denoising, underwater image enhancementDownloads
References
S. Raveendran, M. D. Patil, and G. K. Birajdar, "Underwater image enhancement: a comprehensive review, recent trends, challenges and applications," Artificial Intelligence Review, vol. 54, no. 7, pp. 5413–5467, Oct. 2021.
H. T. R. Kurmasha, A. F. H. Alharan, C. S. Der, and N. H. Azami, "Enhancement of Edge-based Image Quality Measures Using Entropy for Histogram Equalization-based Contrast Enhancement Techniques," Engineering, Technology & Applied Science Research, vol. 7, no. 6, pp. 2277–2281, Dec. 2017.
S. Rani, Y. Chabrra, and K. Malik, "An Improved Denoising Algorithm for Removing Noise in Color Images," Engineering, Technology & Applied Science Research, vol. 12, no. 3, pp. 8738–8744, Jun. 2022.
M. K. Moghimi and F. Mohanna, "Real-time underwater image enhancement: a systematic review," Journal of Real-Time Image Processing, vol. 18, no. 5, pp. 1509–1525, Oct. 2021.
J. Zhou et al., "UGIF-Net: An Efficient Fully Guided Information Flow Network for Underwater Image Enhancement," IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1–17, 2023.
M. Yang, K. Hu, Y. Du, Z. Wei, Z. Sheng, and J. Hu, "Underwater image enhancement based on conditional generative adversarial network," Signal Processing: Image Communication, vol. 81, Feb. 2020, Art. no. 115723.
L. Bai, W. Zhang, X. Pan, and C. Zhao, "Underwater Image Enhancement Based on Global and Local Equalization of Histogram and Dual-Image Multi-Scale Fusion," IEEE Access, vol. 8, pp. 128973–128990, 2020.
X. Chen, P. Zhang, L. Quan, C. Yi, and C. Lu, "Underwater Image Enhancement based on Deep Learning and Image Formation Model." arXiv, Jan. 07, 2021.
D. Zhang et al., "Robust underwater image enhancement with cascaded multi-level sub-networks and triple attention mechanism," Neural Networks, vol. 169, pp. 685–697, Jan. 2024.
C. W. Park and I. K. Eom, "Underwater image enhancement using adaptive standardization and normalization networks," Engineering Applications of Artificial Intelligence, vol. 127, Jan. 2024, Art. no. 107445.
J. Wen et al., "WaterFormer: A Global–Local Transformer for Underwater Image Enhancement With Environment Adaptor," IEEE Robotics & Automation Magazine, vol. 31, no. 1, pp. 29–40, Mar. 2024.
X. Liu, Z. Gu, H. Ding, M. Zhang, and L. Wang, "Underwater Image Super-Resolution Using Frequency-Domain Enhanced Attention Network," IEEE Access, vol. 12, pp. 6136–6147, 2024.
B. Sun, Y. Mei, N. Yan, and Y. Chen, "UMGAN: Underwater Image Enhancement Network for Unpaired Image-to-Image Translation," Journal of Marine Science and Engineering, vol. 11, no. 2, Feb. 2023, Art. no. 447.
C. Li, S. Anwar, J. Hou, R. Cong, C. Guo, and W. Ren, "Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding," IEEE Transactions on Image Processing, vol. 30, pp. 4985–5000, 2021.
P. Zhuang, C. Li, and J. Wu, "Bayesian retinex underwater image enhancement," Engineering Applications of Artificial Intelligence, vol. 101, May 2021, Art. no. 104171.
W. Zhang, P. Zhuang, H. H. Sun, G. Li, S. Kwong, and C. Li, "Underwater Image Enhancement via Minimal Color Loss and Locally Adaptive Contrast Enhancement," IEEE Transactions on Image Processing, vol. 31, pp. 3997–4010, 2022.
C. Li, J. Guo, C. Guo, R. Cong, and J. Gong, "A hybrid method for underwater image correction," Pattern Recognition Letters, vol. 94, pp. 62–67, Jul. 2017.
Y. T. Peng and P. C. Cosman, "Underwater Image Restoration Based on Image Blurriness and Light Absorption," IEEE Transactions on Image Processing, vol. 26, no. 4, pp. 1579–1594, Apr. 2017.
Y. T. Peng, K. Cao, and P. C. Cosman, "Generalization of the Dark Channel Prior for Single Image Restoration," IEEE Transactions on Image Processing, vol. 27, no. 6, pp. 2856–2868, Jun. 2018.
Y. Wang, H. Liu, and L.-P. Chau, "Single Underwater Image Restoration Using Adaptive Attenuation-Curve Prior," IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 65, no. 3, pp. 992–1002, Mar. 2018.
M. Yang, A. Sowmya, Z. Wei, and B. Zheng, "Offshore Underwater Image Restoration Using Reflection-Decomposition-Based Transmission Map Estimation," IEEE Journal of Oceanic Engineering, vol. 45, no. 2, pp. 521–533, Apr. 2020.
D. Berman, D. Levy, S. Avidan, and T. Treibitz, "Underwater Single Image Color Restoration Using Haze-Lines and a New Quantitative Dataset," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 8, pp. 2822–2837, Dec. 2021.
Y. Zhou, Q. Wu, K. Yan, L. Feng, and W. Xiang, "Underwater Image Restoration Using Color-Line Model," IEEE Transactions on Circuits and Systems for Video Technology, vol. 29, no. 3, pp. 907–911, Mar. 2019.
D. Akkaynak and T. Treibitz, "Sea-Thru: A Method for Removing Water From Underwater Images," in 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, Jun. 2019, pp. 1682–1691.
K. Iqbal, M. Odetayo, A. James, Rosalina Abdul Salam, and Abdullah Zawawi Hj Talib, "Enhancing the low quality images using Unsupervised Colour Correction Method," in 2010 IEEE International Conference on Systems, Man and Cybernetics, Istanbul, Turkey, Oct. 2010, pp. 1703–1709.
C. Li et al., "An Underwater Image Enhancement Benchmark Dataset and Beyond," IEEE Transactions on Image Processing, vol. 29, pp. 4376–4389, 2020.
K. B. Bhangale and M. Kothandaraman, "Survey of Deep Learning Paradigms for Speech Processing," Wireless Personal Communications, vol. 125, no. 2, pp. 1913–1949, Jul. 2022.
K. Bhangale and M. Kothandaraman, "Speech Emotion Recognition Based on Multiple Acoustic Features and Deep Convolutional Neural Network," Electronics, vol. 12, no. 4, Jan. 2023, Art. no. 839.
Downloads
How to Cite
License
Copyright (c) 2024 Shubhangi Adagale-Vairagar, Praveen Gupta, R. P. Sharma
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
