Image Registration using Median Absolute Deviation –based Adaptive RANSAC
Received: 3 January 2025 | Revised: 2 February 2025 and 15 February 2025 | Accepted: 21 February 2025 | Online: 4 June 2025
Corresponding author: Khalid Akdim
Abstract
Image registration encompasses topics such as change detection and remote sensing. Feature-based registration is one of the main approaches and relies on feature extraction and matching. The Oriented FAST and Rotated BRIEF (ORB) algorithm is one of the most robust methods used in feature registration. Random sample consensus (RANSAC) is an optimization method for reducing mismatches in ORB algorithm. However, RANSAC-based methods have certain deficiencies, including rapid increase in computational time, higher false positive ratio, and the need for an empirically determined fixed threshold value. The aforementioned shortcomings result in a reduction in the accuracy of the transform model parameters. In this paper, a modified RANSAC algorithm is proposed, incorporating a Median Absolute Deviation (MAD)-based adaptive threshold, to enhance the efficacy of the method. The threshold value is determined by the MAD of the distances between each point and its model-transformed counterpart. This method enhances the RANSAC algorithm, by taking into consideration the early best matches of each iteration, increasing the number of inliers, and looping through an iterative process based on least squares estimation. The simulation results show that the proposed method is robust to distortion and noise. The results demonstrate that the proposed approach outperforms standard ORB in terms of Mean Squared Error (MSE), Normalized Mutual Information (NMI), Structural Similarity Index Method (SSIM), and Peak Signal-to-Noise Ratio (PSNR).
Keywords:
image registration, Oriented FAST and Rotated BRIEF, random sample consensus, MAD, MSE, PSNR, NMIDownloads
References
L. G. Brown, "A survey of image registration techniques," ACM Computing Surveys, vol. 24, no. 4, pp. 325–376, Sep. 1992.
R. Vadhi, V. S. Kilari, and S. S. Kumar, "An Image Fusion Technique Based on Hadamard Transform and HVS," Engineering, Technology & Applied Science Research, vol. 6, no. 4, pp. 1075–1079, Aug. 2016.
C.-L. Tsai, C.-Y. Li, G. Yang, and K.-S. Lin, "The Edge-Driven Dual-Bootstrap Iterative Closest Point Algorithm for Registration of Multimodal Fluorescein Angiogram Sequence," IEEE Transactions on Medical Imaging, vol. 29, no. 3, pp. 636–649, Mar. 2010.
S. Singh et al., "A review of image fusion: Methods, applications and performance metrics," Digital Signal Processing, vol. 137, Jun. 2023, Art. no. 104020.
J. Kim and J. A. Fessler, "Intensity-based image registration using robust correlation coefficients," IEEE Transactions on Medical Imaging, vol. 23, no. 11, pp. 1430–1444, Aug. 2004.
A. Goshtasby, G. C. Stockman, and C. V. Page, "A Region-Based Approach to Digital Image Registration with Subpixel Accuracy," IEEE Transactions on Geoscience and Remote Sensing, vol. GE-24, no. 3, pp. 390–399, Feb. 1986.
J. Zheng, J. Tian, K. Deng, X. Dai, X. Zhang, and M. Xu, "Salient Feature Region: A New Method for Retinal Image Registration," IEEE Transactions on Information Technology in Biomedicine, vol. 15, no. 2, pp. 221–232, Mar. 2011.
S.-Y. Guan, T.-M. Wang, C. Meng, and J.-C. Wang, "A Review of Point Feature Based Medical Image Registration," Chinese Journal of Mechanical Engineering, vol. 31, no. 1, Aug. 2018, Art. no. 76.
H. Chen, "Mutual Information: A Similarity Measure for Intensity Based Image Registration," in Advanced Image Processing Techniques for Remotely Sensed Hyperspectral Data, P. K. Varshney and M. K. Arora, Eds. New York, NY, USA: Springer, 2004, pp. 89–108.
M. Debella-Gilo and A. Kaab, "Sub-pixel precision image matching for measuring surface displacements on mass movements using normalized cross-correlation," Remote Sensing of Environment, vol. 115, no. 1, pp. 130–142, Jan. 2011.
G. Sreeja and O. Saraniya, "A Comparative Study on Image Registration Techniques for SAR Images," in 5th International Conference on Advanced Computing & Communication Systems, Coimbatore, India, Mar. 2019, pp. 947–953.
D. Zhang, H. Wei, X. Huang, and H. Ni, "Research on high precision image registration method based on line segment feature and ICP algorithm," in International Conference on Optics and Machine Vision, Changsha, China, Jan. 2023, vol. 12634, pp. 90–96.
S. Dawn, V. Saxena, and B. Sharma, "Remote Sensing Image Registration Techniques: A Survey," in International Conference on Image and Signal Processing, Trois-Rivieres, QC, Canada, Jul. 2010, pp. 103–112.
B. Zitova and J. Flusser, "Image registration methods: a survey," Image and Vision Computing, vol. 21, no. 11, pp. 977–1000, Oct. 2003.
E. Rublee, V. Rabaud, K. Konolige, and G. Bradski, "ORB: An efficient alternative to SIFT or SURF," in International Conference on Computer Vision, Barcelona, Spain, Nov. 2011, pp. 2564–2571.
Y. Dai and J. Wu, "An Improved ORB Feature Extraction Algorithm Based on Enhanced Image and Truncated Adaptive Threshold," IEEE Access, vol. 11, pp. 32073–32081, Jan. 2023.
Z. He, C. Shen, Q. Wang, X. Zhao, and H. Jiang, "Mismatching Removal for Feature-Point Matching Based on Triangular Topology Probability Sampling Consensus," Remote Sensing, vol. 14, no. 3, Jan. 2022, Art. no. 706.
J. Ma, J. Zhao, J. Tian, X. Bai, and Z. Tu, "Regularized vector field learning with sparse approximation for mismatch removal," Pattern Recognition, vol. 46, no. 12, pp. 3519–3532, Dec. 2013.
G. Wang, Z. Wang, Y. Chen, Q. Zhou, and W. Zhao, "Removing mismatches for retinal image registration via multi-attribute-driven regularized mixture model," Information Sciences, vol. 372, pp. 492–504, Dec. 2016.
W. Aguilar, Y. Frauel, F. Escolano, M. E. Martinez-Perez, A. Espinosa-Romero, and M. A. Lozano, "A robust Graph Transformation Matching for non-rigid registration," Image and Vision Computing, vol. 27, no. 7, pp. 897–910, Jun. 2009.
M. A. Fischler and R. C. Bolles, "Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography," Communications of the ACM, vol. 24, no. 6, pp. 381–395, Mar. 1981.
B. Salehi, S. Jarahizadeh, and A. Sarafraz, "An Improved RANSAC Outlier Rejection Method for UAV-Derived Point Cloud," Remote Sensing, vol. 14, no. 19, Jan. 2022, Art. no. 4917.
B. Li and H. Ye, "RSCJ: Robust Sample Consensus Judging Algorithm for Remote Sensing Image Registration," IEEE Geoscience and Remote Sensing Letters, vol. 9, no. 4, pp. 574–578, Jul. 2012.
Y. Wu, W. Ma, M. Gong, L. Su, and L. Jiao, "A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration," IEEE Geoscience and Remote Sensing Letters, vol. 12, no. 1, pp. 43–47, Jan. 2015.
P. H. S. Torr and A. Zisserman, "MLESAC: A New Robust Estimator with Application to Estimating Image Geometry," Computer Vision and Image Understanding, vol. 78, no. 1, pp. 138–156, Apr. 2000.
O. Chum and J. Matas, "Matching with PROSAC - progressive sample consensus," in Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA, Jun. 2005, vol. 1, pp. 220–226.
Y. Ye and J. Shan, "A local descriptor based registration method for multispectral remote sensing images with non-linear intensity differences," ISPRS Journal of Photogrammetry and Remote Sensing, vol. 90, pp. 83–95, Apr. 2014.
F. Guo, X. Zhao, B. Zou, and Y. Liang, "Automatic Retinal Image Registration Using Blood Vessel Segmentation and SIFT Feature," International Journal of Pattern Recognition and Artificial Intelligence, vol. 31, no. 11, Nov. 2017, Art. no. 1757006.
E. Rosten and T. Drummond, "Machine Learning for High-Speed Corner Detection," in European Conference on Computer Vision, Graz, Austria, Dec. 2006, pp. 430–443.
M. Calonder, V. Lepetit, C. Strecha, and P. Fua, "BRIEF: Binary Robust Independent Elementary Features," in European Conference on Computer Vision, Heraklion, Greece, Sep. 2010, pp. 778–792.
H. Yan, G. Lv, X. Ren, and X. Dong, "Improved Nearest Neighbor Distance Ratio for Matching Local Image Descriptors," in International CCF Conference on Artificial Intelligence, Jinan, China, Aug. 2018, pp. 185–197.
D. G. Lowe, "Object recognition from local scale-invariant features," in Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece, Sep. 1999, vol. 2, pp. 1150–1157 vol.2.
C. Croux and P. J. Rousseeuw, "Time-Efficient Algorithms for Two Highly Robust Estimators of Scale," in Computational Statistics, Y. Dodge and J. Whittaker, Eds. Heidelberg, Germany: Physica-Verlag, 1992, pp. 411–428.
P. J. Rousseeuw and M. Hubert, "Anomaly detection by robust statistics," WIREs Data Mining and Knowledge Discovery, vol. 8, no. 2, 2018, Art. no. e1236.
"Enc_Dec_Times." https://kaggle.com/code/kenny3s/enc-dec-times.
"Brain MRI Images for Brain Tumor Detection." https://www.kaggle.com/datasets/navoneel/brain-mri-images-for-brain-tumor-detection.
"ISPRS Data sets: Zurich Hoengg." https://www.isprs.org/resources/
datasets/sample-datasets/hoengg/cutouts.aspx.
J. Sogaard et al., "Applicability of Existing Objective Metrics of Perceptual Quality for Adaptive Video Streaming," Electronic Imaging, vol. 28, pp. 1–7, Feb. 2016.
S. Rani, Y. Chabrra, and K. Malik, "An Improved Denoising Algorithm for Removing Noise in Color Images," Engineering, Technology & Applied Science Research, vol. 12, no. 3, pp. 8738–8744, Jun. 2022.
C. Studholme, D. L. G. Hill, and D. J. Hawkes, "An overlap invariant entropy measure of 3D medical image alignment," Pattern Recognition, vol. 32, no. 1, pp. 71–86, Jan. 1999.
U. Sara, M. Akter, and M. S. Uddin, "Image Quality Assessment through FSIM, SSIM, MSE and PSNR—A Comparative Study," Journal of Computer and Communications, vol. 7, no. 3, pp. 8–18, Mar. 2019.
M. A. Al-Khasawneh and M. Mahmoud, "Safeguarding Identities with GAN-based Face Anonymization," Engineering, Technology & Applied Science Research, vol. 14, no. 4, pp. 15581–15589, Aug. 2024.
Z. Hossein-Nejad and M. Nasri, "An adaptive image registration method based on SIFT features and RANSAC transform," Computers & Electrical Engineering, vol. 62, pp. 524–537, Aug. 2017.
Downloads
How to Cite
License
Copyright (c) 2025 Khalid Akdim, Hassan Roukhe, Ahmed Roukhe
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
