MTU-Net: Multi-Task Convolutional Neural Network for Breast Calcification Segmentation from Mammograms
Received: 16 July 2024 | Revised: 28 July 2024 and 31 July 2024 | Accepted: 4 August 2024 | Online: 12 August 2024
Corresponding author: Manal Alghamdi
Abstract
Computer-Aided Detection (CAD) is a technology that helps radiologists identify malignant microcalcifications (MCs) on mammograms. By minimizing observational oversight, CAD enhances the radiologist's detection accuracy. However, the high incidence of false positives limits the reliance on these technologies. Breast Arterial Calcifications (BAC) are a common source of false positives. Effective identification and elimination of these false positives are crucial for improving CAD performance in detecting malignant MCs. This paper presents a model that can eliminate BACs from positive findings, thereby enhancing the accuracy of CAD. Inspired by the successful outcomes of the UNet model in various biomedical segmentation tasks, a multitask U-Net (MTU-Net) was developed to simultaneously segment different types of calcifications, including MCs and BACs, in mammograms. This was achieved by integrating multiple fully connected output nodes in the output layer and applying different objective functions for each calcification type instead of training different models or using one model with a shared objective function for different classes. The experimental results demonstrate that the proposed MTU-Net model can reduce training and inference times compared to separate multi-structure segmentation problems. In addition, this helps the model converge faster and delivers better segmentation results for specific samples.
Keywords:
U-Net, mammogram, breast calcification, deep learning, image segmentationDownloads
References
Q. M. Bui and L. B. Daniels, "A Review of the Role of Breast Arterial Calcification for Cardiovascular Risk Stratification in Women," Circulation, vol. 139, no. 8, pp. 1094–1101, Feb. 2019.
M. AlGhamdi, M. Abdel-Mottaleb, and F. Collado-Mesa, "DU-Net: Convolutional Network for the Detection of Arterial Calcifications in Mammograms," IEEE Transactions on Medical Imaging, vol. 39, no. 10, pp. 3240–3249, Oct. 2020.
J. Ge et al., "Automated detection of breast vascular calcification on full-field digital mammograms," in Medical Imaging 2008: Computer-Aided Diagnosis, San Diego, CA, USA, Feb. 2008, vol. 6915, pp. 379–385.
J.-Z. Cheng, E. B. Cole, E. D. Pisano, and D. Shen, "Detection of Arterial Calcification in Mammograms by Random Walks," in International Conference on Information Processing in Medical Imaging, Williamsburg, VA, USA, Jul. 2009, pp. 713–724.
J.-Z. Cheng, C.-M. Chen, E. B. Cole, E. D. Pisano, and D. Shen, "Automated Delineation of Calcified Vessels in Mammography by Tracking With Uncertainty and Graphical Linking Techniques," IEEE Transactions on Medical Imaging, vol. 31, no. 11, pp. 2143–2155, Nov. 2012.
J.-Z. Cheng, C.-M. Chen, and D. Shen, "Identification of breast vascular calcium deposition in digital mammography by linear structure analysis," in 9th IEEE International Symposium on Biomedical Imaging, Barcelona, Spain, Dec. 2012, pp. 126–129.
J.-J. Mordang, A. Gubern-Mérida, G. den Heeten, and N. Karssemeijer, "Reducing false positives of microcalcification detection systems by removal of breast arterial calcifications," Medical Physics, vol. 43, no. 4, pp. 1676–1687, 2016.
J. Wang et al., "Detecting Cardiovascular Disease from Mammograms With Deep Learning," IEEE Transactions on Medical Imaging, vol. 36, no. 5, pp. 1172–1181, May 2017.
S. M. Shaaban, M. Nawaz, Y. Said, and M. Barr, "An Efficient Breast Cancer Segmentation System based on Deep Learning Techniques," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12415–12422, Dec. 2023.
X. Guo et al., "SCU-Net: A deep learning method for segmentation and quantification of breast arterial calcifications on mammograms," Medical Physics, vol. 48, no. 10, pp. 5851–5861, 2021.
A. Baccouche, B. Garcia-Zapirain, C. Castillo Olea, and A. S. Elmaghraby, "Connected-UNets: a deep learning architecture for breast mass segmentation," npj Breast Cancer, vol. 7, no. 1, Dec. 2021, Art. no. 151.
I. Ben Ahmed, W. Ouarda, and C. Ben Amar, "Hybrid UNET Model Segmentation for an Early Breast Cancer Detection Using Ultrasound Images," in International Conference on Computational Collective Intelligence, Hammamet, Tunisia, Sep. 2022, pp. 464–476.
B. Yu and I. Lane, "Multi-task deep learning for image understanding," in 6th International Conference of Soft Computing and Pattern Recognition, Tunis, Tunisia, Aug. 2014, pp. 37–42.
X. Li et al., "DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection," IEEE Transactions on Image Processing, vol. 25, no. 8, pp. 3919–3930, Aug. 2016.
J. Long, E. Shelhamer, and T. Darrell, "Fully Convolutional Networks for Semantic Segmentation," in IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, Jun. 2015, pp. 3431–3440.
O. Ronneberger, P. Fischer, and T. Brox, "U-Net: Convolutional Networks for Biomedical Image Segmentation," in International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany, Oct. 2015, pp. 234–241.
M. Drozdzal, E. Vorontsov, G. Chartrand, S. Kadoury, and C. Pal, "The Importance of Skip Connections in Biomedical Image Segmentation." arXiv, Sep. 22, 2016.
R. M. Trimboli, M. Codari, M. Guazzi, and F. Sardanelli, "Screening mammography beyond breast cancer: breast arterial calcifications as a sex-specific biomarker of cardiovascular risk," European Journal of Radiology, vol. 119, Oct. 2019, Art. no. 108636.
D. Kopans, R. Moore, K. Bowyer, P. Kegelmeyer, and P. E. Shile, "DDSM: Digital Database for Screening Mammography." [Online]. Available: http://www.eng.usf.edu/cvprg/mammography/database.html.
R. S. Lee, F. Gimenez, A. Hoogi, K. K. Miyake, M. Gorovoy, and D. L. Rubin, "A curated mammography data set for use in computer-aided detection and diagnosis research," Scientific Data, vol. 4, Dec. 2017, Art. no. 170177.
"Keras: Deep Learning for humans." https://keras.io/.
Downloads
How to Cite
License
Copyright (c) 2024 Manal Alghamdi
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.