A Multi-Head Self-Attention Mechanism for Improved Brain Tumor Classification using Deep Learning Approaches
Received: 24 July 2024 | Revised: 17 August 2024 | Accepted: 29 August 2024 | Online: 11 September 2024
Corresponding author: Prasadu Reddi
Abstract
One of the most common life-threatening diseases, the brain tumor is a condition characterized by the rapid proliferation of abnormal cells that leads to the destruction of healthy brain cells. Its aggressive nature can result in a patient succumbing to the disease before an accurate diagnosis is achieved. Timely detection is crucial to effective treatment and patient survival. Similarly, early detection plays a pivotal role in the case of brain tumors, where swift identification is vital to providing optimal care and increasing the chances of patient recovery. Streamlining the complex process of brain tumor detection is a significant undertaking that aims to simplify and expedite the procedure, ultimately contributing to saving valuable time and enhancing patient outcomes. The proposed model, a modified VGG-16, facilitates faster and more accurate identification of abnormal brain cells, leading to early detection of brain tumors. A novel multihead self-attention mechanism is used in the modified VGG-16 architecture to improve tumor detection performance. The proposed model performs better than other state-of-the-art models, such as normal VGG-16, ResNet-50, and EfficientNet.
Keywords:
ResNet-50, EfficientNet, VGG-16, modified VGG-16, multi-head self attention mechanismDownloads
References
M. Sajjad, S. Khan, K. Muhammad, W. Wu, A. Ullah, and S. W. Baik, "Multi-grade brain tumor classification using deep CNN with extensive data augmentation," Journal of Computational Science, vol. 30, pp. 174–182, Jan. 2019.
Z. U. Rehman, M. S. Zia, G. R. Bojja, M. Yaqub, F. Jinchao, and K. Arshid, "Texture based localization of a brain tumor from MR-images by using a machine learning approach," Medical Hypotheses, vol. 141, Aug. 2020, Art. no. 109705.
F. Özyurt, E. Sert, E. Avci, and E. Dogantekin, "Brain tumor detection based on Convolutional Neural Network with neutrosophic expert maximum fuzzy sure entropy," Measurement, vol. 147, Dec. 2019, Art. no. 106830.
C. Mantia and J. I. Zwicker, "Anticoagulation in the Setting of Primary and Metastatic Brain Tumors," in Thrombosis and Hemostasis in Cancer, G. Soff, Ed. Cham, Switzerland: Springer International Publishing, 2019, pp. 179–189.
S. S. Veer Handore, A. Deshpande, and P. M. Patil, "An Efficient Algorithm for Segmentation and Classification of Brain Tumor," in 2018 International Conference On Advances in Communication and Computing Technology (ICACCT), Sangamner, India, Feb. 2018, pp. 83–88.
N. Singh and S. Goyal, "Determination and Segmentation of Brain Tumor Using Threshold Segmentation with Morphological Operations," in Soft Computing: Theories and Applications, Singapore, 2018, pp. 715–726.
M. Mudda, R. Manjunath, and N. Krishnamurthy, "Brain Tumor Classification Using Enhanced Statistical Texture Features," IETE Journal of Research, vol. 68, no. 5, pp. 3695–3706, Sep. 2022.
K. Usman and K. Rajpoot, "Brain tumor classification from multi-modality MRI using wavelets and machine learning," Pattern Analysis and Applications, vol. 20, no. 3, pp. 871–881, Aug. 2017.
J. Amin, M. Sharif, N. Gul, M. Yasmin, and S. A. Shad, "Brain tumor classification based on DWT fusion of MRI sequences using convolutional neural network," Pattern Recognition Letters, vol. 129, pp. 115–122, Jan. 2020.
A. R. Raju, P. Suresh, and R. R. Rao, "Bayesian HCS-based multi-SVNN: A classification approach for brain tumor segmentation and classification using Bayesian fuzzy clustering," Biocybernetics and Biomedical Engineering, vol. 38, no. 3, pp. 646–660, Jan. 2018.
S. Banerjee and G. K. Singh, "Quality Aware Compression of Multilead Electrocardiogram Signal using 2-mode Tucker Decomposition and Steganography," Biomedical Signal Processing and Control, vol. 64, Feb. 2021, Art. no. 102230.
S. Banerjee and G. K. Singh, "A new approach of ECG steganography and prediction using deep learning," Biomedical Signal Processing and Control, vol. 64, Feb. 2021, Art. no. 102151.
S. Banerjee and G. K. Singh, "Deep neural network based missing data prediction of electrocardiogram signal using multiagent reinforcement learning," Biomedical Signal Processing and Control, vol. 67, May 2021, Art. no. 102508.
M. Havaei et al., "Brain tumor segmentation with Deep Neural Networks," Medical Image Analysis, vol. 35, pp. 18–31, Jan. 2017.
K. Popuri, D. Cobzas, A. Murtha, and M. Jägersand, "3D variational brain tumor segmentation using Dirichlet priors on a clustered feature set," International Journal of Computer Assisted Radiology and Surgery, vol. 7, no. 4, pp. 493–506, Jul. 2012.
D. S. Krishna, G. Srinivas, and P. V. G. D. Prasad Reddy, "Disaster tweet classification: A majority voting approach using machine learning algorithms," Intelligent Decision Technologies, vol. 17, no. 2, pp. 343–355, Jan. 2023.
D. S. Krishna, G. Srinivas, and P. V. G. D. Prasad Reddy, "A Deep Parallel Hybrid Fusion Model for disaster tweet classification on Twitter data," Decision Analytics Journal, vol. 11, Jun. 2024, Art. no. 100453.
S. K. Dasari, G. Srinivas, and P. V. G. D. Prasad Reddy, "A Comprehensive Study on Disaster Tweet Classification on Social Media Information," in Soft Computing and Signal Processing, Singapore, 2024, pp. 507–516.
S. K. Dasari, L. Sravani, M. U. Kumar, and N. Rama Venkata Sai, "Image Enhancement of Underwater Images Using Deep Learning Techniques," in Proceedings of International Conference on Data Analytics and Insights, ICDAI 2023, Kolkata, India, May 2023, pp. 715–730.
S. K. Dasari, S. K. Kella, and R. Manda, "Enhancing Environmental Sounds Classification through Deep Learning Techniques," in 2023 International Conference on Sustainable Computing and Data Communication Systems (ICSCDS), Erode, India, Mar. 2023, pp. 265–270.
D. S. Krishna, G. Srinivas, and P. V. G. D. P. Reddy, "Novel private cloud architecture: A three tier approach to deploy private cloud using virtual machine manager," Intelligent Decision Technologies, vol. 17, no. 2, pp. 275–285, Jan. 2023.
V. A. Rajendran and S. Shanmugam, "Automated Skin Cancer Detection and Classification using Cat Swarm Optimization with a Deep Learning Model," Engineering, Technology & Applied Science Research, vol. 14, no. 1, pp. 12734–12739, Feb. 2024.
B. H. Bhavani and N. C. Naveen, "An Approach to Determine and Categorize Mental Health Condition using Machine Learning and Deep Learning Models," Engineering, Technology & Applied Science Research, vol. 14, no. 2, pp. 13780–13786, Apr. 2024.
A. Naz, H. Khan, I. U. Din, A. Ali, and M. Husain, "An Efficient Optimization System for Early Breast Cancer Diagnosis based on Internet of Medical Things and Deep Learning," Engineering, Technology & Applied Science Research, vol. 14, no. 4, pp. 15957–15962, Aug. 2024.
S. T. Vemula, M. Sreevani, P. Rajarajeswari, K. Bhargavi, J. M. R. S. Tavares, and S. Alankritha, "Deep Learning Techniques for Lung Cancer Recognition," Engineering, Technology & Applied Science Research, vol. 14, no. 4, pp. 14916–14922, Aug. 2024.
S. Nuanmeesri, "Utilization of Multi-Channel Hybrid Deep Neural Networks for Avocado Ripeness Classification," Engineering, Technology & Applied Science Research, vol. 14, no. 4, pp. 14862–14867, Aug. 2024.
Downloads
How to Cite
License
Copyright (c) 2024 Prasadu Reddi, Gorla Srinivas, P. V. G. D. Prasad Reddy, Dasari Siva Krihsna
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
