NeuroFusion for Robust and Explainable Multimodal Deep Learning in Fine-Grained Staging of Alzheimer's Disease Across Imaging and Clinical Biomarkers
Received: 20 August 2025 | Revised: 4 October 2025 and 17 October 2025 | Accepted: 19 October 2025 | Online: 9 February 2026
Corresponding author: Sumendra Yogarayan
Abstract
The subtle transition from healthy cognition to very mild dementia often leaves even experienced clinicians uncertain, highlighting the need for computational frameworks that integrate heterogeneous data sources while providing clinically meaningful explanations. Existing Artificial Intelligence (AI) approaches frequently reduce Alzheimer's Disease (AD) prediction to binary classification, rely on a single modality, or lack interpretability, thereby limiting their translational impact. This study introduces a multimodal Deep Learning (DL) framework designed for fine-grained, four-stage staging of AD across Non-Demented, Very Mild, Mild, and Moderate states. The framework integrates structural Magnetic Resonance Imaging (MRI) and structured clinical biomarkers within a unified architecture, employing pre-trained convolutional and transformer-based networks for imaging alongside gradient-boosted decision trees for tabular features such as demographics, cognitive scores, and laboratory measures. To promote transparency and clinical trust, the framework incorporates complementary interpretability strategies: Gradient-weighted Class Activation Mapping (Grad-CAM) to identify discriminative neuroanatomical regions and attention mechanisms to highlight influential clinical variables. Evaluation was conducted on the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort, with diagnostic labels determined at the subject level using clinician consensus informed by Clinical Dementia Rating (CDR) and Mini-Mental State Examination (MMSE) scores. The dataset comprised 229 Non-Demented, 398 Very Mild, 192 Mild, and 176 Moderate cases. GhostNet achieved an F1-score of 0.888 for Non-Demented and 0.847 for Mild Dementia, whereas Very Mild remained the most challenging stage (best F1-score ≤ 0.628). On structured clinical features, Extreme Gradient Boosting (XGBoost) attained an accuracy of 95.35%. Despite reduced performance for intermediate stages due to class imbalance and overlapping phenotypes, model training remained stable with minimal overfitting. This work provides one of the first interpretable multimodal frameworks for four-stage AD staging, advancing beyond conventional binary models and demonstrating the value of integrating complementary imaging and clinical modalities. By combining robust diagnostic accuracy with transparent, clinician-facing explanations, the approach offers a scalable and trustworthy pathway toward AI-enabled dementia staging, with particular promise for deployment in resource-limited healthcare systems.
Keywords:
Alzheimer's Disease (AD) staging, multimodal Deep Learning (DL), structural MRI, clinical biomarkers, interpretable artificial intelligence, Convolutional Neural Networks (CNNs), transformer architecturesDownloads
References
J.-H. Shin, "Dementia Epidemiology Fact Sheet 2022," Annals of Rehabilitation Medicine, vol. 46, no. 2, pp. 53–59, Apr. 2022. DOI: https://doi.org/10.5535/arm.22027
E. Nichols and T. Vos, "The estimation of the global prevalence of dementia from 1990-2019 and forecasted prevalence through 2050: An analysis for the Global Burden of Disease (GBD) study 2019," Alzheimer's & Dementia, vol. 17, no. S10, Dec. 2021, Art. no. e051496. DOI: https://doi.org/10.1002/alz.051496
"World Alzheimer Report 2022: Life after diagnosis: Navigating treatment, care and support." Alzheimer's Disease International. https://www.alzint.org/resource/world-alzheimer-report-2022/.
"ADI - Dementia statistics." Alzheimer's Disease International. https://www.alzint.org/about/dementia-facts-figures/dementia-statistics/.
Alzheimer's Association, "2024 Alzheimer's disease facts and figures," Alzheimer's & Dementia, vol. 20, no. 5, pp. 3708–3821, May 2024. DOI: https://doi.org/10.1002/alz.13809
G. Shukla, V. Awasthi, D. Theng, R. Gupta, S. Nipane, and S. Singh, "Hybrid 3D CNN and ResNet Deep Transfer Learning for High-Resolution Hippocampal Atrophy Mapping and Automated Alzheimer's MRI Diagnosis: Deep Hybrid 3D CNN and ResNet Transfer Learning for High-Resolution Hippocampal Atrophy Mapping and Automated Alzheimer's MRI Diagnosis," Engineering, Technology & Applied Science Research, vol. 15, no. 4, pp. 26047–26053, Aug. 2025. DOI: https://doi.org/10.48084/etasr.11372
J. Zhou et al., “A deep learning model for early diagnosis of alzheimer’s disease combined with 3D CNN and video Swin transformer,” Scientific Reports, vol. 15, no. 1, July 2025, Art. no. 23311. DOI: https://doi.org/10.1038/s41598-025-05568-y
G. Castellano, A. Esposito, E. Lella, G. Montanaro, and G. Vessio, "Automated detection of Alzheimer's disease: a multi-modal approach with 3D MRI and amyloid PET," Scientific Reports, vol. 14, no. 1, Mar. 2024, Art. no. 5210. DOI: https://doi.org/10.1038/s41598-024-56001-9
X. Zhang, L. Han, W. Zhu, L. Sun, and D. Zhang, "An Explainable 3D Residual Self-Attention Deep Neural Network for Joint Atrophy Localization and Alzheimer's Disease Diagnosis Using Structural MRI," IEEE Journal of Biomedical and Health Informatics, vol. 26, no. 11, pp. 5289–5297, Nov. 2022. DOI: https://doi.org/10.1109/JBHI.2021.3066832
V. Mubonanyikuzo, H. Yan, T. E. Komolafe, L. Zhou, T. Wu, and N. Wang, "Detection of Alzheimer Disease in Neuroimages Using Vision Transformers: Systematic Review and Meta-Analysis," Journal of Medical Internet Research, vol. 27, no. 1, Feb. 2025, Art. no. e62647. DOI: https://doi.org/10.2196/62647
Y. Li, M. Ghahremani, Y. Wally, and C. Wachinger, "DiaMond: Dementia Diagnosis with Multi-Modal Vision Transformers Using MRI and PET," in 2025 IEEE/CVF Winter Conference on Applications of Computer Vision, Tucson, AZ, USA, 2025, pp. 107–116. DOI: https://doi.org/10.1109/WACV61041.2025.00021
Q. A. Duong, S. D. Tran, and J. K. Gahm, "Multimodal surface-based transformer model for early diagnosis of Alzheimer's disease," Scientific Reports, vol. 15, no. 1, Feb. 2025, Art. no. 5787. DOI: https://doi.org/10.1038/s41598-025-90115-y
M. E. Vlontzou, M. Athanasiou, K. V. Dalakleidi, I. Skampardoni, C. Davatzikos, and K. Nikita, "A comprehensive interpretable machine learning framework for mild cognitive impairment and Alzheimer's disease diagnosis," Scientific Reports, vol. 15, no. 1, Mar. 2025, Art. no. 8410. DOI: https://doi.org/10.1038/s41598-025-92577-6
N. J. Dhinagar, S. I. Thomopoulos, and P. M. Thompson, "Generative AI improves MRI-based Detection of Alzheimer's Disease by using Latent Diffusion Models and Convolutional Neural Networks," Alzheimer's & Dementia, vol. 20, no. S2, Dec. 2024, Art. no. e089958. DOI: https://doi.org/10.1002/alz.089958
B. K. Raghupathy, M. R. Reddy, P. Theeda, E. Balasubramanian, R. K. Namachivayam, and M. Ganesan, "Harnessing Explainable Artificial Intelligence (XAI) based SHAPLEY Values and Ensemble Techniques for Accurate Alzheimer's Disease Diagnosis," Engineering, Technology & Applied Science Research, vol. 15, no. 2, pp. 20743–20747, Apr. 2025. DOI: https://doi.org/10.48084/etasr.9619
"Alzheimer's Disease Neuroimaging Initiative." ADNI. https://adni-lde.loni.usc.edu/.
"Open Access Series of Imaging Studies (OASIS)." Oasisbrains. https://sites.wustl.edu/oasisbrains/.
Downloads
How to Cite
License
Copyright (c) 2026 Garima Shukla, Vanshaj Awasthi, Prashant Dubey, Sakshi Nipane, Sampurna Roy, Rajiv Iyer, Sumendra Yogarayan

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
