A Hybrid Fuzzy CNN–LSTM Approach for Emotion Recognition from EEG–ECG Physiological Signals
Received: 18 September 2025 | Revised: 17 October 2025 | Accepted: 24 October 2025 | Online: 3 December 2025
Corresponding author: S. G. Shaila
Abstract
Emotion recognition from physiological signals is a promising approach in affective computing because it is accurate and less affected by external conditions. This paper proposes a new hybrid model that combines fuzzy logic and deep learning to improve Electroencephalogram (EEG) and Electrocardiogram (ECG)-based multimodal emotion recognition. The system undertakes feature-level fusion of EEG and ECG, coupled with fuzzy logic–based membership scoring for handling uncertainty and subject variability. These fuzzy-enhanced representations are then utilized as input to a hybrid Convolutional Neural Network (CNN)–LSTM model, allowing automatic spatial association extraction and temporal emotional dynamics extraction. When tested on the DREAMER dataset, the proposed method has a total accuracy of 92% compared to current machine learning and deep learning models. The performance metrics of precision, recall, F1-score, confusion matrix, and ROC-AUC analysis show stable classification for four affective classes. The findings validate that the fuzzy-deep hybrid model not only enhances prediction accuracy but also enhances interpretability and robustness against noisy physiological signals, making it appropriate for application in healthcare monitoring, adaptive learning, and human–computer interaction.
Keywords:
emotion recognition, EEG, ECG, fuzzy logic, CNN–LSTM, affective computing, multimodal fusionDownloads
References
J. F. Sedehi, N. J. Dabanloo, K. Maghooli, and A. Sheikhani, "Develop an Emotion Recognition System using Jointly Connectivity between Electroencephalogram and Electrocardiogram Signals," Heliyon, vol. 11, no. 2, Jan. 2025, Art. no. e41767. DOI: https://doi.org/10.1016/j.heliyon.2025.e41767
A. Kumar and A. Kumar, "Human Emotion Recognition using Machine Learning Techniques Based on the Physiological Signal," Biomedical Signal Processing and Control, vol. 100, Feb. 2025, Art. no. 107039. DOI: https://doi.org/10.1016/j.bspc.2024.107039
R. Pillalamarri and U. Shanmugam, "A Review on EEG-Based Multimodal Learning for Emotion Recognition," Artificial Intelligence Review, vol. 58, no. 5, Feb. 2025, Art. no. 131. DOI: https://doi.org/10.1007/s10462-025-11126-9
Y. Miao, H. Wang, W. Wang, and L. Song, "DuMoNet: Enhancing Emotion Recognition with a Dual-Modality Structure from EEG and ECG," in 2025 25th International Conference on Digital Signal Processing (DSP), Pylos, Greece, June 2025, pp. 1–5. DOI: https://doi.org/10.1109/DSP65409.2025.11074850
Z. Aalam, S. Aziz, K. L. Lew, and C. S. Lee, "Real-Time Emotion Detection Using Artificial Intelligence: A Review," International Journal on Robotics, Automation and Sciences, vol. 7, no. 1, pp. 104–110, Mar. 2025. DOI: https://doi.org/10.33093/ijoras.2025.7.1.12
A. Tonacci et al., "Taste the Emotions: Pilot for a Novel, Sensors‐Based Approach to Emotional Analysis During Coffee Tasting," Journal of the Science of Food and Agriculture, vol. 105, no. 3, pp. 1420–1429, Feb. 2025. DOI: https://doi.org/10.1002/jsfa.13172
J. Yu, Y. Ru, B. Xu, and G. Yang, "Emotion Recognition Based on EEG and Peripheral Physiological Signals," in 2025 5th International Symposium on Computer Technology and Information Science (ISCTIS), Xi’an, China, May 2025, pp. 5–9. DOI: https://doi.org/10.1109/ISCTIS65944.2025.11065304
S. Adhikari et al., "Analysis of Frequency Domain Features for the Classification of Evoked Emotions using EEG Signals," Experimental Brain Research, vol. 243, no. 3, Mar. 2025, Art. no. 65. DOI: https://doi.org/10.1007/s00221-025-07002-1
X. Xu et al., "A Multi-Context Emotional EEG Dataset for Cross-Context Emotion Decoding," Scientific Data, vol. 12, no. 1, July 2025, Art. no. 1142. DOI: https://doi.org/10.1038/s41597-025-05349-2
S. M. H. Mousavi, "Synthetic Data Generation by Supervised Neural Gas Network for Physiological Emotion Recognition Data." SSRN Preprint, 2025. DOI: https://doi.org/10.2139/ssrn.5115847
S. Garg, R. K. Patro, S. Behera, N. P. Tigga, and R. Pandey, "An Overlapping Sliding Window and Combined Features-Based Emotion Recognition System for EEG Signals," Applied Computing and Informatics, vol. 21, no. 1&2, pp. 114–130, Aug. 2021. DOI: https://doi.org/10.1108/ACI-05-2021-0130
N. Zhang et al., "Effects of Traffic Noise on the Psychophysiological Responses of College Students: An EEG Study," Building and Environment, vol. 267, Jan. 2025, Art. no. 112171. DOI: https://doi.org/10.1016/j.buildenv.2024.112171
Y. Alidoost and B. Mohammadzadeh Asl, "Entropy-Based Emotion Recognition Using EEG Signals," IEEE Access, vol. 13, pp. 51242–51254, 2025. DOI: https://doi.org/10.1109/ACCESS.2025.3553809
L. Turchet, B. O’Sullivan, R. Ortner, and C. Guger, "Emotion Recognition of Playing Musicians From EEG, ECG, and Acoustic Signals," IEEE Transactions on Human-Machine Systems, vol. 54, no. 5, pp. 619–629, Oct. 2024. DOI: https://doi.org/10.1109/THMS.2024.3430327
G.-Y. Choi et al., "EEG Dataset for the Recognition of Different Emotions Induced in Voice-User Interaction," Scientific Data, vol. 11, no. 1, Oct. 2024, Art. no. 1084. DOI: https://doi.org/10.1038/s41597-024-03887-9
M. S. M. Prasanna, S. G. Shaila, and A. Vadivel, "Phrase-Level Sentence Patterns for Estimating Positive and Negative Emotions using Neuro-Fuzzy Model for Information Retrieval Applications," Multimedia Tools and Applications, vol. 80, no. 13, pp. 20151–20190, May 2021. DOI: https://doi.org/10.1007/s11042-020-10422-6
W. Lin and C. Li, "Review of Studies on Emotion Recognition and Judgment Based on Physiological Signals," Applied Sciences, vol. 13, no. 4, Feb. 2023, Art. no. 2573. DOI: https://doi.org/10.3390/app13042573
S. G. Shaila, A. Vadivel, and S. Avani, "Emotion Estimation from Nose Feature using Pyramid Structure," Multimedia Tools and Applications, vol. 82, no. 27, pp. 42569–42591, Nov. 2023. DOI: https://doi.org/10.1007/s11042-023-14682-w
M. Ramasamy and V. K. Varadan, "Study of Heart-Brain Interactions Through EEG, ECG, and Emotions," SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring, Portland, OR, United States, Apr. 2017, Art. no. 101670I. DOI: https://doi.org/10.1117/12.2264371
N. V. Kimmatkar and B. Vijaya Babu, "Human Emotion Detection with Electroencephalography Signals and Accuracy Analysis using Feature Fusion Techniques and a Multimodal Approach for Multiclass Classification," Engineering, Technology & Applied Science Research, vol. 12, no. 4, pp. 9012–9017, Aug. 2022. DOI: https://doi.org/10.48084/etasr.5073
V. S. Avani, S. G. Shaila, and A. Vadivel, "Interval Graph of Facial Regions with Common Intersection Salient Points for Identifying and Classifying Facial Expression," Multimedia Tools and Applications, vol. 80, no. 3, pp. 3367–3390, Jan. 2021. DOI: https://doi.org/10.1007/s11042-020-09806-5
M. K. Myee, R. D. C. Rebekah, T. Deepa, G. D. Zion, and K. Lokesh, "Detection of Depression in Social Media Posts using Emotional Intensity Analysis," Engineering, Technology & Applied Science Research, vol. 14, no. 5, pp. 16207–16211, Oct. 2024. DOI: https://doi.org/10.48084/etasr.7461
S. Katsigiannis and N. Ramzan, "DREAMER: A Database for Emotion Recognition Through EEG and ECG Signals From Wireless Low-cost Off-the-Shelf Devices," IEEE Journal of Biomedical and Health Informatics, vol. 22, no. 1, pp. 98–107, Jan. 2018. DOI: https://doi.org/10.1109/JBHI.2017.2688239
N. Babu, U. Satija, J. Mathew, and A. P. Vinod, "Emotion Recognition in Virtual and Non-Virtual Environments using EEG Signals: Dataset and Evaluation," Biomedical Signal Processing and Control, vol. 106, Aug. 2025, Art. no. 107674. DOI: https://doi.org/10.1016/j.bspc.2025.107674
N. Babu, J. Mathew, and A. P. Vinod, "Large Language Models for EEG: A Comprehensive Survey and Taxonomy." arXiv, 2025.
Y. Geng, S. Shi, and X. Hao, "Deep Learning-Based EEG Emotion Recognition: A Comprehensive Review," Neural Computing and Applications, vol. 37, no. 4, pp. 1919–1950, Feb. 2025. DOI: https://doi.org/10.1007/s00521-024-10821-y
Downloads
How to Cite
License
Copyright (c) 2025 L. Monish, S. G. Shaila
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
