Human Emotion Detection with Electroencephalography Signals and Accuracy Analysis Using Feature Fusion Techniques and a Multimodal Approach for Multiclass Classification
Received: 12 May 2022 | Revised: 24 May 2022 | Accepted: 4 June 2022 | Online: 7 July 2022
Corresponding author: N. V. Kimmatkar
Abstract
Biological brain signals may be used to identify emotions in a variety of ways, with accuracy depended on the methods used for signal processing, feature extraction, feature selection, and classification. The major goal of the current work was to use an adaptive channel selection and classification strategy to improve the effectiveness of emotion detection utilizing brain signals. Using different features picked by feature fusion approaches, the accuracy of existing classification models' emotion detection is assessed. Statistical modeling is used to determine time-domain and frequency-domain properties. Multiclass classification accuracy is examined using Neural Networks (NNs), Lasso regression, k-Nearest Neighbors (KNN), Support Vector Machine (SVM), and Random Forest (RF). After performing hyperparameter tuning, a remarkable increase in accuracy is achieved using Lasso regression, while RF performed well for all the feature sets. 78.02% and 76.77% accuracy were achieved for a small and noisy 24 feature dataset by Lasso regression and RF respectively whereas 76.54% accuracy is achieved by Lasso regression with the backward elimination wrapper method.
Keywords:
Feature Fusion, Lasso Regression, DNNDownloads
References
S. Gannouni, A. Aledaily, K. Belwafi, and H. Aboalsamh, "Emotion detection using electroencephalography signals and a zero-time windowing-based epoch estimation and relevant electrode identification," Scientific Reports, vol. 11, no. 1, Mar. 2021, Αρτ. Νο. 7071. DOI: https://doi.org/10.1038/s41598-021-86345-5
N. V. Kimmatkar and B. V. Babu, "Novel Approach for Emotion Detection and Stabilizing Mental State by Using Machine Learning Techniques," Computers, vol. 10, no. 3, Mar. 2021, Art. No. 37. DOI: https://doi.org/10.3390/computers10030037
N. V. Kimmatkar and V. B. Babu, "Human Emotion Classification from Brain EEG Signal Using Multimodal Approach of Classifier," in Proceedings of the 2018 International Conference on Intelligent Information Technology, New York, NY, USA, Oct. 2018, pp. 9–13. DOI: https://doi.org/10.1145/3193063.3193067
O. Bazgir, Z. Mohammadi, and S. A. H. Habibi, "Emotion Recognition with Machine Learning Using EEG Signals," in 2018 25th National and 3rd International Iranian Conference on Biomedical Engineering (ICBME), Aug. 2018. DOI: https://doi.org/10.1109/ICBME.2018.8703559
P. Ackermann, C. Kohlschein, J. Á. Bitsch, K. Wehrle, and S. Jeschke, "EEG-based automatic emotion recognition: Feature extraction, selection and classification methods," in 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom), Munich, Germany, Sep. 2016. DOI: https://doi.org/10.1109/HealthCom.2016.7749447
E. S. Pane, M. A. Hendrawan, A. D. Wibawa, and M. H. Purnomo, "Identifying Rules for Electroencephalograph (EEG) Emotion Recognition and Classification," in 2017 5th International Conference on Instrumentation, Communications, Information Technology, and Biomedical Engineering (ICICI-BME), Bandung, Indonesia, Aug. 2017, pp. 167–172. DOI: https://doi.org/10.1109/ICICI-BME.2017.8537731
M. K. Ahirwal and M. R. Kose, "Emotion Recognition System based on EEG signal: A Comparative Study of Different Features and Classifiers," in 2018 Second International Conference on Computing Methodologies and Communication (ICCMC), Erode, India, Oct. 2018, pp. 472–476. DOI: https://doi.org/10.1109/ICCMC.2018.8488044
F. Ren, Y. Dong, and W. Wang, "Emotion recognition based on physiological signals using brain asymmetry index and echo state network," Neural Computing and Applications, vol. 31, no. 9, pp. 4491–4501, Sep. 2019. DOI: https://doi.org/10.1007/s00521-018-3664-1
H. Ranganathan, S. Chakraborty, and S. Panchanathan, "Multimodal emotion recognition using deep learning architectures," in 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA, Mar. 2016. DOI: https://doi.org/10.1109/WACV.2016.7477679
Y. Liu and G. Fu, "Emotion recognition by deeply learned multi-channel textual and EEG features," Future Generation Computer Systems, vol. 119, pp. 1–6, Jun. 2021. DOI: https://doi.org/10.1016/j.future.2021.01.010
Z. Mohammadi, J. Frounchi, and M. Amiri, "Wavelet-based emotion recognition system using EEG signal," Neural Computing and Applications, vol. 28, no. 8, pp. 1985–1990, Aug. 2017. DOI: https://doi.org/10.1007/s00521-015-2149-8
X. Jie, R. Cao, and L. Li, "Emotion recognition based on the sample entropy of EEG," Bio-Medical Materials and Engineering, vol. 24, no. 1, pp. 1185–1192, 2014. DOI: https://doi.org/10.3233/BME-130919
M. Ali, A. H. Mosa, F. Al Machot, and K. Kyamakya, "EEG-based emotion recognition approach for e-healthcare applications," in 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN), Jul. 2016, pp. 946–950. DOI: https://doi.org/10.1109/ICUFN.2016.7536936
N. V. Kimmatkar and B. V. Babu, "Initial analysis of brain EEG signal for mental state detection of human being," in 2017 International Conference on Trends in Electronics and Informatics (ICEI), Tirunelveli, India, Feb. 2017, pp. 287–295. DOI: https://doi.org/10.1109/ICOEI.2017.8300934
S. Yemulwar, "Feature Selection Techniques," Medium.com, Nov. 30, 2020. https://medium.com/analytics-vidhya/feature-selection-technique
s-2614b3b7efcd.
G. Singh et al., "A Comparative Analysis of Emotion Recognition from Stimulated EEG Signals," in Proceedings of the Second International Conference on Soft Computing for Problem Solving (SocProS 2012), December 28-30, 2012, New Delhi, India, 2014, pp. 1109–1115. DOI: https://doi.org/10.1007/978-81-322-1602-5_116
A. Bhardwaj, A. Gupta, P. Jain, A. Rani, and J. Yadav, "Classification of human emotions from EEG signals using SVM and LDA Classifiers," in 2015 2nd International Conference on Signal Processing and Integrated Networks (SPIN), Noida, India, Oct. 2015, pp. 180–185. DOI: https://doi.org/10.1109/SPIN.2015.7095376
H. Alamri, E. Alshanbari, S. Alotaibi, and M. Alghamdi, "Face Recognition and Gender Detection Using SIFT Feature Extraction, LBPH, and SVM," Engineering, Technology & Applied Science Research, vol. 12, no. 2, pp. 8296–8299, Apr. 2022. DOI: https://doi.org/10.48084/etasr.4735
M. Bhalekar and M. Bedekar, "D-CNN: A New model for Generating Image Captions with Text Extraction Using Deep Learning for Visually Challenged Individuals," Engineering, Technology & Applied Science Research, vol. 12, no. 2, pp. 8366–8373, Apr. 2022. DOI: https://doi.org/10.48084/etasr.4772
D. K. Suker, "Deep Learning CNN for the Prediction of Grain Orientations on EBSD Patterns of AA5083 Alloy," Engineering, Technology & Applied Science Research, vol. 12, no. 2, pp. 8393–8401, Apr. 2022. DOI: https://doi.org/10.48084/etasr.4807
Downloads
How to Cite
License
Copyright (c) 2022 N. V. Kimmatkar, B. Vijaya Babu
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
