Human Emotion Detection with Electroencephalography Signals and Accuracy Analysis Using Feature Fusion Techniques and a Multimodal Approach for Multiclass Classification

Authors

  • N. V. Kimmatkar Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, India
  • B. Vijaya Babu Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, India
Volume: 12 | Issue: 4 | Pages: 9012-9017 | August 2022 | https://doi.org/10.48084/etasr.5073

Abstract

Biological brain signals may be used to identify emotions in a variety of ways, with accuracy depended on the methods used for signal processing, feature extraction, feature selection, and classification. The major goal of the current work was to use an adaptive channel selection and classification strategy to improve the effectiveness of emotion detection utilizing brain signals. Using different features picked by feature fusion approaches, the accuracy of existing classification models' emotion detection is assessed. Statistical modeling is used to determine time-domain and frequency-domain properties. Multiclass classification accuracy is examined using Neural Networks (NNs), Lasso regression, k-Nearest Neighbors (KNN), Support Vector Machine (SVM), and Random Forest (RF). After performing hyperparameter tuning, a remarkable increase in accuracy is achieved using Lasso regression, while RF performed well for all the feature sets. 78.02% and 76.77% accuracy were achieved for a small and noisy 24 feature dataset by Lasso regression and RF respectively whereas 76.54% accuracy is achieved by Lasso regression with the backward elimination wrapper method.

Keywords:

Feature Fusion, Lasso Regression, DNN

Downloads

Download data is not yet available.

References

S. Gannouni, A. Aledaily, K. Belwafi, and H. Aboalsamh, "Emotion detection using electroencephalography signals and a zero-time windowing-based epoch estimation and relevant electrode identification," Scientific Reports, vol. 11, no. 1, Mar. 2021, Αρτ. Νο. 7071. DOI: https://doi.org/10.1038/s41598-021-86345-5

N. V. Kimmatkar and B. V. Babu, "Novel Approach for Emotion Detection and Stabilizing Mental State by Using Machine Learning Techniques," Computers, vol. 10, no. 3, Mar. 2021, Art. No. 37. DOI: https://doi.org/10.3390/computers10030037

N. V. Kimmatkar and V. B. Babu, "Human Emotion Classification from Brain EEG Signal Using Multimodal Approach of Classifier," in Proceedings of the 2018 International Conference on Intelligent Information Technology, New York, NY, USA, Oct. 2018, pp. 9–13. DOI: https://doi.org/10.1145/3193063.3193067

O. Bazgir, Z. Mohammadi, and S. A. H. Habibi, "Emotion Recognition with Machine Learning Using EEG Signals," in 2018 25th National and 3rd International Iranian Conference on Biomedical Engineering (ICBME), Aug. 2018. DOI: https://doi.org/10.1109/ICBME.2018.8703559

P. Ackermann, C. Kohlschein, J. Á. Bitsch, K. Wehrle, and S. Jeschke, "EEG-based automatic emotion recognition: Feature extraction, selection and classification methods," in 2016 IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom), Munich, Germany, Sep. 2016. DOI: https://doi.org/10.1109/HealthCom.2016.7749447

E. S. Pane, M. A. Hendrawan, A. D. Wibawa, and M. H. Purnomo, "Identifying Rules for Electroencephalograph (EEG) Emotion Recognition and Classification," in 2017 5th International Conference on Instrumentation, Communications, Information Technology, and Biomedical Engineering (ICICI-BME), Bandung, Indonesia, Aug. 2017, pp. 167–172. DOI: https://doi.org/10.1109/ICICI-BME.2017.8537731

M. K. Ahirwal and M. R. Kose, "Emotion Recognition System based on EEG signal: A Comparative Study of Different Features and Classifiers," in 2018 Second International Conference on Computing Methodologies and Communication (ICCMC), Erode, India, Oct. 2018, pp. 472–476. DOI: https://doi.org/10.1109/ICCMC.2018.8488044

F. Ren, Y. Dong, and W. Wang, "Emotion recognition based on physiological signals using brain asymmetry index and echo state network," Neural Computing and Applications, vol. 31, no. 9, pp. 4491–4501, Sep. 2019. DOI: https://doi.org/10.1007/s00521-018-3664-1

H. Ranganathan, S. Chakraborty, and S. Panchanathan, "Multimodal emotion recognition using deep learning architectures," in 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA, Mar. 2016. DOI: https://doi.org/10.1109/WACV.2016.7477679

Y. Liu and G. Fu, "Emotion recognition by deeply learned multi-channel textual and EEG features," Future Generation Computer Systems, vol. 119, pp. 1–6, Jun. 2021. DOI: https://doi.org/10.1016/j.future.2021.01.010

Z. Mohammadi, J. Frounchi, and M. Amiri, "Wavelet-based emotion recognition system using EEG signal," Neural Computing and Applications, vol. 28, no. 8, pp. 1985–1990, Aug. 2017. DOI: https://doi.org/10.1007/s00521-015-2149-8

X. Jie, R. Cao, and L. Li, "Emotion recognition based on the sample entropy of EEG," Bio-Medical Materials and Engineering, vol. 24, no. 1, pp. 1185–1192, 2014. DOI: https://doi.org/10.3233/BME-130919

M. Ali, A. H. Mosa, F. Al Machot, and K. Kyamakya, "EEG-based emotion recognition approach for e-healthcare applications," in 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN), Jul. 2016, pp. 946–950. DOI: https://doi.org/10.1109/ICUFN.2016.7536936

N. V. Kimmatkar and B. V. Babu, "Initial analysis of brain EEG signal for mental state detection of human being," in 2017 International Conference on Trends in Electronics and Informatics (ICEI), Tirunelveli, India, Feb. 2017, pp. 287–295. DOI: https://doi.org/10.1109/ICOEI.2017.8300934

S. Yemulwar, "Feature Selection Techniques," Medium.com, Nov. 30, 2020. https://medium.com/analytics-vidhya/feature-selection-technique

s-2614b3b7efcd.

G. Singh et al., "A Comparative Analysis of Emotion Recognition from Stimulated EEG Signals," in Proceedings of the Second International Conference on Soft Computing for Problem Solving (SocProS 2012), December 28-30, 2012, New Delhi, India, 2014, pp. 1109–1115. DOI: https://doi.org/10.1007/978-81-322-1602-5_116

A. Bhardwaj, A. Gupta, P. Jain, A. Rani, and J. Yadav, "Classification of human emotions from EEG signals using SVM and LDA Classifiers," in 2015 2nd International Conference on Signal Processing and Integrated Networks (SPIN), Noida, India, Oct. 2015, pp. 180–185. DOI: https://doi.org/10.1109/SPIN.2015.7095376

H. Alamri, E. Alshanbari, S. Alotaibi, and M. Alghamdi, "Face Recognition and Gender Detection Using SIFT Feature Extraction, LBPH, and SVM," Engineering, Technology & Applied Science Research, vol. 12, no. 2, pp. 8296–8299, Apr. 2022. DOI: https://doi.org/10.48084/etasr.4735

M. Bhalekar and M. Bedekar, "D-CNN: A New model for Generating Image Captions with Text Extraction Using Deep Learning for Visually Challenged Individuals," Engineering, Technology & Applied Science Research, vol. 12, no. 2, pp. 8366–8373, Apr. 2022. DOI: https://doi.org/10.48084/etasr.4772

D. K. Suker, "Deep Learning CNN for the Prediction of Grain Orientations on EBSD Patterns of AA5083 Alloy," Engineering, Technology & Applied Science Research, vol. 12, no. 2, pp. 8393–8401, Apr. 2022. DOI: https://doi.org/10.48084/etasr.4807

Downloads

How to Cite

[1]
N. V. Kimmatkar and B. . Vijaya Babu, “Human Emotion Detection with Electroencephalography Signals and Accuracy Analysis Using Feature Fusion Techniques and a Multimodal Approach for Multiclass Classification”, Eng. Technol. Appl. Sci. Res., vol. 12, no. 4, pp. 9012–9017, Aug. 2022.

Metrics

Abstract Views: 240
PDF Downloads: 112

Metrics Information
Bookmark and Share