Improvement of Classification Accuracy of Four-Class Voluntary-Imagery fNIRS Signals using Convolutional Neural Networks
Received: 23 January 2023 | Revised: 6 February 2023 | Accepted: 8 February 2023 | Online: 12 March 2023
Corresponding author: Mohd Abdur Rashid
Abstract
Multiclass functional Near-Infrared Spectroscopy (fNIRS) signal classification has become a convenient way for optical brain-computer interface. fNIRS signal classification with high accuracy is a challenging assignment while the signals are produced by means of voluntary and imagery movements of the same limb. Since the activation in time and space of voluntary and imagery movement show a similar pattern, the classification accuracy by the conventional shallow classifiers cannot reach an acceptable range. This paper proposes an accuracy improvement approach with the use of Convolutional Neural Networks (CNNs). In this work, voluntary and imagery hand movements (left hand and right hand) were performed by several participants. These four-class signals were acquired utilizing fNIRS devices. The signals were separated based on the tasks and filtered. With manual feature extraction, the signals were classified by support vector machine and linear discriminant analysis. The automatic feature extraction and classification mechanism of the CNN were applied to the fNIRS signals. From the results, it was found that CNN improves the classification accuracy to an acceptable range, which has not been achieved by any convolutional network.
Keywords:
fNIRS, voluntary and imagery fNIRS signal, classification accuracy, conventional classifiers, Convolutional Neural Network (CNN)Downloads
References
S. Ajami, A. Mahnam, and V. Abootalebi, "Development of a practical high frequency brain–computer interface based on steady-state visual evoked potentials using a single channel of EEG," Biocybernetics and Biomedical Engineering, vol. 38, no. 1, pp. 106–114, Jan. 2018. DOI: https://doi.org/10.1016/j.bbe.2017.10.004
A. Rezeika, M. Benda, P. Stawicki, F. Gembler, A. Saboor, and I. Volosyak, "Brain–Computer Interface Spellers: A Review," Brain Sciences, vol. 8, no. 4, Apr. 2018, Art. no. 57. DOI: https://doi.org/10.3390/brainsci8040057
F. Cincotti et al., "Non-invasive brain–computer interface system: Towards its application as assistive technology," Brain Research Bulletin, vol. 75, no. 6, pp. 796–803, Apr. 2008. DOI: https://doi.org/10.1016/j.brainresbull.2008.01.007
K. D. Tzimourta et al., "Evaluation of window size in classification of epileptic short-term EEG signals using a Brain Computer Interface software," Engineering, Technology & Applied Science Research, vol. 8, no. 4, pp. 3093–3097, Aug. 2018. DOI: https://doi.org/10.48084/etasr.2031
"What Is MEG?" http://web.mit.edu/kitmitmeg/whatis.html (accessed Feb. 15, 2023).
H. Y. Kim, K. Seo, H. J. Jeon, U. Lee, and H. Lee, "Application of Functional Near-Infrared Spectroscopy to the Study of Brain Function in Humans and Animal Models," Molecules and Cells, vol. 40, no. 8, pp. 523–532, Aug. 2017. DOI: https://doi.org/10.14348/molcells.2017.0153
Md. A. Rahman and M. Ahmad, "Identifying appropriate feature to distinguish between resting and active condition from FNIRS," in 3rd International Conference on Signal Processing and Integrated Networks, Noida, India, Feb. 2016, pp. 671–675. DOI: https://doi.org/10.1109/SPIN.2016.7566781
N. Naseer and K.-S. Hong, "fNIRS-based brain-computer interfaces: a review," Frontiers in Human Neuroscience, vol. 9, 2015, Art. no. 3. DOI: https://doi.org/10.3389/fnhum.2015.00003
S. N. Abdulkader, A. Atia, and M.-S. M. Mostafa, "Brain computer interfacing: Applications and challenges," Egyptian Informatics Journal, vol. 16, no. 2, pp. 213–230, Jul. 2015. DOI: https://doi.org/10.1016/j.eij.2015.06.002
Md. A. Rahman, M. A. Rashid, and M. Ahmad, "Selecting the optimal conditions of Savitzky–Golay filter for fNIRS signal," Biocybernetics and Biomedical Engineering, vol. 39, no. 3, pp. 624–637, Jul. 2019. DOI: https://doi.org/10.1016/j.bbe.2019.06.004
K.-S. Hong, M. J. Khan, and M. J. Hong, "Feature Extraction and Classification Methods for Hybrid fNIRS-EEG Brain-Computer Interfaces," Frontiers in Human Neuroscience, vol. 12, 2018, Art. no. 246. DOI: https://doi.org/10.3389/fnhum.2018.00246
T. Hanakawa, I. Immisch, K. Toma, M. A. Dimyan, P. Van Gelderen, and M. Hallett, "Functional Properties of Brain Areas Associated With Motor Execution and Imagery," Journal of Neurophysiology, vol. 89, no. 2, pp. 989–1002, Feb. 2003. DOI: https://doi.org/10.1152/jn.00132.2002
S. C. Wriessnegger, J. Kurzmann, and C. Neuper, "Spatio-temporal differences in brain oxygenation between movement execution and imagery: A multichannel near-infrared spectroscopy study," International Journal of Psychophysiology, vol. 67, no. 1, pp. 54–63, Jan. 2008. DOI: https://doi.org/10.1016/j.ijpsycho.2007.10.004
A. M. Batula, J. A. Mark, Y. E. Kim, and H. Ayaz, "Comparison of Brain Activation during Motor Imagery and Motor Movement Using fNIRS," Computational Intelligence and Neuroscience, vol. 2017, May 2017, Art. no. e5491296. DOI: https://doi.org/10.1155/2017/5491296
S. M. S. Galib, S. Md. R. Islam, and Md. A. Rahman, "A multiple linear regression model approach for two-class fNIR data classification," Iran Journal of Computer Science, vol. 4, no. 1, pp. 45–58, Mar. 2021. DOI: https://doi.org/10.1007/s42044-020-00064-0
N. Naseer and K.-S. Hong, "Classification of functional near-infrared spectroscopy signals corresponding to the right- and left-wrist motor imagery for development of a brain–computer interface," Neuroscience Letters, vol. 553, pp. 84–89, Oct. 2013. DOI: https://doi.org/10.1016/j.neulet.2013.08.021
K.-S. Hong, N. Naseer, and Y.-H. Kim, "Classification of prefrontal and motor cortex signals for three-class fNIRS–BCI," Neuroscience Letters, vol. 587, pp. 87–92, Feb. 2015. DOI: https://doi.org/10.1016/j.neulet.2014.12.029
A. Janani and M. Sasikala, "Evaluation of classification performance of functional near infrared spectroscopy signals during movement execution for developing a brain–computer interface application using optimal channels," Journal of Near Infrared Spectroscopy, vol. 26, no. 4, pp. 209–221, Aug. 2018. DOI: https://doi.org/10.1177/0967033518787331
A. M. Batula, H. Ayaz, and Y. E. Kim, "Evaluating a four-class motor-imagery-based optical brain-computer interface," in 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA, Aug. 2014, pp. 2000–2003. DOI: https://doi.org/10.1109/EMBC.2014.6944007
Md. A. Rahman, M. S. Uddin, and M. Ahmad, "Modeling and classification of voluntary and imagery movements for brain–computer interface from fNIR and EEG signals through convolutional neural network," Health Information Science and Systems, vol. 7, no. 1, Oct. 2019, Art. no. 22. DOI: https://doi.org/10.1007/s13755-019-0081-5
"fnir-devices-technology.pdf." Accessed: Feb. 15, 2023. [Online]. Available: https://www.biopac.com/wp-content/uploads/fnir-devices-technology.pdf.
"COBI fNIR Imager software | BIOPAC," BIOPAC Systems, Inc. https://www.biopac.com/upgrade/cobi-fnir-imager-software/.
Md. A. Rahman, M. A. Rashid, M. Ahmad, A. Kuwana, and H. Kobayashi, "Activation Modeling and Classification of Voluntary and Imagery Movements From the Prefrontal fNIRS Signals," IEEE Access, vol. 8, pp. 218215–218233, 2020. DOI: https://doi.org/10.1109/ACCESS.2020.3042249
N. C. Kundur and P. B. Mallikarjuna, "Deep Convolutional Neural Network Architecture for Plant Seedling Classification," Engineering, Technology & Applied Science Research, vol. 12, no. 6, pp. 9464–9470, Dec. 2022. DOI: https://doi.org/10.48084/etasr.5282
S. Nuanmeesri, "A Hybrid Deep Learning and Optimized Machine Learning Approach for Rose Leaf Disease Classification," Engineering, Technology & Applied Science Research, vol. 11, no. 5, pp. 7678–7683, Oct. 2021. DOI: https://doi.org/10.48084/etasr.4455
Downloads
How to Cite
License
Copyright (c) 2023 Md. Mahmudul Haque Milu , Md. Asadur Rahman, Mohd Abdur Rashid, Anna Kuwana, Haruo Kobayashi
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
