Temporal Convolutional Learning: A New Sequence-based Structure to Promote the Performance of Convolutional Neural Networks in Recognizing P300 Signals

Document Type : Original Article

Authors

1 Department of Computer Engineering, Faculty of Engineering, Alzahra University, Tehran, Iran

2 Department of Biomedical Engineering, Iranian Research Organization for Science and Technology, Tehran, Iran

Abstract

Distinguishing P300 signals from other components of the EEG is one of the most
challenging issues in Brain Computer Interface (BCI) applications, and machine learning
methods have vastly been utilized as effective tools to perform such separation. Although
in recent years deep neural networks have significantly improved the quality of the above
detection, the significant similarity between P300 and other components of EEG in parallel
with their unrepeatable nature have led to P300 detection, which are still an open problem
in BCI domain. In this study, a novel architecture is proposed in order to detect P300 signal
among EEG, in which the temporal learning concept is engaged as a new substructure
inside the main Convolutional Neural Network (CNN). The above Temporal Convolutional
Network (TCN) may better address the problem of P300 detection, thanks to its potential
in involving time sequence properties in modelling of these signals. The performance of
the proposed method is evaluated on the EPFL BCI dataset, and the obtained results are
compared in two inter-subject and intra-subject scenarios with the results of classical CNN
in which temporal properties of input are not considered. Increased True Positive Rate of
the proposed method (an average of 4 percent) and its accuracy (an average of 2.9 percent)
in parallel with the decrease in its False Positive Rate (averagely 3.1 percent) shows the
effectiveness of the TCN structure in promoting the detection procedure of P300 signals in
BCI applications

Keywords


[1] R. Ramele, A. J. Villar and J. M. Santos, “EEG Waveform Analysis of P300 ERP with Applications to Brain Computer Interfaces,” brain sciences, vol. 8, no. 11, 2018. [2]           J. R. Wolpaw, NielsBirbaumer and D. J. McFarland, “Brain–Computer Interfaces for Communication and Control,” Clinical Neurophysiology, vol. 113, no. 6, pp. 767-791, 2002. [3]        U. Hoffmann, J.-M. Vesin, T. Ebrahimi and K. Diserens, “An Efficient P300-based Brain–Computer Interface for Disabled Subjects,” Journal of Neuroscience Methods, vol. 167, no. 1, pp. 115-125, 2008. [4]    K. J. Panoulas, L. J. Hadjileontiadis and S. M. Panas, “Brain-Computer Interface (BCI): Types, Processing Perspectives and Applications,” in Multimedia Services in Intelligent Environments, Berlin, Springer, 2010, pp. 299-321.[5]           D. J. McFarland, A. T. Lefkowicz and J. R. Wolpaw, “Design and Operation of an EEG-based Brain-Computer Interface with Digital Signal Processing Technology,” Behavior Research Methods, Instruments, & Computers, vol. 29, p. 337–345, 1997. [6]        W. G. WALTER, R. COOPER, V. J. ALDRIDGE, W. C. McCALLUM and A. L. WINTER, “Contingent Negative Variation : An Electric Sign of Sensori-Motor Association and Expectancy in the Human Brain,” Nature, vol. 203, p. 380–384, 1964. [7]           S. V. Shojaedini and S. Morabbi, “Sparse Representation-Based Classification (SRC): A Novel Method to Improve the Performance of Convolutional Neural Networks in Detecting P300 Signals,” Journal of Health Management & informatic, vol. 6, no. 2, pp. 37-46, 2019. [8] S. V. Shojaedini, S. Morabbi and M. R. Keyvanpour, “A New Method for Detecting P300 Signals by Using Deep Learning: Hyperparameter Tuning in High-Dimensional Space by Minimizing Nonconvex Error Function,” Journal of Medical Signals and Sensors, vol. 8, no. 4, p. 205–214, 2018. [9]       L. F. Nicolas-Alonso and J. Gomez-Gil, “Brain Computer Interfaces, a Review,” Sensors , vol. 12, no. 2, pp. 1211-1279, 2012. [10]         L. M. McCane, S. M. Heckman and D. J. McFarland, “P300-based Brain-Computer Interface (BCI) Event-Related Potentials (ERPs): People with Amyotrophic Lateral Sclerosis (ALS) vs. Age-matched Controls,” Clinical Neurophysiology, vol. 126, no. 11, pp. 2124-2131, 2015. [11]    V. Lafuente, J. M. Gorriz, J. Ramirez and E. Gonzalez, “P300 Brainwave Extraction from EEG Signals: An Unsupervised Approach,” Expert Systems with Applications, vol. 74, pp. 1-10, 2017. [12]        S. V. Shojaedini, S. Morabbi and M. R. Keyvanpour, “A New Method to Improve the Performance of Deep Neural Networks in Detecting P300 Signals: Optimizing Curvature of Error Surface Using Genetic Algorithm,” Journal of Biomedical Physics and Engineering, 2020. [13]            E. W. Sellers and E. Donchin, “A P300-based Brain–Computer Interface: Initial Tests by ALS Patients,” Clinical Neurophysiology, vol. 117, no. 3, pp. 538-548, 2006. [14] S. V. Shojaedini and M. Adeli, “A New method for Improvement of the Accuracy of Character Recognition in P300 Speller System: Optimization of Channel Selection by Using Recursive Channel Elimination Algorithm Based on Deep Learning,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 7, no. 1, p. 42–51, 2020. [15]             V. Guy, M.-H. Soriani and M. Bruno, “Brain Computer Interface with the P300 Speller: Usability for Disabled People with Amyotrophic Lateral Sclerosis,” Annals of Physical and Rehabilitation Medicine, vol. 61, no. 1, pp. 5-11, 2018. [16] S. Morabbi, M. R. Keyvanpour and S. V. Shojaedini, “A New Method for P300 Detection in Deep Belief Networks: Nesterov Momentum and Drop Based Learning Rate,” Health and Technology, vol. 9, p. 615–630, 2019. [17]         L. Vareka and P. Mautner, “Using the Windowed Means Paradigm for Single Trial P300 Detection,” in 38th International Conference on Telecommunications and Signal Processing (TSP), Prague, Czech Republic, 2015. [18]        S. J. Luck, “An Introduction to the Event-Related Potential Technique,” Mit Press, 2005. [19]         Y. Li, C. Guan and H. L. Chin, “A Self-Training Semi-Supervised SVM Algorithm and its Application in an EEG-based Brain Computer Interface Speller System,” Pattern Recognition Letters, vol. 29, no. 9, pp. 1285-1294, 2008. [20] A. Sobhani, “P300 Classification Using Deep Belief Nets,” MSC thesis, Colorado State University, 2014.[21]          N. M. Norani, W. Mansor and L. Khuan, “A Review of Signal Processing in Brain Computer Interface System,” in IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES), Kuala Lumpur, Malaysia, 2010. [22] I. Goodfellow, Y. Bengio and A. Courville, Deep Learning, Cambridge: MIT press, 2016.