Deep Q-Learning for Channel Optimization in MRCP BMI Systems: A Teleoperated Robot Implementation

摘要

Brain-machine Interface (BMI) systems utilize brain signals to control external devices. Such systems can assist brain injury survivors who are partly or entirely unable to move the affected parts of the body. Electroencephalogram (EEG), a non-invasive method for recording brain signals in different locations of subjects’ scalp, is commonly used in such applications due to its cost-effectiveness and portability. Although EEG signals provide high temporal features, the signals are not robust due to both internal and external noises. Using all available EEG channels causes the system’s performance to deteriorate. Therefore, it is important to select the most informative channels to improve the system performance while reducing computation complexity. In this work, we propose a new Deep Q Network (DQN) based method to find the best EEG channel combination for motor-related cortical potential (MRCP) tasks. The Deep Learning (DL) model is used to evaluate the DQN’s selected channels and provide feedback in terms of recognition rate. To evaluate the DQN’s performance, we compare the results with Genetic Algorithm (GA) and Backward Elimination (BE) channel optimization methods. Confusion matrix and recognition rates show that the proposed DQN-based EEG channel optimization outperforms other methods. In addition, the results demonstrate that the DQN approach significantly reduces the number of channels while improving the BMI recognition rates. Furthermore, the EEG signals of optimized channels are used to control in real-time a teleoperated robotic hand. The results demonstrate the effectiveness of EEG channel optimization for the Internet of Things (IoT) implementations of BMI systems.