A Hybrid EEG-EMG Framework for Humanoid Control using Deep Learning Transformers

Abstract

Brain-computer interfaces (BCIs) offer promising solutions for upper limb rehabilitation. Despite advancements in deep learning, traditional models for motor rehabilitation using electroencephalography (EEG) or electromyography (EMG) to control assistive devices require enhancement. This study aims to enhance motor control capabilities by integrating EEG and EMG signals using a Transformer-based deep learning model. Ten able-bodies subjects performed center-out tasks on a low-cost upper limb rehabilitation table, capturing 2D kinematic data, EEG, and EMG signals simultaneously. The tasks varied in complexity across four levels. Preprocessed EEG and EMG signals were fused and given as input to the proposed model, which was evaluated using three performance metrics. Results showed that the EEG-EMG combined model achieved 87.27% accuracy across all the four levels. Furthermore, the model's output successfully controlled a humanoid robot to replicate similar movements. These findings highlight the efficacy of combined EEG-EMG data in improving accuracy and performance in BCI applications, advancing assistive technologies and neurorehabilitation interventions.