An SSVEP Stimuli Design using Real-time Camera View with Object Recognition

Abstract

Most SSVEP-based stimuli BCIs are pre-defined using the white blocks. This kind of scenario lead less flexibility in the real life. To represent the flickers with the location, types and configurations of the objects in real world, this paper proposes an SSVEP-based BCI using real-time camera view with object recognition algorithm to provide intuitive BCI for users. A deep learning-based object recognition algorithm is used to calculate the location of the objects on the online camera view from a depth camera. After the bounding box of the objects is estimated, the location of the SSVEP flickers are designed to overlap on the object locations. An overlapping FFT and SVM is used to recognize the EEG signals into corresponding classes. In experimental results, the classification rate for camera view scenario is more than 94.1%. The results show that proposed SSVEP stimuli design is available to create an intuitive and reliable human machine interaction. The proposed results can be used for the users who have motor disabilities to further used to interact with assistive devices, such as: robotic arm and wheelchairs.