Surgical Gesture Recognition in Open Surgery Based on 3DCNN and SlowFast

Abstract

In the field of computer-aided medicine, automated surgical gesture recognition is an important research direction. Its main applications include automated skills assessment, intraoperative guidance, and education and training systems. Current research has focused on robotic surgery, and there is less research on surgical gestures for open surgery. Therefore, in this study, a new simulated open surgery dataset was developed, and a series of surgical gestures for open surgery were defined for closure the abdomen surgery with the cooperation of professional doctors. In addition, this paper uses the classical algorithm 3DCNN and SlowFast model in the field of action recognition to perform offline recognition of surgical gestures for open surgery on the dataset. 3DCNN uses R3D and R(2+1)D models. The experimental results show that on the self-built open surgical dataset, the R3D model has the best surgical gesture recognition results, with an accuracy rate of 90.4%, a precision rate of 90.5%, and a recall rate of 90.0%.