A Multimodal Feedback Sensing System for an Endovascular Surgery Robot

Abstract

Robot-assisted endovascular surgery (RES) acts as a promising alternative to aid medical cures. To overcome the current limitations of single feedback sensing for surgeons in RES, in this work, a multimodal feedback sensing system integrated with four kinds of feedback (temperature, vibration, haptic, and vision) are developed, fabricated, and tested to provide immersive feedback sensing to surgeons, improve the transparency and safety for operations. A small-sized wearable sensing bracelet (WSB), assembled by Peltier module, vibration motor, and film thermistor, is designed to generate continuous real-time feedback sensing (thermal feedback and vibrating feedback) and measure the temperature of thermal feedback. The haptic interface can offer force feedback. The monitor window is able to provide visual feedback. Besides, a multilevel control strategy for the feedback sensing system is proposed to indicate different surgical conditions. The performance evaluation for three feedback and insertions (in vitro experiments) are carried out to verify the feasibility and repeatability. Insertion results by five subjects demonstrate that proposed multimodal feedback sensing system achieves fast response, immersive feedback, and large repetition capacity. Moreover, benefiting from the inspiration of multimodal feedback sensing, it is suitable to combine more feedback stimulus, even possible to explore newly immersive/spatial feedback sensing for leader-follower robotics.