Super-resolution tactile sensor arrays with sparse units enabled by deep learning

Abstract

High-resolution tactile perception is essential for humanoid robots to perform contact-based interaction tasks. However, enhancing resolution is typically accompanied by increasing the density of sensing nodes, large numbers of interconnecting wires, and complex signal processing modules. This work presents super-resolution (SR) tactile sensor arrays with sparsely distributed taxels powered by a universal intelligent framework. Such smart sensor systems involve a general topological optimization strategy for taxel layout design and a deep learning model called self-attention-assisted tactile SR. Driven by the proposed model, they can dynamically distinguish high-density pressure stimuli by generating 2700 virtual taxels from only 23 physical taxels. An SR scale factor of more than 115 and an average localization error of 0.73 millimeters are achieved, approximating human fingertip accuracy and surpassing current state-of-the-art solutions. This framework enhances flexible sensors with SR capabilities in a facile and energy-efficient manner, illustrating the potential to equip robots with embodied tactile perceptions.