Robot Embodied Dynamic Tactile Perception of Liquid in Containers

Abstract

Humans perceive objects and environments actively and dynamically using tactile sensing facilitated by the skin. However, due to the gap in sensing capabilities between electronic skin and human skin, it remains a challenge for robots to achieve intricate tactile perception. For example, the task of liquid properties estimation within containers, demands sensing and comprehension of complex dynamic tactile signals during contact. This paper introduces a novel tactile fingertip inspired by human skin enabling both static tactile sensing facilitated by a layer of porous piezoresistive elastomer and dynamic tactile sensing enabled by condenser microphones. A data-driven methodology is employed to analyze liquids through multimodal signals devoid of physical modelling. The proposed robotic system engages in shaking various bottles filled with different volumes of water, allowing the tactile fingertip to detect changes in grasping force caused by shaking and small vibrations caused by the collision of the container with liquid. Five machine learning models trained on these tactile signals are analyzed and compared. Experimental results demonstrate the proficiency of the tactile system in distinguishing liquid fill percentages across bottles of different shapes and capacities with a remarkable accuracy of $\mathbf{9 8 \%}$. This paper holds promise for advancing the embodied intelligence of robots, enhancing their ability to perceive mixed tactile signals dynamically, thereby facilitating tasks such as liquid estimation and other intricate tactile operations in environments like kitchens and hospitals.