Robotic Object Perception Based on Multispectral Few-Shot Coupled Learning

Abstract

In order to enable intelligent robots to recognize unknown objects as accurately as human beings, object perception research is of great significance in service and industrial robot application scenarios. However, object perception using spectral measurements under few-shot learning usually leads to a poor result because of inadequate training samples. To overcome this problem, this work proposes a novel few-shot learning with coupled dictionary learning (FSL-CDL) framework. First, a hybrid feature fusion method is developed to extract the multiple dimension-reduced features of original spectral measurements to build the hybrid features. Then, based on the hybrid features, a multitask coupled learning method is developed to effectively recognize unknown objects under few-shot learning. In this method, two coupling patterns, i.e., interspectroscopy coupling and intraspectroscopy coupling, effectively bridge the gap between two spectral measurements. Finally, the proposed FSL-CDL is compared with other advanced algorithms on the SMM50 dataset, and reaches 97.5% and 98.4% recognition accuracy under one-shot and five-shot learning, respectively, which are better than other algorithms. Besides, FSL-CDL can be extended to other perception tasks which contains multiple heterogeneous measurements.