Safe Reinforcement Learning-Based Motion Planning for Functional Mobile Robots Suffering Uncontrollable Mobile Robots

摘要

An increasing number of Autonomous Mobile Robots (AMRs) are used in warehouses and factories in recent years. The risk of some of the AMRs being out of control is surging. Although Reinforcement Learning (RL)-based approaches have achieved dramatic success in the motion planning of a large number of AMRs, the available RL-based motion planning approaches cannot provide a safety guarantee for the remaining functional AMRs if some of the AMRs are out of control. To this end, this paper develops a scalable Multi-agent RL (MARL) with Control Barrier Function (CBF)-based shields algorithm. The MARL with CBF-based shields algorithm can address complex high-level tasks by MARL and deal with the safety issue of every single functional AMR by a low-level CBF-based shield. A CBF-based shield is designed for every single functional AMR to ensure that the action of the functional AMR is safe, even if an uncontrollable AMR is pursuing the functional AMR. Experiments are conducted based on simulated warehouse environments to evaluate the effectiveness and scalability of a safe RL-based motion planning approach (The safe RL-based motion planning approach developed in this study is demonstrated in a video: https://youtu.be/I7ja5nFVpY4). developed according to the MARL with CBF-based shields algorithm.