Intelligent Navigation of Indoor Robot Based on Improved DDPG Algorithm

Abstract

Targeting the problem of autonomous navigation of indoor robots in large‐scale, complicated, and unknown environments, an autonomous online decision‐making algorithm based on deep reinforcement learning is put forward in this paper. Traditional path planning methods rely on the environment modeling, which can cause more workload of calculating. In this paper, the sensors to detect surrounding obstacles are combined with the DDPG (deep deterministic policy gradient) algorithm to input environmental perception and control the action direct output, which enables robots to complete the tasks of autonomous navigation and distribution without relying on environment modeling. In addition, the algorithm preprocesses the relevant data in the learning sample with Gaussian noise, facilitating the agent to adapt to noisy training environment and improve its robustness. The simulation results show that the optimized DL‐DDPG algorithm is more efficient on online decision‐making for the indoor robot navigation system, which enables the robot to complete autonomous navigation and intelligent control independently.