Reinforcement Learning-Based Approach to Robot Path Tracking in Nonlinear Dynamic Environments

Abstract

To address the issue of error-prone and unstable trajectory tracking and dynamic obstacle avoidance of mobile robots in locally observable nonlinear dynamic settings, a deep reinforcement learning (RL)-based visual perception, and decision-making system is proposed. The technique creates a closed loop between the system’s environmental perception and decision-making capabilities by combining the perceptual capabilities of convolutional neural networks with the decision-making capabilities of RL in a generic form. It achieves direct output control from the visual perception input of the environment to the action through end-to-end learning. The simulation results show that this approach is capable of meeting the demands of multi-task intelligent perception and decision making. It also more effectively addresses issues with traditional algorithms, including their tendency to fall into local optimums, oscillate in groups of similar obstacles without recognizing the path, oscillate in tight spaces and inaccessible targets close to obstacles and significantly enhance real-time and adaptability of robot trajectory tracking and dynamic obstacle avoidance.