Path Planning for the Robotic Manipulator in Dynamic Environments Based on a Deep Reinforcement Learning Method
Document Type
Article
Publication Date
12-1-2024
Abstract
Collaborative and autonomous robots are increasingly important in meeting the demands of a faster and more cost-effective market. To ensure production efficiency and safety, robots must swiftly respond to the presence of human operators or other dynamic obstacles, avoiding potential collisions by quickly planning alternative paths. Deep Reinforcement Learning (DRL) based methods have shown great potential in path planning due to their rapid response capabilities. However, existing DRL-based planners lack a safety verification system to evaluate the feasibility of actions generated by neural models, and they cannot guarantee 100% collision-free paths. This paper presents an enhanced DRL-based path planning system incorporating a robust safety verification mechanism. This system predicts potential collisions and generates alternative collision-free paths as necessary. We analyzed the essential elements of trajectory planning using the DRL method and proposed improvements to accelerate planning speed. The results demonstrate that our planner consistently generates paths for typical reaching tasks with an average planning time of 12.1 ms, a notable improvement over traditional algorithms. Moreover, the paths produced by our method are nearly optimal, akin to those generated by Optimization-based algorithms.
Keywords
Path planning, Manipulator, Dynamic environment, Twin delayed DDPG (TD3), Deep reinforcement learning
Divisions
sch_ecs,mechanical
Funders
Ministry of Higher Edu-cation for the Fundamental Research Grant Scheme (FRGS/1/2022/TK10/UM/02/7),Application Innovation Project of Hebei Vocational University of Technology and Engineering (202205)
Publication Title
Journal of Intelligent & Robotic Systems
Volume
111
Issue
1
Publisher
Springer
Publisher Location
VAN GODEWIJCKSTRAAT 30, 3311 GZ DORDRECHT, NETHERLANDS