QQ机器人框架源码开源(机器人框架开发)

中文摘要:

针对传统Q-learning算法在复杂环境下移动机器人路径规划问题中容易产生维数灾难的问题，提出一种改进方法。该方法将深度学习融于Q-learning框架中，以网络输出代替Q值表，解决维数灾难问题。通过构建记忆回放矩阵和双层网络结构打断数据相关性，提高算法收敛性。最后，通过栅格法建立仿真环境建模，在不同复杂程度上的地图上进行仿真实验，对比实验验证了传统Q-learning难以在大状态空间下进行路径规划，深度强化学习能够在复杂状态环境下进行良好的路径规划。

英文摘要:

In order to solve the problem that the traditional Q-learning algorithm is proneto dimension disaster in the path planning of mobile robot in complexenvironment,an improved method is proposed.This method integrates deep learninginto the Q-learning framework and replaces the Q-value table with networkoutput to solve the dimensionality disaster problem.In addition,by constructinga memory playback matrix and a two-layer network structure,data correlation isinterrupted to improve the convergence of the algorithm.Finally,the simulationenvironment modeling is established by grid method,and simulation experimentsare carried out on multiple maps with different complexity levels.Thecomparison experiments verify that traditional Q-learning is difficult toperform good path planning in large state space,and deep Q-learning enablesgood path planning in complex state environments.