J4 ›› 2009, Vol. 20 ›› Issue (21): 0-2525.

• 机械科学 •    

模糊神经网络下基于强化学习的自主式地面车辆路径规划研究

王文玺1;肖世德1;孟祥印1;张卫华1,2   

  • 收稿日期:1900-01-01 修回日期:1900-01-01 出版日期:2009-11-10 发布日期:2009-11-10

ALV Path Planning Based on Reinforcement Learning in Fuzzy Neural-networks

Wang Wenxi1;Xiao Shide1;Meng Xiangyin1;Zhang Weihua1,2   

  • Received:1900-01-01 Revised:1900-01-01 Online:2009-11-10 Published:2009-11-10

摘要:

通过引入一种启发式学习算法,部分改进了MAXQ递阶强化学习方法,并结合模糊神经网络开发了一种自主式地面车辆(ALV)全局路径规划Agent。该智能Agent充分融合了人类操作经验和机器学习能力,为强化学习明确了搜索方向,缩减了计算量,具有较强的自适应能力,满足了系统的实时性要求。仿真结果表明:在庞大状态空间和动态变化环境中,全局路径规划Agent能够有效、实时地进行最优行为的策略学习。

关键词: 模糊神经网络;Agent;强化学习;路径规划;自主式地面车辆

Abstract:

By introducing FMQ(frequency maximum Q) heuristic learning algorithm, a hierarchical method of reinforcement learning was improved, through the combination of this method and fuzzy neural-networks, a global path planning Agent was developed. This Agent integrated the human operation experience and the capacity of machine learning, so that it ensured the search direction, reduced the amount of computation, strengthened the adaptive capacity and met the real-time requirements. The simulation results show that the global path planning Agent can find the optimal strategy effective and real-time in the large state space and the dynamic changing environment.

Key words: fuzzy neural-network, Agent, reinforcement learning, path planning, automated land vehicle(ALV)

中图分类号: