A study on multi-agent reinforcement learning problem based on hierarchical modular fuzzy model

Abstract

Reinforcement learning is a promising approach to realize intelligent agent such as autonomous mobile robots. In order to apply the reinforcement learning to actual sized problem, the ldquocurse of dimensionalityrdquo problem in partition of sensory states should be avoided maintaining computational efficiency. The paper describes a hierarchical modular reinforcement learning that profit sharing learning algorithm is combined with Q-learning reinforcement learning algorithm hierarchically in multi-agent pursuit environment. As the model structure for such huge problem, I propose a modular fuzzy model extending SIRMs architecture. Through numerical experiments, I found that the proposed method has good convergence property of learning compared with the conventional algorithms.