Adaptively Finding Optimal Routes under Principles of Spatial Cognition-A Hierarchical Reinforcement Learning Approach
- 10.2991/icaita-16.2016.56How to use a DOI?
- spatial cognition; route selection; hierarchical reinforcement learning; pre-learning; real-time learning
Way finding research has paid much attention to the selection of optimal routes under principles of spatial cognition. However, the commonly employed implemental approaches suffer inevitably from the contradictions between personalized network modelling and network data sharing. This paper presents one kind of interactive route selection approach based on hierarchical reinforcement learning. In this approach, a complete network model is unnecessary, but the environmental states are automatically perceived by the agent and then mapped into the reward function defining the goal of cognitively optimal routes. The optimal routes corresponding to the policies with maximal cumulative rewards can be found through a two-stage learning process including a pre-learning stage and a real-time learning one. Our experimental results show that the proposed approach learns effectively enough for real-time route selection and ensures found routes close to global optimal ones.
- © 2016, the Authors. Published by Atlantis Press.
- Open Access
- This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).
Cite this article
TY - CONF AU - Weifeng Zhao AU - Qin Zhang PY - 2016/01 DA - 2016/01 TI - Adaptively Finding Optimal Routes under Principles of Spatial Cognition-A Hierarchical Reinforcement Learning Approach BT - Proceedings of the 2016 International Conference on Artificial Intelligence: Technologies and Applications PB - Atlantis Press SP - 227 EP - 230 SN - 1951-6851 UR - https://doi.org/10.2991/icaita-16.2016.56 DO - 10.2991/icaita-16.2016.56 ID - Zhao2016/01 ER -