Search:
Computing and Library Services - delivering an inspiring information environment

Real-Time Path Planning using a Simulation-Based Markov Decision Process

Naveed, Munir, Crampton, Andrew, Kitchin, Diane E. and McCluskey, T.L. (2011) Real-Time Path Planning using a Simulation-Based Markov Decision Process. Research and Development in Intelligent Systems XXVIII Research and Development in Intelligent Systems XXVIII . Springer, London. ISBN 978-1-4471-2317-0

[img]
Preview
PDF
paper274.pdf - Accepted Version

Download (261kB) | Preview

Abstract

This paper introduces a novel path planning technique called MCRT which is aimed at non-deterministic, partially known, real-time domains populated with dynamically moving obstacles, such as might be found in a real-time strategy (RTS) game. The technique combines an efficient form of Monte-Carlo tree search with the randomized exploration capabilities of rapidly exploring random tree (RRT) planning. The main innovation of MCRT is in incrementally building an RRT structure with a collision-sensitive reward function, and then re-using it to efficiently solve multiple, sequential goals. We have implemented the technique in MCRT-planner, a program which solves non-deterministic path planning problems in imperfect information RTS games, and evaluated it in comparison to four other state of the art techniques. Planners embedding each technique were applied to a typical RTS game and evaluated using the game score and the planning cost. The empirical evidence demonstrates the success of MCRT-planner.

Item Type: Book
Additional Information: Research and Development in Intelligent Systems XXVIII Research and Development in Intelligent Systems XXVIII Incorporating Applications and Innovations in Intelligent Systems XIX Proceedings of AI-2011, the Thirty-first SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence
Subjects: Q Science > Q Science (General)
Q Science > QA Mathematics
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Q Science > QA Mathematics > QA76 Computer software
Schools: School of Computing and Engineering
School of Computing and Engineering > High-Performance Intelligent Computing > Planning, Autonomy and Representation of Knowledge
School of Computing and Engineering > High-Performance Intelligent Computing > Planning, Autonomy and Representation of Knowledge
Related URLs:
Depositing User: Munir Naveed
Date Deposited: 11 Aug 2011 10:20
Last Modified: 10 Aug 2012 12:39
URI: http://eprints.hud.ac.uk/id/eprint/11200

Downloads

Downloads per month over past year

Repository Staff Only: item control page

View Item View Item

University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©