Search:
Computing and Library Services - delivering an inspiring information environment

Real-Time Path Planning using a Simulation-Based Markov Decision Process

Naveed, Munir, Crampton, Andrew, Kitchin, Diane E. and McCluskey, T.L. (2011) Real-Time Path Planning using a Simulation-Based Markov Decision Process. Research and Development in Intelligent Systems XXVIII Research and Development in Intelligent Systems XXVIII . Springer, London. ISBN 978-1-4471-2317-0

[img]
Preview
PDF - Accepted Version
Download (255kB) | Preview

    Abstract

    This paper introduces a novel path planning technique called MCRT which is aimed at non-deterministic, partially known, real-time domains populated with dynamically moving obstacles, such as might be found in a real-time strategy (RTS) game. The technique combines an efficient form of Monte-Carlo tree search with the randomized exploration capabilities of rapidly exploring random tree (RRT) planning. The main innovation of MCRT is in incrementally building an RRT structure with a collision-sensitive reward function, and then re-using it to efficiently solve multiple, sequential goals. We have implemented the technique in MCRT-planner, a program which solves non-deterministic path planning problems in imperfect information RTS games, and evaluated it in comparison to four other state of the art techniques. Planners embedding each technique were applied to a typical RTS game and evaluated using the game score and the planning cost. The empirical evidence demonstrates the success of MCRT-planner.

    Item Type: Book
    Additional Information: Research and Development in Intelligent Systems XXVIII Research and Development in Intelligent Systems XXVIII Incorporating Applications and Innovations in Intelligent Systems XIX Proceedings of AI-2011, the Thirty-first SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence
    Subjects: Q Science > Q Science (General)
    Q Science > QA Mathematics
    Q Science > QA Mathematics > QA75 Electronic computers. Computer science
    Q Science > QA Mathematics > QA76 Computer software
    Schools: School of Computing and Engineering
    School of Computing and Engineering > Informatics Research Group > Knowledge Engineering and Intelligent Interfaces
    Related URLs:
    Depositing User: Munir Naveed
    Date Deposited: 11 Aug 2011 11:20
    Last Modified: 10 Aug 2012 13:39
    URI: http://eprints.hud.ac.uk/id/eprint/11200

    Document Downloads

    Downloader Countries

    More statistics for this item...

    Item control for Repository Staff only:

    View Item

    University of Huddersfield, Queensgate, Huddersfield, HD1 3DH Copyright and Disclaimer All rights reserved ©