Towards a Protocol for Benchmark Selection in IPC

Vallati, Mauro and Vaquero, Tiago (2015) Towards a Protocol for Benchmark Selection in IPC. In: Workshop on the International Planning Competition, 8th June 2015, Jerusalem, Israel. (Unpublished)

PDF Download (102kB)

Abstract

The planning competition has traditionally played an
important role in motivating research and advances in
Planning & Scheduling techniques. Despite its pivotal
role in the planning community, some aspects of the
competition have not been engineered yet. This is the
case for the protocol for selecting benchmark instances.
Benchmarks are of critical importance, since they can
significantly affect competition results.
In this paper we describe desirable properties of a selection
protocol, discuss methods exploited in past SAT
and planning competitions, and identify challenges that
organisers of future competitions have to address in order
to improve reliability and usefulness of the insights
gained by looking at competitions’ results.

Item Type:	Conference or Workshop Item (Paper)
Subjects:	Q Science > QA Mathematics > QA76 Computer software
Schools:	School of Computing and Engineering > High-Performance Intelligent Computing > Planning, Autonomy and Representation of Knowledge School of Computing and Engineering > High-Performance Intelligent Computing > Planning, Autonomy and Representation of Knowledge
Related URLs:	Author Conference
Depositing User:	Mauro Vallati
Date Deposited:	28 Apr 2015 15:15
Last Modified:	04 Dec 2016 05:29
URI:	http://eprints.hud.ac.uk/id/eprint/24293

Downloads

Repository Staff Only: item control page

View Item