Vallati, Mauro and Vaquero, Tiago (2015) Towards a Protocol for Benchmark Selection in IPC. In: Workshop on the International Planning Competition, 8th June 2015, Jerusalem, Israel. (Unpublished)
The planning competition has traditionally played an
important role in motivating research and advances in
Planning & Scheduling techniques. Despite its pivotal
role in the planning community, some aspects of the
competition have not been engineered yet. This is the
case for the protocol for selecting benchmark instances.
Benchmarks are of critical importance, since they can
significantly affect competition results.
In this paper we describe desirable properties of a selection
protocol, discuss methods exploited in past SAT
and planning competitions, and identify challenges that
organisers of future competitions have to address in order
to improve reliability and usefulness of the insights
gained by looking at competitions’ results.
|Item Type:||Conference or Workshop Item (Paper)|
|Subjects:||Q Science > QA Mathematics > QA76 Computer software|
|Schools:||School of Computing and Engineering > High-Performance Intelligent Computing > Planning, Autonomy and Representation of Knowledge
School of Computing and Engineering > High-Performance Intelligent Computing > Planning, Autonomy and Representation of Knowledge
|Depositing User:||Mauro Vallati|
|Date Deposited:||28 Apr 2015 15:15|
|Last Modified:||24 Mar 2016 11:37|
Downloads per month over past year
Repository Staff Only: item control page