RulesThese are the official rules for SAT-Race 2008 (version 1.1, last updated on 03/04/2008).
An entrant to the SAT-Race 2008 is a SAT solver submitted in either source code or binary format using the Web registration form. Binary format submissions must be compatible with the competition hardware and operating system. Each SAT-Race 2008 entrant must include a README file explaining how to (compile and) install the solver. Installation and execution of solvers must not require root access. Binaries should be statically linked. The organizers will make reasonable efforts to install each system, including communication with the submitters of the system in case of difficulties. Nevertheless, the organizers reserve the right to reject an entrant if its compilation or installation process proves overly difficult. In order to obtain reproducible results, SAT solvers should refrain from using non-deterministic program constructs as far as possible.
Note for Track 1 (parallel track): For many parallel solver implementations it is very hard to achieve reproducable runtimes. Therefore, this requirement does not apply to the parallel track.
Each entrant to the SAT-Race 2008 must include a short (1-2 pages) description of the system. This should include a list of all authors of the system and their present institutional affiliations. It should also describe any algorithms or data structures that are not standardly used in such systems. System descriptions will be posted on the SAT-Race 2008 website.
In contrast to former SAT Competitions, it is not required to make source code or binaries publicly available after SAT-Race 2008.
Submitters are encouraged to be physically present at the SAT'08 conference, but are not required to be so to participate or win.
The input and output format requirements are the same as those used for the SAT Competitions for solvers of the Main Track and Special Track 1 (CNF-based solvers). For Special Track 2 (AIG-based solvers), adherence to the AIG format specification is mandatory; however, no “witness” is required for the solution in case of a satisfiable instance.
The benchmarks for SAT-Race 2008 (as well as for the qualification rounds) will be selected randomly out of a pool of SAT instances. This pool mainly consists of instances from the industrial category of previous SAT Competitions, but may also contain a smaller fraction of new instances stemming from applications with industrial relevance.
To obtain benchmarks of suitable difficulty we select only such instances that can be solved by at least one of the participating solvers in a sensible time-frame around the Race's threshold run-time. For the qualification rounds no such restriction applies.
Solvers will be assessed based on a score that takes into account (1) the number of instances solved within the run- time limit and (2) the total time needed to solve all instances.
The exact assessment scheme is as follows: