Reproducing Test-Comp Results

A description on how we make the results of the competition reproducible can be found in the competition report; the components that are listed below in the table are described in Sect. 4 "Reproducibility".

Here is the list of components that were used for Test-Comp 2020:

Component Repository Release Tag
Tester Archives git@gitlab.com:sosy-lab/test-comp/archives-2020.git testcomp20
Test Tasks git@github.com:sosy-lab/sv-benchmarks.git testcomp20
Benchmark Definitions git@gitlab.com:sosy-lab/test-comp/bench-defs.git testcomp20
BenchExec git@github.com:sosy-lab/benchexec.git 2.5.1

Participating Systems

Tool Lang. Jury member Affiliation Archive Bechmark definition System description
Overview Dirk Beyer LMU Munich
CoVeriTest C Marie-Christine Jakobs TU Darmstadt, Germany Download coveritest.xml ...
ESBMC C Lucas Cordeiro University of Manchester, UK Download esbmc-falsi.xml ...
HybridTiger C Sebastian Ruland TU Darmstadt, Germany Download hybridtiger.xml ...
KLEE C Martin Nowack Imperial College London, UK Download klee.xml ...
Legion C Gidon Ernst LMU Munich, Germany Download legion.xml ...
LibKluzzer C Hoang M. Le University of Bremen, Germany Download libkluzzer.xml ...
PRTest C Thomas Lemberger LMU Munich, Germany Download prtest.xml ...
Symbiotic C Marek Chalupa Masaryk University, Germany Download symbiotic.xml ...
Tracer-X C Joxan Jaffar National University of Singapore, Singapore Download tracerx.xml ...
VeriFuzz C Raveendra Kumar Medicherla Tata Consultancy Service, India Download verifuzz.xml ...

Validators

Validator Contact Affiliation Archive Benchmark definition
TestVal Test-Suite Validator Thomas Lemberger LMU Munich, Germany Download testcov-validate-test-suites.xml