Reproducing Test-Comp Results

A description on how we make the results of the competition reproducible can be found in the competition report; the components that are listed below in the table are described in Sect. 4 "Reproducibility".

An overview over all components that were uses in the competition can be found on the reproduction page.

Verifiers

Tool Lang. Jury member Affiliation Archive Bechmark definition Publication
Overview Chair Dirk Beyer LMU Munich, Germany
CoVeriTest C Marie-Christine Jakobs TU Darmstadt, Germany coveritest.zip coveritest.xml ...
ESBMC-kind C Rafael Sá Menezes University of Manchester, UK esbmc-kind.zip esbmc-kind.xml ...
FuSeBMC C Kaled Alshmrany University of Manchester / Institute of Public Administration, UK / Saudi Arabia FuSeBMC.zip FuSeBMC.xml ...
FuSeBMC_IA C Mohannad Aldughaim University of Manchester / King Saud University, UK / Saudi Arabia FuSeBMC_IA.zip FuSeBMC_IA.xml ...
HybridTiger C Hors Concours --, -- hybridtiger.zip hybridtiger.xml ...
KLEE C Hors Concours --, -- klee.zip klee.xml ...
Legion C Hors Concours --, -- legion.zip legion.xml ...
Legion/SymCC C Gidon Ernst LMU Munich, Germany legion-symcc.zip legion-symcc.xml ...
PRTest C Thomas Lemberger QAware GmbH, Germany prtest.zip prtest.xml ...
Symbiotic C Marek Trtík Masaryk University, Brno, Czechia symbiotic.zip symbiotic.xml ...
TracerX C Joxan Jaffar National University of Singapore, Singapore tracerx.zip tracerx.xml ...
VeriFuzz C Raveendra Kumar Medicherla Tata Consultancy Services, India verifuzz.zip verifuzz.xml ...
WASP-C C Filipe Marques INESC-ID, Lisbon, Portugal wasp-c.zip wasp-c.xml ...

Validators

Tool Lang. Type Contact Affiliation Bechmark definition Publication
TestCov C testcovvalidate-test-suites Matthias Kettl LMU Munich, Germany testcov-validate-test-suites.xml ...