Competition Artifacts (DOIs)

For reproducibility, it is important to store snapshots of the used components in a long-term archive.

Edition Test-Suite Generators Test-Generation Tasks Competition Results Test Suites (Coverage Witnesses) BenchExec CoVeriTeam
2023 10. 5281/ zenodo. 7701118 10. 5281/ zenodo. 7627783 10. 5281/ zenodo. 7701122 10. 5281/ zenodo. 7701126 10. 5281/ zenodo. 7612021 10. 5281/ zenodo. 7635975

Competition Repositories

For reproducibility, it is important to make all used components publicly available.

Repository Locations

Component Repository
Test-Generation Tasks https://gitlab.com/sosy-lab/benchmarking/sv-benchmarks
Benchmark Definitions https://gitlab.com/sosy-lab/test-comp/bench-defs
BenchExec https://github.com/sosy-lab/benchexec
Tool-Info Modules https://github.com/sosy-lab/benchexec/tree/main/benchexec/tools
Test Format https://gitlab.com/sosy-lab/test-comp/test-format
CoVeriTeam https://gitlab.com/sosy-lab/software/coveriteam
Tool Archives 2023 https://gitlab.com/sosy-lab/test-comp/archives-2023
Tool Archives 2022 https://gitlab.com/sosy-lab/test-comp/archives-2022
Tool Archives 2021 https://gitlab.com/sosy-lab/test-comp/archives-2021
Tool Archives 2020 https://gitlab.com/sosy-lab/test-comp/archives-2020
Tool Archives 2019 https://gitlab.com/sosy-lab/test-comp/archives-2019

Repository Tags

Edition Test-Suite Generators Test-Generation Tasks Benchmark Definitions BenchExec Tool-Info Modules Test Format CoVeriTeam
2023 testcomp23 testcomp23 testcomp23 3.16 3.16 testcomp23 1.0