Competition Artifacts (DOIs)
For reproducibility, it is important to store snapshots of the used components in a long-term archive.
Edition | Test-Suite Generators | Test-Generation Tasks | Competition Results | Test Suites (Coverage Witnesses) | BenchExec | CoVeriTeam |
2023 | 10. 5281/ zenodo. 7701118 | 10. 5281/ zenodo. 7627783 | 10. 5281/ zenodo. 7701122 | 10. 5281/ zenodo. 7701126 | 10. 5281/ zenodo. 7612021 | 10. 5281/ zenodo. 7635975 |
Competition Repositories
For reproducibility, it is important to make all used components publicly available.
Repository Locations
Component | Repository |
Test-Generation Tasks | https://gitlab.com/sosy-lab/benchmarking/sv-benchmarks |
Benchmark Definitions | https://gitlab.com/sosy-lab/test-comp/bench-defs |
BenchExec | https://github.com/sosy-lab/benchexec |
Tool-Info Modules | https://github.com/sosy-lab/benchexec/tree/main/benchexec/tools |
Test Format | https://gitlab.com/sosy-lab/test-comp/test-format |
CoVeriTeam | https://gitlab.com/sosy-lab/software/coveriteam |
Tool Archives 2023 | https://gitlab.com/sosy-lab/test-comp/archives-2023 |
Tool Archives 2022 | https://gitlab.com/sosy-lab/test-comp/archives-2022 |
Tool Archives 2021 | https://gitlab.com/sosy-lab/test-comp/archives-2021 |
Tool Archives 2020 | https://gitlab.com/sosy-lab/test-comp/archives-2020 |
Tool Archives 2019 | https://gitlab.com/sosy-lab/test-comp/archives-2019 |
Repository Tags
Edition | Test-Suite Generators | Test-Generation Tasks | Benchmark Definitions | BenchExec | Tool-Info Modules | Test Format | CoVeriTeam |
2023 | testcomp23 | testcomp23 | testcomp23 | 3.16 | 3.16 | testcomp23 | 1.0 |