Benchmark Test Tasks
All test tasks are available for web browsing and for download via the following Git repository (for Test-Comp 2025 visit the tag 'testcomp25'): https://gitlab.com/sosy-lab/benchmarking/sv-benchmarks
This edition of the competition on software testing is based on the following categories of test tasks. The test tasks are taken from the most diverse and publicly available repository of tasks, which were collected and contributed by the community on software verification.
For illustration, the structured overview
from the competition report shows the categories.
The authorative definition of the category structure (from which this web page is generated) is maintained in the repository for the benchmark definitions (https://gitlab.com/sosy-lab/test-comp/bench-defs).
1. Cover-Error
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
coverage-error-call
The verification tasks consist of the programs that match
with the specification:
2. Cover-Branches
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
coverage-branches
The verification tasks consist of the programs that match
with the specification:
3. Overall
- Cover-Error
- Cover-Branches