Task filter
CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Add filter for:
Benchmark Setup
Benchmark | CPA/CoVeriTest | FuSeBMC | FuSeBMC_IA | HybridTiger | KLEE | Legion | Legion/SymCC | PRtest | Symbiotic | Tracer-X | VeriFuzz | WASP-C | ||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Tool | CPAchecker 2.1.2-svn-41925 | FuSeBMC v.4.2.1 | FuSeBMC v.5.0.1 | CPAchecker 1.9.2-svn-35606M | KLEE 2.2-pre-test-comp | Legion 1.0-testcomp2021 | Legion/SymCC testcomp2023 | PRTest v2.3 | symbiotic 9.0.0-dev-b34dd3a1 | Tracer-X 1.2.0 | VeriFuzz 1.2.11 | WASP-C version 0.1 | ||||||||||||||||||||||||||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Host | apollon* | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
OS | Linux 5.15.0-56-generic | Linux 5.15.0-60-generic | Linux 5.15.0-56-generic | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33480 MB | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Date of execution | 2022-12-20 15:58:25 CET | 2022-12-20 14:35:10 CET | 2022-12-20 14:32:46 CET | 2022-12-20 14:55:20 CET | 2023-02-09 12:02:40 CET | 2023-02-10 12:16:37 CET | 2022-12-21 10:08:19 CET | 2022-12-21 19:07:52 CET | 2022-12-21 18:27:28 CET | 2022-12-22 00:18:16 CET | 2022-12-21 23:42:42 CET | 2022-12-22 03:17:26 CET | ||||||||||||||||||||||||||||||||||||||||||||||||
Run set | coveritest.Test-Comp23_coverage-branches.ReachSafety-BitVectors | FuSeBMC.Test-Comp23_coverage-branches.ReachSafety-BitVectors | FuSeBMC_IA.Test-Comp23_coverage-branches.ReachSafety-BitVectors | hybridtiger.Test-Comp23_coverage-branches.ReachSafety-BitVectors | klee.Test-Comp23_coverage-branches.ReachSafety-BitVectors | legion.Test-Comp23_coverage-branches.ReachSafety-BitVectors | legion-symcc.Test-Comp23_coverage-branches.ReachSafety-BitVectors | prtest.Test-Comp23_coverage-branches.ReachSafety-BitVectors | symbiotic.Test-Comp23_coverage-branches.ReachSafety-BitVectors | tracerx.Test-Comp23_coverage-branches.ReachSafety-BitVectors | verifuzz.Test-Comp23_coverage-branches.ReachSafety-BitVectors | wasp-c.Test-Comp23_coverage-branches.ReachSafety-BitVectors | ||||||||||||||||||||||||||||||||||||||||||||||||
Options |
|
|
|
|
|
|
|
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||
Properties | coverage-branches |
Statistics
CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-branches.ReachSafety-BitVectors
FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-branches.ReachSafety-BitVectors
FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-branches.ReachSafety-BitVectors
CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-branches.ReachSafety-BitVectors
KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-branches.ReachSafety-BitVectors
PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-branches.ReachSafety-BitVectors
symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-branches.ReachSafety-BitVectors
VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-branches.ReachSafety-BitVectors
WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-branches.ReachSafety-BitVectors
Click here to select columns
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
all results
61
48.1
20000
180000
230000
61
48.5
55000
8400
690000
61
41.7
28000
8900
360000
61
16.1
7400
94000
81000
61
31.2
22000
22000
270000
61
33.2
51000
350000
460000
61
43.5
40000
480000
540000
61
32.6
54000
1800
750000
61
48.4
36000
38000
380000
61
48.0
33000
100000
410000
61
45.0
55000
22000
680000
61
34.2
29000
97000
340000
correct results
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
54
10.1
2800
90000
29000
11
6.27
920
670
13000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
9
7.84
1900
9000
27000
0
-
-
-
-
0
-
-
-
-
correct true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
54
10.1
2800
90000
29000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
correct false
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
11
6.27
920
670
13000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
9
7.84
1900
9000
27000
0
-
-
-
-
0
-
-
-
-
incorrect results
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect false
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
Generated by BenchExec 3.17-dev