Task filter
CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Add filter for:
Benchmark Setup
Benchmark | CMA-ES Fuzz | CPA/CoVeriTest | FuSeBMC | HybridTiger | KLEE | Legion | Legion/SymCC | LibKluzzer | PRtest | Symbiotic | Tracer-X | VeriFuzz | ||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Tool | CMA-ES Fuzz | CPAchecker 2.0.1-svn-38826 | FuSeBMC v.4.1.14 | CPAchecker 1.9.2-svn-35606M | KLEE 2.2-pre-test-comp | Legion 1.0-testcomp2021 | Legion/SymCC testcomp2022 | LibKluzzer 1.0 | PRTest v2.2 | symbiotic 9.0.0-dev-71ddb4b1 | Tracer-X 1.2.0 | VeriFuzz 1.2.10 | ||||||||||||||||||||||||||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Host | Unknown | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
OS | Unknown | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
System | Unknown | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Date of execution | 2021-12-15 19:44:24 CET | 2021-12-15 19:57:13 CET | 2021-12-16 03:43:34 CET | 2021-12-16 04:41:54 CET | 2021-12-16 10:08:26 CET | 2021-12-16 15:28:39 CET | 2021-12-16 13:27:02 CET | 2021-12-16 20:24:25 CET | 2021-12-16 23:53:20 CET | 2021-12-17 02:47:56 CET | 2021-12-16 00:12:46 CET | 2021-12-17 07:59:01 CET | ||||||||||||||||||||||||||||||||||||||||||||||||
Run set | cmaesfuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | coveritest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | FuSeBMC.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | hybridtiger.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | klee.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | legion.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | legion-symcc.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | libkluzzer.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | prtest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | symbiotic.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | tracerx.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | verifuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety | ||||||||||||||||||||||||||||||||||||||||||||||||
Options |
|
|
|
|
|
|
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||
Properties | coverage-branches |
Statistics
CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Click here to select columns
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
total
290
13.2
190000
140000
290
59.5
40000
210000
440000
290
59.2
260000
360000
3300000
290
5.76
28000
190000
300000
290
24.7
60000
220000
790000
290
55.6
260000
240000
2300000
290
46.8
260000
210000
3400000
290
57.3
230000
450000
2600000
290
15.9
250000
39000
3600000
290
42.3
240000
660000
2900000
290
56.3
13000
130000
160000
290
57.0
260000
160000
3300000
correct results
0
-
-
-
0
-
-
-
-
0
-
-
-
-
264
4.60
4600
86000
46000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
63
8.92
8500
83000
100000
0
-
-
-
-
correct true
0
-
-
-
0
-
-
-
-
0
-
-
-
-
264
4.60
4600
86000
46000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
correct false
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
63
8.92
8500
83000
100000
0
-
-
-
-
incorrect results
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect true
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect false
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
Generated by BenchExec 3.11-dev