Task filter
FuSeBMC 2020-12-12 23:21:24 CET FuSeBMC.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
CMA-ES Fuzz 2020-12-13 03:33:00 CET cmaesfuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
CoVeriTest 2020-12-12 23:21:46 CET coveritest.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
CPAchecker 2020-12-13 11:24:40 CET hybridtiger.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
KLEE 2020-12-13 07:36:55 CET klee.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
Legion 2020-12-13 15:46:08 CET legion.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
LibKluzzer 2020-12-13 15:28:01 CET libkluzzer.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
PRTest 2020-12-12 23:14:55 CET prtest.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
symbiotic 2020-12-13 12:43:53 CET symbiotic.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
Tracer-X 2020-12-14 20:56:36 CET tracerx.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
VeriFuzz 2020-12-13 18:29:59 CET verifuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Add filter for:
Benchmark Setup
Benchmark | FuSeBMC | CMA-ES Fuzz | CPA/CoVeriTest | HybridTiger | KLEE | Legion | LibKluzzer | PRtest | Symbiotic | Tracer-X | VeriFuzz | ||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Tool | FuSeBMC v.3.6.6 | CMA-ES Fuzz | CoVeriTest 2.0.1-svn-eda176372c+ | CPAchecker 1.9.2-svn-35606M | KLEE 2.2-pre-test-comp | Legion | LibKluzzer 1.0 | PRTest v2.2 | symbiotic 8.0.0-pre-49dd01a3 | Tracer-X 1.2.0 | VeriFuzz 1.1.0 | ||||||||||||||||||||||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1 | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Host | apollon* | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
OS | Linux 5.4.0-56-generic | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33493 MB | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
Date of execution | 2020-12-12 23:21:24 CET | 2020-12-13 03:33:00 CET | 2020-12-12 23:21:46 CET | 2020-12-13 11:24:40 CET | 2020-12-13 07:36:55 CET | 2020-12-13 15:46:08 CET | 2020-12-13 15:28:01 CET | 2020-12-12 23:14:55 CET | 2020-12-13 12:43:53 CET | 2020-12-14 20:56:36 CET | 2020-12-13 18:29:59 CET | ||||||||||||||||||||||||||||||||||||||||||||
Run set | FuSeBMC.Test-Comp21_coverage-branches.ReachSafety-BitVectors | cmaesfuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors | coveritest.Test-Comp21_coverage-branches.ReachSafety-BitVectors | hybridtiger.Test-Comp21_coverage-branches.ReachSafety-BitVectors | klee.Test-Comp21_coverage-branches.ReachSafety-BitVectors | legion.Test-Comp21_coverage-branches.ReachSafety-BitVectors | libkluzzer.Test-Comp21_coverage-branches.ReachSafety-BitVectors | prtest.Test-Comp21_coverage-branches.ReachSafety-BitVectors | symbiotic.Test-Comp21_coverage-branches.ReachSafety-BitVectors | tracerx.Test-Comp21_coverage-branches.ReachSafety-BitVectors | verifuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors | ||||||||||||||||||||||||||||||||||||||||||||
Options |
|
|
|
|
|
|
| ||||||||||||||||||||||||||||||||||||||||||||||||
Properties | coverage-branches |
Statistics
FuSeBMC 2020-12-12 23:21:24 CET FuSeBMC.Test-Comp21_coverage-branches.ReachSafety-BitVectors
CMA-ES Fuzz 2020-12-13 03:33:00 CET cmaesfuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors
CoVeriTest 2020-12-12 23:21:46 CET coveritest.Test-Comp21_coverage-branches.ReachSafety-BitVectors
CPAchecker 2020-12-13 11:24:40 CET hybridtiger.Test-Comp21_coverage-branches.ReachSafety-BitVectors
KLEE 2020-12-13 07:36:55 CET klee.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Legion 2020-12-13 15:46:08 CET legion.Test-Comp21_coverage-branches.ReachSafety-BitVectors
LibKluzzer 2020-12-13 15:28:01 CET libkluzzer.Test-Comp21_coverage-branches.ReachSafety-BitVectors
PRTest 2020-12-12 23:14:55 CET prtest.Test-Comp21_coverage-branches.ReachSafety-BitVectors
symbiotic 2020-12-13 12:43:53 CET symbiotic.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Tracer-X 2020-12-14 20:56:36 CET tracerx.Test-Comp21_coverage-branches.ReachSafety-BitVectors
VeriFuzz 2020-12-13 18:29:59 CET verifuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Click here to select columns
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
total
62
37.0
20000
100000
220000
62
22.7
35000
4000
62
39.1
24000
240000
250000
62
13.0
7700
96000
85000
62
27.9
24000
21000
310000
62
28.5
44000
400000
370000
62
39.6
56000
130000
610000
62
26.9
55000
1500
780000
62
37.1
36000
46000
390000
62
37.2
31000
96000
390000
62
38.0
56000
19000
700000
correct results
0
-
-
-
-
0
-
-
-
0
-
-
-
-
55
7.92
3200
93000
32000
10
5.08
980
650
14000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
8
6.14
1200
5900
14000
0
-
-
-
-
correct true
0
-
-
-
-
0
-
-
-
0
-
-
-
-
55
7.92
3200
93000
32000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
correct false
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
10
5.08
980
650
14000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
8
6.14
1200
5900
14000
0
-
-
-
-
incorrect results
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect true
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect false
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
Loading...
Generated by BenchExec 3.6