Task filter
CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
ESBMC 2022-12-20 14:32:31 CET esbmc-kind.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Add filter for:
Benchmark Setup
Benchmark | CPA/CoVeriTest | ESBMC-bkind | FuSeBMC | FuSeBMC_IA | HybridTiger | KLEE | Legion | Legion/SymCC | PRtest | Symbiotic | Tracer-X | VeriFuzz | WASP-C | ||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Tool | CPAchecker 2.1.2-svn-41925 | ESBMC version 7.0.0 64-bit x86_64 linux | FuSeBMC v.4.2.1 | FuSeBMC v.5.0.1 | CPAchecker 1.9.2-svn-35606M | KLEE 2.2-pre-test-comp | Legion 1.0-testcomp2021 | Legion/SymCC testcomp2023 | PRTest v2.3 | symbiotic 9.0.0-dev-b34dd3a1 | Tracer-X 1.2.0 | VeriFuzz 1.2.11 | WASP-C version 0.1 | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Host | apollon* | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
OS | Linux 5.15.0-56-generic | Linux 5.15.0-60-generic | Linux 5.15.0-56-generic | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33480 MB | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Date of execution | 2022-12-20 15:58:25 CET | 2022-12-20 14:32:31 CET | 2022-12-20 14:35:10 CET | 2022-12-20 14:32:46 CET | 2022-12-20 14:55:20 CET | 2023-02-09 12:02:40 CET | 2023-02-10 12:16:37 CET | 2022-12-21 10:08:19 CET | 2022-12-21 19:07:52 CET | 2022-12-21 18:27:28 CET | 2022-12-22 00:18:16 CET | 2022-12-21 23:42:42 CET | 2022-12-22 03:17:26 CET | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Run set | coveritest.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | esbmc-kind.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | FuSeBMC.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | FuSeBMC_IA.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | hybridtiger.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | klee.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | legion.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | legion-symcc.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | prtest.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | symbiotic.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | tracerx.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | verifuzz.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | wasp-c.Test-Comp23_coverage-error-call.ReachSafety-BitVectors | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Options |
|
|
|
|
|
|
|
|
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||
Properties | coverage-error-call |
Statistics
CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
ESBMC 2022-12-20 14:32:31 CET esbmc-kind.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-error-call.ReachSafety-BitVectors
Click here to select columns
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
all results
9
7
1600
35000
18000
9
1700
130000
20000
9
9
880
1000
11000
9
9
880
1000
11000
9
5
2500
27000
29000
9
8
910
430
11000
9
1
6800
64000
53000
9
3
2500
16000
35000
9
5
7200
270
92000
9
7
1000
1000
9200
9
.82
100
7.9
9
9
340
1400
4500
9
7
1300
16000
14000
correct results
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
4
4
520
5700
5600
8
8
5.5
220
71
0
-
-
-
-
3
3
890
470
12000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
correct true
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
4
4
520
5700
5600
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
correct false
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
8
8
5.5
220
71
0
-
-
-
-
3
3
890
470
12000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect results
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect true
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect false
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
Generated by BenchExec 3.17-dev