Task filter
CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
ESBMC 2022-12-20 14:32:31 CET esbmc-kind.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Add filter for:
Benchmark Setup
Benchmark | CPA/CoVeriTest | ESBMC-bkind | FuSeBMC | FuSeBMC_IA | HybridTiger | KLEE | Legion | Legion/SymCC | PRtest | Symbiotic | Tracer-X | VeriFuzz | WASP-C | ||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Tool | CPAchecker 2.1.2-svn-41925 | ESBMC version 7.0.0 64-bit x86_64 linux | FuSeBMC v.4.2.1 | FuSeBMC v.5.0.1 | CPAchecker 1.9.2-svn-35606M | KLEE 2.2-pre-test-comp | Legion 1.0-testcomp2021 | Legion/SymCC testcomp2023 | PRTest v2.3 | symbiotic 9.0.0-dev-b34dd3a1 | Tracer-X 1.2.0 | VeriFuzz 1.2.11 | WASP-C version 0.1 | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Host | apollon* | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
OS | Linux 5.15.0-56-generic | Linux 5.15.0-60-generic | Linux 5.15.0-56-generic | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33480 MB | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Date of execution | 2022-12-20 15:58:25 CET | 2022-12-20 14:32:31 CET | 2022-12-20 14:35:10 CET | 2022-12-20 14:32:46 CET | 2022-12-20 14:55:20 CET | 2023-02-09 12:02:40 CET | 2023-02-10 12:16:37 CET | 2022-12-21 10:08:19 CET | 2022-12-21 19:07:52 CET | 2022-12-21 18:27:28 CET | 2022-12-22 00:18:16 CET | 2022-12-21 23:42:42 CET | 2022-12-22 03:17:26 CET | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Run set | coveritest.Test-Comp23_coverage-error-call.ReachSafety-XCSP | esbmc-kind.Test-Comp23_coverage-error-call.ReachSafety-XCSP | FuSeBMC.Test-Comp23_coverage-error-call.ReachSafety-XCSP | FuSeBMC_IA.Test-Comp23_coverage-error-call.ReachSafety-XCSP | hybridtiger.Test-Comp23_coverage-error-call.ReachSafety-XCSP | klee.Test-Comp23_coverage-error-call.ReachSafety-XCSP | legion.Test-Comp23_coverage-error-call.ReachSafety-XCSP | legion-symcc.Test-Comp23_coverage-error-call.ReachSafety-XCSP | prtest.Test-Comp23_coverage-error-call.ReachSafety-XCSP | symbiotic.Test-Comp23_coverage-error-call.ReachSafety-XCSP | tracerx.Test-Comp23_coverage-error-call.ReachSafety-XCSP | verifuzz.Test-Comp23_coverage-error-call.ReachSafety-XCSP | wasp-c.Test-Comp23_coverage-error-call.ReachSafety-XCSP | ||||||||||||||||||||||||||||||||||||||||||||||||||||
Options |
|
|
|
|
|
|
|
|
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||
Properties | coverage-error-call |
Statistics
CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-error-call.ReachSafety-XCSP
ESBMC 2022-12-20 14:32:31 CET esbmc-kind.Test-Comp23_coverage-error-call.ReachSafety-XCSP
FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-error-call.ReachSafety-XCSP
FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-error-call.ReachSafety-XCSP
CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-error-call.ReachSafety-XCSP
KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-error-call.ReachSafety-XCSP
PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-error-call.ReachSafety-XCSP
symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-error-call.ReachSafety-XCSP
VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-error-call.ReachSafety-XCSP
WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-error-call.ReachSafety-XCSP
Click here to select columns
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
status
raw score
cpu
(s)
(s)
mem
(MB)
(MB)
energy
(J)
(J)
all results
54
45
10000
64000
81000
54
49
6100
4100
84000
54
47
7500
4500
100000
54
47
7300
4700
95000
54
47
29000
79000
330000
54
32
3800
3700
50000
54
49000
8400
360000
54
140
11000
1800
54
49000
1800
570000
54
16
41000
23000
350000
54
5.7
730
57
54
49
5600
9500
72000
54
49
6200
5200
90000
correct results
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
24
24
1600
27000
17000
32
32
2500
2500
33000
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
correct true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
24
24
1600
27000
17000
0
-
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
correct false
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
32
32
2500
2500
33000
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect results
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
incorrect false
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
Generated by BenchExec 3.17-dev