Task filter


CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

ESBMC 2022-12-20 14:32:31 CET esbmc-kind.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-error-call.ReachSafety-Arrays

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCPA/CoVeriTestESBMC-bkindFuSeBMCFuSeBMC_IAHybridTigerKLEELegionLegion/SymCCPRtestSymbioticTracer-XVeriFuzzWASP-C
ToolCPAchecker 2.1.2-svn-41925ESBMC version 7.0.0 64-bit x86_64 linuxFuSeBMC v.4.2.1FuSeBMC v.5.0.1CPAchecker 1.9.2-svn-35606MKLEE 2.2-pre-test-compLegion 1.0-testcomp2021Legion/SymCC testcomp2023PRTest v2.3symbiotic 9.0.0-dev-b34dd3a1Tracer-X 1.2.0VeriFuzz 1.2.11WASP-C version 0.1
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
Hostapollon*
OSLinux 5.15.0-56-genericLinux 5.15.0-60-genericLinux 5.15.0-56-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33480 MB
Date of execution2022-12-20 15:58:25 CET2022-12-20 14:32:31 CET2022-12-20 14:35:10 CET2022-12-20 14:32:46 CET2022-12-20 14:55:20 CET2023-02-09 12:02:40 CET2023-02-10 12:16:37 CET2022-12-21 10:08:19 CET2022-12-21 19:07:52 CET2022-12-21 18:27:28 CET2022-12-22 00:18:16 CET2022-12-21 23:42:42 CET2022-12-22 03:17:26 CET
Run setcoveritest.Test-Comp23_coverage-error-call.ReachSafety-Arraysesbmc-kind.Test-Comp23_coverage-error-call.ReachSafety-ArraysFuSeBMC.Test-Comp23_coverage-error-call.ReachSafety-ArraysFuSeBMC_IA.Test-Comp23_coverage-error-call.ReachSafety-Arrayshybridtiger.Test-Comp23_coverage-error-call.ReachSafety-Arraysklee.Test-Comp23_coverage-error-call.ReachSafety-Arrayslegion.Test-Comp23_coverage-error-call.ReachSafety-Arrayslegion-symcc.Test-Comp23_coverage-error-call.ReachSafety-Arraysprtest.Test-Comp23_coverage-error-call.ReachSafety-Arrayssymbiotic.Test-Comp23_coverage-error-call.ReachSafety-Arraystracerx.Test-Comp23_coverage-error-call.ReachSafety-Arraysverifuzz.Test-Comp23_coverage-error-call.ReachSafety-Arrayswasp-c.Test-Comp23_coverage-error-call.ReachSafety-Arrays
Options
  • -benchmark
  • -heap 10000M
  • -testcomp23
  • -setprop log.consoleLevel=SEVERE
  • -s kinduction
  • -s incr
  • -s incr
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • -a True
  • -q
  • -b ./binary
  • -e
  • --test-comp
  • --testcomp
  • --smt-assume
  • --policy breadth
  • --test-comp
Propertiescoverage-error-call

Statistics

CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-error-call.ReachSafety-Arrays
ESBMC 2022-12-20 14:32:31 CET esbmc-kind.Test-Comp23_coverage-error-call.ReachSafety-Arrays
FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-error-call.ReachSafety-Arrays
FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-error-call.ReachSafety-Arrays
CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-error-call.ReachSafety-Arrays
KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-error-call.ReachSafety-Arrays
Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-error-call.ReachSafety-Arrays
Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-error-call.ReachSafety-Arrays
PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-error-call.ReachSafety-Arrays
symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-error-call.ReachSafety-Arrays
Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-error-call.ReachSafety-Arrays
VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-error-call.ReachSafety-Arrays
WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-error-call.ReachSafety-Arrays
Click here to select columns
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
all results
90
71
29000
130000
380000
90
5
26000
1200000
240000
90
90
15000
140000
200000
90
88
15000
25000
190000
90
67
60000
86000
760000
90
85
2000
47000
27000
90
67
80000
260000
870000
90
19
15000
20000
220000
90
36
19000
130000
270000
90
72
16000
22000
130000
90
7.8
1000
72
90
88
620
60000
6800
90
78
4800
28000
56000
    correct results
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
28
28
5200
19000
63000
85
85
110
5100
1100
0
-
-
-
-
19
19
17
2400
220
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
28
28
5200
19000
63000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct false
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
85
85
110
5100
1100
0
-
-
-
-
19
19
17
2400
220
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
    incorrect results
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-

Generated by BenchExec 3.17-dev