Task filter


CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-branches.ReachSafety-Arrays

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCPA/CoVeriTestFuSeBMCFuSeBMC_IAHybridTigerKLEELegionLegion/SymCCPRtestSymbioticTracer-XVeriFuzzWASP-C
ToolCPAchecker 2.1.2-svn-41925FuSeBMC v.4.2.1FuSeBMC v.5.0.1CPAchecker 1.9.2-svn-35606MKLEE 2.2-pre-test-compLegion 1.0-testcomp2021Legion/SymCC testcomp2023PRTest v2.3symbiotic 9.0.0-dev-b34dd3a1Tracer-X 1.2.0VeriFuzz 1.2.11WASP-C version 0.1
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
Hostapollon*
OSLinux 5.15.0-56-genericLinux 5.15.0-60-genericLinux 5.15.0-56-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33480 MB
Date of execution2022-12-20 15:58:25 CET2022-12-20 14:35:10 CET2022-12-20 14:32:46 CET2022-12-20 14:55:20 CET2023-02-09 12:02:40 CET2023-02-10 12:16:37 CET2022-12-21 10:08:19 CET2022-12-21 19:07:52 CET2022-12-21 18:27:28 CET2022-12-22 00:18:16 CET2022-12-21 23:42:42 CET2022-12-22 03:17:26 CET
Run setcoveritest.Test-Comp23_coverage-branches.ReachSafety-ArraysFuSeBMC.Test-Comp23_coverage-branches.ReachSafety-ArraysFuSeBMC_IA.Test-Comp23_coverage-branches.ReachSafety-Arrayshybridtiger.Test-Comp23_coverage-branches.ReachSafety-Arraysklee.Test-Comp23_coverage-branches.ReachSafety-Arrayslegion.Test-Comp23_coverage-branches.ReachSafety-Arrayslegion-symcc.Test-Comp23_coverage-branches.ReachSafety-Arraysprtest.Test-Comp23_coverage-branches.ReachSafety-Arrayssymbiotic.Test-Comp23_coverage-branches.ReachSafety-Arraystracerx.Test-Comp23_coverage-branches.ReachSafety-Arraysverifuzz.Test-Comp23_coverage-branches.ReachSafety-Arrayswasp-c.Test-Comp23_coverage-branches.ReachSafety-Arrays
Options
  • -benchmark
  • -heap 10000M
  • -testcomp23
  • -setprop log.consoleLevel=SEVERE
  • -s incr
  • -s incr
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • --coverage-only
  • -a True
  • -q
  • -b ./binary
  • --test-comp
  • --testcomp
  • --smt-assume
  • --policy breadth
  • --test-comp
Propertiescoverage-branches

Statistics

CPAchecker 2022-12-20 15:58:25 CET coveritest.Test-Comp23_coverage-branches.ReachSafety-Arrays
FuSeBMC 2022-12-20 14:35:10 CET FuSeBMC.Test-Comp23_coverage-branches.ReachSafety-Arrays
FuSeBMC 2022-12-20 14:32:46 CET FuSeBMC_IA.Test-Comp23_coverage-branches.ReachSafety-Arrays
CPAchecker 2022-12-20 14:55:20 CET hybridtiger.Test-Comp23_coverage-branches.ReachSafety-Arrays
KLEE 2023-02-09 12:02:40 CET klee.Test-Comp23_coverage-branches.ReachSafety-Arrays
Legion 2023-02-10 12:16:37 CET legion.Test-Comp23_coverage-branches.ReachSafety-Arrays
Legion/SymCC 2022-12-21 10:08:19 CET legion-symcc.Test-Comp23_coverage-branches.ReachSafety-Arrays
PRTest 2022-12-21 19:07:52 CET prtest.Test-Comp23_coverage-branches.ReachSafety-Arrays
symbiotic 2022-12-21 18:27:28 CET symbiotic.Test-Comp23_coverage-branches.ReachSafety-Arrays
Tracer-X 2022-12-22 00:18:16 CET tracerx.Test-Comp23_coverage-branches.ReachSafety-Arrays
VeriFuzz 2022-12-21 23:42:42 CET verifuzz.Test-Comp23_coverage-branches.ReachSafety-Arrays
WASP-C 2022-12-22 03:17:26 CET wasp-c.Test-Comp23_coverage-branches.ReachSafety-Arrays
Click here to select columns
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
all results
292
208
240000
600000
3100000
292
253
260000
410000
3500000
292
249
170000
360000
2200000
292
202   
240000
560000
3100000
292
72.8 
34000
260000
410000
292
171
210000
1900000
2200000
292
98.7
250000
390000
3500000
292
127
110000
300000
1600000
292
204
230000
320000
2700000
292
200   
81000
300000
1000000
292
238
250000
650000
3000000
292
191
140000
320000
1600000
    correct results
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
10
4.06
420
6400
4600
9
6.38
64
1600
460
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
6
4.62
63
400
780
0
-
-
-
-
0
-
-
-
-
        correct true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
10
4.06
420
6400
4600
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct false
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
9
6.38
64
1600
460
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
6
4.62
63
400
780
0
-
-
-
-
0
-
-
-
-
    incorrect results
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-

Generated by BenchExec 3.17-dev