Task filter


CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.ReachSafety-ECA

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCMA-ES FuzzCPA/CoVeriTestFuSeBMCHybridTigerKLEELegionLegion/SymCCLibKluzzerPRtestSymbioticTracer-XVeriFuzz
ToolCMA-ES Fuzz CPAchecker 2.0.1-svn-38826FuSeBMC v.4.1.14CPAchecker 1.9.2-svn-35606MKLEE 2.2-pre-test-compLegion 1.0-testcomp2021Legion/SymCC testcomp2022LibKluzzer 1.0PRTest v2.2symbiotic 9.0.0-dev-71ddb4b1Tracer-X 1.2.0VeriFuzz 1.2.10
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
HostUnknown
OSUnknown
SystemUnknown
Date of execution2021-12-15 19:44:24 CET2021-12-15 19:57:13 CET2021-12-16 03:43:34 CET2021-12-16 04:41:54 CET2021-12-16 10:08:26 CET2021-12-16 15:28:39 CET2021-12-16 13:27:02 CET2021-12-16 20:24:25 CET2021-12-16 23:53:20 CET2021-12-17 02:47:56 CET2021-12-16 00:12:46 CET2021-12-17 07:59:01 CET
Run setcmaesfuzz.Test-Comp22_coverage-branches.ReachSafety-ECAcoveritest.Test-Comp22_coverage-branches.ReachSafety-ECAFuSeBMC.Test-Comp22_coverage-branches.ReachSafety-ECAhybridtiger.Test-Comp22_coverage-branches.ReachSafety-ECAklee.Test-Comp22_coverage-branches.ReachSafety-ECAlegion.Test-Comp22_coverage-branches.ReachSafety-ECAlegion-symcc.Test-Comp22_coverage-branches.ReachSafety-ECAlibkluzzer.Test-Comp22_coverage-branches.ReachSafety-ECAprtest.Test-Comp22_coverage-branches.ReachSafety-ECAsymbiotic.Test-Comp22_coverage-branches.ReachSafety-ECAtracerx.Test-Comp22_coverage-branches.ReachSafety-ECAverifuzz.Test-Comp22_coverage-branches.ReachSafety-ECA
Options
  • -st real
  • -xml
  • -benchmark
  • -heap 10000M
  • -testcomp22
  • -setprop log.consoleLevel=SEVERE
  • -s incr
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • --coverage-only
  • -L ubuntu2004/lib
  • --test-comp
  • --testcomp
Propertiescoverage-branches

Statistics

CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.ReachSafety-ECA
CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.ReachSafety-ECA
FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.ReachSafety-ECA
CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.ReachSafety-ECA
KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.ReachSafety-ECA
Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.ReachSafety-ECA
Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.ReachSafety-ECA
LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.ReachSafety-ECA
PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.ReachSafety-ECA
symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.ReachSafety-ECA
Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.ReachSafety-ECA
VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.ReachSafety-ECA
Click here to select columns
 
status
raw score
cpu
(s)
mem
(MB)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
total
29
.0561
23000
16000
29
5.77
24000
250000
230000
29
10.7
26000
92000
330000
29
2.40
23000
260000
230000
29
7.23
26000
130000
230000
29
2.67
19000
360000
190000
29
2.99
25000
160000
310000
29
10.1
26000
63000
250000
29
2.03
26000
7800
360000
29
9.95
21000
380000
170000
29
7.60
7700
94000
66000
29
11.6
25000
45000
320000
    correct results
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
8
3.87
2400
27000
18000
0
-
-
-
-
        correct true
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct false
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
8
3.87
2400
27000
18000
0
-
-
-
-
    incorrect results
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-

Generated by BenchExec 3.11-dev