Task filter


CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-error-call.ReachSafety-Loops

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCMA-ES FuzzCPA/CoVeriTestFuSeBMCHybridTigerKLEELegionLibKluzzerPRtestSymbioticTracer-XVeriFuzz
ToolCMA-ES Fuzz CPAchecker 2.0.1-svn-38826FuSeBMC v.4.1.14CPAchecker 1.9.2-svn-35606MKLEE 2.2-pre-test-compLegion 1.0-testcomp2021LibKluzzer 1.0PRTest v2.2symbiotic 9.0.0-dev-71ddb4b1Tracer-X 1.2.0VeriFuzz 1.2.10
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
HostUnknown
OSUnknown
SystemUnknown
Date of execution2021-12-15 19:44:24 CET2021-12-15 19:57:13 CET2021-12-16 03:43:34 CET2021-12-16 04:41:54 CET2021-12-16 10:08:26 CET2021-12-16 15:28:39 CET2021-12-16 20:24:25 CET2021-12-16 23:53:20 CET2021-12-17 02:47:56 CET2021-12-16 00:12:46 CET2021-12-17 07:59:01 CET
Run setcmaesfuzz.Test-Comp22_coverage-error-call.ReachSafety-Loopscoveritest.Test-Comp22_coverage-error-call.ReachSafety-LoopsFuSeBMC.Test-Comp22_coverage-error-call.ReachSafety-Loopshybridtiger.Test-Comp22_coverage-error-call.ReachSafety-Loopsklee.Test-Comp22_coverage-error-call.ReachSafety-Loopslegion.Test-Comp22_coverage-error-call.ReachSafety-Loopslibkluzzer.Test-Comp22_coverage-error-call.ReachSafety-Loopsprtest.Test-Comp22_coverage-error-call.ReachSafety-Loopssymbiotic.Test-Comp22_coverage-error-call.ReachSafety-Loopstracerx.Test-Comp22_coverage-error-call.ReachSafety-Loopsverifuzz.Test-Comp22_coverage-error-call.ReachSafety-Loops
Options
  • -st real
  • -xml
  • -benchmark
  • -heap 10000M
  • -testcomp22
  • -setprop log.consoleLevel=SEVERE
  • -s incr
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • --test-comp
  • --testcomp
Propertiescoverage-error-call

Statistics

CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-error-call.ReachSafety-Loops
CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-error-call.ReachSafety-Loops
FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-error-call.ReachSafety-Loops
CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-error-call.ReachSafety-Loops
KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-error-call.ReachSafety-Loops
Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-error-call.ReachSafety-Loops
LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-error-call.ReachSafety-Loops
PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-error-call.ReachSafety-Loops
symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-error-call.ReachSafety-Loops
Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-error-call.ReachSafety-Loops
VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-error-call.ReachSafety-Loops
Click here to select columns
 
status
cpu
(s)
mem
(MB)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
total
157
65000
14000
157
75
110000
540000
1200000
157
146
41000
27000
530000
157
53
91000
210000
990000
157
95
39000
46000
540000
157
4
130000
150000
890000
157
136
130000
320000
1400000
157
102
140000
8600
1800000
157
81
41000
56000
530000
157
12
1800
130
157
142
13000
61000
160000
    correct results
0
-
-
0
-
-
-
-
0
-
-
-
-
18
18
3300
13000
38000
95
95
3400
3400
47000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
        correct true
0
-
-
0
-
-
-
-
0
-
-
-
-
18
18
3300
13000
38000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
        correct false
0
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
95
95
3400
3400
47000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
    incorrect results
0
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-

Generated by BenchExec 3.11-dev