Task filter


FuSeBMC 2020-12-12 23:21:24 CET FuSeBMC.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

CMA-ES Fuzz 2020-12-13 03:33:00 CET cmaesfuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

CoVeriTest 2020-12-12 23:21:46 CET coveritest.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

CPAchecker 2020-12-13 11:24:40 CET hybridtiger.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

KLEE 2020-12-13 07:36:55 CET klee.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

Legion 2020-12-13 15:46:08 CET legion.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

LibKluzzer 2020-12-13 15:28:01 CET libkluzzer.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

PRTest 2020-12-12 23:14:55 CET prtest.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

symbiotic 2020-12-13 12:43:53 CET symbiotic.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

Tracer-X 2020-12-14 20:56:36 CET tracerx.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

VeriFuzz 2020-12-13 18:29:59 CET verifuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors

Add filter for:

Benchmark Setup

BenchmarkFuSeBMC CMA-ES Fuzz CPA/CoVeriTest HybridTiger KLEE Legion LibKluzzer PRtest Symbiotic Tracer-X VeriFuzz
ToolFuSeBMC v.3.6.6 CMA-ES Fuzz CoVeriTest 2.0.1-svn-eda176372c+ CPAchecker 1.9.2-svn-35606M KLEE 2.2-pre-test-comp Legion LibKluzzer 1.0 PRTest v2.2 symbiotic 8.0.0-pre-49dd01a3 Tracer-X 1.2.0 VeriFuzz 1.1.0
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
Hostapollon*
OSLinux 5.4.0-56-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33493 MB
Date of execution2020-12-12 23:21:24 CET 2020-12-13 03:33:00 CET 2020-12-12 23:21:46 CET 2020-12-13 11:24:40 CET 2020-12-13 07:36:55 CET 2020-12-13 15:46:08 CET 2020-12-13 15:28:01 CET 2020-12-12 23:14:55 CET 2020-12-13 12:43:53 CET 2020-12-14 20:56:36 CET 2020-12-13 18:29:59 CET
Run setFuSeBMC.Test-Comp21_coverage-branches.ReachSafety-BitVectors cmaesfuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors coveritest.Test-Comp21_coverage-branches.ReachSafety-BitVectors hybridtiger.Test-Comp21_coverage-branches.ReachSafety-BitVectors klee.Test-Comp21_coverage-branches.ReachSafety-BitVectors legion.Test-Comp21_coverage-branches.ReachSafety-BitVectors libkluzzer.Test-Comp21_coverage-branches.ReachSafety-BitVectors prtest.Test-Comp21_coverage-branches.ReachSafety-BitVectors symbiotic.Test-Comp21_coverage-branches.ReachSafety-BitVectors tracerx.Test-Comp21_coverage-branches.ReachSafety-BitVectors verifuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Options
  • -s incr
  • -st real
  • -xml
  • -benchmark
  • -heap 10000M
  • -testcomp21
  • -setprop log.consoleLevel=SEVERE
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • --coverage-only
  • --test-comp
  • --testcomp
Propertiescoverage-branches

Statistics

FuSeBMC 2020-12-12 23:21:24 CET FuSeBMC.Test-Comp21_coverage-branches.ReachSafety-BitVectors
CMA-ES Fuzz 2020-12-13 03:33:00 CET cmaesfuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors
CoVeriTest 2020-12-12 23:21:46 CET coveritest.Test-Comp21_coverage-branches.ReachSafety-BitVectors
CPAchecker 2020-12-13 11:24:40 CET hybridtiger.Test-Comp21_coverage-branches.ReachSafety-BitVectors
KLEE 2020-12-13 07:36:55 CET klee.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Legion 2020-12-13 15:46:08 CET legion.Test-Comp21_coverage-branches.ReachSafety-BitVectors
LibKluzzer 2020-12-13 15:28:01 CET libkluzzer.Test-Comp21_coverage-branches.ReachSafety-BitVectors
PRTest 2020-12-12 23:14:55 CET prtest.Test-Comp21_coverage-branches.ReachSafety-BitVectors
symbiotic 2020-12-13 12:43:53 CET symbiotic.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Tracer-X 2020-12-14 20:56:36 CET tracerx.Test-Comp21_coverage-branches.ReachSafety-BitVectors
VeriFuzz 2020-12-13 18:29:59 CET verifuzz.Test-Comp21_coverage-branches.ReachSafety-BitVectors
Click here to select columns
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
total
62
37.0
20000
100000
220000
62
22.7
35000
4000
62
39.1
24000
240000
250000
62
13.0 
7700
96000
85000
62
27.9 
24000
21000
310000
62
28.5
44000
400000
370000
62
39.6
56000
130000
610000
62
26.9
55000
1500
780000
62
37.1
36000
46000
390000
62
37.2 
31000
96000
390000
62
38.0
56000
19000
700000
    correct results
0
-
-
-
-
0
-
-
-
0
-
-
-
-
55
7.92
3200
93000
32000
10
5.08
980
650
14000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
8
6.14
1200
5900
14000
0
-
-
-
-
        correct true
0
-
-
-
-
0
-
-
-
0
-
-
-
-
55
7.92
3200
93000
32000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct false
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
10
5.08
980
650
14000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
8
6.14
1200
5900
14000
0
-
-
-
-
    incorrect results
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
Loading...

Generated by BenchExec 3.6