Task filter


FuSeBMC 2020-12-12 23:21:24 CET FuSeBMC.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

CMA-ES Fuzz 2020-12-13 03:33:00 CET cmaesfuzz.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

CoVeriTest 2020-12-12 23:21:46 CET coveritest.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

CPAchecker 2020-12-13 11:24:40 CET hybridtiger.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

KLEE 2020-12-13 07:36:55 CET klee.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

Legion 2020-12-13 15:46:08 CET legion.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

LibKluzzer 2020-12-13 15:28:01 CET libkluzzer.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

PRTest 2020-12-12 23:14:55 CET prtest.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

symbiotic 2020-12-13 12:43:53 CET symbiotic.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

Tracer-X 2020-12-14 20:56:36 CET tracerx.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

VeriFuzz 2020-12-13 18:29:59 CET verifuzz.Test-Comp21_coverage-branches.Termination-MainHeap

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkFuSeBMC CMA-ES Fuzz CPA/CoVeriTest HybridTiger KLEE Legion LibKluzzer PRtest Symbiotic Tracer-X VeriFuzz
ToolFuSeBMC v.3.6.6 CMA-ES Fuzz CoVeriTest 2.0.1-svn-eda176372c+ CPAchecker 1.9.2-svn-35606M KLEE 2.2-pre-test-comp Legion LibKluzzer 1.0 PRTest v2.2 symbiotic 8.0.0-pre-49dd01a3 Tracer-X 1.2.0 VeriFuzz 1.1.0
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1 timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
Hostapollon*
OSLinux 5.4.0-56-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33493 MB
Date of execution2020-12-12 23:21:24 CET 2020-12-13 03:33:00 CET 2020-12-12 23:21:46 CET 2020-12-13 11:24:40 CET 2020-12-13 07:36:55 CET 2020-12-13 15:46:08 CET 2020-12-13 15:28:01 CET 2020-12-12 23:14:55 CET 2020-12-13 12:43:53 CET 2020-12-14 20:56:36 CET 2020-12-13 18:29:59 CET
Run setFuSeBMC.Test-Comp21_coverage-branches.Termination-MainHeap cmaesfuzz.Test-Comp21_coverage-branches.Termination-MainHeap coveritest.Test-Comp21_coverage-branches.Termination-MainHeap hybridtiger.Test-Comp21_coverage-branches.Termination-MainHeap klee.Test-Comp21_coverage-branches.Termination-MainHeap legion.Test-Comp21_coverage-branches.Termination-MainHeap libkluzzer.Test-Comp21_coverage-branches.Termination-MainHeap prtest.Test-Comp21_coverage-branches.Termination-MainHeap symbiotic.Test-Comp21_coverage-branches.Termination-MainHeap tracerx.Test-Comp21_coverage-branches.Termination-MainHeap verifuzz.Test-Comp21_coverage-branches.Termination-MainHeap
Options
  • -s incr
  • -st real
  • -xml
  • -benchmark
  • -heap 10000M
  • -testcomp21
  • -setprop log.consoleLevel=SEVERE
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • --coverage-only
  • --test-comp
  • --testcomp
Propertiescoverage-branches

Statistics

FuSeBMC 2020-12-12 23:21:24 CET FuSeBMC.Test-Comp21_coverage-branches.Termination-MainHeap
CMA-ES Fuzz 2020-12-13 03:33:00 CET cmaesfuzz.Test-Comp21_coverage-branches.Termination-MainHeap
CoVeriTest 2020-12-12 23:21:46 CET coveritest.Test-Comp21_coverage-branches.Termination-MainHeap
CPAchecker 2020-12-13 11:24:40 CET hybridtiger.Test-Comp21_coverage-branches.Termination-MainHeap
KLEE 2020-12-13 07:36:55 CET klee.Test-Comp21_coverage-branches.Termination-MainHeap
Legion 2020-12-13 15:46:08 CET legion.Test-Comp21_coverage-branches.Termination-MainHeap
LibKluzzer 2020-12-13 15:28:01 CET libkluzzer.Test-Comp21_coverage-branches.Termination-MainHeap
PRTest 2020-12-12 23:14:55 CET prtest.Test-Comp21_coverage-branches.Termination-MainHeap
symbiotic 2020-12-13 12:43:53 CET symbiotic.Test-Comp21_coverage-branches.Termination-MainHeap
Tracer-X 2020-12-14 20:56:36 CET tracerx.Test-Comp21_coverage-branches.Termination-MainHeap
VeriFuzz 2020-12-13 18:29:59 CET verifuzz.Test-Comp21_coverage-branches.Termination-MainHeap
Click here to select columns
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
total
231
202
110000
200000
1300000
231
138
98000
60000
231
193
24000
150000
280000
231
189  
18000
210000
230000
231
119   
10000
18000
130000
231
166
190000
980000
960000
231
199
120000
630000
1400000
231
50.9
68000
120000
960000
231
178
190000
150000
2400000
231
185
65000
200000
720000
231
204
210000
57000
2700000
    correct results
0
-
-
-
-
0
-
-
-
0
-
-
-
-
25
20.2
360
7800
3300
5
2.59
16
160
240
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct true
0
-
-
-
-
0
-
-
-
0
-
-
-
-
25
20.2
360
7800
3300
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct false
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
5
2.59
16
160
240
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
    incorrect results
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
Loading...

Generated by BenchExec 3.6