Task filter


CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.ReachSafety-XCSP

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCMA-ES FuzzCPA/CoVeriTestFuSeBMCHybridTigerKLEELegionLegion/SymCCLibKluzzerPRtestSymbioticTracer-XVeriFuzz
ToolCMA-ES Fuzz CPAchecker 2.0.1-svn-38826FuSeBMC v.4.1.14CPAchecker 1.9.2-svn-35606MKLEE 2.2-pre-test-compLegion 1.0-testcomp2021Legion/SymCC testcomp2022LibKluzzer 1.0PRTest v2.2symbiotic 9.0.0-dev-71ddb4b1Tracer-X 1.2.0VeriFuzz 1.2.10
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
HostUnknown
OSUnknown
SystemUnknown
Date of execution2021-12-15 19:44:24 CET2021-12-15 19:57:13 CET2021-12-16 03:43:34 CET2021-12-16 04:41:54 CET2021-12-16 10:08:26 CET2021-12-16 15:28:39 CET2021-12-16 13:27:02 CET2021-12-16 20:24:25 CET2021-12-16 23:53:20 CET2021-12-17 02:47:56 CET2021-12-16 00:12:46 CET2021-12-17 07:59:01 CET
Run setcmaesfuzz.Test-Comp22_coverage-branches.ReachSafety-XCSPcoveritest.Test-Comp22_coverage-branches.ReachSafety-XCSPFuSeBMC.Test-Comp22_coverage-branches.ReachSafety-XCSPhybridtiger.Test-Comp22_coverage-branches.ReachSafety-XCSPklee.Test-Comp22_coverage-branches.ReachSafety-XCSPlegion.Test-Comp22_coverage-branches.ReachSafety-XCSPlegion-symcc.Test-Comp22_coverage-branches.ReachSafety-XCSPlibkluzzer.Test-Comp22_coverage-branches.ReachSafety-XCSPprtest.Test-Comp22_coverage-branches.ReachSafety-XCSPsymbiotic.Test-Comp22_coverage-branches.ReachSafety-XCSPtracerx.Test-Comp22_coverage-branches.ReachSafety-XCSPverifuzz.Test-Comp22_coverage-branches.ReachSafety-XCSP
Options
  • -st real
  • -xml
  • -benchmark
  • -heap 10000M
  • -testcomp22
  • -setprop log.consoleLevel=SEVERE
  • -s incr
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • --coverage-only
  • -L ubuntu2004/lib
  • --test-comp
  • --testcomp
Propertiescoverage-branches

Statistics

CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.ReachSafety-XCSP
CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.ReachSafety-XCSP
FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.ReachSafety-XCSP
CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.ReachSafety-XCSP
KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.ReachSafety-XCSP
Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.ReachSafety-XCSP
Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.ReachSafety-XCSP
LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.ReachSafety-XCSP
PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.ReachSafety-XCSP
symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.ReachSafety-XCSP
Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.ReachSafety-XCSP
VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.ReachSafety-XCSP
Click here to select columns
 
status
raw score
cpu
(s)
mem
(MB)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
total
119
.00
180
7800
119
116
21000
110000
170000
119
107
110000
22000
1400000
119
119
6000
46000
53000
119
102
17000
13000
200000
119
2.50
110000
20000
710000
119
102
100000
81000
1200000
119
118
110000
270000
1200000
119
102
110000
3200
1300000
119
114
44000
58000
480000
119
96.1
9500
19000
130000
119
110
110000
43000
1400000

Generated by BenchExec 3.11-dev