Task filter


CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

Benchmark Setup

BenchmarkCMA-ES FuzzCPA/CoVeriTestFuSeBMCHybridTigerKLEELegionLegion/SymCCLibKluzzerPRtestSymbioticTracer-XVeriFuzz
ToolCMA-ES Fuzz CPAchecker 2.0.1-svn-38826FuSeBMC v.4.1.14CPAchecker 1.9.2-svn-35606MKLEE 2.2-pre-test-compLegion 1.0-testcomp2021Legion/SymCC testcomp2022LibKluzzer 1.0PRTest v2.2symbiotic 9.0.0-dev-71ddb4b1Tracer-X 1.2.0VeriFuzz 1.2.10
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
HostUnknown
OSUnknown
SystemUnknown
Date of execution2021-12-15 19:44:24 CET2021-12-15 19:57:13 CET2021-12-16 03:43:34 CET2021-12-16 04:41:54 CET2021-12-16 10:08:26 CET2021-12-16 15:28:39 CET2021-12-16 13:27:02 CET2021-12-16 20:24:25 CET2021-12-16 23:53:20 CET2021-12-17 02:47:56 CET2021-12-16 00:12:46 CET2021-12-17 07:59:01 CET
Run setcmaesfuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetycoveritest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetyFuSeBMC.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetyhybridtiger.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetyklee.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetylegion.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetylegion-symcc.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetylibkluzzer.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetyprtest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetysymbiotic.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetytracerx.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafetyverifuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Options
  • -st real
  • -xml
  • -benchmark
  • -heap 10000M
  • -testcomp22
  • -setprop log.consoleLevel=SEVERE
  • -s incr
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • --coverage-only
  • -L ubuntu2004/lib
  • --test-comp
  • --testcomp
Propertiescoverage-branches

Statistics

CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Click here to select columns
 
status
raw score
cpu
(s)
mem
(MB)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
total
290
13.2
190000
140000
290
59.5
40000
210000
440000
290
59.2
260000
360000
3300000
290
5.76
28000
190000
300000
290
24.7
60000
220000
790000
290
55.6
260000
240000
2300000
290
46.8
260000
210000
3400000
290
57.3
230000
450000
2600000
290
15.9
250000
39000
3600000
290
42.3
240000
660000
2900000
290
56.3 
13000
130000
160000
290
57.0
260000
160000
3300000
    correct results
0
-
-
-
0
-
-
-
-
0
-
-
-
-
264
4.60
4600
86000
46000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
63
8.92
8500
83000
100000
0
-
-
-
-
        correct true
0
-
-
-
0
-
-
-
-
0
-
-
-
-
264
4.60
4600
86000
46000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct false
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
63
8.92
8500
83000
100000
0
-
-
-
-
    incorrect results
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-

Generated by BenchExec 3.11-dev