Task filter


CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCMA-ES FuzzCPA/CoVeriTestFuSeBMCHybridTigerKLEELegionLibKluzzerPRtestSymbioticTracer-XVeriFuzz
ToolCMA-ES Fuzz CPAchecker 2.0.1-svn-38826FuSeBMC v.4.1.14CPAchecker 1.9.2-svn-35606MKLEE 2.2-pre-test-compLegion 1.0-testcomp2021LibKluzzer 1.0PRTest v2.2symbiotic 9.0.0-dev-71ddb4b1Tracer-X 1.2.0VeriFuzz 1.2.10
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
HostUnknown
OSUnknown
SystemUnknown
Date of execution2021-12-15 19:44:24 CET2021-12-15 19:57:13 CET2021-12-16 03:43:34 CET2021-12-16 04:41:54 CET2021-12-16 10:08:26 CET2021-12-16 15:28:39 CET2021-12-16 20:24:25 CET2021-12-16 23:53:20 CET2021-12-17 02:47:56 CET2021-12-16 00:12:46 CET2021-12-17 07:59:01 CET
Run setcmaesfuzz.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetycoveritest.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetyFuSeBMC.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetyhybridtiger.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetyklee.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetylegion.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetylibkluzzer.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetyprtest.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetysymbiotic.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetytracerx.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafetyverifuzz.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
Options
  • -st real
  • -xml
  • -benchmark
  • -heap 10000M
  • -testcomp22
  • -setprop log.consoleLevel=SEVERE
  • -s incr
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • --test-comp
  • --testcomp
Propertiescoverage-error-call

Statistics

CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-error-call.SoftwareSystems-BusyBox-MemSafety
Click here to select columns
 
status
cpu
(s)
mem
(MB)
 
status
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
cpu
(s)
mem
(MB)
energy
(J)
 
status
cpu
(s)
mem
(MB)
energy
(J)
 
status
cpu
(s)
mem
(MB)
energy
(J)
 
status
cpu
(s)
mem
(MB)
energy
(J)
 
status
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
total
13
2300
710
13
12000
52000
120000
13
2
9300
3500
120000
13
12000
130000
130000
13
1
3600  
13000
44000
13
11000
2200
72000
13
11000
4500
150000
13
11000
46000
140000
13
11000
5100
150000
13
1.4
180
17
13
2
9200
5000
110000
    correct results
0
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
1
1
1.8
100
31
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
        correct true
0
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
        correct false
0
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
1
1
1.8
100
31
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
    incorrect results
0
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
0
-
-
-
-

Generated by BenchExec 3.11-dev