Task filter


CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCMA-ES FuzzCPA/CoVeriTestFuSeBMCHybridTigerKLEELegionLegion/SymCCLibKluzzerPRtestSymbioticTracer-XVeriFuzz
ToolCMA-ES Fuzz CPAchecker 2.0.1-svn-38826FuSeBMC v.4.1.14CPAchecker 1.9.2-svn-35606MKLEE 2.2-pre-test-compLegion 1.0-testcomp2021Legion/SymCC testcomp2022LibKluzzer 1.0PRTest v2.2symbiotic 9.0.0-dev-71ddb4b1Tracer-X 1.2.0VeriFuzz 1.2.10
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 1timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
HostUnknown
OSUnknown
SystemUnknown
Date of execution2021-12-15 19:44:24 CET2021-12-15 19:57:13 CET2021-12-16 03:43:34 CET2021-12-16 04:41:54 CET2021-12-16 10:08:26 CET2021-12-16 15:28:39 CET2021-12-16 13:27:02 CET2021-12-16 20:24:25 CET2021-12-16 23:53:20 CET2021-12-17 02:47:56 CET2021-12-16 00:12:46 CET2021-12-17 07:59:01 CET
Run setcmaesfuzz.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetycoveritest.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetyFuSeBMC.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetyhybridtiger.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetyklee.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetylegion.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetylegion-symcc.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetylibkluzzer.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetyprtest.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetysymbiotic.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetytracerx.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafetyverifuzz.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
Options
  • -st real
  • -xml
  • -benchmark
  • -heap 10000M
  • -testcomp22
  • -setprop log.consoleLevel=SEVERE
  • -s incr
  • -benchmark
  • -heap 10000M
  • -tigertestcomp20
  • --score uct
  • --core 8
  • --tree-depth-limit 100000
  • --conex-timeout 0
  • --symex-timeout 0
  • --min-samples 1
  • --save-tests REDUCED
  • --persistent
  • --time-penalty 0
  • --random-seed 0
  • -o ./binary.instr
  • --compile svcomp
  • --coverage-only
  • -L ubuntu2004/lib
  • --test-comp
  • --testcomp
Propertiescoverage-branches

Statistics

CMA-ES Fuzz 2021-12-15 19:44:24 CET cmaesfuzz.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
CPAchecker 2021-12-15 19:57:13 CET coveritest.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
FuSeBMC 2021-12-16 03:43:34 CET FuSeBMC.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
CPAchecker 2021-12-16 04:41:54 CET hybridtiger.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
KLEE 2021-12-16 10:08:26 CET klee.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
Legion 2021-12-16 15:28:39 CET legion.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
Legion/SymCC 2021-12-16 13:27:02 CET legion-symcc.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
LibKluzzer 2021-12-16 20:24:25 CET libkluzzer.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
PRTest 2021-12-16 23:53:20 CET prtest.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
symbiotic 2021-12-17 02:47:56 CET symbiotic.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
Tracer-X 2021-12-16 00:12:46 CET tracerx.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
VeriFuzz 2021-12-17 07:59:01 CET verifuzz.Test-Comp22_coverage-branches.SoftwareSystems-SQLite-MemSafety
Click here to select columns
 
status
raw score
cpu
(s)
mem
(MB)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
 
status
raw score
cpu
(s)
mem
(MB)
energy
(J)
total
1
.00
880
390
1
.0002
900
2600
10000
1
.0426
900
6400
8700
1
.00
900
3000
11000
1
.0226
30
180
360
1
.0
900
370
7400
1
.0274
190
510
2300
1
.0331
130
1100
1400
1
.0236
900
150
13000
1
.0266
900
610
10000
1
.0221
48
2400
580
1
.111
900
770
11000

Generated by BenchExec 3.11-dev