Benchmark | FairFuzz | TBF Test-Suite Validator | ||||||||||||||||||||||||
Tool | FairFuzz TC-0.0.2 | Tbf Test-suite Validator v1.2 | ||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2 | ||||||||||||||||||||||||
Host | apollon* | |||||||||||||||||||||||||
OS | Linux 4.15.0-45-generic | |||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB | |||||||||||||||||||||||||
Date of execution | 2019-02-08 09:39:09 CET | 2019-02-08 13:22:04 CET | ||||||||||||||||||||||||
Run set | fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-ControlFlow | tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-ControlFlow | ||||||||||||||||||||||||
Options | --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip | |||||||||||||||||||||||||
sv-benchmarks/c/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
ntdrivers-simplified/cdaudio_simpl1.cil-1.yml | timeout | prog | tests | 51 | inspect | 900 | 840 | 20 | 3900 | 1.2 | 0 | unknown | prog | tests | 0 | inspect | 47.4 | 67.1 | .49 | .53 | 21 | 6.8 | 0 | |||
ntdrivers-simplified/floppy_simpl3.cil-1.yml | false(unreach-call) | 1 | prog | tests | 35 | inspect | 450 | 420 | 20 | 1500 | .63 | 0 | true | prog | tests | 1 | inspect | 60.5 | 76.3 | .24 | .24 | 18 | .89 | 0 | ||
ntdrivers-simplified/floppy_simpl4.cil-1.yml | false(unreach-call) | 1 | prog | tests | 64 | inspect | 660 | 620 | 20 | 2000 | .88 | 0 | true | prog | tests | 1 | inspect | 71.9 | 85.7 | .43 | .44 | 20 | 3.9 | 0 | ||
ntdrivers-simplified/kbfiltr_simpl2.cil-2.yml | false(unreach-call) | 1 | prog | tests | 24 | inspect | 240 | 220 | 19 | 920 | .52 | 0 | true | prog | tests | 1 | inspect | 56.8 | 76.3 | .29 | .28 | 17 | 1.1 | 0 | ||
ssh-simplified/s3_clnt_1.cil-2.yml | done | prog | tests | 1 | inspect | 26 | 24 | 14 | 120 | .26 | .061 | unknown | prog | tests | 0 | inspect | 3.09 | 18.7 | .19 | .19 | 17 | .12 | 0 | |||
ssh-simplified/s3_clnt_2.cil-1.yml | done | prog | tests | 1 | inspect | 39 | 37 | 13 | 100 | .26 | 0 | unknown | prog | tests | 0 | inspect | 3.09 | 18.6 | .19 | .20 | 17 | .12 | 0 | |||
ssh-simplified/s3_clnt_3.cil-2.yml | done | prog | tests | 1 | inspect | 38 | 36 | 14 | 110 | .26 | 0 | unknown | prog | tests | 0 | inspect | 3.09 | 19.3 | .20 | .20 | 17 | .12 | 0 | |||
ssh-simplified/s3_clnt_4.cil-2.yml | done | prog | tests | 1 | inspect | 40 | 38 | 14 | 120 | .26 | 0 | unknown | prog | tests | 0 | inspect | 3.09 | 19.1 | .19 | .19 | 17 | .12 | 0 | |||
sv-benchmarks/c/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
total | 8 | 3 | 2400 | 2200 | 130 | 8700 | 4.3 | .061 | 8 | 249 | 381 | 2.2 | 2.3 | 140 | 13 | 0 | ||||||||||
Run set | fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-ControlFlow | tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-ControlFlow |