Benchmark | FairFuzz | TBF Test-Suite Validator | ||||||||||||||||||||||||
Tool | FairFuzz TC-0.0.2 | Tbf Test-suite Validator v1.2 | ||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2 | ||||||||||||||||||||||||
Host | apollon* | |||||||||||||||||||||||||
OS | Linux 4.15.0-45-generic | |||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB | |||||||||||||||||||||||||
Date of execution | 2019-02-08 09:39:09 CET | 2019-02-08 13:22:04 CET | ||||||||||||||||||||||||
Run set | fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Heap | tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Heap | ||||||||||||||||||||||||
Options | --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip | |||||||||||||||||||||||||
sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
fo_test.yml | false(unreach-call) | 1 | prog | tests | 2 | inspect | 2.8 | 2.7 | 17 | 56 | .22 | 0 | true | prog | tests | 1 | inspect | 100 | 100 | .15 | .15 | 16 | .14 | 0 | ||
rule60_list2.c_1.yml | false(unreach-call) | 1 | prog | tests | 8 | inspect | 16 | 14 | 15 | 62 | .30 | 0 | true | prog | tests | 1 | inspect | 64.3 | 89.7 | .14 | .14 | 16 | .086 | 0 | ||
test21-2.yml | false(unreach-call) | 1 | prog | tests | 6 | inspect | 25 | 24 | 17 | 79 | .27 | 0 | true | prog | tests | 1 | inspect | 87.5 | 100 | .13 | .13 | 17 | .13 | 0 | ||
test22-2.yml | false(unreach-call) | 1 | prog | tests | 4 | inspect | 10 | 9.4 | 15 | 31 | .27 | 0 | true | prog | tests | 1 | inspect | 58.3 | 91.3 | .12 | .12 | 17 | .082 | 0 | ||
test23-1.yml | false(unreach-call) | 1 | prog | tests | 6 | inspect | 26 | 24 | 17 | 120 | .28 | 0 | true | prog | tests | 1 | inspect | 78.6 | 100 | .13 | .13 | 16 | .13 | 0 | ||
test24-2.yml | false(unreach-call) | 1 | prog | tests | 2 | inspect | 21 | 19 | 13 | 63 | .21 | 0 | true | prog | tests | 1 | inspect | 60.0 | 88.9 | .12 | .15 | 16 | .078 | 0 | ||
test25-1.yml | false(unreach-call) | 1 | prog | tests | 4 | inspect | 21 | 19 | 14 | 60 | .28 | 0 | true | prog | tests | 1 | inspect | 91.7 | 100 | .14 | .13 | 17 | .13 | 0 | ||
test28-1.yml | done | 1 | prog | tests | 1 | inspect | 13 | 12 | 17 | 100 | .20 | 0 | true | prog | tests | 1 | inspect | 50.0 | 80.0 | .12 | .12 | 16 | .070 | 0 | ||
test29-1.yml | false(unreach-call) | 1 | prog | tests | 3 | inspect | 7.9 | 7.2 | 14 | 35 | .20 | 0 | true | prog | tests | 1 | inspect | 62.5 | 90.9 | .12 | .12 | 16 | .090 | 0 | ||
sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
total | 9 | 9 | 140 | 130 | 140 | 610 | 2.2 | 0 | 9 | 653 | 841 | 1.2 | 1.2 | 150 | .93 | 0 | ||||||||||
Run set | fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Heap | tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Heap |