| Benchmark | VeriFuzz | TBF Test-Suite Validator | ||||||||||||||||||||||||
| Tool | VeriFuzz 1.0.1 | Tbf Test-suite Validator v1.2 | ||||||||||||||||||||||||
| Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2 | ||||||||||||||||||||||||
| Host | apollon* | |||||||||||||||||||||||||
| OS | Linux 4.15.0-45-generic | |||||||||||||||||||||||||
| System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB | |||||||||||||||||||||||||
| Date of execution | 2019-02-06 07:17:17 CET | 2019-02-06 14:51:38 CET | ||||||||||||||||||||||||
| Run set | verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Heap | tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Heap | ||||||||||||||||||||||||
| Options | --testcomp | --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/verifuzz.2019-02-06_0717.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip | ||||||||||||||||||||||||
| sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
| fo_test.yml | done | 1 | prog | tests | 1 | inspect | 4.9 | 2.6 | 170 | 46 | .58 | 0 | true | prog | tests | 1 | inspect |
|
50.0 | 87.5 | .15 | .15 | 17 | .082 | 0 | |
| rule60_list2.c_1.yml | done | 1 | prog | tests | 1 | inspect | 4.8 | 2.4 | 170 | 53 | .39 | 0 | true | prog | tests | 1 | inspect |
|
64.3 | 89.7 | .16 | .16 | 17 | .086 | 0 | |
| test21-2.yml | done | 1 | prog | tests | 1 | inspect | 3.5 | 2.2 | 150 | 33 | .48 | 0 | true | prog | tests | 1 | inspect |
|
50.0 | 94.4 | .12 | .12 | 16 | .082 | 0 | |
| test22-2.yml | done | 1 | prog | tests | 1 | inspect | 6.5 | 5.0 | 150 | 72 | .66 | 0 | true | prog | tests | 1 | inspect |
|
58.3 | 91.3 | .11 | .13 | 16 | .082 | 0 | |
| test23-1.yml | done | 1 | prog | tests | 1 | inspect | 3.6 | 2.3 | 150 | 36 | .55 | 0 | true | prog | tests | 1 | inspect |
|
57.1 | 95.8 | .13 | .13 | 16 | .082 | 0 | |
| test24-2.yml | done | 1 | prog | tests | 1 | inspect | 4.2 | 2.7 | 150 | 48 | .91 | 0 | true | prog | tests | 1 | inspect |
|
60.0 | 88.9 | .13 | .13 | 16 | .078 | 0 | |
| test25-1.yml | done | 1 | prog | tests | 1 | inspect | 4.0 | 2.4 | 150 | 40 | .63 | 0 | true | prog | tests | 1 | inspect |
|
66.7 | 94.4 | .12 | .12 | 16 | .078 | 0 | |
| test28-1.yml | timeout | prog | tests | 0 | inspect | 900 | 920 | 150 | 12000 | .92 | 0 | error (0) | prog | tests | 0 | inspect |
|
0 | 0 | .057 | .058 | 9.0 | 0 | 0 | ||
| test29-1.yml | done | 1 | prog | tests | 1 | inspect | 3.7 | 2.4 | 150 | 36 | 2.7 | 0 | true | prog | tests | 1 | inspect |
|
50.0 | 81.8 | .11 | .11 | 17 | .074 | 0 | |
| sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
| total | 9 | 8 | 940 | 950 | 1400 | 12000 | 7.8 | 0 | 9 | 456 | 724 | 1.1 | 1.1 | 140 | .64 | 0 | ||||||||||
| Run set | verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Heap | tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Heap | ||||||||||||||||||||||||