Benchmark | ESBMC-falsif | TBF Test-Suite Validator | ||||||||||||||||||||||||
Tool | ESBMC version 6.0.0 64-bit x86_64 linux | Tbf Test-suite Validator v1.2 | ||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2 | ||||||||||||||||||||||||
Host | apollon* | |||||||||||||||||||||||||
OS | Linux 4.15.0-45-generic | |||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB | |||||||||||||||||||||||||
Date of execution | 2019-02-05 21:11:17 CET | 2019-02-06 06:16:01 CET | ||||||||||||||||||||||||
Run set | esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Heap | tbf-testsuite-validator-esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Heap | ||||||||||||||||||||||||
Options | -s falsi | --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/esbmc-falsi.2019-02-05_2111.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip | ||||||||||||||||||||||||
sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
alias_of_return_2.c_1.yml | unknown | .0 | prog | tests | 0 | inspect | .028 | .030 | 5.7 | .17 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .059 | .060 | 8.9 | 0 | 0 | ||
alias_of_return_2.yml | unknown | .0 | prog | tests | 0 | inspect | .022 | .022 | 5.7 | .081 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .057 | .058 | 9.0 | 0 | 0 | ||
fo_test.yml | unknown | .0 | prog | tests | 0 | inspect | .022 | .023 | 5.6 | .15 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .066 | .066 | 8.9 | 0 | 0 | ||
rule60_list2.c_1.yml | unknown | .0 | prog | tests | 0 | inspect | .025 | .025 | 5.7 | .11 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .059 | .060 | 8.9 | 0 | 0 | ||
rule60_list2.yml | unknown | .0 | prog | tests | 0 | inspect | .021 | .021 | 5.7 | .043 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .058 | .058 | 9.0 | 0 | 0 | ||
sizeofparameters_test.yml | unknown | .0 | prog | tests | 0 | inspect | .019 | .019 | 5.7 | .084 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .092 | .095 | 9.0 | 0 | 0 | ||
test10.yml | unknown | .0 | prog | tests | 0 | inspect | .029 | .031 | 5.7 | .064 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .058 | .059 | 8.9 | 0 | 0 | ||
test11.yml | unknown | .0 | prog | tests | 0 | inspect | .021 | .021 | 5.7 | .081 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .060 | .061 | 8.9 | 0 | 0 | ||
test14.yml | unknown | .0 | prog | tests | 0 | inspect | .023 | .024 | 5.7 | .20 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .057 | .058 | 8.9 | 0 | 0 | ||
test15.yml | unknown | .0 | prog | tests | 0 | inspect | .023 | .025 | 5.6 | .14 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .060 | .061 | 8.9 | 0 | 0 | ||
test19.yml | unknown | .0 | prog | tests | 0 | inspect | .025 | .027 | 5.7 | .11 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .063 | .064 | 8.9 | 0 | 0 | ||
test21-1.yml | unknown | .0 | prog | tests | 0 | inspect | .027 | .029 | 5.7 | .18 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .059 | .060 | 9.0 | 0 | 0 | ||
test21-2.yml | unknown | .0 | prog | tests | 0 | inspect | .027 | .028 | 5.7 | .14 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .061 | .062 | 8.9 | 0 | 0 | ||
test22-1.yml | unknown | .0 | prog | tests | 0 | inspect | .025 | .026 | 5.7 | .14 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .062 | .063 | 9.0 | 0 | 0 | ||
test22-2.yml | unknown | .0 | prog | tests | 0 | inspect | .030 | .031 | 5.7 | .17 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .061 | .061 | 8.9 | 0 | 0 | ||
test23-1.yml | unknown | .0 | prog | tests | 0 | inspect | .047 | .048 | 5.6 | .091 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .060 | .061 | 9.0 | 0 | 0 | ||
test23-2.yml | unknown | .0 | prog | tests | 0 | inspect | .019 | .019 | 5.7 | .15 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .059 | .060 | 9.0 | 0 | 0 | ||
test24-1.yml | unknown | .0 | prog | tests | 0 | inspect | .049 | .050 | 5.7 | .090 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .063 | .064 | 8.9 | 0 | 0 | ||
test24-2.yml | unknown | .0 | prog | tests | 0 | inspect | .023 | .025 | 5.7 | .16 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .065 | .066 | 9.0 | 0 | 0 | ||
test25-1.yml | unknown | .0 | prog | tests | 0 | inspect | .031 | .031 | 5.7 | .068 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .065 | .066 | 8.9 | 0 | 0 | ||
test25-2.yml | unknown | .0 | prog | tests | 0 | inspect | .023 | .024 | 5.7 | .17 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .070 | .071 | 9.0 | 0 | 0 | ||
test28-1.yml | unknown | .0 | prog | tests | 0 | inspect | .053 | .054 | 5.8 | .089 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .060 | .061 | 9.0 | 0 | 0 | ||
test28-2.yml | unknown | .0 | prog | tests | 0 | inspect | .022 | .022 | 5.7 | .12 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .057 | .059 | 9.0 | 0 | 0 | ||
test29-1.yml | unknown | .0 | prog | tests | 0 | inspect | .027 | .028 | 5.7 | .12 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .087 | .088 | 8.9 | 0 | 0 | ||
test29-2.yml | unknown | .0 | prog | tests | 0 | inspect | .029 | .031 | 5.7 | .19 | 0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .060 | .060 | 8.9 | 0 | 0 | ||
sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
total | 25 | .0 | .69 | .71 | 140 | 3.1 | 0 | 0 | 25 | 0 | 0 | 1.6 | 1.6 | 220 | 0 | 0 | ||||||||||
Run set | esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Heap | tbf-testsuite-validator-esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Heap |