Benchmark | ESBMC-falsif | TBF Test-Suite Validator | ||||||||||||||||||||||||
Tool | ESBMC version 6.0.0 64-bit x86_64 linux | Tbf Test-suite Validator v1.2 | ||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2 | ||||||||||||||||||||||||
Host | apollon* | |||||||||||||||||||||||||
OS | Linux 4.15.0-45-generic | |||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB | |||||||||||||||||||||||||
Date of execution | 2019-02-05 21:11:17 CET | 2019-02-06 06:16:01 CET | ||||||||||||||||||||||||
Run set | esbmc-falsi.test-comp19_prop-coverage-error-call.ReachSafety-Heap | tbf-testsuite-validator-esbmc-falsi.test-comp19_prop-coverage-error-call.ReachSafety-Heap | ||||||||||||||||||||||||
Options | -s falsi | --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/esbmc-falsi.2019-02-05_2111.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip | ||||||||||||||||||||||||
sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
fo_test.yml | false(unreach-call) | prog | tests | 1 | inspect | .12 | .12 | 27 | .94 | 1.0 | 0 | unknown | prog | tests | 0 | inspect | .00 | 37.5 | .14 | .14 | 17 | .14 | 0 | |||
rule60_list2.c_1.yml | false(unreach-call) | prog | tests | 1 | inspect | .16 | .16 | 27 | 2.4 | 1.0 | 0 | unknown | prog | tests | 0 | inspect | 7.14 | 27.6 | .13 | .13 | 17 | .13 | 0 | |||
test21-2.yml | false(unreach-call) | prog | tests | 0 | inspect | .13 | .13 | 26 | 1.1 | 1.0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .059 | .060 | 9.0 | 0 | 0 | |||
test22-2.yml | false(unreach-call) | prog | tests | 0 | inspect | .11 | .12 | 26 | 1.2 | 1.0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .059 | .060 | 9.0 | 0 | 0 | |||
test23-1.yml | false(unreach-call) | prog | tests | 0 | inspect | 1.4 | 1.4 | 32 | 21 | 1.0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .058 | .059 | 9.0 | 0 | 0 | |||
test24-2.yml | error (1) | prog | tests | 0 | inspect | .33 | .33 | 33 | 3.9 | 1.0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .057 | .057 | 9.0 | 0 | 0 | |||
test25-1.yml | error (1) | prog | tests | 0 | inspect | .24 | .24 | 29 | 2.5 | 1.0 | 0 | error (0) | prog | tests | 0 | inspect | 0 | 0 | .058 | .059 | 9.0 | 0 | 0 | |||
test28-1.yml | false(unreach-call) | 1 | prog | tests | 1 | inspect | .10 | .10 | 26 | 1.1 | 1.0 | 0 | true | prog | tests | 1 | inspect | 50.0 | 80.0 | .12 | .12 | 16 | .086 | 0 | ||
test29-1.yml | false(unreach-call) | prog | tests | 1 | inspect | .11 | .11 | 26 | 1.2 | 1.0 | 0 | unknown | prog | tests | 0 | inspect | 12.5 | 36.4 | .12 | .12 | 17 | .090 | 0 | |||
sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
total | 9 | 1 | 2.7 | 2.7 | 250 | 35 | 9.1 | 0 | 9 | 69.6 | 181 | .80 | .80 | 110 | .45 | 0 | ||||||||||
Run set | esbmc-falsi.test-comp19_prop-coverage-error-call.ReachSafety-Heap | tbf-testsuite-validator-esbmc-falsi.test-comp19_prop-coverage-error-call.ReachSafety-Heap |