Benchmark | PRtest | TBF Test-Suite Validator | ||||||||||||||||||||||||
Tool | tbf v0.3.0-testcomp19 | Tbf Test-suite Validator v1.2 | ||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2 | ||||||||||||||||||||||||
Host | apollon* | [apollon010; apollon052; apollon080; apollon107; apollon135; apollon167] | ||||||||||||||||||||||||
OS | Linux 4.15.0-45-generic | |||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB | |||||||||||||||||||||||||
Date of execution | 2019-02-06 06:02:44 CET | 2019-02-06 13:26:19 CET | ||||||||||||||||||||||||
Run set | prtest.test-comp19_prop-coverage-branches.ReachSafety-Heap | tbf-testsuite-validator-prtest.test-comp19_prop-coverage-branches.ReachSafety-Heap | ||||||||||||||||||||||||
Options | --stats -i random --write-xml --svcomp-nondets | --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/prtest.2019-02-06_0602.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip | ||||||||||||||||||||||||
sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
alias_of_return_2.c_1.yml | timeout | .25 | prog | tests | 1 | inspect | 900 | 850 | 31 | 13000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 25.0 | 45.5 | .12 | .12 | 17 | .078 | 0 | ||
alias_of_return_2.yml | timeout | .75 | prog | tests | 2 | inspect | 900 | 850 | 31 | 12000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 75.0 | 81.8 | .12 | .12 | 17 | .094 | 0 | ||
fo_test.yml | done | .0 | prog | tests | 0 | inspect | .24 | .44 | 31 | 3.4 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .067 | .068 | 9.0 | 0 | 0 | ||
rule60_list2.c_1.yml | timeout | .714 | prog | tests | 3 | inspect | 900 | 850 | 31 | 13000 | .020 | 0 | unknown | prog | tests | 0 | inspect | 71.4 | 89.7 | .14 | .18 | 16 | .14 | 0 | ||
rule60_list2.yml | timeout | .571 | prog | tests | 2 | inspect | 900 | 850 | 31 | 13000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 57.1 | 85.7 | .14 | .14 | 17 | .13 | 0 | ||
sizeofparameters_test.yml | timeout | .5 | prog | tests | 1 | inspect | 900 | 850 | 31 | 12000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 50.0 | 80.0 | .14 | .14 | 16 | .078 | 0 | ||
test10.yml | timeout | .5 | prog | tests | 1 | inspect | 900 | 850 | 31 | 13000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 50.0 | 95.5 | .12 | .12 | 16 | .078 | 0 | ||
test11.yml | timeout | .5 | prog | tests | 1 | inspect | 900 | 850 | 31 | 13000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 50.0 | 86.7 | .12 | .12 | 16 | .078 | 0 | ||
test14.yml | timeout | .5 | prog | tests | 1 | inspect | 900 | 850 | 31 | 14000 | .029 | 0 | unknown | prog | tests | 0 | inspect | 50.0 | 91.7 | .13 | .13 | 16 | .078 | 0 | ||
test15.yml | timeout | .5 | prog | tests | 1 | inspect | 900 | 850 | 31 | 15000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 50.0 | 80.0 | .12 | .12 | 16 | .078 | 0 | ||
test19.yml | timeout | .5 | prog | tests | 1 | inspect | 900 | 850 | 31 | 13000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 50.0 | 85.7 | .11 | .12 | 17 | .078 | 0 | ||
test21-1.yml | timeout | .5 | prog | tests | 2 | inspect | 900 | 840 | 30 | 13000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 50.0 | 88.9 | .12 | .12 | 17 | .098 | 0 | ||
test21-2.yml | done | .0 | prog | tests | 0 | inspect | .25 | .44 | 31 | 3.1 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .062 | .063 | 9.0 | 0 | 0 | ||
test22-1.yml | timeout | .667 | prog | tests | 3 | inspect | 900 | 840 | 31 | 12000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 66.7 | 91.3 | .13 | .13 | 16 | .11 | 0 | ||
test22-2.yml | done | .667 | prog | tests | 3 | inspect | 10 | 9.5 | 31 | 150 | 0 | 0 | unknown | prog | tests | 0 | inspect | 66.7 | 91.3 | .13 | .13 | 16 | .11 | 0 | ||
test23-1.yml | done | .429 | prog | tests | 3 | inspect | 580 | 540 | 31 | 8400 | 0 | 0 | unknown | prog | tests | 0 | inspect | 42.9 | 58.3 | .12 | .12 | 16 | .11 | 0 | ||
test23-2.yml | timeout | .714 | prog | tests | 4 | inspect | 900 | 840 | 31 | 14000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 71.4 | 91.7 | .13 | .13 | 16 | .13 | 0 | ||
test24-1.yml | timeout | .875 | prog | tests | 3 | inspect | 900 | 840 | 31 | 14000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 87.5 | 86.7 | .12 | .12 | 17 | .11 | 0 | ||
test24-2.yml | timeout | .5 | prog | tests | 2 | inspect | 900 | 840 | 31 | 12000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 50.0 | 38.9 | .13 | .13 | 17 | .094 | 0 | ||
test25-1.yml | timeout | .417 | prog | tests | 2 | inspect | 900 | 840 | 30 | 13000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 41.7 | 38.9 | .12 | .12 | 16 | .094 | 0 | ||
test25-2.yml | timeout | .417 | prog | tests | 2 | inspect | 900 | 840 | 31 | 12000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 41.7 | 38.9 | .13 | .12 | 16 | .094 | 0 | ||
test28-1.yml | done | .375 | prog | tests | 1 | inspect | 710 | 660 | 31 | 9800 | 0 | 0 | unknown | prog | tests | 0 | inspect | 37.5 | 70.0 | .12 | .12 | 17 | .070 | 0 | ||
test28-2.yml | timeout | .875 | prog | tests | 2 | inspect | 900 | 850 | 31 | 14000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 87.5 | 80.0 | .12 | .12 | 16 | .086 | 0 | ||
test29-1.yml | done | .375 | prog | tests | 1 | inspect | 690 | 650 | 31 | 11000 | 0 | 0 | unknown | prog | tests | 0 | inspect | 37.5 | 72.7 | .12 | .12 | 16 | .074 | 0 | ||
test29-2.yml | timeout | .875 | prog | tests | 2 | inspect | 900 | 850 | 30 | 12000 | .012 | 0 | unknown | prog | tests | 0 | inspect | 87.5 | 80.0 | .12 | .12 | 17 | .086 | 0 | ||
sv-benchmarks/c/ldv-regression/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
total | 25 | 13.0 | 19000 | 18000 | 770 | 270000 | .26 | 0 | 25 | 1300 | 1750 | 3.0 | 3.0 | 400 | 2.2 | 0 | ||||||||||
Run set | prtest.test-comp19_prop-coverage-branches.ReachSafety-Heap | tbf-testsuite-validator-prtest.test-comp19_prop-coverage-branches.ReachSafety-Heap |