Benchmark | PRtest | TBF Test-Suite Validator | ||||||||||||||||||||||||
Tool | tbf v0.3.0-testcomp19 | Tbf Test-suite Validator v1.2 | ||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2 | ||||||||||||||||||||||||
Host | apollon* | [apollon010; apollon052; apollon080; apollon107; apollon135; apollon167] | ||||||||||||||||||||||||
OS | Linux 4.15.0-45-generic | |||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB | |||||||||||||||||||||||||
Date of execution | 2019-02-06 06:02:44 CET | 2019-02-06 13:26:19 CET | ||||||||||||||||||||||||
Run set | prtest.test-comp19_prop-coverage-error-call.ReachSafety-Recursive | tbf-testsuite-validator-prtest.test-comp19_prop-coverage-error-call.ReachSafety-Recursive | ||||||||||||||||||||||||
Options | --stats -i random --write-xml --svcomp-nondets | --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/prtest.2019-02-06_0602.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip | ||||||||||||||||||||||||
sv-benchmarks/c/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
recursive/Ackermann02.yml | timeout | prog | tests | 4 | inspect | 900 | 840 | 30 | 15000 | .029 | 0 | unknown | prog | tests | 0 | inspect | 43.8 | 41.2 | .14 | .14 | 17 | .13 | 0 | |||
recursive/Addition02.yml | error (0) | prog | tests | 2 | inspect | .24 | .42 | 31 | 3.4 | 0 | 0 | unknown | prog | tests | 0 | inspect | 18.8 | 21.1 | .14 | .14 | 16 | .094 | 0 | |||
recursive/BallRajamani-SPIN2000-Fig1.yml | unknown | 1 | prog | tests | 1 | inspect | .23 | .33 | 30 | 3.3 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 100 | .12 | .12 | 16 | .078 | 0 | ||
recursive/EvenOdd03.yml | error (0) | prog | tests | 1 | inspect | .27 | .45 | 31 | 3.2 | 0 | 0 | unknown | prog | tests | 0 | inspect | 7.14 | 19.1 | .12 | .12 | 16 | .078 | 0 | |||
recursive/Fibonacci04.yml | error (0) | prog | tests | 1 | inspect | .25 | .44 | 31 | 4.1 | 0 | 0 | unknown | prog | tests | 0 | inspect | 25.0 | 66.7 | .12 | .12 | 16 | .078 | 0 | |||
recursive/Fibonacci05.yml | error (0) | prog | tests | 1 | inspect | .27 | .46 | 31 | 2.8 | 0 | 0 | unknown | prog | tests | 0 | inspect | 25.0 | 66.7 | .12 | .12 | 16 | .078 | 0 | |||
recursive/McCarthy91-1.yml | error (0) | prog | tests | 0 | inspect | .25 | .44 | 31 | 3.1 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .059 | .060 | 9.0 | 0 | 0 | |||
recursive-simple/id2_b3_o2.yml | error (0) | prog | tests | 0 | inspect | .26 | .45 | 31 | 3.1 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .059 | .059 | 9.0 | 0 | 0 | |||
recursive-simple/id_b3_o2-2.yml | error (0) | prog | tests | 0 | inspect | .26 | .45 | 31 | 3.0 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .059 | .060 | 9.0 | 0 | 0 | |||
recursive-simple/id_o10.yml | error (0) | prog | tests | 0 | inspect | .26 | .45 | 31 | 3.0 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .060 | .060 | 9.0 | 0 | 0 | |||
recursive-simple/id_o100.yml | error (0) | prog | tests | 0 | inspect | .26 | .45 | 31 | 3.0 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .071 | .072 | 9.0 | 0 | 0 | |||
recursive-simple/id_o1000.yml | error (0) | prog | tests | 0 | inspect | .25 | .44 | 30 | 3.0 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .060 | .060 | 9.0 | 0 | 0 | |||
recursive-simple/id_o20.yml | error (0) | prog | tests | 0 | inspect | .27 | .46 | 31 | 3.1 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .061 | .061 | 9.0 | 0 | 0 | |||
recursive-simple/id_o200.yml | error (0) | prog | tests | 0 | inspect | .26 | .44 | 30 | 3.2 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .065 | .067 | 9.1 | 0 | 0 | |||
recursive-simple/id_o3.yml | error (0) | prog | tests | 0 | inspect | .26 | .45 | 30 | 3.6 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .062 | .063 | 9.1 | 0 | 0 | |||
recursive-simple/sum_non_eq-3.yml | error (0) | prog | tests | 0 | inspect | .26 | .44 | 30 | 2.8 | 0 | 0 | unknown | prog | tests | 0 | inspect | 0 | 0 | .060 | .062 | 8.9 | 0 | 0 | |||
sv-benchmarks/c/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
total | 16 | 1 | 900 | 850 | 490 | 16000 | .029 | 0 | 16 | 195 | 315 | 1.4 | 1.4 | 190 | .53 | 0 | ||||||||||
Run set | prtest.test-comp19_prop-coverage-error-call.ReachSafety-Recursive | tbf-testsuite-validator-prtest.test-comp19_prop-coverage-error-call.ReachSafety-Recursive |