| Benchmark | CPA/Tiger-MGP | TBF Test-Suite Validator | ||||||||||||||||||||||||
| Tool | CPAchecker 1.8-svn 30541M | Tbf Test-suite Validator v1.2 | ||||||||||||||||||||||||
| Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2 | ||||||||||||||||||||||||
| Host | apollon* | |||||||||||||||||||||||||
| OS | Linux 4.15.0-45-generic | |||||||||||||||||||||||||
| System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB | |||||||||||||||||||||||||
| Date of execution | 2019-02-05 21:13:54 CET | 2019-02-06 06:15:02 CET | ||||||||||||||||||||||||
| Run set | cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-ControlFlow | tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-ControlFlow | ||||||||||||||||||||||||
| Options | -benchmark -heap 10000M -tigertestcomp19 | --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/cpa-tiger.2019-02-05_2113.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip | ||||||||||||||||||||||||
| sv-benchmarks/c/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
| ntdrivers-simplified/cdaudio_simpl1.cil-1.yml | unknown | 1 | prog | tests | 1 | inspect | 9.6 | 4.0 | 400 | 79 | .0041 | 0 | true | prog | tests | 1 | inspect |
|
9.12 | 14.5 | .28 | .28 | 20 | .29 | 0 | |
| ntdrivers-simplified/floppy_simpl3.cil-1.yml | unknown | 1 | prog | tests | 1 | inspect | 5.8 | 2.7 | 320 | 57 | .0041 | 0 | true | prog | tests | 1 | inspect |
|
19.8 | 32.8 | .19 | .19 | 18 | .19 | 0 | |
| ntdrivers-simplified/floppy_simpl4.cil-1.yml | unknown | 1 | prog | tests | 1 | inspect | 7.5 | 3.4 | 350 | 68 | .0041 | 0 | true | prog | tests | 1 | inspect |
|
14.5 | 23.9 | .34 | .35 | 38 | .24 | 0 | |
| ntdrivers-simplified/kbfiltr_simpl2.cil-2.yml | unknown | 1 | prog | tests | 1 | inspect | 4.9 | 2.1 | 300 | 45 | .0041 | 0 | true | prog | tests | 1 | inspect |
|
12.5 | 26.9 | .20 | .20 | 17 | .17 | 0 | |
| ssh-simplified/s3_clnt_1.cil-2.yml | unknown | 1 | prog | tests | 1 | inspect | 6.9 | 2.5 | 330 | 59 | .0041 | 0 | true | prog | tests | 1 | inspect |
|
26.5 | 40.2 | .29 | .29 | 17 | .12 | 0 | |
| ssh-simplified/s3_clnt_2.cil-1.yml | unknown | 1 | prog | tests | 1 | inspect | 5.9 | 2.4 | 310 | 49 | .0041 | 0 | true | prog | tests | 1 | inspect |
|
26.5 | 41.6 | .26 | .26 | 17 | .12 | 0 | |
| ssh-simplified/s3_clnt_3.cil-2.yml | unknown | 1 | prog | tests | 1 | inspect | 7.2 | 2.7 | 340 | 64 | .0041 | 0 | true | prog | tests | 1 | inspect |
|
26.5 | 42.7 | .27 | .27 | 17 | .12 | 0 | |
| ssh-simplified/s3_clnt_4.cil-2.yml | unknown | 1 | prog | tests | 1 | inspect | 6.1 | 2.4 | 310 | 56 | .0041 | 0 | true | prog | tests | 1 | inspect |
|
23.5 | 39.3 | .26 | .26 | 17 | .12 | 0 | |
| sv-benchmarks/c/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
| total | 8 | 8 | 54 | 22 | 2700 | 480 | .033 | 0 | 8 | 159 | 262 | 2.1 | 2.1 | 160 | 1.4 | 0 | ||||||||||
| Run set | cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-ControlFlow | tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-ControlFlow | ||||||||||||||||||||||||