Benchmark CPA/Tiger-MGP TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30541M Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:13:54 CET 2019-02-06 06:15:02 CET
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Heap tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Heap
Options -benchmark -heap 10000M -tigertestcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/cpa-tiger.2019-02-05_2113.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ldv-regression/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
alias_of_return_2.c_1.yml true .25  prog tests 1 inspect 3.0 1.3 270 29 .0041 0   unknown prog tests 0 inspect
25.0 45.5 .12 .12 16 .078 0  
alias_of_return_2.yml true .75  prog tests 3 inspect 3.2 1.4 270 26 .0041 0   unknown prog tests 0 inspect
75.0 81.8 .13 .17 17 .11  0  
fo_test.yml unknown .5   prog tests 4 inspect 3.8 1.5 270 39 .0041 0   true prog tests 1 inspect
50.0 87.5 .17 .21 16 .25  0  
rule60_list2.c_1.yml unknown .929 prog tests 9 inspect 4.4 1.8 280 44 .0041 0   true prog tests 1 inspect
92.9 100   .17 .17 16 .45  0  
rule60_list2.yml true .857 prog tests 7 inspect 4.3 1.7 280 43 .0041 0   unknown prog tests 0 inspect
85.7 92.9 .15 .15 17 .36  0  
sizeofparameters_test.yml true .5   prog tests 1 inspect 3.6 1.5 270 37 .0041 0   unknown prog tests 0 inspect
50.0 80.0 .12 .12 16 .078 0  
test10.yml unknown .5   prog tests 1 inspect 3.1 1.4 260 30 .0041 0   unknown prog tests 0 inspect
50.0 95.5 .12 .12 16 .078 0  
test11.yml true .6   prog tests 4 inspect 3.3 1.4 270 35 .0041 0   unknown prog tests 0 inspect
60.0 86.7 .13 .15 16 .13  0  
test14.yml unknown .625 prog tests 3 inspect 3.1 1.4 260 32 .0041 0   unknown prog tests 0 inspect
62.5 91.7 .12 .15 16 .11  0  
test15.yml unknown .5   prog tests 1 inspect 2.9 1.3 270 28 .0041 0   unknown prog tests 0 inspect
50.0 80.0 .12 .12 16 .078 0  
test19.yml unknown .5   prog tests 1 inspect 2.9 1.3 260 26 .0041 0   unknown prog tests 0 inspect
50.0 85.7 .11 .11 16 .078 0  
test21-1.yml unknown .75  prog tests 4 inspect 3.3 1.4 270 31 .0041 0   unknown prog tests 0 inspect
75.0 88.9 .13 .12 16 .13  0  
test21-2.yml unknown .875 prog tests 5 inspect 3.4 1.5 270 34 .0041 0   true prog tests 1 inspect
87.5 100   .13 .13 17 .15  0  
test22-1.yml unknown .833 prog tests 7 inspect 12   8.8 290 150 .0041 0   unknown prog tests 0 inspect
83.3 91.3 .14 .14 16 .18  0  
test22-2.yml unknown .917 prog tests 7 inspect 3.6 1.6 280 38 .0041 0   true prog tests 1 inspect
91.7 100   .14 .17 17 .17  0  
test23-1.yml unknown .857 prog tests 7 inspect 21   18   340 250 .0041 0   true prog tests 1 inspect
85.7 100   .15 .19 16 .18  0  
test23-2.yml unknown .857 prog tests 7 inspect 12   8.8 300 110 .0041 0   unknown prog tests 0 inspect
85.7 91.7 .14 .14 17 .18  0  
test24-1.yml unknown .875 prog tests 5 inspect 12   8.3 350 120 .0041 0   unknown prog tests 0 inspect
87.5 86.7 .13 .13 17 .14  0  
test24-2.yml unknown .9   prog tests 4 inspect 9.8 4.2 450 110 .0041 0   true prog tests 1 inspect
90.0 94.4 .14 .14 16 .13  0  
test25-1.yml unknown 1.0   prog tests 6 inspect 20   15   390 220 .0041 0   true prog tests 1 inspect
100   100   .16 .16 16 .16  0  
test25-2.yml timeout .75  prog tests 2 inspect 900   900   1200 11000 .0041 0   unknown prog tests 0 inspect
75.0 88.9 .14 .14 16 .094 0  
test28-1.yml unknown .875 prog tests 5 inspect 3.2 1.4 270 32 .0041 0   true prog tests 1 inspect
87.5 100   .14 .14 16 .14  0  
test28-2.yml unknown .875 prog tests 6 inspect 3.3 1.5 270 30 .0041 0   unknown prog tests 0 inspect
87.5 80.0 .12 .12 16 .15  0  
test29-1.yml unknown 1.0   prog tests 4 inspect 3.0 1.3 270 30 .0041 0   true prog tests 1 inspect
100   100   .12 .14 16 .12  0  
test29-2.yml unknown .875 prog tests 2 inspect 3.1 1.3 270 29 .0041 0   unknown prog tests 0 inspect
87.5 80.0 .15 .15 16 .086 0  
sv-benchmarks/c/ldv-regression/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 25 18.7  1000 990   8200 12000 .10  0   25 1870 2230 3.4 3.6 410 3.8 0  
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Heap tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Heap