Benchmark VeriFuzz TBF Test-Suite Validator
Tool VeriFuzz 1.0.1 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:17:17 CET 2019-02-06 14:51:38 CET
Run set verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Heap tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Heap
Options --testcomp --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/verifuzz.2019-02-06_0717.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ldv-regression/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
alias_of_return_2.c_1.yml timeout .25  prog tests 8 inspect 900 920 150 13000 1.2  0   unknown prog tests 0 inspect
25.0 45.5 .14 .14 17 .19  0  
alias_of_return_2.yml timeout .5   prog tests 1 inspect 900 920 150 13000 .97 0   unknown prog tests 0 inspect
50.0 72.7 .11 .11 17 .078 0  
fo_test.yml error 1.0   prog tests 8 inspect 890 900 170 11000 2800    0   true prog tests 1 inspect
100   100   .17 .17 16 .48  0  
rule60_list2.c_1.yml error .929 prog tests 21 inspect 890 900 170 11000 4400    0   true prog tests 1 inspect
92.9 100   .22 .23 17 .99  0  
rule60_list2.yml timeout .857 prog tests 18 inspect 900 920 170 13000 .76 0   unknown prog tests 0 inspect
85.7 92.9 .19 .20 16 .85  0  
sizeofparameters_test.yml timeout .5   prog tests 2 inspect 900 920 170 13000 .87 0   unknown prog tests 0 inspect
50.0 80.0 .12 .12 16 .12  0  
test10.yml timeout .5   prog tests 2 inspect 900 920 150 13000 .94 0   unknown prog tests 0 inspect
50.0 95.5 .14 .14 16 .094 0  
test11.yml timeout .6   prog tests 2 inspect 900 920 150 12000 .99 0   unknown prog tests 0 inspect
60.0 86.7 .12 .11 16 .094 0  
test14.yml timeout .5   prog tests 8 inspect 900 920 150 12000 .91 0   unknown prog tests 0 inspect
50.0 91.7 .14 .13 16 .19  0  
test15.yml timeout .5   prog tests 2 inspect 900 920 150 13000 .98 0   unknown prog tests 0 inspect
50.0 80.0 .11 .11 16 .094 0  
test19.yml timeout .5   prog tests 2 inspect 900 920 150 11000 .97 0   unknown prog tests 0 inspect
50.0 85.7 .12 .12 16 .094 0  
test21-1.yml timeout .75  prog tests 9 inspect 900 920 150 11000 1.1  0   unknown prog tests 0 inspect
75.0 88.9 .16 .16 17 .21  0  
test21-2.yml error .875 prog tests 9 inspect 890 900 150 13000 11000    0   true prog tests 1 inspect
87.5 100   .14 .16 16 .21  0  
test22-1.yml timeout .75  prog tests 3 inspect 900 920 150 11000 1.1  0   unknown prog tests 0 inspect
75.0 91.3 .13 .13 16 .11  0  
test22-2.yml timeout .833 prog tests 10 inspect 900 900 150 12000 2.6  0   true prog tests 1 inspect
83.3 100   3.5  3.5  17 .23  0  
test23-1.yml error .714 prog tests 2 inspect 880 900 150 13000 5400    0   true prog tests 1 inspect
71.4 100   .12 .12 16 .098 0  
test23-2.yml error .714 prog tests 2 inspect 880 900 150 11000 .90 0   unknown prog tests 0 inspect
71.4 91.7 .12 .12 17 .098 0  
test24-1.yml timeout .75  prog tests 3 inspect 900 920 150 11000 1.1  0   unknown prog tests 0 inspect
75.0 86.7 .13 .13 16 .11  0  
test24-2.yml error .8   prog tests 3 inspect 890 900 150 12000 7800    0   true prog tests 1 inspect
80.0 94.4 .12 .12 16 .11  0  
test25-1.yml error .917 prog tests 4 inspect 880 900 150 13000 1500    0   true prog tests 1 inspect
91.7 100   .13 .13 17 .13  0  
test25-2.yml timeout .833 prog tests 3 inspect 900 920 150 11000 1.1  0   unknown prog tests 0 inspect
83.3 88.9 .12 .12 17 .11  0  
test28-1.yml timeout .875 prog tests 2 inspect 900 920 150 11000 .93 0   true prog tests 1 inspect
87.5 100   .12 .12 17 .086 0  
test28-2.yml timeout .875 prog tests 2 inspect 900 920 150 12000 .93 0   unknown prog tests 0 inspect
87.5 80.0 .12 .12 17 .086 0  
test29-1.yml error 1.0   prog tests 3 inspect 880 900 150 11000 420    0   true prog tests 1 inspect
100   100   .13 .12 16 .11  0  
test29-2.yml timeout .875 prog tests 2 inspect 900 920 150 13000 .95 0   unknown prog tests 0 inspect
87.5 80.0 .14 .14 16 .086 0  
sv-benchmarks/c/ldv-regression/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 25 18.2 22000 23000 3900 300000 33000 0   25 1820 2230 6.8 6.8 410 5.1 0  
Run set verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Heap tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Heap