Benchmark VeriFuzz TBF Test-Suite Validator
Tool VeriFuzz 1.0.1 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:17:17 CET 2019-02-06 14:51:38 CET
Run set verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Recursive
Options --testcomp --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/verifuzz.2019-02-06_0717.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
recursive/Ackermann01-2.yml timeout .722 prog tests 17 inspect 900 910 150 13000 1.0  0   unknown prog tests 0 inspect
72.2 94.1 .17 .16 16 .34  0  
recursive/Ackermann02.yml error .875 prog tests 17 inspect 900 900 150 11000 15    0   true prog tests 1 inspect
87.5 100   .18 .17 16 .34  0  
recursive/Ackermann03.yml timeout .833 prog tests 17 inspect 900 910 150 14000 1.0  0   unknown prog tests 0 inspect
83.3 94.1 1.1  1.0  16 .34  0  
recursive/Ackermann04.yml timeout .833 prog tests 17 inspect 900 910 150 13000 1.0  0   unknown prog tests 0 inspect
83.3 94.1 .17 .16 17 .34  0  
recursive/Addition01-2.yml timeout .625 prog tests 14 inspect 900 900 150 10000 .70 0   unknown prog tests 0 inspect
62.5 79.0 .16 .17 17 .29  0  
recursive/Addition02.yml timeout .688 prog tests 14 inspect 900 900 150 12000 43    0   true prog tests 1 inspect
68.8 84.2 .16 .15 16 .29  0  
recursive/Addition03-1.yml timeout .5   prog tests 20 inspect 900 900 150 11000 .79 0   unknown prog tests 0 inspect
50.0 86.7 .17 .17 16 .37  0  
recursive/BallRajamani-SPIN2000-Fig1.yml error 1.0   prog tests 2 inspect 890 900 150 12000 7400    0   true prog tests 1 inspect
100   100   .12 .12 16 .094 0  
recursive/EvenOdd01-1.yml timeout .786 prog tests 13 inspect 900 900 150 12000 .75 0   unknown prog tests 0 inspect
78.6 90.5 .15 .15 16 .27  0  
recursive/EvenOdd03.yml timeout .786 prog tests 13 inspect 900 900 150 11000 11    0   true prog tests 1 inspect
78.6 90.5 .16 .15 17 .27  0  
recursive/Fibonacci01-1.yml timeout .8   prog tests 14 inspect 900 900 150 12000 .74 0   unknown prog tests 0 inspect
80.0 92.9 .20 .19 16 .29  0  
recursive/Fibonacci03.yml timeout .9   prog tests 14 inspect 900 900 150 11000 .75 0   unknown prog tests 0 inspect
90.0 92.9 .21 .20 16 .29  0  
recursive/Fibonacci04.yml timeout .875 prog tests 14 inspect 900 900 150 14000 .88 0   true prog tests 1 inspect
87.5 100   .54 .57 16 .29  0  
recursive/Fibonacci05.yml timeout 1.0   prog tests 13 inspect 900 900 150 11000 .76 0   true prog tests 1 inspect
100   100   .20 .20 17 .27  0  
recursive/McCarthy91-1.yml timeout .875 prog tests 18 inspect 900 900 150 12000 1.4  0   true prog tests 1 inspect
87.5 100   .18 .17 16 .36  0  
recursive/McCarthy91-2.yml timeout .75  prog tests 17 inspect 900 900 150 17000 .75 0   unknown prog tests 0 inspect
75.0 90.0 .16 .15 16 .32  0  
recursive/MultCommutative-2.yml timeout .556 prog tests 14 inspect 900 920 150 12000 1.2  0   unknown prog tests 0 inspect
55.6 88.9 .16 .15 16 .29  0  
recursive/gcd01-1.yml timeout .611 prog tests 24 inspect 900 900 150 11000 .75 0   unknown prog tests 0 inspect
61.1 89.5 .19 .18 16 .45  0  
recursive/gcd02.yml timeout .727 prog tests 20 inspect 900 900 150 9100 .91 0   unknown prog tests 0 inspect
72.7 88.5 .15 .14 16 .23  0  
recursive/recHanoi01.yml timeout .8   prog tests 11 inspect 900 900 150 11000 .75 0   unknown prog tests 0 inspect
80.0 95.0 .15 .15 16 .24  0  
recursive/recHanoi02-2.yml timeout .75  prog tests 10 inspect 900 920 160 12000 1.1  0   unknown prog tests 0 inspect
75.0 91.7 .14 .14 17 .23  0  
recursive/recHanoi03-2.yml timeout .75  prog tests 10 inspect 900 920 150 11000 1.1  0   unknown prog tests 0 inspect
75.0 91.7 .16 .16 16 .23  0  
recursive-simple/id2_b2_o3.yml timeout .9   prog tests 16 inspect 900 900 150 11000 .75 0   unknown prog tests 0 inspect
90.0 93.3 .21 .22 16 .32  0  
recursive-simple/id2_b3_o2.yml timeout 1.0   prog tests 16 inspect 900 900 150 10000 3.5  0   true prog tests 1 inspect
100   100   .17 .23 16 .32  0  
recursive-simple/id2_b3_o5.yml timeout .9   prog tests 16 inspect 900 900 150 11000 .73 0   unknown prog tests 0 inspect
90.0 93.3 .17 .16 16 .32  0  
recursive-simple/id2_b5_o10.yml timeout .9   prog tests 18 inspect 900 900 150 12000 .75 0   unknown prog tests 0 inspect
90.0 93.3 .17 .16 16 .36  0  
recursive-simple/id_b2_o3.yml timeout .833 prog tests 13 inspect 900 900 150 11000 1.2  0   unknown prog tests 0 inspect
83.3 90.0 .15 .16 17 .27  0  
recursive-simple/id_b3_o2-2.yml timeout 1.0   prog tests 14 inspect 900 900 150 11000 1.7  0   true prog tests 1 inspect
100   100   .18 .18 16 .29  0  
recursive-simple/id_b3_o5-2.yml timeout .833 prog tests 14 inspect 900 900 150 12000 .75 0   unknown prog tests 0 inspect
83.3 90.0 .15 .14 16 .29  0  
recursive-simple/id_b5_o10-2.yml timeout .833 prog tests 14 inspect 900 900 150 11000 .76 0   unknown prog tests 0 inspect
83.3 90.0 .15 .15 16 .29  0  
recursive-simple/id_o10.yml timeout 1.0   prog tests 13 inspect 900 900 150 12000 .72 0   true prog tests 1 inspect
100   100   .16 .16 16 .27  0  
recursive-simple/id_o100.yml timeout 1.0   prog tests 13 inspect 900 900 150 10000 .79 0   true prog tests 1 inspect
100   100   .15 .15 16 .27  0  
recursive-simple/id_o1000.yml timeout 1.0   prog tests 13 inspect 900 900 150 12000 .79 0   true prog tests 1 inspect
100   100   .15 .15 16 .27  0  
recursive-simple/id_o20.yml timeout 1.0   prog tests 13 inspect 900 900 150 10000 .72 0   true prog tests 1 inspect
100   100   .16 .17 16 .27  0  
recursive-simple/id_o200.yml timeout .75  prog tests 12 inspect 900 900 150 11000 .68 0   unknown prog tests 0 inspect
75.0 87.5 .17 .16 16 .26  0  
recursive-simple/id_o3.yml timeout 1.0   prog tests 12 inspect 900 900 150 10000 .76 0   true prog tests 1 inspect
100   100   .16 .19 17 .26  0  
recursive-simple/sum_non_eq-2.yml timeout .75  prog tests 12 inspect 900 900 150 10000 .68 0   unknown prog tests 0 inspect
75.0 90.0 .15 .15 16 .26  0  
recursive-simple/sum_non_eq-3.yml timeout .75  prog tests 12 inspect 900 900 150 11000 3.5  0   true prog tests 1 inspect
75.0 100   .15 .14 16 .26  0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 38 31.5 34000 34000 5800 440000 7600 0   38 3150 3560 7.5 7.5 620 11 0  
Run set verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Recursive