Benchmark VeriFuzz TBF Test-Suite Validator
Tool VeriFuzz 1.0.1 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:17:17 CET 2019-02-06 14:51:38 CET
Run set verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops
Options --testcomp --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/verifuzz.2019-02-06_0717.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-2.yml done 1 prog tests 1 inspect 3.5 2.1 150 33 .54 0   true prog tests 1 inspect
66.7 86.7 .11  .11  16   .078 0  
loops/compact.yml done 1 prog tests 1 inspect 4.0 2.7 150 41 .73 0   true prog tests 1 inspect
83.3 87.5 2.7   2.7   420   .070 0  
loops/count_up_down-2.yml done 1 prog tests 1 inspect 5.4 3.9 150 54 .53 0   true prog tests 1 inspect
50.0 72.7 .11  .11  17   .078 0  
loops/eureka_01-1.yml done 1 prog tests 1 inspect 4.4 3.1 150 51 .65 0   true prog tests 1 inspect
76.9 93.5 .11  .11  16   .082 0  
loops/for_bounded_loop1.yml done 1 prog tests 1 inspect 3.4 2.0 150 29 .48 0   true prog tests 1 inspect
75.0 100   .11  .11  16   .078 0  
loops/insertion_sort-1.yml done 1 prog tests 1 inspect 3.6 2.4 150 41 1.1  0   true prog tests 1 inspect
91.7 94.4 .18  .18  18   .078 0  
loops/invert_string-1.yml done 1 prog tests 1 inspect 3.4 2.0 150 34 .57 0   true prog tests 1 inspect
87.5 100   .15  .15  16   .078 0  
loops/linear_search.yml done 1 prog tests 1 inspect 3.7 2.2 150 41 1.5  0   true prog tests 1 inspect
64.3 94.1 .14  .14  17   .078 0  
loops/matrix-2.yml done 1 prog tests 1 inspect 12   11   150 130 .64 0   true prog tests 1 inspect
83.3 100   2.8   2.8   430   .082 0  
loops/nec20.yml done 1 prog tests 1 inspect 3.8 2.4 150 37 1.6  0   true prog tests 1 inspect
41.7 62.5 .12  .12  16   .078 0  
loops/string-2.yml done 1 prog tests 1 inspect 4.0 2.5 150 41 .63 0   true prog tests 1 inspect
69.2 86.2 .11  .11  16   .082 0  
loops/sum01-1.yml done 1 prog tests 1 inspect 6.7 5.4 160 69 .66 0   true prog tests 1 inspect
70.0 90.0 .12  .12  16   .078 0  
loops/sum01_bug02.yml done 1 prog tests 1 inspect 8.9 7.6 150 98 .54 0   true prog tests 1 inspect
70.0 90.9 2.5   2.5   16   .078 0  
loops/sum01_bug02_sum01_bug02_base.case.yml done 1 prog tests 1 inspect 9.4 7.9 150 79 .71 0   true prog tests 1 inspect
70.0 90.0 .67  .67  16   .078 0  
loops/sum03-1.yml done 1 prog tests 1 inspect 3.4 2.2 150 34 .54 0   true prog tests 1 inspect
87.5 100   .12  .12  17   .078 0  
loops/sum_array-1.yml done 1 prog tests 1 inspect 10   9.1 150 130 .65 0   true prog tests 1 inspect
80.0 93.8 .12  .12  16   .078 0  
loops/terminator_01.yml done 1 prog tests 1 inspect 3.4 2.1 150 35 .53 0   true prog tests 1 inspect
50.0 72.7 .11  .11  16   .078 0  
loops/terminator_02-1.yml done 1 prog tests 1 inspect 3.4 2.0 150 35 .53 0   true prog tests 1 inspect
25.0 56.2 .11  .11  16   .078 0  
loops/terminator_03-1.yml done 1 prog tests 1 inspect 3.3 2.1 150 31 .53 0   true prog tests 1 inspect
50.0 83.3 .11  .11  16   .078 0  
loops/trex01-1.yml done 1 prog tests 1 inspect 3.6 2.3 150 40 .55 0   true prog tests 1 inspect
28.6 50.0 .13  .13  16   .082 0  
loops/trex02-2.yml done 1 prog tests 1 inspect 24   23   150 290 .61 0   true prog tests 1 inspect
33.3 50.0 .12  .12  17   .078 0  
loops/trex03-1.yml error prog tests 0 inspect 12   10   150 160 .54 0   error (0) prog tests 0 inspect
0   0   .065 .065 9.0 0     0  
loops/vogal-2.yml done 1 prog tests 1 inspect 3.8 2.4 150 40 .72 0   true prog tests 1 inspect
88.9 88.5 .12  .12  16   .078 0  
loop-acceleration/array_3-2.yml done 1 prog tests 1 inspect 3.4 1.9 150 38 .54 0   true prog tests 1 inspect
75.0 88.9 .14  .14  17   .078 0  
loop-acceleration/diamond_1-2.yml done 1 prog tests 1 inspect 3.5 2.0 150 34 .54 0   true prog tests 1 inspect
66.7 83.3 .11  .11  17   .078 0  
loop-acceleration/multivar_1-2.yml done 1 prog tests 1 inspect 3.4 2.1 150 34 .53 0   true prog tests 1 inspect
50.0 72.7 .11  .11  16   .078 0  
loop-invgen/id_trans.yml done 1 prog tests 1 inspect 4.1 2.9 150 46 .62 0   true prog tests 1 inspect
62.5 93.3 .12  .12  17   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 27 26 160 120 4100 1700 18 0   27 1700 2180 11 11 1300 2.0 0  
Run set verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops