Benchmark FairFuzz TBF Test-Suite Validator
Tool FairFuzz TC-0.0.2 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-08 09:39:09 CET 2019-02-08 13:22:04 CET
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Arrays tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Arrays
Options --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/standard_copy1_ground-2.yml timeout 1 prog tests 7 inspect 900   910   59 13000 .31 0     true prog tests 1 inspect
87.5 90.0 5.3   5.3   810   .078 0  
array-examples/standard_copy2_ground-1.yml timeout 1 prog tests 9 inspect 900   910   71 11000 .32 0     true prog tests 1 inspect
90.0 91.7 5.4   5.4   810   .078 0  
array-examples/standard_copy3_ground-2.yml timeout 1 prog tests 9 inspect 900   910   72 11000 .31 0     true prog tests 1 inspect
91.7 92.9 5.4   5.4   810   .078 0  
array-examples/standard_copy4_ground-2.yml timeout 1 prog tests 10 inspect 900   910   79 13000 .31 0     true prog tests 1 inspect
92.9 93.8 5.3   5.3   810   .078 0  
array-examples/standard_copy5_ground-2.yml timeout 1 prog tests 7 inspect 900   910   63 13000 .31 0     true prog tests 1 inspect
93.8 94.4 5.3   5.3   810   .078 0  
array-examples/standard_copy6_ground-1.yml timeout 1 prog tests 9 inspect 900   910   74 11000 .32 0     true prog tests 1 inspect
94.4 95.0 5.4   5.4   810   .078 0  
array-examples/standard_copy7_ground-1.yml timeout 1 prog tests 7 inspect 900   910   62 11000 .31 0     true prog tests 1 inspect
95.0 95.5 5.4   5.4   810   .082 0  
array-examples/standard_copy8_ground-2.yml timeout 1 prog tests 8 inspect 900   910   65 9900 .31 0     true prog tests 1 inspect
95.5 95.8 5.4   5.4   810   .082 0  
array-examples/standard_copy9_ground-1.yml timeout 1 prog tests 10 inspect 900   910   79 11000 .32 0     true prog tests 1 inspect
95.8 96.2 5.3   5.4   810   .082 0  
array-examples/standard_partition_ground-1.yml couldn't run: all seeds time out or crash prog tests 0 inspect 1.4 1.4 14 17 .23 0     unknown prog tests 0 inspect
0   0   .059 .059 9.1 0     0  
array-industry-pattern/array_ptr_single_elem_init-2.yml couldn't run: all seeds time out or crash prog tests 0 inspect 1.4 1.4 15 15 .20 0     unknown prog tests 0 inspect
0   0   .059 .060 9.0 0     0  
array-industry-pattern/array_single_elem_init.yml timeout prog tests 18 inspect 900   910   69 12000 .70 .061 unknown prog tests 0 inspect
92.9 100   44     44     450   .36  0  
reducercommutativity/rangesum.yml false(unreach-call) 1 prog tests 41 inspect 730   730   57 8800 .40 0     true prog tests 1 inspect
81.2 96.8 3.7   3.7   220   .15  0  
reducercommutativity/rangesum05.yml false(unreach-call) 1 prog tests 2 inspect 11   9.8 15 32 .21 .094 true prog tests 1 inspect
85.7 96.3 .12  .14  16   .098 0  
reducercommutativity/rangesum10.yml false(unreach-call) 1 prog tests 2 inspect 8.4 7.7 13 27 .21 0     true prog tests 1 inspect
85.7 96.3 .12  .12  16   .098 0  
reducercommutativity/rangesum20.yml false(unreach-call) 1 prog tests 2 inspect 8.6 7.9 13 37 .24 0     true prog tests 1 inspect
85.7 96.3 .12  .12  16   .098 0  
reducercommutativity/rangesum40.yml false(unreach-call) 1 prog tests 2 inspect 14   13   12 42 .24 0     true prog tests 1 inspect
78.6 92.6 .12  .13  16   .082 0  
reducercommutativity/rangesum60.yml false(unreach-call) 1 prog tests 2 inspect 14   13   12 52 .24 .061 true prog tests 1 inspect
85.7 96.3 .13  .13  16   .098 0  
array-tiling/mlceu.yml done prog tests 21 inspect 28   26   14 120 .29 0     unknown prog tests 0 inspect
75.0 91.7 .19  .20  16   .41  0  
array-tiling/skippedu.yml timeout 1 prog tests 46 inspect 900   900   34 13000 .85 0     true prog tests 1 inspect
88.9 100   1.8   1.8   150   .18  0  
array-programs/copysome1-2.yml couldn't run: all seeds time out or crash prog tests 0 inspect 3.1 3.2 17 45 .20 0     unknown prog tests 0 inspect
0   0   .062 .063 9.0 0     0  
array-programs/copysome2-2.yml couldn't run: all seeds time out or crash prog tests 0 inspect 3.1 3.2 15 44 .20 0     unknown prog tests 0 inspect
0   0   .061 .062 8.9 0     0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 22 16 11000 11000 920 140000 7.0 .22 22 1600 1710 99 99 8300 2.3 0  
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Arrays tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Arrays