Benchmark FairFuzz TBF Test-Suite Validator
Tool FairFuzz TC-0.0.2 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-08 09:39:09 CET 2019-02-08 13:22:04 CET
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops
Options --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-2.yml false(unreach-call) 1 prog tests 2 inspect 17    16    16 61   .21 0     true prog tests 1 inspect
66.7 86.7 .12  .12  16   .078 0  
loops/compact.yml timeout 1 prog tests 14 inspect 900    910    63 12000   .70 0     true prog tests 1 inspect
100   100   10     10     430   .12  0  
loops/count_up_down-2.yml couldn't run: all seeds time out or crash prog tests 0 inspect .13 .15 10 1.5 .19 0     unknown prog tests 0 inspect
0   0   .059 .060 9.0 0     0  
loops/eureka_01-1.yml false(unreach-call) 1 prog tests 24 inspect 60    55    19 170   .29 0     true prog tests 1 inspect
88.5 100   .15  .21  17   .21  0  
loops/for_bounded_loop1.yml false(unreach-call) 1 prog tests 31 inspect 110    100    19 340   .29 0     true prog tests 1 inspect
100   100   .20  .20  16   .41  0  
loops/insertion_sort-1.yml false(unreach-call) 1 prog tests 20 inspect 35    34    16 440   .30 0     true prog tests 1 inspect
91.7 94.4 .12  .13  17   .078 0  
loops/invert_string-1.yml couldn't run: all seeds time out or crash prog tests 0 inspect 2.2  2.2  11 28   .23 0     unknown prog tests 0 inspect
0   0   .064 .065 9.0 0     0  
loops/linear_search.yml false(unreach-call) 1 prog tests 24 inspect 30    27    19 130   .29 0     true prog tests 1 inspect
64.3 94.1 .12  .12  16   .078 0  
loops/matrix-2.yml timeout 1 prog tests 119 inspect 900    900    180 13000   1.3  0     true prog tests 1 inspect
100   100   1.8   1.8   270   .11  0  
loops/nec20.yml false(unreach-call) 1 prog tests 5 inspect 8.7  8.0  16 30   .28 0     true prog tests 1 inspect
41.7 62.5 .12  .12  16   .078 0  
loops/string-2.yml false(unreach-call) 1 prog tests 24 inspect 45    41    16 220   .28 0     true prog tests 1 inspect
69.2 86.2 .11  .11  16   .082 0  
loops/sum01-1.yml false(unreach-call) 1 prog tests 11 inspect 22    20    18 53   .28 0     true prog tests 1 inspect
90.0 100   .13  .12  16   .13  0  
loops/sum01_bug02.yml false(unreach-call) 1 prog tests 17 inspect 560    560    11 7700   .33 0     true prog tests 1 inspect
90.0 100   .15  .15  16   .094 0  
loops/sum01_bug02_sum01_bug02_base.case.yml false(unreach-call) 1 prog tests 12 inspect 770    770    10 11000   .40 0     true prog tests 1 inspect
70.0 90.0 .13  .13  16   .078 0  
loops/sum03-1.yml couldn't run: all seeds time out or crash prog tests 0 inspect .16 .17 10 1.5 .20 0     unknown prog tests 0 inspect
0   0   .060 .060 9.0 0     0  
loops/sum_array-1.yml false(unreach-call) 1 prog tests 47 inspect 710    710    150 9300   .36 0     true prog tests 1 inspect
80.0 93.8 6.5   6.4   1000   .094 0  
loops/terminator_01.yml couldn't run: all seeds time out or crash prog tests 0 inspect .15 .17 11 1.3 .19 0     unknown prog tests 0 inspect
0   0   .060 .061 8.9 0     0  
loops/terminator_02-1.yml couldn't run: all seeds time out or crash prog tests 0 inspect .13 .15 10 1.6 .20 0     unknown prog tests 0 inspect
0   0   .061 .061 9.0 0     0  
loops/terminator_03-1.yml false(unreach-call) 1 prog tests 4 inspect 10    9.7  16 100   .20 0     true prog tests 1 inspect
41.7 75.0 .12  .12  16   .078 0  
loops/trex01-1.yml couldn't run: all seeds time out or crash prog tests 0 inspect 1.1  1.2  18 16   .20 0     unknown prog tests 0 inspect
0   0   .058 .059 9.0 0     0  
loops/trex02-2.yml timeout 1 prog tests 14 inspect 900    910    41 11000   .43 .061 true prog tests 1 inspect
83.3 100   .54  .53  66   .14  0  
loops/trex03-1.yml timeout 1 prog tests 13 inspect 900    910    69 10000   .30 0     true prog tests 1 inspect
50.0 87.5 6.3   6.3   1000   .094 0  
loops/vogal-2.yml false(unreach-call) 1 prog tests 65 inspect 130    120    19 390   .30 0     true prog tests 1 inspect
100   100   .12  .12  17   .094 0  
loop-acceleration/array_3-2.yml done prog tests 15 inspect 510    510    11 3200   .31 0     unknown prog tests 0 inspect
75.0 88.9 .55  .54  17   .31  0  
loop-acceleration/diamond_1-2.yml couldn't run: all seeds time out or crash prog tests 0 inspect .14 .16 11 1.8 .20 .045 unknown prog tests 0 inspect
0   0   .059 .060 9.0 0     0  
loop-acceleration/multivar_1-2.yml couldn't run: all seeds time out or crash prog tests 0 inspect .14 .15 11 1.5 .19 0     unknown prog tests 0 inspect
0   0   .063 .064 9.0 0     0  
loop-invgen/id_trans.yml false(unreach-call) 1 prog tests 4 inspect 9.4  8.6  16 44   .29 0     true prog tests 1 inspect
75.0 100   .12  .12  16   .094 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 27 18 6600 6600 820 80000 8.8 .11 27 1480 1760 28 28 3100 2.4 0  
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops