Benchmark FairFuzz TBF Test-Suite Validator
Tool FairFuzz TC-0.0.2 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-08 09:39:09 CET 2019-02-08 13:22:04 CET
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops
Options --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-2.yml 1 17    16    16 61   .21 0     66.7 86.7 .12  .12  16   .078 0  
loops/compact.yml 1 900    910    63 12000   .70 0     100   100   10     10     430   .12  0  
loops/count_up_down-2.yml .13 .15 10 1.5 .19 0     0   0   .059 .060 9.0 0     0  
loops/eureka_01-1.yml 1 60    55    19 170   .29 0     88.5 100   .15  .21  17   .21  0  
loops/for_bounded_loop1.yml 1 110    100    19 340   .29 0     100   100   .20  .20  16   .41  0  
loops/insertion_sort-1.yml 1 35    34    16 440   .30 0     91.7 94.4 .12  .13  17   .078 0  
loops/invert_string-1.yml 2.2  2.2  11 28   .23 0     0   0   .064 .065 9.0 0     0  
loops/linear_search.yml 1 30    27    19 130   .29 0     64.3 94.1 .12  .12  16   .078 0  
loops/matrix-2.yml 1 900    900    180 13000   1.3  0     100   100   1.8   1.8   270   .11  0  
loops/nec20.yml 1 8.7  8.0  16 30   .28 0     41.7 62.5 .12  .12  16   .078 0  
loops/string-2.yml 1 45    41    16 220   .28 0     69.2 86.2 .11  .11  16   .082 0  
loops/sum01-1.yml 1 22    20    18 53   .28 0     90.0 100   .13  .12  16   .13  0  
loops/sum01_bug02.yml 1 560    560    11 7700   .33 0     90.0 100   .15  .15  16   .094 0  
loops/sum01_bug02_sum01_bug02_base.case.yml 1 770    770    10 11000   .40 0     70.0 90.0 .13  .13  16   .078 0  
loops/sum03-1.yml .16 .17 10 1.5 .20 0     0   0   .060 .060 9.0 0     0  
loops/sum_array-1.yml 1 710    710    150 9300   .36 0     80.0 93.8 6.5   6.4   1000   .094 0  
loops/terminator_01.yml .15 .17 11 1.3 .19 0     0   0   .060 .061 8.9 0     0  
loops/terminator_02-1.yml .13 .15 10 1.6 .20 0     0   0   .061 .061 9.0 0     0  
loops/terminator_03-1.yml 1 10    9.7  16 100   .20 0     41.7 75.0 .12  .12  16   .078 0  
loops/trex01-1.yml 1.1  1.2  18 16   .20 0     0   0   .058 .059 9.0 0     0  
loops/trex02-2.yml 1 900    910    41 11000   .43 .061 83.3 100   .54  .53  66   .14  0  
loops/trex03-1.yml 1 900    910    69 10000   .30 0     50.0 87.5 6.3   6.3   1000   .094 0  
loops/vogal-2.yml 1 130    120    19 390   .30 0     100   100   .12  .12  17   .094 0  
loop-acceleration/array_3-2.yml 510    510    11 3200   .31 0     75.0 88.9 .55  .54  17   .31  0  
loop-acceleration/diamond_1-2.yml .14 .16 11 1.8 .20 .045 0   0   .059 .060 9.0 0     0  
loop-acceleration/multivar_1-2.yml .14 .15 11 1.5 .19 0     0   0   .063 .064 9.0 0     0  
loop-invgen/id_trans.yml 1 9.4  8.6  16 44   .29 0     75.0 100   .12  .12  16   .094 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 27 18 6600 6600 820 80000 8.8 .11 27 1480 1760 28 28 3100 2.4 0  
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Loops