Benchmark FairFuzz TBF Test-Suite Validator
Tool FairFuzz TC-0.0.2 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-08 09:39:09 CET 2019-02-08 13:22:04 CET
Run set fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Heap tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Heap
Options --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ldv-regression/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
alias_of_return_2.c_1.yml done .0   prog tests 1 inspect 12    10    25 57   .20 0   unknown prog tests 0 inspect
0   0   .062 .063 9.1 0     0  
alias_of_return_2.yml done .5   prog tests 1 inspect 19    17    17 100   .20 0   unknown prog tests 0 inspect
50.0 72.7 .12  .12  17   .078 0  
fo_test.yml false(unreach-call) 1.0   prog tests 2 inspect 8.7  8.0  16 32   .22 0   true prog tests 1 inspect
100   100   .15  .15  16   .14  0  
rule60_list2.c_1.yml false(unreach-call) .929 prog tests 8 inspect 14    13    14 64   .30 0   true prog tests 1 inspect
92.9 100   .18  .17  17   .40  0  
rule60_list2.yml done .857 prog tests 6 inspect 18    16    15 54   .30 0   unknown prog tests 0 inspect
85.7 92.9 .15  .15  17   .31  0  
sizeofparameters_test.yml couldn't run: all seeds time out or crash .0   prog tests 0 inspect .16 .18 11 1.6 .21 0   unknown prog tests 0 inspect
0   0   .060 .061 9.0 0     0  
test10.yml done .5   prog tests 1 inspect 29    26    16 87   .20 0   unknown prog tests 0 inspect
50.0 95.5 .11  .12  16   .078 0  
test11.yml done .5   prog tests 1 inspect 29    27    15 85   .20 0   unknown prog tests 0 inspect
50.0 86.7 .11  .13  16   .078 0  
test14.yml done .5   prog tests 1 inspect 29    27    15 91   .20 0   unknown prog tests 0 inspect
50.0 91.7 .12  .12  16   .078 0  
test15.yml done .5   prog tests 1 inspect 19    17    16 91   .20 0   unknown prog tests 0 inspect
50.0 80.0 .11  .12  16   .078 0  
test19.yml done .5   prog tests 1 inspect 19    18    16 88   .20 0   unknown prog tests 0 inspect
50.0 85.7 .12  .12  17   .078 0  
test21-1.yml done .5   prog tests 1 inspect 31    28    17 110   .21 0   unknown prog tests 0 inspect
50.0 88.9 .11  .11  16   .082 0  
test21-2.yml false(unreach-call) .875 prog tests 6 inspect 16    15    16 76   .27 0   true prog tests 1 inspect
87.5 100   .14  .15  17   .16  0  
test22-1.yml done .333 prog tests 1 inspect 32    30    16 110   .21 0   unknown prog tests 0 inspect
33.3 60.9 .12  .12  16   .082 0  
test22-2.yml false(unreach-call) .917 prog tests 4 inspect 19    18    15 52   .27 0   true prog tests 1 inspect
91.7 100   .13  .13  16   .13  0  
test23-1.yml false(unreach-call) .857 prog tests 6 inspect 31    29    16 71   .28 0   true prog tests 1 inspect
85.7 100   .14  .14  16   .16  0  
test23-2.yml done .786 prog tests 4 inspect 18    16    14 77   .28 0   unknown prog tests 0 inspect
78.6 91.7 .13  .13  16   .13  0  
test24-1.yml done .75  prog tests 2 inspect 10    9.3  15 41   .21 0   unknown prog tests 0 inspect
75.0 86.7 .18  .18  17   .094 0  
test24-2.yml false(unreach-call) .7   prog tests 2 inspect 18    17    13 60   .21 0   true prog tests 1 inspect
70.0 94.4 .13  .13  17   .094 0  
test25-1.yml false(unreach-call) .917 prog tests 4 inspect 13    13    14 41   .27 0   true prog tests 1 inspect
91.7 100   .13  .13  16   .13  0  
test25-2.yml done .833 prog tests 3 inspect 12    11    13 36   .27 0   unknown prog tests 0 inspect
83.3 88.9 .12  .12  16   .11  0  
test28-1.yml done .5   prog tests 1 inspect 28    25    16 66   .20 0   true prog tests 1 inspect
50.0 80.0 .12  .12  17   .070 0  
test28-2.yml done .5   prog tests 1 inspect 28    26    17 66   .20 0   unknown prog tests 0 inspect
50.0 70.0 .12  .13  16   .070 0  
test29-1.yml false(unreach-call) 1.0   prog tests 3 inspect 8.9  8.2  16 34   .20 0   true prog tests 1 inspect
100   100   .12  .12  16   .11  0  
test29-2.yml done .5   prog tests 1 inspect 19    17    16 83   .20 0   unknown prog tests 0 inspect
50.0 70.0 .13  .13  16   .070 0  
sv-benchmarks/c/ldv-regression/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 25 15.8  480 440 390 1700 5.7 0   25 1580 2040 3.1 3.2 400 2.8 0  
Run set fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Heap tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Heap