Benchmark FairFuzz TBF Test-Suite Validator
Tool FairFuzz TC-0.0.2 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-08 09:39:09 CET 2019-02-08 13:22:04 CET
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Recursive tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Recursive
Options --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
recursive/Ackermann02.yml false(unreach-call) 1 prog tests 28 inspect 110    100    20 660   .35 0     true prog tests 1 inspect
81.2 94.1 20     20     16   .16  0  
recursive/Addition02.yml false(unreach-call) 1 prog tests 3 inspect 16    15    16 82   .20 0     true prog tests 1 inspect
62.5 79.0 .12  .12  17   .11  0  
recursive/BallRajamani-SPIN2000-Fig1.yml false(unreach-call) 1 prog tests 2 inspect 9.8  9.0  17 23   .21 0     true prog tests 1 inspect
100   100   .12  .12  16   .094 0  
recursive/EvenOdd03.yml timeout 1 prog tests 23 inspect 900    900    10 12000   .34 0     true prog tests 1 inspect
64.3 81.0 .12  .12  17   .094 0  
recursive/Fibonacci04.yml timeout 1 prog tests 93 inspect 900    900    17 12000   .86 0     true prog tests 1 inspect
87.5 100   81     81     16   .21  0  
recursive/Fibonacci05.yml timeout 1 prog tests 97 inspect 900    900    17 11000   1.1  0     true prog tests 1 inspect
87.5 100   40     40     17   .11  0  
recursive/McCarthy91-1.yml false(unreach-call) 1 prog tests 70 inspect 810    810    19 11000   .41 0     true prog tests 1 inspect
87.5 100   .32  .30  21   .57  0  
recursive-simple/id2_b3_o2.yml false(unreach-call) 1 prog tests 20 inspect 67    66    17 550   .31 0     true prog tests 1 inspect
100   100   .18  .17  22   .29  0  
recursive-simple/id_b3_o2-2.yml false(unreach-call) 1 prog tests 16 inspect 70    69    17 410   .28 0     true prog tests 1 inspect
100   100   .15  .15  16   .23  0  
recursive-simple/id_o10.yml false(unreach-call) 1 prog tests 2 inspect 19    18    18 100   .20 .061 true prog tests 1 inspect
75.0 100   .12  .12  17   .078 0  
recursive-simple/id_o100.yml false(unreach-call) 1 prog tests 2 inspect 29    27    16 85   .20 0     true prog tests 1 inspect
75.0 100   .12  .12  16   .078 0  
recursive-simple/id_o1000.yml false(unreach-call) 1 prog tests 2 inspect 29    27    17 75   .20 0     true prog tests 1 inspect
100   100   .13  .13  16   .094 0  
recursive-simple/id_o20.yml false(unreach-call) 1 prog tests 2 inspect 28    26    17 78   .20 0     true prog tests 1 inspect
100   100   .12  .12  17   .094 0  
recursive-simple/id_o200.yml false(unreach-call) 1 prog tests 2 inspect 28    26    17 72   .20 0     true prog tests 1 inspect
75.0 100   .12  .12  16   .078 0  
recursive-simple/id_o3.yml false(unreach-call) 1 prog tests 2 inspect 27    24    18 96   .20 0     true prog tests 1 inspect
75.0 100   .12  .12  16   .078 0  
recursive-simple/sum_non_eq-3.yml couldn't run: all seeds time out or crash prog tests 0 inspect .14 .16 10 1.9 .19 0     unknown prog tests 0 inspect
0   0   .061 .062 8.9 0     0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 16 15 3900 3900 260 49000 5.5 .061 16 1270 1450 140 140 270 2.4 0  
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Recursive tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Recursive