Benchmark FairFuzz TBF Test-Suite Validator
Tool FairFuzz TC-0.0.2 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-08 09:39:09 CET 2019-02-08 13:22:04 CET
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Floats tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Floats
Options --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
floats-cdfpl/newton_1_4.yml timeout prog tests 4 inspect 900   900   11 12000 .30 0     unknown prog tests 0 inspect
83.3  90.9  .13  .13  17   .13  0  
floats-cdfpl/newton_1_5.yml timeout prog tests 4 inspect 900   900   10 12000 .30 0     unknown prog tests 0 inspect
83.3  90.9  .13  .12  16   .13  0  
floats-cdfpl/newton_1_6.yml timeout prog tests 4 inspect 900   900   10 12000 .31 0     unknown prog tests 0 inspect
83.3  90.9  .13  .16  16   .13  0  
floats-cdfpl/newton_1_7.yml timeout prog tests 4 inspect 900   900   10 10000 .31 0     unknown prog tests 0 inspect
83.3  90.9  .12  .12  17   .13  0  
floats-cdfpl/newton_1_8.yml timeout prog tests 4 inspect 900   900   10 12000 .30 0     unknown prog tests 0 inspect
83.3  90.9  .13  .15  16   .13  0  
floats-cdfpl/newton_2_6.yml timeout prog tests 4 inspect 900   900   10 14000 .30 0     unknown prog tests 0 inspect
83.3  91.7  .13  .13  17   .13  0  
floats-cdfpl/newton_2_7.yml timeout prog tests 4 inspect 900   900   10 13000 .31 0     unknown prog tests 0 inspect
83.3  91.7  .13  .13  17   .13  0  
floats-cdfpl/newton_2_8.yml timeout 1 prog tests 5 inspect 900   900   11 12000 .32 0     true prog tests 1 inspect
66.7  91.7  .13  .13  16   .094 0  
floats-cdfpl/newton_3_6.yml timeout prog tests 4 inspect 900   900   10 14000 .32 0     unknown prog tests 0 inspect
83.3  92.3  .13  .16  17   .13  0  
floats-cdfpl/newton_3_7.yml timeout prog tests 4 inspect 900   900   10 14000 .32 0     unknown prog tests 0 inspect
83.3  92.3  .13  .13  17   .13  0  
floats-cdfpl/newton_3_8.yml timeout prog tests 4 inspect 900   900   10 12000 .32 0     unknown prog tests 0 inspect
83.3  92.3  .14  .13  17   .13  0  
floats-cdfpl/sine_1.yml timeout 1 prog tests 5 inspect 900   900   10 12000 .30 0     true prog tests 1 inspect
50.0  87.5  .12  .12  16   .078 0  
floats-cdfpl/sine_2.yml timeout 1 prog tests 5 inspect 900   900   10 13000 .30 0     true prog tests 1 inspect
62.5  87.5  .13  .13  16   .094 0  
floats-cdfpl/sine_3.yml timeout prog tests 4 inspect 900   900   10 11000 .29 0     unknown prog tests 0 inspect
75.0  87.5  .12  .12  17   .13  0  
floats-cdfpl/square_1.yml timeout prog tests 4 inspect 900   900   10 13000 .29 .061 unknown prog tests 0 inspect
75.0  88.9  .13  .16  16   .13  0  
floats-cdfpl/square_2.yml timeout prog tests 4 inspect 900   900   11 11000 .30 0     unknown prog tests 0 inspect
75.0  88.9  .13  .13  16   .13  0  
floats-cdfpl/square_3.yml timeout prog tests 4 inspect 900   900   10 13000 .30 .061 unknown prog tests 0 inspect
75.0  88.9  .14  .14  16   .13  0  
float-benchs/cast_float_ptr.yml false(unreach-call) 1 prog tests 4 inspect 13   12   15 60 .28 0     true prog tests 1 inspect
41.7  68.8  .12  .12  17   .078 0  
float-benchs/cast_union_loose.yml timeout 1 prog tests 4 inspect 900   900   11 14000 .31 0     true prog tests 1 inspect
70.0  100    .12  .12  17   .094 0  
float-benchs/cast_union_tight.yml false(unreach-call) 1 prog tests 3 inspect 9.4 8.6 16 27 .21 0     true prog tests 1 inspect
100    100    .12  .12  16   .094 0  
float-benchs/float_int_inv_square.yml timeout 1 prog tests 4 inspect 900   900   11 11000 .31 0     true prog tests 1 inspect
83.3  100    .13  .13  16   .11  0  
float-benchs/inv_Newton-2.yml couldn't run: all seeds time out or crash prog tests 0 inspect 3.1 3.2 11 42 .20 0     unknown prog tests 0 inspect
0    0    .060 .061 9.0 0     0  
float-benchs/inv_Newton.c.p+cfa-reducer.yml done prog tests 2 inspect 16   15   15 56 .22 0     unknown prog tests 0 inspect
22.2  21.6  .12  .12  16   .098 0  
float-benchs/inv_square-1.yml false(unreach-call) prog tests 6 inspect 740   740   11 9200 .33 .061 unknown prog tests 0 inspect
62.5  55.6  .13  .13  17   .16  0  
float-benchs/nan_double.yml false(unreach-call) 1 prog tests 2 inspect 20   19   16 120 .21 0     true prog tests 1 inspect
100    100    .11  .11  16   .094 0  
float-benchs/nan_float.yml false(unreach-call) 1 prog tests 2 inspect 19   17   16 89 .20 0     true prog tests 1 inspect
50.0  80.0  .12  .12  16   .078 0  
float-benchs/sin_interpolated_index-1.yml done prog tests 9 inspect 890   890   10 11000 .54 0     unknown prog tests 0 inspect
81.2  100    .15  .15  17   .30  0  
float-benchs/sqrt_poly2.yml couldn't run: all seeds time out or crash prog tests 0 inspect 3.1 3.2 11 48 .20 0     unknown prog tests 0 inspect
0    0    .061 .062 8.9 0     0  
float-newlib/double_req_bl_0870a.yml false(unreach-call) 1 prog tests 5 inspect 44   41   17 110 .42 0     true prog tests 1 inspect
6.59 6.89 .17  .17  17   .32  0  
float-newlib/float_req_bl_0870a.yml done prog tests 2 inspect 11   10   15 41 .43 0     unknown prog tests 0 inspect
4.17 5.67 .15  .15  17   .18  0  
loop-floats-scientific-comp/loop1-2.yml false(unreach-call) 1 prog tests 10 inspect 70   65   18 340 .28 0     true prog tests 1 inspect
75.0  92.9  .12  .12  16   .078 0  
loop-floats-scientific-comp/loop2-1.yml couldn't run: all seeds time out or crash prog tests 0 inspect 3.1 3.2 10 42 .21 0     unknown prog tests 0 inspect
0    0    .059 .060 9.0 0     0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 32 11 19000 19000 380 260000 9.5 .18 32 2010 2370 3.9 4.0 510 3.7 0  
Run set fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Floats tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Floats