Benchmark FairFuzz TBF Test-Suite Validator
Tool FairFuzz TC-0.0.2 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-08 09:39:09 CET 2019-02-08 13:22:04 CET
Run set fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Floats tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Floats
Options --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
floats-cdfpl/newton_1_1.yml timeout .833  prog tests 4 inspect 900   900   11 13000 .32 0     unknown prog tests 0 inspect
83.3  90.9  .13  .13  17   .13  0  
floats-cdfpl/newton_1_2.yml timeout .833  prog tests 4 inspect 900   900   11 12000 .30 0     unknown prog tests 0 inspect
83.3  90.9  .13  .17  16   .13  0  
floats-cdfpl/newton_1_3.yml timeout .833  prog tests 4 inspect 900   900   11 12000 .30 .061 unknown prog tests 0 inspect
83.3  90.9  .13  .13  16   .13  0  
floats-cdfpl/newton_1_4.yml timeout .833  prog tests 4 inspect 900   900   10 12000 .30 .061 unknown prog tests 0 inspect
83.3  90.9  .12  .12  16   .13  0  
floats-cdfpl/newton_1_5.yml timeout 1.0    prog tests 5 inspect 900   900   11 11000 .30 0     true prog tests 1 inspect
100    100    .13  .13  17   .14  0  
floats-cdfpl/newton_1_6.yml timeout .833  prog tests 4 inspect 900   900   11 13000 .31 0     unknown prog tests 0 inspect
83.3  90.9  .13  .13  17   .13  0  
floats-cdfpl/newton_1_7.yml timeout .833  prog tests 3 inspect 900   900   11 12000 .31 0     unknown prog tests 0 inspect
83.3  90.9  .12  .12  16   .11  0  
floats-cdfpl/newton_1_8.yml timeout 1.0    prog tests 5 inspect 900   900   10 12000 .31 0     true prog tests 1 inspect
100    100    .13  .16  16   .14  0  
floats-cdfpl/newton_2_1.yml timeout .833  prog tests 4 inspect 900   900   10 11000 .31 0     unknown prog tests 0 inspect
83.3  91.7  .13  .13  16   .13  0  
floats-cdfpl/newton_2_2.yml timeout .833  prog tests 4 inspect 900   900   11 11000 .32 .061 unknown prog tests 0 inspect
83.3  91.7  .13  .13  16   .13  0  
floats-cdfpl/newton_2_3.yml timeout .833  prog tests 4 inspect 900   900   11 14000 .32 0     unknown prog tests 0 inspect
83.3  91.7  .13  .12  16   .13  0  
floats-cdfpl/newton_2_4.yml timeout .833  prog tests 4 inspect 900   900   10 12000 .32 .061 unknown prog tests 0 inspect
83.3  91.7  .13  .13  16   .13  0  
floats-cdfpl/newton_2_5.yml timeout .833  prog tests 4 inspect 900   900   10 12000 .31 0     unknown prog tests 0 inspect
83.3  91.7  .12  .12  16   .13  0  
floats-cdfpl/newton_2_6.yml timeout .833  prog tests 4 inspect 900   900   11 15000 .31 0     unknown prog tests 0 inspect
83.3  91.7  .13  .18  16   .13  0  
floats-cdfpl/newton_2_7.yml timeout .833  prog tests 4 inspect 900   900   11 14000 .30 0     unknown prog tests 0 inspect
83.3  91.7  .12  .12  16   .13  0  
floats-cdfpl/newton_2_8.yml timeout .833  prog tests 4 inspect 900   900   11 12000 .30 0     unknown prog tests 0 inspect
83.3  91.7  .13  .13  16   .13  0  
floats-cdfpl/newton_3_1.yml timeout .833  prog tests 4 inspect 900   900   11 12000 .32 0     unknown prog tests 0 inspect
83.3  92.3  .13  .13  16   .13  0  
floats-cdfpl/newton_3_2.yml timeout .833  prog tests 4 inspect 900   900   10 13000 .32 0     unknown prog tests 0 inspect
83.3  92.3  .12  .12  17   .13  0  
floats-cdfpl/newton_3_3.yml timeout .833  prog tests 4 inspect 900   900   10 12000 .32 0     unknown prog tests 0 inspect
83.3  92.3  .13  .17  16   .13  0  
floats-cdfpl/newton_3_4.yml timeout .833  prog tests 4 inspect 900   900   11 12000 .31 0     unknown prog tests 0 inspect
83.3  92.3  .13  .13  16   .13  0  
floats-cdfpl/newton_3_5.yml timeout .833  prog tests 3 inspect 900   900   10 14000 .32 0     unknown prog tests 0 inspect
83.3  92.3  .12  .12  17   .11  0  
floats-cdfpl/newton_3_6.yml timeout .833  prog tests 4 inspect 900   900   11 15000 .32 0     unknown prog tests 0 inspect
83.3  92.3  .14  .15  16   .13  0  
floats-cdfpl/newton_3_7.yml timeout .833  prog tests 4 inspect 900   900   11 12000 .31 0     unknown prog tests 0 inspect
83.3  92.3  .17  .17  16   .13  0  
floats-cdfpl/newton_3_8.yml timeout 1.0    prog tests 5 inspect 900   900   10 12000 .32 0     true prog tests 1 inspect
100    100    .13  .14  17   .15  0  
floats-cdfpl/sine_1.yml timeout .875  prog tests 5 inspect 900   900   11 12000 .30 0     true prog tests 1 inspect
87.5  100    .13  .13  17   .14  0  
floats-cdfpl/sine_2.yml timeout .875  prog tests 5 inspect 900   900   11 13000 .30 0     true prog tests 1 inspect
87.5  100    .13  .13  16   .14  0  
floats-cdfpl/sine_3.yml timeout .75   prog tests 4 inspect 900   900   10 11000 .30 0     unknown prog tests 0 inspect
75.0  87.5  .13  .13  17   .13  0  
floats-cdfpl/sine_4.yml timeout .75   prog tests 4 inspect 900   900   10 13000 .30 0     unknown prog tests 0 inspect
75.0  87.5  .13  .14  17   .13  0  
floats-cdfpl/sine_5.yml timeout .75   prog tests 3 inspect 900   900   10 11000 .30 0     unknown prog tests 0 inspect
75.0  87.5  .12  .12  16   .11  0  
floats-cdfpl/sine_6.yml timeout .75   prog tests 4 inspect 900   900   10 11000 .30 0     unknown prog tests 0 inspect
75.0  87.5  .13  .15  16   .13  0  
floats-cdfpl/sine_7.yml timeout .75   prog tests 4 inspect 900   900   10 13000 .31 .061 unknown prog tests 0 inspect
75.0  87.5  .13  .12  16   .13  0  
floats-cdfpl/sine_8.yml timeout .75   prog tests 4 inspect 900   900   10 12000 .31 0     unknown prog tests 0 inspect
75.0  87.5  .13  .13  16   .13  0  
floats-cdfpl/square_1.yml timeout .625  prog tests 4 inspect 900   900   11 14000 .30 0     unknown prog tests 0 inspect
62.5  88.9  .12  .13  16   .13  0  
floats-cdfpl/square_2.yml timeout .75   prog tests 4 inspect 900   900   10 12000 .30 .061 unknown prog tests 0 inspect
75.0  88.9  .17  .16  16   .13  0  
floats-cdfpl/square_3.yml timeout .75   prog tests 4 inspect 900   900   11 11000 .30 0     unknown prog tests 0 inspect
75.0  88.9  .13  .16  16   .13  0  
floats-cdfpl/square_4.yml timeout .75   prog tests 4 inspect 900   900   10 11000 .30 0     unknown prog tests 0 inspect
75.0  88.9  .12  .12  17   .13  0  
floats-cdfpl/square_5.yml timeout .75   prog tests 4 inspect 900   900   11 13000 .30 0     unknown prog tests 0 inspect
75.0  88.9  .13  .13  16   .13  0  
floats-cdfpl/square_6.yml timeout .625  prog tests 3 inspect 900   900   10 14000 .31 0     unknown prog tests 0 inspect
62.5  88.9  .12  .12  16   .11  0  
floats-cdfpl/square_7.yml timeout .75   prog tests 4 inspect 900   900   10 12000 .30 0     unknown prog tests 0 inspect
75.0  88.9  .14  .14  16   .13  0  
floats-cdfpl/square_8.yml timeout .75   prog tests 4 inspect 900   900   10 13000 .30 .061 unknown prog tests 0 inspect
75.0  88.9  .13  .15  17   .13  0  
floats-cbmc-regression/float-no-simp2.yml done .5    prog tests 2 inspect 150   150   17 2000 .22 0     unknown prog tests 0 inspect
50.0  100    .14  .14  16   .15  0  
floats-cbmc-regression/float-to-double1.yml done .667  prog tests 2 inspect 9.0 8.4 16 29 .27 0     unknown prog tests 0 inspect
66.7  100    .14  .14  17   .14  0  
floats-cbmc-regression/float12.yml done .75   prog tests 3 inspect 23   21   16 67 .27 0     unknown prog tests 0 inspect
75.0  100    .15  .15  16   .10  0  
floats-cbmc-regression/float19.yml done .75   prog tests 2 inspect 7.3 6.5 17 57 .27 0     unknown prog tests 0 inspect
75.0  100    .14  .14  16   .15  0  
floats-cbmc-regression/float20.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 41 .21 0     unknown prog tests 0 inspect
0    0    .060 .060 9.0 0     0  
floats-cbmc-regression/float3.yml done .5    prog tests 1 inspect 27   25   17 86 .20 0     unknown prog tests 0 inspect
50.0  90.9  .11  .11  16   .078 0  
floats-cbmc-regression/float4.yml done .5    prog tests 3 inspect 150   150   16 2300 .22 0     unknown prog tests 0 inspect
50.0  100    .15  .14  16   .23  0  
floats-cbmc-regression/float5.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 11 44 .20 .061 unknown prog tests 0 inspect
0    0    .063 .064 9.0 0     0  
floats-cbmc-regression/float6.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 11 38 .20 0     unknown prog tests 0 inspect
0    0    .059 .060 9.0 0     0  
floats-cbmc-regression/float8.yml done .5    prog tests 3 inspect 120   120   17 1600 .22 0     unknown prog tests 0 inspect
50.0  100    .14  .15  16   .21  0  
float-benchs/arctan_Pade.yml done .714  prog tests 6 inspect 460   460   15 6100 .34 0     unknown prog tests 0 inspect
71.4  100    .13  .13  16   .17  0  
float-benchs/bary_diverge.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 18 40 .21 0     unknown prog tests 0 inspect
0    0    .062 .063 9.0 0     0  
float-benchs/cast_float_ptr.yml false(unreach-call) .583  prog tests 4 inspect 16   14   15 74 .28 0     true prog tests 1 inspect
58.3  93.8  .13  .17  17   .13  0  
float-benchs/cast_float_union.yml done .25   prog tests 1 inspect 29   27   17 81 .21 0     unknown prog tests 0 inspect
25.0  72.2  .11  .13  16   .078 0  
float-benchs/cast_union_loose.yml timeout .8    prog tests 4 inspect 900   900   10 14000 .30 0     true prog tests 1 inspect
80.0  100    .15  .15  16   .13  0  
float-benchs/cast_union_tight.yml false(unreach-call) 1.0    prog tests 3 inspect 7.2 6.6 10 33 .21 0     true prog tests 1 inspect
100    100    .12  .12  16   .11  0  
float-benchs/cos_polynomial.yml done .562  prog tests 4 inspect 710   710   10 8600 .33 0     unknown prog tests 0 inspect
56.2  71.4  .13  .13  17   .13  0  
float-benchs/divmul_buf_diverge.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 16 44 .21 0     unknown prog tests 0 inspect
0    0    .065 .066 9.0 0     0  
float-benchs/divmul_diverge.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 17 42 .21 0     unknown prog tests 0 inspect
0    0    .059 .060 9.0 0     0  
float-benchs/exp_loop.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 10 41 .23 0     unknown prog tests 0 inspect
0    0    .058 .059 9.0 0     0  
float-benchs/feedback_diverge.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 17 39 .21 0     unknown prog tests 0 inspect
0    0    .064 .065 9.0 0     0  
float-benchs/filter1.c.p+cfa-reducer.yml timeout .75   prog tests 17 inspect 900   910   89 12000 .73 0     unknown prog tests 0 inspect
75.0  82.5  48     48     1100   .34  0  
float-benchs/filter1.c.v+lhb-reducer.yml timeout .719  prog tests 12 inspect 900   910   65 12000 .52 0     unknown prog tests 0 inspect
71.9  80.0  30     30     1000   .31  0  
float-benchs/filter1.c.v+nlh-reducer.yml timeout .719  prog tests 12 inspect 900   910   72 11000 .53 0     unknown prog tests 0 inspect
71.9  79.8  37     38     1000   .31  0  
float-benchs/filter1.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 14 45 .21 0     unknown prog tests 0 inspect
0    0    .060 .061 9.1 0     0  
float-benchs/filter2.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 15 37 .21 .061 unknown prog tests 0 inspect
0    0    .057 .058 9.0 0     0  
float-benchs/filter2_alt.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 15 49 .21 0     unknown prog tests 0 inspect
0    0    .062 .063 9.0 0     0  
float-benchs/filter2_reinit.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 14 44 .21 0     unknown prog tests 0 inspect
0    0    .066 .067 9.0 0     0  
float-benchs/filter2_set.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 36 .21 0     unknown prog tests 0 inspect
0    0    .077 .078 9.0 0     0  
float-benchs/filter_iir.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 19 42 .21 0     unknown prog tests 0 inspect
0    0    .061 .062 9.0 0     0  
float-benchs/float_int_inv_square.yml timeout .833  prog tests 4 inspect 900   900   10 12000 .30 0     true prog tests 1 inspect
83.3  100    .13  .13  17   .13  0  
float-benchs/image_filter.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.3 3.3 17 49 1.4  .061 unknown prog tests 0 inspect
0    0    .060 .061 9.1 0     0  
float-benchs/interpolation.c.p+cfa-reducer.yml done .75   prog tests 6 inspect 33   30   17 150 .28 0     unknown prog tests 0 inspect
75.0  81.1  .14  .13  16   .16  0  
float-benchs/interpolation.c.v+cfa-reducer.yml done .688  prog tests 6 inspect 25   23   16 84 .28 0     unknown prog tests 0 inspect
68.8  77.1  .14  .14  16   .16  0  
float-benchs/interpolation.c.v+nlh-reducer.yml done .714  prog tests 6 inspect 26   24   17 110 .27 0     unknown prog tests 0 inspect
71.4  78.0  .14  .13  16   .18  0  
float-benchs/interpolation.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 42 .20 0     unknown prog tests 0 inspect
0    0    .061 .062 9.0 0     0  
float-benchs/interpolation2.c.p+cfa-reducer.yml done .75   prog tests 6 inspect 38   34   17 220 .28 0     unknown prog tests 0 inspect
75.0  82.0  .14  .21  16   .16  0  
float-benchs/interpolation2.c.v+cfa-reducer.yml done .688  prog tests 6 inspect 46   43   17 120 .28 .061 unknown prog tests 0 inspect
68.8  78.4  .14  .13  16   .16  0  
float-benchs/interpolation2.c.v+nlh-reducer.yml done .679  prog tests 6 inspect 32   29   17 150 .28 0     unknown prog tests 0 inspect
67.9  76.9  .16  .16  17   .18  0  
float-benchs/interpolation2.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 10 45 .20 0     unknown prog tests 0 inspect
0    0    .059 .060 9.0 0     0  
float-benchs/inv_Newton-1.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 42 .20 0     unknown prog tests 0 inspect
0    0    .063 .063 9.0 0     0  
float-benchs/inv_Newton-2.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 10 39 .20 0     unknown prog tests 0 inspect
0    0    .061 .062 9.1 0     0  
float-benchs/inv_Newton.c.p+cfa-reducer.yml done .222  prog tests 2 inspect 15   13   14 66 .22 0     unknown prog tests 0 inspect
22.2  21.6  .12  .12  16   .098 0  
float-benchs/inv_sqrt_Quake.c.v+cfa-reducer.yml done .667  prog tests 3 inspect 22   20   16 58 .28 .061 unknown prog tests 0 inspect
66.7  78.8  .12  .14  16   .11  0  
float-benchs/inv_sqrt_Quake.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 11 41 .20 0     unknown prog tests 0 inspect
0    0    .058 .059 9.0 0     0  
float-benchs/inv_square-1.yml false(unreach-call) .625  prog tests 6 inspect 850   850   11 12000 .33 0     unknown prog tests 0 inspect
62.5  55.6  .13  .13  16   .16  0  
float-benchs/inv_square-2.yml done .9    prog tests 6 inspect 740   740   10 9600 .32 0     unknown prog tests 0 inspect
90.0  100    .14  .13  17   .16  0  
float-benchs/inv_square_int.yml timeout .667  prog tests 3 inspect 900   900   10 12000 .30 .061 unknown prog tests 0 inspect
66.7  100    .13  .13  16   .11  0  
float-benchs/nan_double.yml false(unreach-call) 1.0    prog tests 2 inspect 27   25   17 82 .20 0     true prog tests 1 inspect
100    100    .12  .12  16   .094 0  
float-benchs/nan_double_range.yml done .667  prog tests 2 inspect 7.0 6.5 16 27 .27 0     unknown prog tests 0 inspect
66.7  100    .12  .12  16   .094 0  
float-benchs/nan_float.yml false(unreach-call) 1.0    prog tests 2 inspect 29   27   16 76 .20 0     true prog tests 1 inspect
100    100    .12  .12  16   .094 0  
float-benchs/nan_float_range.yml done .667  prog tests 2 inspect 7.5 6.9 14 35 .20 0     unknown prog tests 0 inspect
66.7  100    .13  .13  16   .094 0  
float-benchs/rlim_exit.yml timeout .8    prog tests 29 inspect 900   910   130 13000 .93 0     unknown prog tests 0 inspect
80.0  100    78     79     930   .54  0  
float-benchs/rlim_invariant.c.p+cfa-reducer.yml timeout .875  prog tests 27 inspect 900   910   110 12000 .93 0     unknown prog tests 0 inspect
87.5  88.7  55     55     900   .61  0  
float-benchs/rlim_invariant.c.v+lhb-reducer.yml timeout .75   prog tests 29 inspect 900   910   76 12000 1.1  0     unknown prog tests 0 inspect
75.0  81.7  35     35     840   .77  0  
float-benchs/rlim_invariant.c.v+nlh-reducer.yml timeout .771  prog tests 26 inspect 900   910   90 12000 .99 0     unknown prog tests 0 inspect
77.1  81.7  45     45     880   .70  0  
float-benchs/rlim_invariant.yml timeout .75   prog tests 21 inspect 900   910   110 13000 .70 0     unknown prog tests 0 inspect
75.0  100    62     62     840   .41  0  
float-benchs/sin_interpolated_bigrange_loose.yml timeout .812  prog tests 9 inspect 900   900   11 12000 .63 0     unknown prog tests 0 inspect
81.2  100    .16  .18  17   .30  0  
float-benchs/sin_interpolated_bigrange_tight.yml done .812  prog tests 9 inspect 850   850   12 11000 .46 0     unknown prog tests 0 inspect
81.2  100    .15  .15  17   .30  0  
float-benchs/sin_interpolated_index-1.yml timeout .812  prog tests 9 inspect 900   900   10 11000 .58 .061 unknown prog tests 0 inspect
81.2  100    .15  .15  17   .30  0  
float-benchs/sin_interpolated_index-2.yml timeout .812  prog tests 9 inspect 900   900   14 12000 .57 0     unknown prog tests 0 inspect
81.2  100    .15  .15  17   .30  0  
float-benchs/sin_interpolated_negation.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 11 39 .31 0     unknown prog tests 0 inspect
0    0    .16  .16  8.9 0     0  
float-benchs/sin_interpolated_smallrange.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 11 37 .28 0     unknown prog tests 0 inspect
0    0    .063 .063 9.0 0     0  
float-benchs/sqrt_Householder_constant.c.p+cfa-reducer.yml done .0    prog tests 1 inspect 11   10   23 53 .22 0     unknown prog tests 0 inspect
0    0    .062 .063 9.1 0     0  
float-benchs/sqrt_Householder_interval.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 52 .21 0     unknown prog tests 0 inspect
0    0    .061 .062 8.9 0     0  
float-benchs/sqrt_Householder_pseudoconstant.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 11 44 .21 0     unknown prog tests 0 inspect
0    0    .061 .062 9.0 0     0  
float-benchs/sqrt_Newton_pseudoconstant.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 47 .21 0     unknown prog tests 0 inspect
0    0    .065 .066 9.0 0     0  
float-benchs/sqrt_biNewton_pseudoconstant.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 10 47 .21 0     unknown prog tests 0 inspect
0    0    .061 .061 9.0 0     0  
float-benchs/sqrt_poly.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.2 3.2 11 39 .20 0     unknown prog tests 0 inspect
0    0    .060 .060 9.0 0     0  
float-benchs/sqrt_poly2.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 46 .20 0     unknown prog tests 0 inspect
0    0    .061 .061 9.0 0     0  
float-benchs/zonotope_3.c.p+cfa-reducer.yml timeout .786  prog tests 14 inspect 900   910   26 14000 .53 0     unknown prog tests 0 inspect
78.6  90.8  2.7   2.7   420   .34  0  
float-benchs/zonotope_3.c.v+lhb-reducer.yml timeout .721  prog tests 29 inspect 900   910   27 13000 .65 0     unknown prog tests 0 inspect
72.1  91.7  2.7   2.7   420   1.4   0  
float-benchs/zonotope_3.yml timeout .75   prog tests 12 inspect 900   900   24 11000 .32 0     unknown prog tests 0 inspect
75.0  100    2.7   2.7   420   .26  0  
float-benchs/zonotope_loose.c.v+cfa-reducer.yml done .571  prog tests 4 inspect 18   17   16 79 .27 0     unknown prog tests 0 inspect
57.1  66.7  .13  .12  17   .13  0  
float-benchs/zonotope_loose.yml done .667  prog tests 5 inspect 810   810   11 11000 .33 0     unknown prog tests 0 inspect
66.7  88.9  .16  .16  16   .14  0  
float-benchs/zonotope_tight.yml done .667  prog tests 5 inspect 680   680   10 8400 .32 0     unknown prog tests 0 inspect
66.7  88.9  .13  .16  17   .14  0  
float-newlib/double_req_bl_0281.yml done .0455 prog tests 2 inspect 8.0 7.3 14 35 .34 0     unknown prog tests 0 inspect
4.55 2.84 .14  .14  17   .13  0  
float-newlib/double_req_bl_0320.yml done .0370 prog tests 3 inspect 14   13   21 76 .59 .37  unknown prog tests 0 inspect
3.70 5.48 .16  .16  18   .25  0  
float-newlib/double_req_bl_0460.yml done .109  prog tests 3 inspect 20   18   16 49 .39 0     unknown prog tests 0 inspect
10.9  11.5  .13  .13  17   .15  0  
float-newlib/double_req_bl_0660a.yml done .108  prog tests 2 inspect 18   17   16 59 .35 0     unknown prog tests 0 inspect
10.8  19.4  .13  .13  17   .13  0  
float-newlib/double_req_bl_0660b.yml done .108  prog tests 2 inspect 14   13   15 66 .35 0     unknown prog tests 0 inspect
10.8  19.4  .13  .13  17   .13  0  
float-newlib/double_req_bl_0661a.yml done .118  prog tests 2 inspect 3.3 2.9 14 30 .29 .061 unknown prog tests 0 inspect
11.8  21.9  .14  .14  16   .14  0  
float-newlib/double_req_bl_0661b.yml done .118  prog tests 2 inspect 4.9 4.5 16 27 .29 0     unknown prog tests 0 inspect
11.8  21.9  .14  .14  17   .14  0  
float-newlib/double_req_bl_0662a.yml done .122  prog tests 2 inspect 15   14   17 51 .35 .061 unknown prog tests 0 inspect
12.2  18.6  .13  .13  17   .13  0  
float-newlib/double_req_bl_0662b.yml done .122  prog tests 2 inspect 12   11   14 52 .35 0     unknown prog tests 0 inspect
12.2  18.6  .13  .13  17   .13  0  
float-newlib/double_req_bl_0663a.yml done .122  prog tests 2 inspect 4.6 4.2 10 19 .29 .061 unknown prog tests 0 inspect
12.2  18.6  .13  .13  17   .13  0  
float-newlib/double_req_bl_0663b.yml done .122  prog tests 2 inspect 5.9 5.5 16 21 .29 0     unknown prog tests 0 inspect
12.2  18.6  .13  .13  17   .13  0  
float-newlib/double_req_bl_0670.yml done .105  prog tests 4 inspect 26   24   16 64 .35 .061 unknown prog tests 0 inspect
10.5  16.0  .14  .14  16   .19  0  
float-newlib/double_req_bl_0682a.yml done .179  prog tests 3 inspect 19   18   17 63 .36 0     unknown prog tests 0 inspect
17.9  28.7  .14  .14  17   .16  0  
float-newlib/double_req_bl_0682b.yml done .179  prog tests 3 inspect 13   12   16 62 .36 .061 unknown prog tests 0 inspect
17.9  28.7  .15  .15  17   .16  0  
float-newlib/double_req_bl_0683a.yml done .188  prog tests 3 inspect 14   13   16 38 .36 0     unknown prog tests 0 inspect
18.8  30.7  .14  .15  17   .17  0  
float-newlib/double_req_bl_0683b.yml done .188  prog tests 3 inspect 13   12   15 40 .36 0     unknown prog tests 0 inspect
18.8  30.7  .14  .14  17   .17  0  
float-newlib/double_req_bl_0684a.yml done .184  prog tests 3 inspect 18   17   17 47 .36 0     unknown prog tests 0 inspect
18.4  27.9  .13  .13  17   .16  0  
float-newlib/double_req_bl_0684b.yml done .184  prog tests 3 inspect 13   12   14 43 .36 0     unknown prog tests 0 inspect
18.4  27.9  .14  .14  17   .16  0  
float-newlib/double_req_bl_0832.yml done .267  prog tests 3 inspect 24   22   17 78 .29 0     unknown prog tests 0 inspect
26.7  30.4  .13  .13  17   .13  0  
float-newlib/double_req_bl_0870a.yml done .0440 prog tests 2 inspect 8.9 8.2 16 32 .42 .020 unknown prog tests 0 inspect
4.40 6.29 .15  .15  18   .19  0  
float-newlib/double_req_bl_0870b.yml done .038  prog tests 3 inspect 17   16   17 57 .42 0     unknown prog tests 0 inspect
3.80 6.29 .15  .15  18   .23  0  
float-newlib/double_req_bl_0872a.yml done .0111 prog tests 1 inspect 20   18   16 98 .35 .061 unknown prog tests 0 inspect
1.11 5.12 .14  .14  17   .14  0  
float-newlib/double_req_bl_0872b.yml done .0111 prog tests 1 inspect 25   23   16 87 .35 0     unknown prog tests 0 inspect
1.11 5.12 .14  .14  18   .14  0  
float-newlib/double_req_bl_0874.yml done .0934 prog tests 3 inspect 13   12   15 42 .42 0     unknown prog tests 0 inspect
9.34 12.6  .16  .16  18   .23  0  
float-newlib/double_req_bl_0876.yml done .0978 prog tests 3 inspect 22   20   16 62 .42 0     unknown prog tests 0 inspect
9.78 11.3  .15  .15  17   .24  0  
float-newlib/double_req_bl_0882.yml done .114  prog tests 3 inspect 13   12   16 52 .42 0     unknown prog tests 0 inspect
11.4  13.1  .16  .23  18   .23  0  
float-newlib/double_req_bl_0883.yml done .0824 prog tests 3 inspect 10   9.3 16 61 .42 0     unknown prog tests 0 inspect
8.24 12.6  .16  .18  18   .23  0  
float-newlib/double_req_bl_0920a.yml done .25   prog tests 2 inspect 12   11   15 45 .32 0     unknown prog tests 0 inspect
25.0  27.0  .15  .14  16   .11  0  
float-newlib/double_req_bl_0970a.yml done .0278 prog tests 2 inspect 12   11   16 61 .35 0     unknown prog tests 0 inspect
2.78 4.40 .13  .13  17   .12  0  
float-newlib/double_req_bl_1121a.yml done .0323 prog tests 1 inspect 20   18   15 110 .25 0     unknown prog tests 0 inspect
3.23 18.8  .13  .13  17   .090 0  
float-newlib/double_req_bl_1121b.yml done .0323 prog tests 1 inspect 27   25   17 87 .25 0     unknown prog tests 0 inspect
3.23 18.8  .12  .12  17   .090 0  
float-newlib/double_req_bl_1122a.yml done .0645 prog tests 2 inspect 8.0 7.3 15 40 .25 0     unknown prog tests 0 inspect
6.45 18.8  .13  .13  16   .11  0  
float-newlib/double_req_bl_1122b.yml done .0645 prog tests 2 inspect 7.8 7.2 14 35 .25 0     unknown prog tests 0 inspect
6.45 18.8  .13  .12  17   .11  0  
float-newlib/double_req_bl_1130a.yml done .147  prog tests 3 inspect 5.1 4.7 10 14 .32 0     unknown prog tests 0 inspect
14.7  24.5  .14  .13  17   .15  0  
float-newlib/double_req_bl_1131a.yml done .125  prog tests 2 inspect 7.5 7.0 11 17 .32 0     unknown prog tests 0 inspect
12.5  24.5  .13  .15  17   .12  0  
float-newlib/double_req_bl_1131b.yml done .125  prog tests 2 inspect 6.0 5.5 13 18 .32 0     unknown prog tests 0 inspect
12.5  24.8  .13  .13  17   .11  0  
float-newlib/double_req_bl_1211a.yml done .312  prog tests 1 inspect 19   18   15 85 .23 0     unknown prog tests 0 inspect
31.2  49.2  .13  .15  17   .086 0  
float-newlib/double_req_bl_1211b.yml done .312  prog tests 1 inspect 20   18   16 100 .23 0     unknown prog tests 0 inspect
31.2  49.2  .12  .12  16   .086 0  
float-newlib/double_req_bl_1231b.yml done .525  prog tests 5 inspect 29   26   17 120 .28 0     unknown prog tests 0 inspect
52.5  81.2  .13  .13  17   .17  0  
float-newlib/double_req_bl_1251b.yml done .525  prog tests 5 inspect 29   27   17 91 .28 0     unknown prog tests 0 inspect
52.5  81.2  .14  .14  16   .17  0  
float-newlib/double_req_bl_1300.yml done .667  prog tests 2 inspect 10   9.4 14 27 .28 0     unknown prog tests 0 inspect
66.7  95.0  .12  .12  16   .098 0  
float-newlib/float_req_bl_0281.yml done .167  prog tests 3 inspect 15   14   15 56 .26 0     unknown prog tests 0 inspect
16.7  13.6  .13  .13  16   .15  0  
float-newlib/float_req_bl_0460.yml done .175  prog tests 3 inspect 22   20   16 66 .30 0     unknown prog tests 0 inspect
17.5  13.7  .13  .13  16   .14  0  
float-newlib/float_req_bl_0660a.yml done .125  prog tests 2 inspect 11   10   17 48 .27 0     unknown prog tests 0 inspect
12.5  17.9  .13  .15  17   .13  0  
float-newlib/float_req_bl_0660b.yml done .114  prog tests 2 inspect 18   16   16 50 .27 0     unknown prog tests 0 inspect
11.4  17.9  .14  .14  17   .13  0  
float-newlib/float_req_bl_0661a.yml done .114  prog tests 2 inspect 14   13   15 59 .27 .061 unknown prog tests 0 inspect
11.4  17.9  .13  .13  17   .13  0  
float-newlib/float_req_bl_0661b.yml done .186  prog tests 3 inspect 18   17   15 100 .33 0     unknown prog tests 0 inspect
18.6  26.5  .14  .13  16   .15  0  
float-newlib/float_req_bl_0662a.yml done .129  prog tests 2 inspect 12   11   15 66 .27 0     unknown prog tests 0 inspect
12.9  17.1  .13  .14  17   .13  0  
float-newlib/float_req_bl_0662b.yml done .129  prog tests 2 inspect 16   15   16 54 .27 0     unknown prog tests 0 inspect
12.9  17.1  .14  .14  17   .13  0  
float-newlib/float_req_bl_0663a.yml done .129  prog tests 2 inspect 24   22   15 64 .27 .061 unknown prog tests 0 inspect
12.9  17.1  .13  .15  17   .13  0  
float-newlib/float_req_bl_0663b.yml done .129  prog tests 2 inspect 16   15   17 70 .27 0     unknown prog tests 0 inspect
12.9  17.1  .14  .14  16   .13  0  
float-newlib/float_req_bl_0670.yml done .111  prog tests 4 inspect 22   21   17 72 .33 0     unknown prog tests 0 inspect
11.1  14.4  .14  .14  17   .18  0  
float-newlib/float_req_bl_0682a.yml done .181  prog tests 3 inspect 13   12   17 47 .33 0     unknown prog tests 0 inspect
18.1  23.8  .14  .13  17   .15  0  
float-newlib/float_req_bl_0682b.yml done .181  prog tests 3 inspect 12   11   15 46 .33 0     unknown prog tests 0 inspect
18.1  23.8  .14  .13  17   .15  0  
float-newlib/float_req_bl_0683a.yml done .189  prog tests 3 inspect 8.7 8.0 15 39 .34 0     unknown prog tests 0 inspect
18.9  26.2  .14  .14  17   .16  0  
float-newlib/float_req_bl_0683b.yml done .189  prog tests 3 inspect 9.6 8.9 14 35 .34 0     unknown prog tests 0 inspect
18.9  26.2  .14  .14  16   .16  0  
float-newlib/float_req_bl_0684a.yml done .186  prog tests 3 inspect 13   12   16 36 .33 0     unknown prog tests 0 inspect
18.6  22.9  .14  .14  17   .15  0  
float-newlib/float_req_bl_0684b.yml done .186  prog tests 3 inspect 16   15   15 47 .33 0     unknown prog tests 0 inspect
18.6  22.9  .13  .13  17   .15  0  
float-newlib/float_req_bl_0710.yml done .231  prog tests 2 inspect 11   10   15 35 .22 0     unknown prog tests 0 inspect
23.1  29.4  .13  .13  17   .10  0  
float-newlib/float_req_bl_0870a.yml done .0417 prog tests 2 inspect 9.9 9.2 14 25 .43 0     unknown prog tests 0 inspect
4.17 5.67 .15  .16  17   .18  0  
float-newlib/float_req_bl_0870b.yml done .0357 prog tests 3 inspect 18   16   16 60 .43 0     unknown prog tests 0 inspect
3.57 5.67 .15  .15  17   .23  0  
float-newlib/float_req_bl_0872a.yml done .012  prog tests 1 inspect 29   27   19 99 .36 0     unknown prog tests 0 inspect
1.20 4.50 .15  .15  17   .14  0  
float-newlib/float_req_bl_0872b.yml done .012  prog tests 1 inspect 20   18   15 120 .36 0     unknown prog tests 0 inspect
1.20 4.50 .15  .15  17   .14  0  
float-newlib/float_req_bl_0874.yml done .0774 prog tests 3 inspect 18   16   15 60 .43 0     unknown prog tests 0 inspect
7.74 10.3  .15  .15  17   .23  0  
float-newlib/float_req_bl_0875.yml done .0824 prog tests 3 inspect 20   19   15 67 .36 0     unknown prog tests 0 inspect
8.24 10.1  .15  .15  17   .23  0  
float-newlib/float_req_bl_0876.yml done .0824 prog tests 3 inspect 17   15   16 65 .43 0     unknown prog tests 0 inspect
8.24 10.1  .16  .16  17   .23  0  
float-newlib/float_req_bl_0877.yml done .0774 prog tests 3 inspect 21   19   16 62 .36 0     unknown prog tests 0 inspect
7.74 10.2  .15  .15  17   .23  0  
float-newlib/float_req_bl_0880.yml done .305  prog tests 36 inspect 100   91   19 410 .45 0     unknown prog tests 0 inspect
30.5  31.0  .33  .32  19   1.7   0  
float-newlib/float_req_bl_0881.yml done .310  prog tests 39 inspect 60   55   19 270 .44 0     unknown prog tests 0 inspect
31.1  30.7  .30  .28  18   1.9   0  
float-newlib/float_req_bl_0883.yml done .143  prog tests 6 inspect 40   37   20 170 .43 0     unknown prog tests 0 inspect
14.3  15.6  .16  .19  17   .36  0  
float-newlib/float_req_bl_0920a.yml done .214  prog tests 2 inspect 7.8 7.2 14 33 .25 0     unknown prog tests 0 inspect
21.4  27.1  .12  .12  16   .11  0  
float-newlib/float_req_bl_0970a.yml done .167  prog tests 2 inspect 11   10   15 33 .27 0     unknown prog tests 0 inspect
16.7  21.6  .14  .14  17   .12  0  
float-newlib/float_req_bl_1121a.yml done .0526 prog tests 1 inspect 20   18   15 71 .25 0     unknown prog tests 0 inspect
5.26 26.6  .15  .15  17   .086 0  
float-newlib/float_req_bl_1121b.yml done .0526 prog tests 1 inspect 20   18   17 110 .25 0     unknown prog tests 0 inspect
5.26 26.6  .12  .12  16   .086 0  
float-newlib/float_req_bl_1122a.yml done .105  prog tests 2 inspect 7.4 6.8 15 41 .25 0     unknown prog tests 0 inspect
10.5  26.6  .13  .13  17   .11  0  
float-newlib/float_req_bl_1122b.yml done .105  prog tests 2 inspect 8.9 8.2 16 36 .25 0     unknown prog tests 0 inspect
10.5  26.6  .13  .13  17   .11  0  
float-newlib/float_req_bl_1130a.yml done .204  prog tests 2 inspect 8.8 8.1 16 34 .25 0     unknown prog tests 0 inspect
20.4  32.4  .13  .13  17   .11  0  
float-newlib/float_req_bl_1130b.yml done .204  prog tests 2 inspect 8.5 7.9 15 29 .25 0     unknown prog tests 0 inspect
20.4  32.4  .12  .12  16   .11  0  
float-newlib/float_req_bl_1131a.yml done .175  prog tests 2 inspect 8.4 7.7 14 25 .32 0     unknown prog tests 0 inspect
17.5  33.3  .13  .13  17   .11  0  
float-newlib/float_req_bl_1131b.yml done .175  prog tests 2 inspect 7.8 7.2 11 25 .32 0     unknown prog tests 0 inspect
17.5  33.3  .13  .13  17   .11  0  
float-newlib/float_req_bl_1211a.yml done .333  prog tests 1 inspect 28   26   17 80 .22 0     unknown prog tests 0 inspect
33.3  61.9  .12  .12  16   .082 0  
float-newlib/float_req_bl_1211b.yml done .333  prog tests 1 inspect 30   27   17 88 .22 0     unknown prog tests 0 inspect
33.3  61.9  .12  .12  16   .082 0  
float-newlib/float_req_bl_1231.yml done .64   prog tests 4 inspect 17   16   16 70 .29 0     unknown prog tests 0 inspect
64.0  72.2  .13  .13  16   .15  0  
float-newlib/float_req_bl_1251.yml done .64   prog tests 4 inspect 31   28   16 98 .29 0     unknown prog tests 0 inspect
64.0  81.2  .14  .14  17   .15  0  
float-newlib/float_req_bl_1270a.yml done .239  prog tests 3 inspect 21   19   15 76 .31 0     unknown prog tests 0 inspect
23.9  32.8  .13  .13  16   .14  0  
float-newlib/float_req_bl_1270b.yml done .239  prog tests 3 inspect 22   20   16 95 .31 0     unknown prog tests 0 inspect
23.9  32.8  .13  .20  16   .14  0  
float-newlib/float_req_bl_1270c.yml done .239  prog tests 3 inspect 18   17   16 98 .31 0     unknown prog tests 0 inspect
23.9  32.8  .13  .15  16   .14  0  
float-newlib/float_req_bl_1270d.yml done .239  prog tests 3 inspect 20   18   17 61 .31 0     unknown prog tests 0 inspect
23.9  32.8  .13  .13  16   .14  0  
float-newlib/float_req_bl_1271a.yml done .208  prog tests 3 inspect 11   10   14 46 .32 0     unknown prog tests 0 inspect
20.8  28.5  .13  .16  17   .14  0  
float-newlib/float_req_bl_1271b.yml done .208  prog tests 3 inspect 16   14   16 50 .31 0     unknown prog tests 0 inspect
20.8  30.8  .13  .13  16   .14  0  
float-newlib/float_req_bl_1381.yml done .5    prog tests 1 inspect 20   18   15 92 .21 0     unknown prog tests 0 inspect
50.0  93.8  .12  .12  17   .078 0  
loop-floats-scientific-comp/loop1-1.yml timeout .75   prog tests 10 inspect 900   900   10 14000 .37 0     unknown prog tests 0 inspect
75.0  100    .15  .17  16   .23  0  
loop-floats-scientific-comp/loop1-2.yml false(unreach-call) 1.0    prog tests 10 inspect 110   100   18 290 .28 0     true prog tests 1 inspect
100    100    .15  .17  16   .23  0  
loop-floats-scientific-comp/loop2-1.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 43 .21 .061 unknown prog tests 0 inspect
0    0    .059 .060 9.0 0     0  
loop-floats-scientific-comp/loop2-2.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 45 .21 0     unknown prog tests 0 inspect
0    0    .068 .070 8.9 0     0  
loop-floats-scientific-comp/loop3.yml couldn't run: all seeds time out or crash .0    prog tests 0 inspect 3.1 3.2 10 41 .21 0     unknown prog tests 0 inspect
0    0    .060 .060 9.0 0     0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 212 83.0  60000 60000 3600 800000 69   1.8 212 8300 10400 420 420 12000 34 0  
Run set fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Floats tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Floats