Benchmark KLEE TBF Test-Suite Validator
Tool KLEE 2.0.0-pre-test-comp Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:09:47 CET 2019-02-06 06:16:47 CET
Run set klee.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-klee.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/klee.2019-02-05_2109.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/sanfoundry_10_ground.yml timeout .944  prog tests 5 inspect 900    900    10000 9800    .037 0   unknown prog tests 0 inspect
94.4  100   13     13     440   .14  0  
array-examples/sanfoundry_24-1.yml timeout .917  prog tests 10 inspect 900    900    5900 10000    .070 0   unknown prog tests 0 inspect
91.7  100   .15  .20  16   .23  0  
array-examples/standard_copy1_ground-1.yml done .875  prog tests 1 inspect 2.0  2.1  110 26    .016 0   unknown prog tests 0 inspect
87.5  100   2.6   2.6   440   .078 0  
array-examples/standard_copy1_ground-2.yml timeout (false(unreach-call)) .75   prog tests 2 inspect 900    900    240 8600    .049 0   true prog tests 1 inspect
75.0  90.0 11     11     920   .094 0  
array-examples/standard_copy2_ground-1.yml timeout (false(unreach-call)) .8    prog tests 2 inspect 900    900    250 9700    .037 0   true prog tests 1 inspect
80.0  91.7 10     10     920   .094 0  
array-examples/standard_copy2_ground-2.yml done .9    prog tests 1 inspect 2.5  2.5  110 32    .016 0   unknown prog tests 0 inspect
90.0  100   2.6   2.6   440   .078 0  
array-examples/standard_copy3_ground-1.yml done .917  prog tests 1 inspect 2.9  2.9  110 38    .016 0   unknown prog tests 0 inspect
91.7  100   2.7   2.7   440   .078 0  
array-examples/standard_copy3_ground-2.yml timeout (false(unreach-call)) .833  prog tests 2 inspect 900    900    250 9500    .049 0   true prog tests 1 inspect
83.3  92.9 11     11     920   .090 0  
array-examples/standard_copy4_ground-1.yml done .929  prog tests 1 inspect 3.3  3.3  120 46    .016 0   unknown prog tests 0 inspect
92.9  100   2.7   2.7   440   .078 0  
array-examples/standard_copy4_ground-2.yml timeout (false(unreach-call)) .857  prog tests 2 inspect 900    900    250 9400    .049 0   true prog tests 1 inspect
85.7  93.8 11     11     920   .094 0  
array-examples/standard_copy5_ground-1.yml done .938  prog tests 1 inspect 3.8  3.8  120 50    .016 0   unknown prog tests 0 inspect
93.8  100   2.7   2.7   440   .078 0  
array-examples/standard_copy5_ground-2.yml timeout (false(unreach-call)) .875  prog tests 2 inspect 900    900    260 11000    .049 0   true prog tests 1 inspect
87.5  94.4 11     11     920   .094 0  
array-examples/standard_copy6_ground-1.yml timeout (false(unreach-call)) .889  prog tests 2 inspect 900    900    260 7900    .049 0   true prog tests 1 inspect
88.9  95.0 11     11     920   .094 0  
array-examples/standard_copy6_ground-2.yml done .944  prog tests 1 inspect 4.2  4.2  120 51    .016 0   unknown prog tests 0 inspect
94.4  100   2.6   2.6   440   .078 0  
array-examples/standard_copy7_ground-1.yml timeout (false(unreach-call)) .9    prog tests 2 inspect 900    900    270 9300    .045 0   true prog tests 1 inspect
90.0  95.5 10     10     920   .098 0  
array-examples/standard_copy7_ground-2.yml done .95   prog tests 1 inspect 4.7  4.7  130 60    .016 0   unknown prog tests 0 inspect
95.0  100   2.6   2.6   440   .082 0  
array-examples/standard_copy8_ground-1.yml done .955  prog tests 1 inspect 5.1  5.1  130 76    .016 0   unknown prog tests 0 inspect
95.5  100   2.7   2.8   440   .074 0  
array-examples/standard_copy8_ground-2.yml timeout (false(unreach-call)) .909  prog tests 2 inspect 900    900    270 11000    .049 0   true prog tests 1 inspect
90.9  95.8 11     11     920   .098 0  
array-examples/standard_copy9_ground-1.yml timeout (false(unreach-call)) .917  prog tests 2 inspect 900    900    270 9200    .045 0   true prog tests 1 inspect
91.7  96.2 11     11     920   .098 0  
array-examples/standard_copy9_ground-2.yml done .958  prog tests 1 inspect 5.6  5.7  140 94    .016 0   unknown prog tests 0 inspect
95.8  100   2.6   2.6   440   .082 0  
array-examples/standard_copyInitSum_ground.yml done .9    prog tests 1 inspect 2.0  2.0  56 30    .016 0   unknown prog tests 0 inspect
90.0  100   .11  .11  17   .078 0  
array-examples/standard_find_ground-1.yml timeout .9    prog tests 5 inspect 900    900    1600 11000    .070 0   unknown prog tests 0 inspect
90.0  100   13     13     440   .14  0  
array-examples/standard_partition_ground-1.yml out of memory .143  prog tests 1 inspect 8.3  7.9  15000 110    .074 0   unknown prog tests 0 inspect
14.3  36.4 .14  .14  16   .078 0  
array-examples/standard_sentinel-2.yml unknown .8    prog tests 4 inspect .93 .95 170 12    .016 0   unknown prog tests 0 inspect
80.0  92.3 10     10     440   .13  0  
array-examples/standard_sentinel.i.v+cfa-reducer.yml unknown .8    prog tests 4 inspect .95 .95 170 11    .016 0   unknown prog tests 0 inspect
80.0  81.8 10     10     440   .13  0  
array-examples/standard_strcpy_ground-1.yml timeout .8    prog tests 4 inspect 900    900    5400 12000    .045 0   unknown prog tests 0 inspect
80.0  100   10     10     440   .13  0  
array-examples/standard_strcpy_original-2.yml timeout .75   prog tests 5 inspect 900    900    2000 12000    .066 0   unknown prog tests 0 inspect
75.0  100   13     13     440   .14  0  
array-examples/standard_two_index_01.yml done .875  prog tests 1 inspect .32 .34 27 3.8  .016 0   unknown prog tests 0 inspect
87.5  100   .37  .37  44   .078 0  
array-examples/standard_two_index_02.yml done .875  prog tests 1 inspect 1.5  1.5  110 21    .016 0   unknown prog tests 0 inspect
87.5  100   2.6   2.6   440   .078 0  
array-examples/standard_two_index_03.yml done .875  prog tests 1 inspect .24 .25 28 3.2  .016 0   unknown prog tests 0 inspect
87.5  100   .37  .37  44   .078 0  
array-examples/standard_two_index_04.yml done .875  prog tests 1 inspect 1.2  1.2  110 20    .016 0   unknown prog tests 0 inspect
87.5  100   2.6   2.6   440   .078 0  
array-examples/standard_two_index_05.yml done .875  prog tests 1 inspect 1.1  1.1  110 16    .016 0   unknown prog tests 0 inspect
87.5  100   2.5   2.5   440   .078 0  
array-examples/standard_two_index_06.yml done .875  prog tests 1 inspect .22 .23 27 2.4  .016 0   unknown prog tests 0 inspect
87.5  100   .36  .36  44   .078 0  
array-examples/standard_two_index_07.yml done .875  prog tests 1 inspect 1.1  1.1  110 14    .016 0   unknown prog tests 0 inspect
87.5  100   2.7   2.7   440   .078 0  
array-examples/standard_two_index_08.yml done .875  prog tests 1 inspect 1.0  1.0  110 15    .016 0   unknown prog tests 0 inspect
87.5  100   2.6   2.6   440   .078 0  
array-examples/standard_two_index_09.yml done .875  prog tests 1 inspect 1.0  1.0  110 13    .016 0   unknown prog tests 0 inspect
87.5  100   2.6   2.6   440   .078 0  
array-industry-pattern/array_monotonic.yml timeout .3    prog tests 3 inspect 900    900    14000 7000    .066 0   unknown prog tests 0 inspect
30.0  55.6 .13  .17  16   .11  0  
array-industry-pattern/array_mul_init.yml out of memory .286  prog tests 1 inspect 8.3  7.9  15000 99    .066 0   unknown prog tests 0 inspect
28.6  50.0 .12  .12  16   .078 0  
array-industry-pattern/array_of_struct_break.yml done .9    prog tests 5 inspect 2.4  2.5  21 42    .016 0   unknown prog tests 0 inspect
90.0  100   .13  .13  16   .14  0  
array-industry-pattern/array_of_struct_ptr_mul_init.yml out of memory .357  prog tests 2 inspect 9.5  9.2  15000 120    .074 0   unknown prog tests 0 inspect
35.7  53.9 .12  .12  17   .094 0  
array-industry-pattern/array_of_struct_single_elem_init.yml timeout .25   prog tests 3 inspect 900    900    11000 6700    .057 0   unknown prog tests 0 inspect
25.0  50.0 .13  .19  17   .11  0  
array-industry-pattern/array_ptr_single_elem_init-2.yml timeout .5    prog tests 4 inspect 900    900    11000 6600    .070 0   unknown prog tests 0 inspect
50.0  64.7 .13  .13  16   .13  0  
array-industry-pattern/array_shadowinit.yml false(valid-deref) .875  prog tests 7 inspect .13 .15 21 1.6  .016 0   unknown prog tests 0 inspect
87.5  100   .14  .17  16   .14  0  
array-industry-pattern/array_single_elem_init.yml timeout .5    prog tests 4 inspect 900    900    11000 7000    .070 0   unknown prog tests 0 inspect
50.0  64.7 .13  .13  16   .13  0  
reducercommutativity/avg.yml false(valid-deref) .8    prog tests 7 inspect .14 .16 21 1.5  .016 0   unknown prog tests 0 inspect
80.0  95.2 .14  .14  16   .18  0  
reducercommutativity/avg05-1.yml done .8    prog tests 1 inspect .12 .14 21 1.3  .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .13  16   .078 0  
reducercommutativity/avg10-2.yml done .8    prog tests 1 inspect .13 .16 21 1.2  .016 0   unknown prog tests 0 inspect
80.0  94.7 .11  .11  17   .078 0  
reducercommutativity/avg20-2.yml done .8    prog tests 1 inspect .14 .16 21 .91 .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
reducercommutativity/avg40-2.yml done .8    prog tests 1 inspect .13 .15 21 1.3  .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
reducercommutativity/avg60-1.yml done .8    prog tests 1 inspect .12 .14 21 1.5  .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
reducercommutativity/max.yml false(valid-deref) .8    prog tests 7 inspect .16 .18 21 1.5  .016 0   unknown prog tests 0 inspect
80.0  95.2 .14  .14  16   .18  0  
reducercommutativity/max05-1.yml done .8    prog tests 6 inspect .56 .56 22 7.4  .016 0   unknown prog tests 0 inspect
80.0  94.7 .14  .21  16   .16  0  
reducercommutativity/max10-1.yml done .8    prog tests 8 inspect 50    50    110 770    .016 0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  17   .19  0  
reducercommutativity/max20-1.yml timeout .8    prog tests 7 inspect 900    900    1700 8200    .066 0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .18  0  
reducercommutativity/max40-1.yml timeout .8    prog tests 3 inspect 900    900    1700 7900    .037 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .11  0  
reducercommutativity/max60-2.yml timeout .8    prog tests 7 inspect 900    900    1800 9000    .070 0   unknown prog tests 0 inspect
80.0  94.7 .15  .14  16   .18  0  
reducercommutativity/rangesum.yml false(valid-deref) .875  prog tests 11 inspect .22 .24 40 3.9  .016 0   true prog tests 1 inspect
87.5  96.8 .16  .16  17   .25  0  
reducercommutativity/rangesum05.yml false(unreach-call) .857  prog tests 3 inspect .13 .14 21 1.5  .016 0   true prog tests 1 inspect
85.7  96.3 .13  .13  16   .11  0  
reducercommutativity/rangesum10.yml false(unreach-call) .857  prog tests 3 inspect .14 .16 22 1.2  .016 0   true prog tests 1 inspect
85.7  96.3 .13  .13  16   .11  0  
reducercommutativity/rangesum20.yml false(unreach-call) .857  prog tests 3 inspect .20 .22 36 2.3  .016 0   true prog tests 1 inspect
85.7  96.3 .13  .13  17   .11  0  
reducercommutativity/rangesum40.yml false(unreach-call) .857  prog tests 3 inspect .20 .22 41 2.6  .016 0   true prog tests 1 inspect
85.7  96.3 .14  .15  16   .11  0  
reducercommutativity/rangesum60.yml false(unreach-call) .857  prog tests 3 inspect .25 .27 48 2.6  .016 0   true prog tests 1 inspect
85.7  96.3 .13  .13  16   .11  0  
reducercommutativity/sep.yml false(valid-deref) .833  prog tests 7 inspect .15 .17 21 1.4  .016 0   unknown prog tests 0 inspect
83.3  95.7 .14  .14  17   .18  0  
reducercommutativity/sep05-1.yml done .833  prog tests 10 inspect .14 .16 21 1.4  .016 0   unknown prog tests 0 inspect
83.3  95.2 .15  .15  16   .23  0  
reducercommutativity/sep10-2.yml done .833  prog tests 6 inspect .58 .60 26 7.5  .016 0   unknown prog tests 0 inspect
83.3  95.2 .14  .14  17   .16  0  
reducercommutativity/sep20-1.yml timeout .833  prog tests 5 inspect 900    900    6400 6100    .070 0   unknown prog tests 0 inspect
83.3  95.2 .14  .13  17   .14  0  
reducercommutativity/sep40-1.yml timeout .833  prog tests 3 inspect 900    900    11000 10000    .053 0   unknown prog tests 0 inspect
83.3  95.2 .13  .17  17   .11  0  
reducercommutativity/sep60-2.yml timeout .833  prog tests 3 inspect 900    900    11000 13000    .029 0   unknown prog tests 0 inspect
83.3  95.2 .13  .13  17   .11  0  
reducercommutativity/sum.yml false(valid-deref) .8    prog tests 6 inspect .15 .17 20 1.4  .016 0   unknown prog tests 0 inspect
80.0  95.2 .13  .13  16   .16  0  
reducercommutativity/sum05-2.yml done .8    prog tests 1 inspect .13 .15 21 2.4  .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
reducercommutativity/sum10-1.yml done .8    prog tests 1 inspect .13 .15 20 1.3  .016 0   unknown prog tests 0 inspect
80.0  94.7 .11  .11  17   .078 0  
reducercommutativity/sum20-2.yml done .8    prog tests 1 inspect .13 .15 21 1.1  .016 0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  17   .078 0  
reducercommutativity/sum40-2.yml done .8    prog tests 1 inspect .12 .12 21 1.2  .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
reducercommutativity/sum60-2.yml done .8    prog tests 1 inspect .12 .13 21 1.2  .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
array-tiling/mbpr2.yml false(valid-deref) .75   prog tests 12 inspect .14 .16 21 1.1  .016 0   unknown prog tests 0 inspect
75.0  91.7 .15  .19  16   .26  0  
array-tiling/mbpr3.yml done .125  prog tests 5 inspect .15 .17 21 1.2  .016 0   unknown prog tests 0 inspect
12.5  33.3 .13  .13  16   .15  0  
array-tiling/mbpr4.yml false(valid-deref) .75   prog tests 16 inspect .15 .17 21 1.7  .020 0   unknown prog tests 0 inspect
75.0  90.9 .18  .26  17   .39  0  
array-tiling/mbpr5.yml done .0938 prog tests 4 inspect .16 .18 21 1.2  .020 0   unknown prog tests 0 inspect
9.38 22.8 .13  .18  16   .15  0  
array-tiling/mlceu.yml done .833  prog tests 8 inspect .16 .18 21 1.2  .016 0   unknown prog tests 0 inspect
83.3  91.7 .14  .14  16   .19  0  
array-tiling/nr2.yml false(valid-deref) .833  prog tests 11 inspect .15 .17 21 1.4  .016 0   unknown prog tests 0 inspect
83.3  100   81     81     16   .25  0  
array-tiling/nr3.yml done .167  prog tests 5 inspect .14 .16 21 1.4  .016 0   unknown prog tests 0 inspect
16.7  47.1 .13  .16  17   .15  0  
array-tiling/nr4.yml false(valid-deref) .833  prog tests 11 inspect .14 .16 21 1.3  .016 0   unknown prog tests 0 inspect
83.3  100   81     81     16   .25  0  
array-tiling/nr5.yml done .167  prog tests 4 inspect .15 .17 21 1.3  .016 0   unknown prog tests 0 inspect
16.7  50.0 .13  .13  16   .13  0  
array-tiling/pnr2.yml timeout .875  prog tests 14 inspect 900    900    11000 9100    .061 0   unknown prog tests 0 inspect
87.5  100   .17  .16  16   .29  0  
array-tiling/pnr3.yml done .278  prog tests 4 inspect .12 .12 21 1.3  .016 0   unknown prog tests 0 inspect
27.8  28.6 .16  .18  16   .11  0  
array-tiling/pnr4.yml timeout .9    prog tests 18 inspect 900    900    11000 7800    .074 0   unknown prog tests 0 inspect
90.0  100   .18  .17  16   .36  0  
array-tiling/pnr5.yml done .227  prog tests 4 inspect .13 .15 21 1.3  .016 0   unknown prog tests 0 inspect
22.7  22.2 .13  .12  16   .14  0  
array-tiling/poly1.yml done .9    prog tests 7 inspect .14 .16 21 1.3  .016 0   unknown prog tests 0 inspect
90.0  100   .14  .14  16   .18  0  
array-tiling/poly2.yml done .917  prog tests 8 inspect .13 .13 21 1.0  .016 0   unknown prog tests 0 inspect
91.7  100   .14  .14  16   .19  0  
array-tiling/pr2.yml false(valid-deref) .611  prog tests 10 inspect .16 .18 21 1.1  .016 0   unknown prog tests 0 inspect
61.1  90.0 60     60     17   .23  0  
array-tiling/pr3.yml done .15   prog tests 4 inspect .12 .14 21 2.7  .016 0   unknown prog tests 0 inspect
15.0  41.7 .13  .13  16   .13  0  
array-tiling/pr4.yml false(valid-deref) .591  prog tests 10 inspect .13 .15 21 1.4  .016 0   unknown prog tests 0 inspect
59.1  85.7 60     60     16   .23  0  
array-tiling/pr5.yml done .125  prog tests 5 inspect .13 .15 21 1.4  .016 0   unknown prog tests 0 inspect
12.5  37.5 .14  .16  16   .15  0  
array-tiling/revcpyswp2.yml done .938  prog tests 10 inspect .16 .18 21 1.5  .016 0   unknown prog tests 0 inspect
93.8  100   .16  .15  16   .23  0  
array-tiling/rew.yml done .917  prog tests 8 inspect .13 .14 21 2.5  .016 0   unknown prog tests 0 inspect
91.7  100   .14  .13  16   .19  0  
array-tiling/rewnif.yml done .917  prog tests 8 inspect .13 .15 21 1.2  .016 0   unknown prog tests 0 inspect
91.7  100   .15  .15  16   .19  0  
array-tiling/rewnifrev.yml done .917  prog tests 8 inspect .45 .47 21 5.8  .016 0   unknown prog tests 0 inspect
91.7  100   .16  .16  16   .19  0  
array-tiling/rewnifrev2.yml done .9    prog tests 7 inspect .45 .48 21 5.1  .016 0   unknown prog tests 0 inspect
90.0  100   .14  .13  16   .18  0  
array-tiling/rewrev.yml done .917  prog tests 8 inspect .42 .44 21 5.2  .016 0   unknown prog tests 0 inspect
91.7  100   .14  .14  16   .19  0  
array-tiling/skipped.yml timeout .889  prog tests 14 inspect 900    900    11000 8500    .070 0   unknown prog tests 0 inspect
88.9  100   .18  .17  16   .29  0  
array-tiling/skippedu.yml timeout (false(unreach-call)) .944  prog tests 16 inspect 900    900    11000 12000    .074 0   true prog tests 1 inspect
94.4  100   .18  .19  16   .33  0  
array-tiling/tcpy.yml done .857  prog tests 9 inspect .30 .32 21 3.6  .016 0   unknown prog tests 0 inspect
85.7  100   .16  .15  16   .21  0  
array-programs/copysome1-1.yml done .917  prog tests 1 inspect 5.6  5.6  360 76    .016 0   unknown prog tests 0 inspect
91.7  100   10     11     1700   .078 0  
array-programs/copysome1-2.yml false(unreach-call) 1.0    prog tests 3 inspect 5.8  5.9  400 89    .016 0   true prog tests 1 inspect
100    100   30     30     1800   .11  0  
array-programs/copysome2-1.yml unknown .929  prog tests 1 inspect 7.7  7.7  530 140    .016 0   unknown prog tests 0 inspect
92.9  100   15     15     2600   .078 0  
array-programs/copysome2-2.yml false(unreach-call) 1.0    prog tests 3 inspect 7.8  7.8  610 100    .016 0   true prog tests 1 inspect
100    100   46     46     2800   .11  0  
array-crafted/bAnd1.yml done .8    prog tests 1 inspect .16 .18 21 1.3  .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
array-crafted/bAnd2.yml done .8    prog tests 1 inspect .51 .53 25 6.2  .016 0   unknown prog tests 0 inspect
80.0  94.7 .16  .16  17   .078 0  
array-crafted/bAnd3.yml done .8    prog tests 1 inspect 38    38    84 460    .016 0   unknown prog tests 0 inspect
80.0  94.7 .37  .37  44   .078 0  
array-crafted/bAnd4.yml timeout .8    prog tests 1 inspect 900    900    150 8900    .016 0   unknown prog tests 0 inspect
80.0  94.7 2.7   2.7   440   .078 0  
array-crafted/bAnd5.yml false(valid-deref) .833  prog tests 7 inspect .15 .17 21 1.8  .016 0   unknown prog tests 0 inspect
83.3  95.7 .14  .14  16   .18  0  
array-crafted/bor1.yml done .8    prog tests 1 inspect .15 .17 21 1.2  .016 0   unknown prog tests 0 inspect
80.0  94.7 .11  .11  16   .078 0  
array-crafted/bor2.yml done .8    prog tests 1 inspect .52 .53 25 6.7  .016 0   unknown prog tests 0 inspect
80.0  94.7 .16  .16  17   .078 0  
array-crafted/bor3.yml done .8    prog tests 1 inspect 39    39    84 570    .016 0   unknown prog tests 0 inspect
80.0  94.7 .37  .37  44   .078 0  
array-crafted/bor4.yml timeout .8    prog tests 1 inspect 900    900    150 11000    .016 0   unknown prog tests 0 inspect
80.0  94.7 2.7   2.7   440   .078 0  
array-crafted/bor5.yml false(valid-deref) .833  prog tests 7 inspect .15 .17 21 1.4  .016 0   unknown prog tests 0 inspect
83.3  95.7 .14  .13  17   .18  0  
array-crafted/mapavg1.yml done .8    prog tests 1 inspect .14 .16 21 1.2  .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
array-crafted/mapavg2.yml done .8    prog tests 1 inspect .45 .47 25 6.8  .016 0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  17   .078 0  
array-crafted/mapavg3.yml done .8    prog tests 1 inspect 27    27    84 390    .016 0   unknown prog tests 0 inspect
80.0  94.7 .39  .39  44   .078 0  
array-crafted/mapavg4.yml unknown .0    prog tests 0 inspect 79    79    160 580    .016 0   unknown prog tests 0 inspect
0    0   .058 .060 9.0 0     0  
array-crafted/mapavg5.yml false(valid-deref) .833  prog tests 8 inspect .15 .15 21 1.7  .016 0   unknown prog tests 0 inspect
83.3  95.7 .15  .14  16   .20  0  
array-crafted/mapsum1.yml done .8    prog tests 1 inspect .13 .15 21 1.4  .016 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
array-crafted/mapsum2.yml done .8    prog tests 1 inspect .45 .47 25 6.6  .016 0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  17   .078 0  
array-crafted/mapsum3.yml done .8    prog tests 1 inspect 27    27    84 470    .016 0   unknown prog tests 0 inspect
80.0  94.7 .41  .42  44   .078 0  
array-crafted/mapsum4.yml unknown .0    prog tests 0 inspect 79    79    160 720    .016 0   unknown prog tests 0 inspect
0    0   .060 .061 9.0 0     0  
array-crafted/mapsum5.yml timeout (false(valid-deref)) .833  prog tests 6 inspect 900    900    570 11000    .029 0   unknown prog tests 0 inspect
83.3  95.7 .14  .14  17   .16  0  
array-crafted/xor1.yml done .8    prog tests 1 inspect 1.3  1.3  33 17    .016 0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .078 0  
array-crafted/xor2.yml done .8    prog tests 1 inspect 470    470    310 4000    .016 0   unknown prog tests 0 inspect
80.0  94.7 .15  .15  17   .078 0  
array-crafted/xor3.yml unknown .0    prog tests 0 inspect 39    39    95 600    .016 0   unknown prog tests 0 inspect
0    0   .061 .062 8.9 0     0  
array-crafted/xor4.yml timeout .8    prog tests 1 inspect 900    900    150 8500    .016 0   unknown prog tests 0 inspect
80.0  94.7 2.7   2.7   440   .078 0  
array-crafted/xor5.yml false(valid-deref) .833  prog tests 7 inspect .33 .35 25 3.8  .016 0   unknown prog tests 0 inspect
83.3  95.7 .15  .14  16   .18  0  
array-crafted/zero_sum1.yml done .9    prog tests 7 inspect .17 .19 21 1.4  .016 0   unknown prog tests 0 inspect
90.0  100   .16  .16  16   .18  0  
array-crafted/zero_sum2.yml done .929  prog tests 9 inspect .16 .17 21 1.4  .016 0   unknown prog tests 0 inspect
92.9  100   .16  .16  16   .21  0  
array-crafted/zero_sum3.yml done .944  prog tests 11 inspect .19 .21 21 1.5  .016 0   unknown prog tests 0 inspect
94.4  100   .16  .16  16   .25  0  
array-crafted/zero_sum4.yml done .955  prog tests 13 inspect .17 .19 21 1.8  .016 0   unknown prog tests 0 inspect
95.5  100   .18  .17  16   .28  0  
array-crafted/zero_sum5.yml done .962  prog tests 15 inspect .18 .20 21 2.0  .016 0   unknown prog tests 0 inspect
96.2  100   .19  .18  16   .31  0  
array-crafted/zero_sum_const1.yml done .917  prog tests 8 inspect .13 .15 21 1.3  .016 0   unknown prog tests 0 inspect
91.7  100   .15  .14  16   .19  0  
array-crafted/zero_sum_const2.yml done .938  prog tests 10 inspect .13 .13 21 1.8  .016 0   unknown prog tests 0 inspect
93.8  100   .15  .14  16   .23  0  
array-crafted/zero_sum_const3.yml done .95   prog tests 12 inspect .13 .15 21 1.5  .016 0   unknown prog tests 0 inspect
95.0  100   .15  .15  17   .26  0  
array-crafted/zero_sum_const4.yml done .958  prog tests 14 inspect .13 .15 21 1.8  .016 0   unknown prog tests 0 inspect
95.8  100   .17  .23  16   .29  0  
array-crafted/zero_sum_const5.yml done .964  prog tests 16 inspect .14 .16 21 1.4  .016 0   unknown prog tests 0 inspect
96.4  100   .19  .25  16   .33  0  
array-crafted/zero_sum_const_m2.yml done .938  prog tests 10 inspect .13 .15 21 1.4  .016 0   unknown prog tests 0 inspect
93.8  100   .15  .17  16   .23  0  
array-crafted/zero_sum_const_m3.yml done .95   prog tests 12 inspect .16 .17 21 1.5  .016 0   unknown prog tests 0 inspect
95.0  100   .16  .16  16   .26  0  
array-crafted/zero_sum_const_m4.yml done .958  prog tests 14 inspect .14 .16 21 2.0  .016 0   unknown prog tests 0 inspect
95.8  100   .16  .17  16   .28  0  
array-crafted/zero_sum_const_m5.yml done .964  prog tests 16 inspect .15 .16 21 1.4  .016 0   unknown prog tests 0 inspect
96.4  100   .18  .22  16   .33  0  
array-crafted/zero_sum_m2.yml done .929  prog tests 9 inspect .16 .18 22 1.4  .016 0   unknown prog tests 0 inspect
92.9  100   .16  .15  17   .21  0  
array-crafted/zero_sum_m3.yml done .944  prog tests 11 inspect .15 .17 21 1.7  .016 0   unknown prog tests 0 inspect
94.4  100   .17  .16  16   .25  0  
array-crafted/zero_sum_m4.yml done .955  prog tests 13 inspect .17 .19 21 1.5  .016 0   unknown prog tests 0 inspect
95.5  100   .18  .17  16   .28  0  
array-crafted/zero_sum_m5.yml done .962  prog tests 15 inspect .18 .20 21 2.1  .016 0   unknown prog tests 0 inspect
96.2  100   .19  .18  17   .31  0  
array-multidimensional/add-2-n-u.yml unknown .0    prog tests 1 inspect 56    56    3400 860    .016 0   unknown prog tests 0 inspect
0    0   75     76     3800   .082 0  
array-multidimensional/add-3-n-u.yml out of memory .0    prog tests 0 inspect 5.5  5.2  15000 60    1.1   0   unknown prog tests 0 inspect
0    0   .064 .065 9.0 0     0  
array-multidimensional/copy-2-u.yml unknown .929  prog tests 1 inspect 25    25    890 320    .016 0   unknown prog tests 0 inspect
92.9  97.1 25     25     4300   .082 0  
array-multidimensional/copy-3-n-u.yml false(valid-deref) .0    prog tests 1 inspect 1.9  1.9  2200 21    .016 0   unknown prog tests 0 inspect
0    0   .12  .12  16   .086 0  
array-multidimensional/copy-partial-2-n-u.yml unknown .0    prog tests 1 inspect 19    19    1300 230    .016 0   unknown prog tests 0 inspect
0    0   36     37     1900   .082 0  
array-multidimensional/copy-partial-3-u.yml false(valid-deref) .0    prog tests 1 inspect .12 .13 22 1.5  .016 0   unknown prog tests 0 inspect
0    0   .11  .12  17   .086 0  
array-multidimensional/diff-2-n-u.yml unknown .0    prog tests 1 inspect 79    79    5000 1100    .016 0   out of memory prog tests 0 inspect
110     110     7000   0     0  
array-multidimensional/diff-3-n-u.yml out of memory .0    prog tests 0 inspect 5.6  5.2  15000 55    .053 0   unknown prog tests 0 inspect
0    0   .061 .061 8.9 0     0  
array-multidimensional/init-2-n-u.yml done .9    prog tests 1 inspect 19    19    73 330    .016 0   unknown prog tests 0 inspect
90.0  96.2 .13  .13  17   .078 0  
array-multidimensional/init-3-u.yml false(valid-deref) .0    prog tests 1 inspect .14 .16 21 1.3  .016 0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/init-4-n-u.yml timeout .0    prog tests 1 inspect 900    900    5600 14000    .066 0   unknown prog tests 0 inspect
0    0   .12  .13  16   .082 0  
array-multidimensional/init-non-constant-2-n-u.yml timeout .9    prog tests 11 inspect 900    900    11000 13000    .049 0   unknown prog tests 0 inspect
90.0  96.7 .15  .15  16   .25  0  
array-multidimensional/init-non-constant-3-u.yml false(valid-deref) .0    prog tests 1 inspect .11 .13 22 1.6  .016 0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/max-2-u.yml timeout .0    prog tests 2 inspect 900    900    3200 8300    .070 0   unknown prog tests 0 inspect
0    0   71     72     2300   .082 0  
array-multidimensional/max-3-n-u.yml out of memory .0    prog tests 0 inspect 5.6  5.2  15000 68    .14  0   unknown prog tests 0 inspect
0    0   .059 .060 9.0 0     0  
array-multidimensional/min-2-u.yml timeout .0    prog tests 2 inspect 900    900    3000 8600    .061 0   unknown prog tests 0 inspect
0    0   39     40     1900   .082 0  
array-multidimensional/min-3-n-u.yml out of memory .0    prog tests 0 inspect 5.5  5.1  15000 72    .070 0   unknown prog tests 0 inspect
0    0   .059 .060 9.0 0     0  
array-multidimensional/rev-2-n-u.yml unknown .0    prog tests 1 inspect 43    43    1300 610    .016 0   unknown prog tests 0 inspect
0    0   36     36     1900   .082 0  
array-multidimensional/rev-3-u.yml false(valid-deref) .0    prog tests 1 inspect .14 .16 21 1.2  .016 0   unknown prog tests 0 inspect
0    0   .12  .16  17   .086 0  
array-multidimensional/transpose-u.yml unknown .929  prog tests 1 inspect 25    25    880 340    .016 0   unknown prog tests 0 inspect
92.9  100   26     27     4300   .082 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 169 120   34000 34000 300000 360000 5.5  0   169 12000 13800 1000 1000 57000 23 0  
Run set klee.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-klee.test-comp19_prop-coverage-branches.ReachSafety-Arrays