Benchmark Symbiotic TBF Test-Suite Validator
Tool symbiotic 6.0.3-dev-fd3f777b Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:07:32 CET 2019-02-06 14:52:39 CET
Run set symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options --test-comp --verifier klee-testcomp --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/symbiotic.2019-02-06_0707.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/sanfoundry_10_ground.yml done .833 prog tests 2 inspect 850    850    2900 10000   0     0      unknown prog tests 0 inspect
83.3 90.0 4.8   4.8   390   .094 0  
array-examples/sanfoundry_24-1.yml done .917 prog tests 4 inspect 890    890    10000 10000   0     0      unknown prog tests 0 inspect
91.7 100   .15  .17  16   .13  0  
array-examples/standard_copy1_ground-1.yml done .875 prog tests 1 inspect 3.8  3.8  380 48   0     0      unknown prog tests 0 inspect
87.5 100   2.5   2.5   380   .078 0  
array-examples/standard_copy1_ground-2.yml done .75  prog tests 1 inspect 840    840    420 7400   0     0      true prog tests 1 inspect
75.0 90.0 5.1   5.1   760   .078 0  
array-examples/standard_copy2_ground-1.yml done .8   prog tests 1 inspect 840    840    530 7100   0     0      true prog tests 1 inspect
80.0 91.7 4.9   4.9   760   .078 0  
array-examples/standard_copy2_ground-2.yml done .9   prog tests 1 inspect 4.4  4.4  440 54   0     0      unknown prog tests 0 inspect
90.0 100   2.4   2.4   380   .078 0  
array-examples/standard_copy3_ground-1.yml done .917 prog tests 1 inspect 5.0  5.0  500 63   0     0      unknown prog tests 0 inspect
91.7 100   2.5   2.5   390   .078 0  
array-examples/standard_copy3_ground-2.yml done .833 prog tests 1 inspect 840    840    580 7300   0     0      true prog tests 1 inspect
83.3 92.9 5.0   5.0   760   .078 0  
array-examples/standard_copy4_ground-1.yml done .929 prog tests 1 inspect 5.6  5.6  560 77   0     0      unknown prog tests 0 inspect
92.9 100   2.5   2.6   390   .078 0  
array-examples/standard_copy4_ground-2.yml done .857 prog tests 1 inspect 840    840    640 8100   0     0      true prog tests 1 inspect
85.7 93.8 5.2   5.3   760   .078 0  
array-examples/standard_copy5_ground-1.yml done .938 prog tests 1 inspect 6.0  6.0  620 77   0     0      unknown prog tests 0 inspect
93.8 100   2.4   2.4   390   .078 0  
array-examples/standard_copy5_ground-2.yml done .875 prog tests 1 inspect 840    840    700 7500   0     0      true prog tests 1 inspect
87.5 94.4 5.1   5.1   760   .078 0  
array-examples/standard_copy6_ground-1.yml done .889 prog tests 1 inspect 840    840    760 7700   0     0      true prog tests 1 inspect
88.9 95.0 5.0   5.0   760   .078 0  
array-examples/standard_copy6_ground-2.yml done .944 prog tests 1 inspect 6.5  6.5  680 100   0     0      unknown prog tests 0 inspect
94.4 100   2.5   2.5   390   .078 0  
array-examples/standard_copy7_ground-1.yml done .9   prog tests 1 inspect 840    840    820 8300   0     0      true prog tests 1 inspect
90.0 95.5 4.9   4.9   760   .082 0  
array-examples/standard_copy7_ground-2.yml done .95  prog tests 1 inspect 7.3  7.3  740 100   0     0      unknown prog tests 0 inspect
95.0 100   2.5   2.5   390   .082 0  
array-examples/standard_copy8_ground-1.yml done .955 prog tests 1 inspect 7.9  7.9  800 130   0     0      unknown prog tests 0 inspect
95.5 100   2.4   2.5   390   .082 0  
array-examples/standard_copy8_ground-2.yml done .909 prog tests 1 inspect 840    840    880 7200   0     0      true prog tests 1 inspect
90.9 95.8 5.1   5.2   760   .082 0  
array-examples/standard_copy9_ground-1.yml done .917 prog tests 1 inspect 840    840    940 8300   0     0      true prog tests 1 inspect
91.7 96.2 5.0   5.0   760   .082 0  
array-examples/standard_copy9_ground-2.yml done .958 prog tests 1 inspect 8.5  8.5  850 110   0     0      unknown prog tests 0 inspect
95.8 100   2.5   2.5   390   .082 0  
array-examples/standard_copyInitSum_ground.yml done .9   prog tests 1 inspect 2.5  2.5  310 30   0     0      unknown prog tests 0 inspect
90.0 100   .12  .13  16   .074 0  
array-examples/standard_find_ground-1.yml done .8   prog tests 2 inspect 860    860    3600 10000   0     0      unknown prog tests 0 inspect
80.0 100   4.8   4.8   390   .094 0  
array-examples/standard_partition_ground-1.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 45    45    15000 510   .016 0      error (0) prog tests 0 inspect
0   0   .091 .093 8.9 0     0  
array-examples/standard_sentinel-2.yml done .3   prog tests 1 inspect 2.9  2.8  320 46   0     0      unknown prog tests 0 inspect
30.0 53.9 2.5   2.6   380   .057 0  
array-examples/standard_sentinel.i.v+cfa-reducer.yml done .5   prog tests 2 inspect 3.4  3.3  350 38   0     0      unknown prog tests 0 inspect
50.0 40.9 4.7   4.7   390   .094 0  
array-examples/standard_strcpy_ground-1.yml done .8   prog tests 2 inspect 860    860    5300 10000   0     0      unknown prog tests 0 inspect
80.0 100   4.9   4.9   390   .094 0  
array-examples/standard_strcpy_original-2.yml done .75  prog tests 2 inspect 870    870    5800 10000   0     0      unknown prog tests 0 inspect
75.0 100   4.8   4.8   390   .094 0  
array-examples/standard_two_index_01.yml done .875 prog tests 1 inspect .64 .64 51 7.4 0     0      unknown prog tests 0 inspect
87.5 100   .36  .36  44   .078 0  
array-examples/standard_two_index_02.yml done .875 prog tests 1 inspect 3.1  3.1  300 35   0     0      unknown prog tests 0 inspect
87.5 100   2.5   2.5   380   .049 0  
array-examples/standard_two_index_03.yml done .875 prog tests 1 inspect .55 .55 40 6.8 0     0      unknown prog tests 0 inspect
87.5 100   .35  .35  44   .078 0  
array-examples/standard_two_index_04.yml done .875 prog tests 1 inspect 2.6  2.6  260 33   0     0      unknown prog tests 0 inspect
87.5 100   2.5   2.5   380   .078 0  
array-examples/standard_two_index_05.yml done .875 prog tests 1 inspect 2.6  2.6  260 33   0     0      unknown prog tests 0 inspect
87.5 100   2.5   2.5   380   .078 0  
array-examples/standard_two_index_06.yml done .875 prog tests 1 inspect .51 .51 38 7.2 0     0      unknown prog tests 0 inspect
87.5 100   .35  .35  44   .078 0  
array-examples/standard_two_index_07.yml done .875 prog tests 1 inspect 2.5  2.5  250 28   0     0      unknown prog tests 0 inspect
87.5 100   2.5   2.5   380   .078 0  
array-examples/standard_two_index_08.yml done .875 prog tests 1 inspect 2.5  2.5  240 29   0     0      unknown prog tests 0 inspect
87.5 100   2.5   2.5   380   .078 0  
array-examples/standard_two_index_09.yml done .875 prog tests 1 inspect 2.4  2.4  240 32   0     0      unknown prog tests 0 inspect
87.5 100   2.5   2.5   380   .078 0  
array-industry-pattern/array_monotonic.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 14    13    15000 180   .074 0      error (0) prog tests 0 inspect
0   0   .058 .060 8.9 0     0  
array-industry-pattern/array_mul_init.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 10    10    15000 130   .016 0      error (0) prog tests 0 inspect
0   0   .056 .056 8.9 0     0  
array-industry-pattern/array_of_struct_break.yml done .9   prog tests 2 inspect 1.4  1.4  170 22   0     0      unknown prog tests 0 inspect
90.0 100   .12  .12  17   .094 0  
array-industry-pattern/array_of_struct_ptr_mul_init.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 13    13    15000 180   .070 0      error (0) prog tests 0 inspect
0   0   .057 .058 8.9 0     0  
array-industry-pattern/array_of_struct_single_elem_init.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 28    28    15000 160   .025 0      error (0) prog tests 0 inspect
0   0   .064 .065 8.9 0     0  
array-industry-pattern/array_ptr_single_elem_init-2.yml done .714 prog tests 1 inspect 1.7  1.7  180 21   0     0      true prog tests 1 inspect
71.4 94.1 2.6   2.6   380   .078 0  
array-industry-pattern/array_shadowinit.yml done .875 prog tests 3 inspect 840    840    1200 14000   0     0      unknown prog tests 0 inspect
87.5 100   .12  .12  16   .11  0  
array-industry-pattern/array_single_elem_init.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 15    14    15000 200   .074 0      error (0) prog tests 0 inspect
0   0   .057 .058 9.0 0     0  
reducercommutativity/avg.yml done .8   prog tests 3 inspect 840    840    990 8800   0     0      unknown prog tests 0 inspect
80.0 95.2 .13  .13  16   .094 0  
reducercommutativity/avg05-1.yml done .8   prog tests 1 inspect .35 .35 18 4.4 0     0      unknown prog tests 0 inspect
80.0 94.7 .12  .12  17   .078 0  
reducercommutativity/avg10-2.yml done .8   prog tests 1 inspect .36 .36 18 4.1 0     0      unknown prog tests 0 inspect
80.0 94.7 .13  .21  16   .078 0  
reducercommutativity/avg20-2.yml done .8   prog tests 1 inspect .37 .37 19 4.2 0     0      unknown prog tests 0 inspect
80.0 94.7 .11  .13  16   .078 0  
reducercommutativity/avg40-2.yml done .8   prog tests 1 inspect .37 .37 19 4.9 0     0      unknown prog tests 0 inspect
80.0 94.7 .14  .14  16   .078 0  
reducercommutativity/avg60-1.yml done .8   prog tests 1 inspect .35 .35 19 4.8 0     0      unknown prog tests 0 inspect
80.0 94.7 .11  .11  16   .078 0  
reducercommutativity/max.yml done .8   prog tests 3 inspect 840    840    950 11000   0     0      unknown prog tests 0 inspect
80.0 95.2 .12  .12  16   .094 0  
reducercommutativity/max05-1.yml done .8   prog tests 1 inspect 4.8  4.8  27 66   0     0      unknown prog tests 0 inspect
80.0 94.7 .12  .12  16   .078 0  
reducercommutativity/max10-1.yml done .8   prog tests 1 inspect 220    220    51 3000   0     0      unknown prog tests 0 inspect
80.0 94.7 .12  .12  17   .078 0  
reducercommutativity/max20-1.yml timeout (verification) .0   prog tests 0 inspect 900    900    120 13000   .012 0      error (0) prog tests 0 inspect
0   0   .058 .060 8.9 0     0  
reducercommutativity/max40-1.yml timeout (verification) .0   prog tests 0 inspect 900    900    150 12000   .012 0      error (0) prog tests 0 inspect
0   0   .057 .058 9.0 0     0  
reducercommutativity/max60-2.yml timeout (verification) .0   prog tests 0 inspect 900    900    230 11000   .012 0      error (0) prog tests 0 inspect
0   0   .061 .062 9.0 0     0  
reducercommutativity/rangesum.yml done .938 prog tests 5 inspect 840    840    200 9600   0     0      true prog tests 1 inspect
93.8 100   .14  .15  16   .13  0  
reducercommutativity/rangesum05.yml done .857 prog tests 2 inspect .66 .65 64 8.9 0     0      true prog tests 1 inspect
85.7 96.3 .12  .12  16   .098 0  
reducercommutativity/rangesum10.yml done .857 prog tests 2 inspect .66 .66 62 10   0     0      true prog tests 1 inspect
85.7 96.3 .12  .12  16   .098 0  
reducercommutativity/rangesum20.yml done .857 prog tests 2 inspect 1.5  1.5  65 18   0     0      true prog tests 1 inspect
85.7 96.3 .12  .12  17   .098 0  
reducercommutativity/rangesum40.yml done .857 prog tests 2 inspect 6.9  6.9  71 88   0     0      true prog tests 1 inspect
85.7 96.3 .12  .12  16   .098 0  
reducercommutativity/rangesum60.yml done .857 prog tests 2 inspect 50    50    86 580   0     0      true prog tests 1 inspect
85.7 96.3 .12  .15  16   .098 0  
reducercommutativity/sep.yml done .75  prog tests 3 inspect 840    840    950 12000   0     0      unknown prog tests 0 inspect
75.0 91.3 .12  .12  16   .094 0  
reducercommutativity/sep05-1.yml done .75  prog tests 1 inspect .38 .38 18 4.9 0     0      unknown prog tests 0 inspect
75.0 90.5 .12  .12  16   .078 0  
reducercommutativity/sep10-2.yml done .75  prog tests 1 inspect .37 .37 18 5.0 0     0      unknown prog tests 0 inspect
75.0 90.5 .11  .11  16   .078 0  
reducercommutativity/sep20-1.yml done .75  prog tests 1 inspect .37 .37 18 4.6 0     0      unknown prog tests 0 inspect
75.0 90.5 .14  .14  16   .078 0  
reducercommutativity/sep40-1.yml done .75  prog tests 1 inspect .37 .36 19 4.4 0     0      unknown prog tests 0 inspect
75.0 90.5 .14  .14  16   .078 0  
reducercommutativity/sep60-2.yml done .75  prog tests 1 inspect .41 .41 19 4.3 0     0      unknown prog tests 0 inspect
75.0 90.5 .12  .12  16   .078 0  
reducercommutativity/sum.yml done .8   prog tests 3 inspect 840    840    960 11000   0     0      unknown prog tests 0 inspect
80.0 95.2 .12  .11  16   .094 0  
reducercommutativity/sum05-2.yml done .8   prog tests 1 inspect .38 .38 19 6.3 0     0      unknown prog tests 0 inspect
80.0 94.7 .12  .12  17   .078 0  
reducercommutativity/sum10-1.yml done .8   prog tests 1 inspect .35 .35 18 3.9 0     0      unknown prog tests 0 inspect
80.0 94.7 .11  .11  16   .078 0  
reducercommutativity/sum20-2.yml done .8   prog tests 1 inspect .37 .37 19 4.9 0     0      unknown prog tests 0 inspect
80.0 94.7 .11  .11  16   .078 0  
reducercommutativity/sum40-2.yml done .8   prog tests 1 inspect .35 .35 18 4.5 0     0      unknown prog tests 0 inspect
80.0 94.7 .11  .12  17   .078 0  
reducercommutativity/sum60-2.yml done .8   prog tests 1 inspect .36 .36 19 5.1 0     0      unknown prog tests 0 inspect
80.0 94.7 .12  .12  16   .078 0  
array-tiling/mbpr2.yml done .8   prog tests 3 inspect 840    840    92 11000   0     0      unknown prog tests 0 inspect
80.0 91.7 .13  .13  17   .11  0  
array-tiling/mbpr3.yml done .792 prog tests 3 inspect 840    840    89 10000   0     0      unknown prog tests 0 inspect
79.2 90.9 .12  .12  16   .12  0  
array-tiling/mbpr4.yml done .786 prog tests 3 inspect 840    840    90 13000   0     0      unknown prog tests 0 inspect
78.6 90.9 .12  .12  16   .13  0  
array-tiling/mbpr5.yml done .781 prog tests 3 inspect 840    840    90 9900   0     0      unknown prog tests 0 inspect
78.1 91.2 .16  .16  16   .13  0  
array-tiling/mlceu.yml done .75  prog tests 3 inspect 850    850    2100 11000   0     0      unknown prog tests 0 inspect
75.0 91.7 .12  .12  17   .11  0  
array-tiling/nr2.yml done .889 prog tests 3 inspect 840    840    92 13000   0     0      unknown prog tests 0 inspect
88.9 100   .15  .15  16   .11  0  
array-tiling/nr3.yml done .889 prog tests 3 inspect 840    840    89 11000   0     0      unknown prog tests 0 inspect
88.9 100   .15  .15  16   .11  0  
array-tiling/nr4.yml done .889 prog tests 3 inspect 840    840    92 11000   0     0      unknown prog tests 0 inspect
88.9 100   .12  .12  16   .11  0  
array-tiling/nr5.yml done .889 prog tests 3 inspect 840    840    83 12000   0     0      unknown prog tests 0 inspect
88.9 100   .12  .12  16   .11  0  
array-tiling/pnr2.yml done .75  prog tests 3 inspect 840    840    92 10000   0     0      unknown prog tests 0 inspect
75.0 91.7 .12  .12  16   .11  0  
array-tiling/pnr3.yml done .722 prog tests 3 inspect 840    840    88 11000   0     0      unknown prog tests 0 inspect
72.2 89.3 .12  .12  16   .11  0  
array-tiling/pnr4.yml done .7   prog tests 3 inspect 840    840    89 11000   0     0      unknown prog tests 0 inspect
70.0 87.5 .14  .14  16   .11  0  
array-tiling/pnr5.yml done .682 prog tests 3 inspect 840    840    85 12000   0     0      unknown prog tests 0 inspect
68.2 86.1 .12  .12  16   .12  0  
array-tiling/poly1.yml done .8   prog tests 3 inspect 850    850    2100 12000   0     0      unknown prog tests 0 inspect
80.0 100   .12  .12  16   .11  0  
array-tiling/poly2.yml done .833 prog tests 3 inspect 840    840    1100 12000   0     0      unknown prog tests 0 inspect
83.3 100   .13  .12  16   .11  0  
array-tiling/pr2.yml done .667 prog tests 4 inspect 840    840    1600 10000   0     0      unknown prog tests 0 inspect
66.7 90.0 .13  .13  16   .13  0  
array-tiling/pr3.yml done .65  prog tests 4 inspect 840    840    1400 9400   0     0      unknown prog tests 0 inspect
65.0 87.5 .14  .16  16   .13  0  
array-tiling/pr4.yml done .636 prog tests 4 inspect 840    840    1700 8000   0     0      unknown prog tests 0 inspect
63.6 85.7 .14  .20  16   .13  0  
array-tiling/pr5.yml done .625 prog tests 4 inspect 840    840    1400 9700   0     0      unknown prog tests 0 inspect
62.5 84.4 .14  .17  17   .090 0  
array-tiling/revcpyswp2.yml done .875 prog tests 3 inspect 840    840    820 13000   0     0      unknown prog tests 0 inspect
87.5 100   .16  .16  16   .11  0  
array-tiling/rew.yml done .833 prog tests 3 inspect 850    850    2100 12000   0     0      unknown prog tests 0 inspect
83.3 100   .12  .12  16   .11  0  
array-tiling/rewnif.yml done .833 prog tests 3 inspect 850    850    2100 11000   0     0      unknown prog tests 0 inspect
83.3 100   .12  .12  16   .11  0  
array-tiling/rewnifrev.yml done .833 prog tests 3 inspect 840    840    110 13000   0     0      unknown prog tests 0 inspect
83.3 100   .12  .12  17   .11  0  
array-tiling/rewnifrev2.yml done .8   prog tests 3 inspect 850    850    110 12000   0     0      unknown prog tests 0 inspect
80.0 100   .12  .12  16   .11  0  
array-tiling/rewrev.yml done .833 prog tests 3 inspect 850    850    120 12000   0     0      unknown prog tests 0 inspect
83.3 100   .12  .12  17   .11  0  
array-tiling/skipped.yml done .833 prog tests 7 inspect 880    880    9900 10000   0     0      unknown prog tests 0 inspect
83.3 94.1 .14  .14  17   .18  0  
array-tiling/skippedu.yml done .833 prog tests 7 inspect 880    880    9600 12000   0     0      unknown prog tests 0 inspect
83.3 94.1 .14  .26  16   .18  0  
array-tiling/tcpy.yml done .857 prog tests 4 inspect 840    840    190 9000   0     0      unknown prog tests 0 inspect
85.7 100   .13  .13  17   .13  0  
array-programs/copysome1-1.yml done .917 prog tests 1 inspect 16    16    850 170   0     0      unknown prog tests 0 inspect
91.7 100   9.4   9.4   1500   .078 0  
array-programs/copysome1-2.yml done 1.0   prog tests 2 inspect 19    19    940 160   0     0      true prog tests 1 inspect
100   100   19     19     1600   .094 0  
array-programs/copysome2-1.yml done .929 prog tests 1 inspect 35    35    1300 230   0     0      unknown prog tests 0 inspect
92.9 100   14     14     2300   .078 0  
array-programs/copysome2-2.yml done 1.0   prog tests 2 inspect 39    39    1500 250   0     0      true prog tests 1 inspect
100   100   28     28     2300   .094 0  
array-crafted/bAnd1.yml done .8   prog tests 1 inspect .37 .37 20 4.7 0     0      unknown prog tests 0 inspect
80.0 94.7 .12  .12  16   .078 0  
array-crafted/bAnd2.yml done .8   prog tests 1 inspect .56 .56 39 8.9 0     0      unknown prog tests 0 inspect
80.0 94.7 .14  .14  17   .078 0  
array-crafted/bAnd3.yml done .8   prog tests 1 inspect 17    17    940 220   0     0      unknown prog tests 0 inspect
80.0 94.7 .36  .36  44   .078 0  
array-crafted/bAnd4.yml unknown .0   prog tests 0 inspect 3.7  3.7  310 45   0     0      error (0) prog tests 0 inspect
0   0   .058 .059 8.9 0     0  
array-crafted/bAnd5.yml done .833 prog tests 3 inspect 840    840    430 10000   0     0      unknown prog tests 0 inspect
83.3 95.7 .12  .12  16   .11  0  
array-crafted/bor1.yml done .8   prog tests 1 inspect .36 .36 19 5.1 0     0      unknown prog tests 0 inspect
80.0 94.7 .12  .12  17   .078 0  
array-crafted/bor2.yml done .8   prog tests 1 inspect .49 .49 39 6.1 0     0      unknown prog tests 0 inspect
80.0 94.7 .14  .14  17   .078 0  
array-crafted/bor3.yml done .8   prog tests 1 inspect 7.7  7.7  1300 100   0     0      unknown prog tests 0 inspect
80.0 94.7 .35  .35  44   .078 0  
array-crafted/bor4.yml unknown .0   prog tests 0 inspect 3.7  3.7  310 56   0     0      error (0) prog tests 0 inspect
0   0   .060 .062 8.9 0     0  
array-crafted/bor5.yml done .833 prog tests 3 inspect 840    840    400 9500   0     0      unknown prog tests 0 inspect
83.3 95.7 .13  .18  17   .057 0  
array-crafted/mapavg1.yml done .8   prog tests 1 inspect .37 .37 19 4.5 0     0      unknown prog tests 0 inspect
80.0 94.7 .14  .15  16   .078 0  
array-crafted/mapavg2.yml done .8   prog tests 1 inspect .86 .86 38 12   0     0      unknown prog tests 0 inspect
80.0 94.7 .14  .14  17   .078 0  
array-crafted/mapavg3.yml done .8   prog tests 1 inspect 56    57    1300 770   0     0      unknown prog tests 0 inspect
80.0 94.7 .36  .36  44   .078 0  
array-crafted/mapavg4.yml done .8   prog tests 1 inspect 840    840    470 7700   0     0      unknown prog tests 0 inspect
80.0 94.7 2.5   2.5   380   .078 0  
array-crafted/mapavg5.yml timeout (verification) .0   prog tests 0 inspect 900    900    71 12000   .012 0      error (0) prog tests 0 inspect
0   0   .058 .059 8.9 0     0  
array-crafted/mapsum1.yml done .8   prog tests 1 inspect .37 .37 19 5.0 0     0      unknown prog tests 0 inspect
80.0 94.7 .12  .13  16   .078 0  
array-crafted/mapsum2.yml done .8   prog tests 1 inspect .85 .84 39 12   0     0      unknown prog tests 0 inspect
80.0 94.7 .13  .13  17   .078 0  
array-crafted/mapsum3.yml done .8   prog tests 1 inspect 56    56    1300 810   0     0      unknown prog tests 0 inspect
80.0 94.7 .37  .37  44   .078 0  
array-crafted/mapsum4.yml done .8   prog tests 1 inspect 840    840    470 7800   0     0      unknown prog tests 0 inspect
80.0 94.7 2.6   2.6   380   .078 0  
array-crafted/mapsum5.yml timeout (verification) .0   prog tests 0 inspect 900    900    140 12000   .012 0      error (0) prog tests 0 inspect
0   0   .062 .062 8.9 0     0  
array-crafted/xor1.yml done .8   prog tests 1 inspect .37 .37 19 5.1 0     0      unknown prog tests 0 inspect
80.0 94.7 .12  .12  17   .078 0  
array-crafted/xor2.yml done .8   prog tests 1 inspect .50 .50 39 6.7 0     0      unknown prog tests 0 inspect
80.0 94.7 .14  .14  17   .078 0  
array-crafted/xor3.yml done .8   prog tests 1 inspect 9.1  9.1  1300 120   0     0      unknown prog tests 0 inspect
80.0 94.7 .35  .35  44   .078 0  
array-crafted/xor4.yml unknown .0   prog tests 0 inspect 3.8  3.8  310 50   0     0      error (0) prog tests 0 inspect
0   0   .062 .063 8.9 0     0  
array-crafted/xor5.yml done .833 prog tests 3 inspect 860    860    130 11000   0     0      unknown prog tests 0 inspect
83.3 95.7 .12  .12  16   .094 0  
array-crafted/zero_sum1.yml done .9   prog tests 3 inspect 840    840    1700 13000   0     0      unknown prog tests 0 inspect
90.0 100   .15  .15  16   .11  0  
array-crafted/zero_sum2.yml done .929 prog tests 3 inspect 840    840    1600 12000   0     0      unknown prog tests 0 inspect
92.9 100   .14  .14  17   .11  0  
array-crafted/zero_sum3.yml done .944 prog tests 3 inspect 840    840    1400 9700   0     0      unknown prog tests 0 inspect
94.4 100   .14  .14  16   .11  0  
array-crafted/zero_sum4.yml done .955 prog tests 3 inspect 840    840    1300 13000   0     0      unknown prog tests 0 inspect
95.5 100   .15  .14  17   .11  0  
array-crafted/zero_sum5.yml done .962 prog tests 3 inspect 840    840    1100 13000   0     0      unknown prog tests 0 inspect
96.2 100   .14  .14  17   .11  0  
array-crafted/zero_sum_const1.yml done .833 prog tests 3 inspect 850    850    1100 12000   0     0      unknown prog tests 0 inspect
83.3 100   .12  .12  17   .11  0  
array-crafted/zero_sum_const2.yml done .875 prog tests 3 inspect 850    850    1000 11000   0     0      unknown prog tests 0 inspect
87.5 100   .12  .12  16   .11  0  
array-crafted/zero_sum_const3.yml done .9   prog tests 3 inspect 850    850    990 10000   0     0      unknown prog tests 0 inspect
90.0 100   .12  .12  16   .11  0  
array-crafted/zero_sum_const4.yml done .917 prog tests 3 inspect 850    850    980 12000   0     0      unknown prog tests 0 inspect
91.7 100   .13  .12  16   .11  0  
array-crafted/zero_sum_const5.yml done .929 prog tests 3 inspect 850    850    1000 10000   0     0      unknown prog tests 0 inspect
92.9 100   .12  .12  16   .11  0  
array-crafted/zero_sum_const_m2.yml done .875 prog tests 3 inspect 850    850    1000 13000   0     0      unknown prog tests 0 inspect
87.5 100   .12  .12  16   .11  0  
array-crafted/zero_sum_const_m3.yml done .9   prog tests 3 inspect 850    850    990 11000   0     0      unknown prog tests 0 inspect
90.0 100   .12  .12  16   .11  0  
array-crafted/zero_sum_const_m4.yml done .917 prog tests 3 inspect 850    850    1000 13000   0     0      unknown prog tests 0 inspect
91.7 100   .13  .13  16   .11  0  
array-crafted/zero_sum_const_m5.yml done .929 prog tests 3 inspect 850    850    1000 12000   0     0      unknown prog tests 0 inspect
92.9 100   .12  .15  16   .11  0  
array-crafted/zero_sum_m2.yml done .929 prog tests 3 inspect 840    840    1500 11000   0     0      unknown prog tests 0 inspect
92.9 100   .15  .15  17   .11  0  
array-crafted/zero_sum_m3.yml done .944 prog tests 3 inspect 840    840    1500 12000   0     0      unknown prog tests 0 inspect
94.4 100   .14  .14  16   .11  0  
array-crafted/zero_sum_m4.yml done .955 prog tests 3 inspect 840    840    1600 11000   0     0      unknown prog tests 0 inspect
95.5 100   .16  .16  17   .11  0  
array-crafted/zero_sum_m5.yml done .962 prog tests 3 inspect 840    840    1600 13000   0     0      unknown prog tests 0 inspect
96.2 100   .14  .14  17   .11  0  
array-multidimensional/add-2-n-u.yml done .0   prog tests 1 inspect 96    96    9100 1100   0     0      unknown prog tests 0 inspect
0   0   71     71     2300   .082 0  
array-multidimensional/add-3-n-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 150    150    15000 2100   .020 0      error (0) prog tests 0 inspect
0   0   .058 .060 8.9 0     0  
array-multidimensional/copy-2-u.yml done .929 prog tests 1 inspect 38    38    3800 540   0     0      unknown prog tests 0 inspect
92.9 97.1 25     25     3800   .082 0  
array-multidimensional/copy-3-n-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 160    160    15000 1900   .025 .0041 error (0) prog tests 0 inspect
0   0   .058 .059 9.0 0     0  
array-multidimensional/copy-partial-2-n-u.yml done .0   prog tests 1 inspect 40    40    4000 470   0     0      unknown prog tests 0 inspect
0   0   34     35     1100   .082 0  
array-multidimensional/copy-partial-3-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 180    180    15000 2800   .029 .0082 error (0) prog tests 0 inspect
0   0   .060 .062 8.9 0     0  
array-multidimensional/diff-2-n-u.yml done .0   prog tests 1 inspect 160    160    13000 2200   0     0      unknown prog tests 0 inspect
0   0   140     140     4400   .086 0  
array-multidimensional/diff-3-n-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 160    150    15000 2300   .020 .0041 error (0) prog tests 0 inspect
0   0   .091 .092 8.9 0     0  
array-multidimensional/init-2-n-u.yml done .9   prog tests 1 inspect 18    18    2400 250   0     0      unknown prog tests 0 inspect
90.0 96.2 .13  .13  17   .078 0  
array-multidimensional/init-3-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 250    250    15000 3900   .037 .0041 error (0) prog tests 0 inspect
0   0   .056 .057 8.9 0     0  
array-multidimensional/init-4-n-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 290    290    15000 3800   .020 .033  error (0) prog tests 0 inspect
0   0   .059 .059 8.9 0     0  
array-multidimensional/init-non-constant-2-n-u.yml done .9   prog tests 5 inspect 850    850    4300 11000   0     0      unknown prog tests 0 inspect
90.0 96.7 .16  .16  16   .15  0  
array-multidimensional/init-non-constant-3-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 140    140    15000 2200   .029 .0041 error (0) prog tests 0 inspect
0   0   .060 .061 9.0 0     0  
array-multidimensional/max-2-u.yml unknown .0   prog tests 0 inspect 35    35    3300 460   0     0      error (0) prog tests 0 inspect
0   0   .068 .069 8.9 0     0  
array-multidimensional/max-3-n-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 170    170    15000 2200   .020 .0082 error (0) prog tests 0 inspect
0   0   .056 .056 8.9 0     0  
array-multidimensional/min-2-u.yml unknown .0   prog tests 0 inspect 36    36    3300 510   0     0      error (0) prog tests 0 inspect
0   0   .056 .057 8.9 0     0  
array-multidimensional/min-3-n-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 170    170    15000 2100   .025 0      error (0) prog tests 0 inspect
0   0   .060 .060 8.9 0     0  
array-multidimensional/rev-2-n-u.yml done .0   prog tests 1 inspect 57    57    5700 740   0     0      unknown prog tests 0 inspect
0   0   34     34     1100   .082 0  
array-multidimensional/rev-3-u.yml out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 170    160    15000 2100   .020 0      error (0) prog tests 0 inspect
0   0   .062 .063 8.9 0     0  
array-multidimensional/transpose-u.yml done .929 prog tests 1 inspect 39    39    3900 430   0     0      unknown prog tests 0 inspect
92.9 100   25     25     3800   .082 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 169 116 69000 69000 420000 870000 .58 .066 169 11600 13300 530 530 42000 14 0  
Run set symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Arrays