Benchmark VeriFuzz TBF Test-Suite Validator
Tool VeriFuzz 1.0.1 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:17:17 CET 2019-02-06 14:51:38 CET
Run set verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options --testcomp --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/verifuzz.2019-02-06_0717.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/sanfoundry_10_ground.yml timeout .944 prog tests 23 inspect 900   900   150 12000 .88 0      unknown prog tests 0 inspect
94.4 100   56     56     440   .44  0  
array-examples/sanfoundry_24-1.yml timeout .917 prog tests 24 inspect 900   900   150 12000 6.3  0      unknown prog tests 0 inspect
91.7 100   1.5   1.4   97   .41  0  
array-examples/standard_copy1_ground-1.yml timeout .875 prog tests 8 inspect 900   900   150 12000 .62 0      unknown prog tests 0 inspect
87.5 100   20     20     420   .19  0  
array-examples/standard_copy1_ground-2.yml timeout .875 prog tests 13 inspect 900   900   150 12000 1500    0      true prog tests 1 inspect
87.5 90.0 65     65     1100   .27  0  
array-examples/standard_copy2_ground-1.yml timeout .9   prog tests 13 inspect 900   900   150 11000 1300    0      true prog tests 1 inspect
90.0 91.7 64     64     1100   .27  0  
array-examples/standard_copy2_ground-2.yml timeout .9   prog tests 8 inspect 900   900   150 12000 .62 0      unknown prog tests 0 inspect
90.0 100   20     20     420   .19  0  
array-examples/standard_copy3_ground-1.yml timeout .917 prog tests 8 inspect 900   900   150 12000 .63 0      unknown prog tests 0 inspect
91.7 100   20     20     420   .19  0  
array-examples/standard_copy3_ground-2.yml timeout .917 prog tests 12 inspect 900   900   150 11000 1200    0      true prog tests 1 inspect
91.7 92.9 60     60     1000   .26  0  
array-examples/standard_copy4_ground-1.yml timeout .929 prog tests 8 inspect 900   900   150 11000 .63 0      unknown prog tests 0 inspect
92.9 100   20     20     420   .19  0  
array-examples/standard_copy4_ground-2.yml timeout .929 prog tests 11 inspect 900   900   150 11000 1100    0      true prog tests 1 inspect
92.9 93.8 53     54     1000   .24  0  
array-examples/standard_copy5_ground-1.yml timeout .938 prog tests 8 inspect 900   900   150 14000 .62 0      unknown prog tests 0 inspect
93.8 100   20     20     420   .19  0  
array-examples/standard_copy5_ground-2.yml timeout .938 prog tests 12 inspect 900   900   150 11000 1000    0      true prog tests 1 inspect
93.8 94.4 61     61     1000   .26  0  
array-examples/standard_copy6_ground-1.yml timeout .944 prog tests 12 inspect 900   900   160 11000 900    0      true prog tests 1 inspect
94.4 95.0 60     60     1000   .26  0  
array-examples/standard_copy6_ground-2.yml timeout .944 prog tests 8 inspect 900   900   150 9600 .64 0      unknown prog tests 0 inspect
94.4 100   20     20     420   .19  0  
array-examples/standard_copy7_ground-1.yml timeout .95  prog tests 12 inspect 900   900   150 12000 850    0      true prog tests 1 inspect
95.0 95.5 60     60     1000   .26  0  
array-examples/standard_copy7_ground-2.yml timeout .95  prog tests 8 inspect 900   900   150 14000 .63 0      unknown prog tests 0 inspect
95.0 100   20     20     420   .20  0  
array-examples/standard_copy8_ground-1.yml timeout .955 prog tests 8 inspect 900   900   150 10000 .65 0      unknown prog tests 0 inspect
95.5 100   20     20     420   .20  0  
array-examples/standard_copy8_ground-2.yml timeout .955 prog tests 12 inspect 900   900   150 12000 830    0      true prog tests 1 inspect
95.5 95.8 62     62     1000   .26  0  
array-examples/standard_copy9_ground-1.yml timeout .958 prog tests 11 inspect 900   900   160 12000 750    0      true prog tests 1 inspect
95.8 96.2 54     54     1000   .25  0  
array-examples/standard_copy9_ground-2.yml timeout .958 prog tests 8 inspect 900   900   150 11000 .65 0      unknown prog tests 0 inspect
95.8 100   20     20     420   .20  0  
array-examples/standard_copyInitSum_ground.yml timeout .9   prog tests 8 inspect 900   900   150 9800 .61 0      unknown prog tests 0 inspect
90.0 100   .15  .15  16   .19  0  
array-examples/standard_find_ground-1.yml timeout .9   prog tests 17 inspect 900   900   150 14000 .76 0      unknown prog tests 0 inspect
90.0 100   41     42     420   .34  0  
array-examples/standard_partition_ground-1.yml timeout .929 prog tests 24 inspect 900   900   160 12000 1700    0      true prog tests 1 inspect
92.9 95.5 60     60     550   .45  0  
array-examples/standard_sentinel-2.yml timeout .8   prog tests 10 inspect 900   900   4400 12000 .72 0      unknown prog tests 0 inspect
80.0 100   24     24     420   .23  0  
array-examples/standard_sentinel.i.v+cfa-reducer.yml timeout .8   prog tests 9 inspect 900   900   3000 11000 .75 0      unknown prog tests 0 inspect
80.0 86.4 22     22     420   .21  0  
array-examples/standard_strcpy_ground-1.yml timeout .8   prog tests 15 inspect 900   900   160 12000 .78 0      unknown prog tests 0 inspect
80.0 100   37     37     420   .31  0  
array-examples/standard_strcpy_original-2.yml timeout .75  prog tests 15 inspect 900   900   150 13000 .77 0      unknown prog tests 0 inspect
75.0 100   38     38     420   .31  0  
array-examples/standard_two_index_01.yml timeout .875 prog tests 8 inspect 900   900   150 14000 3.5  0      unknown prog tests 0 inspect
87.5 100   2.1   2.1   50   .19  0  
array-examples/standard_two_index_02.yml timeout .875 prog tests 8 inspect 900   900   150 12000 .62 0      unknown prog tests 0 inspect
87.5 100   19     19     420   .19  0  
array-examples/standard_two_index_03.yml timeout .875 prog tests 8 inspect 900   910   150 13000 3.5  0      unknown prog tests 0 inspect
87.5 100   2.2   2.2   50   .19  0  
array-examples/standard_two_index_04.yml timeout .875 prog tests 8 inspect 900   900   150 9700 .61 0      unknown prog tests 0 inspect
87.5 100   19     19     420   .19  0  
array-examples/standard_two_index_05.yml timeout .875 prog tests 8 inspect 900   900   150 14000 .62 0      unknown prog tests 0 inspect
87.5 100   19     19     420   .19  0  
array-examples/standard_two_index_06.yml timeout .875 prog tests 8 inspect 900   910   150 13000 3.5  0      unknown prog tests 0 inspect
87.5 100   2.1   2.1   50   .19  0  
array-examples/standard_two_index_07.yml timeout .875 prog tests 8 inspect 900   900   150 14000 .62 0      unknown prog tests 0 inspect
87.5 100   20     20     420   .19  0  
array-examples/standard_two_index_08.yml timeout .875 prog tests 8 inspect 900   900   150 12000 .62 0      unknown prog tests 0 inspect
87.5 100   20     20     420   .19  0  
array-examples/standard_two_index_09.yml timeout .875 prog tests 8 inspect 900   900   150 12000 .62 0      unknown prog tests 0 inspect
87.5 100   19     19     420   .19  0  
array-industry-pattern/array_monotonic.yml timeout .9   prog tests 23 inspect 900   900   150 12000 .87 0      unknown prog tests 0 inspect
90.0 100   28     28     230   .44  0  
array-industry-pattern/array_mul_init.yml timeout .857 prog tests 16 inspect 900   900   1600 12000 .83 0      unknown prog tests 0 inspect
85.7 100   58     58     770   .32  0  
array-industry-pattern/array_of_struct_break.yml timeout .9   prog tests 8 inspect 900   900   150 14000 .60 0      unknown prog tests 0 inspect
90.0 100   .15  .14  17   .19  0  
array-industry-pattern/array_of_struct_ptr_mul_init.yml timeout .857 prog tests 17 inspect 900   900   510 12000 .93 0      unknown prog tests 0 inspect
85.7 100   69     69     730   .34  0  
array-industry-pattern/array_of_struct_single_elem_init.yml timeout .917 prog tests 16 inspect 900   900   150 13000 .72 0      unknown prog tests 0 inspect
91.7 100   79     79     930   .32  0  
array-industry-pattern/array_ptr_single_elem_init-2.yml timeout .857 prog tests 28 inspect 900   900   150 13000 2800    0      true prog tests 1 inspect
85.7 94.1 70     70     580   .52  0  
array-industry-pattern/array_shadowinit.yml timeout .875 prog tests 12 inspect 900   910   160 11000 2.5  0      unknown prog tests 0 inspect
87.5 100   .15  .18  16   .26  0  
array-industry-pattern/array_single_elem_init.yml timeout .929 prog tests 25 inspect 900   900   160 12000 .95 0      unknown prog tests 0 inspect
92.9 100   62     63     440   .47  0  
reducercommutativity/avg.yml timeout .8   prog tests 15 inspect 900   910   150 12000 1.2  .27   unknown prog tests 0 inspect
80.0 95.2 .19  .18  16   .31  0  
reducercommutativity/avg05-1.yml timeout .8   prog tests 8 inspect 900   920   150 11000 1.0  0      unknown prog tests 0 inspect
80.0 94.7 .16  .15  16   .19  0  
reducercommutativity/avg10-2.yml timeout .8   prog tests 8 inspect 900   920   150 10000 1.1  0      unknown prog tests 0 inspect
80.0 94.7 .15  .14  16   .19  0  
reducercommutativity/avg20-2.yml timeout .8   prog tests 8 inspect 900   920   150 11000 .92 0      unknown prog tests 0 inspect
80.0 94.7 .15  .14  17   .19  0  
reducercommutativity/avg40-2.yml timeout .8   prog tests 8 inspect 900   920   160 11000 .95 0      unknown prog tests 0 inspect
80.0 94.7 .14  .14  16   .19  0  
reducercommutativity/avg60-1.yml timeout .8   prog tests 8 inspect 900   920   150 11000 1.0  0      unknown prog tests 0 inspect
80.0 94.7 .18  .18  17   .19  0  
reducercommutativity/max.yml timeout .8   prog tests 16 inspect 900   910   150 11000 1.4  .27   unknown prog tests 0 inspect
80.0 95.2 .17  .16  17   .31  0  
reducercommutativity/max05-1.yml timeout .8   prog tests 8 inspect 900   920   150 14000 1.0  0      unknown prog tests 0 inspect
80.0 94.7 .14  .13  16   .19  0  
reducercommutativity/max10-1.yml timeout .8   prog tests 8 inspect 900   920   150 13000 .99 0      unknown prog tests 0 inspect
80.0 94.7 .14  .13  16   .19  0  
reducercommutativity/max20-1.yml timeout .8   prog tests 8 inspect 900   920   150 12000 .95 0      unknown prog tests 0 inspect
80.0 94.7 .15  .14  17   .19  0  
reducercommutativity/max40-1.yml timeout .8   prog tests 8 inspect 900   920   150 13000 1.0  0      unknown prog tests 0 inspect
80.0 94.7 .14  .14  16   .19  0  
reducercommutativity/max60-2.yml timeout .8   prog tests 8 inspect 900   920   150 11000 .97 0      unknown prog tests 0 inspect
80.0 94.7 .16  .16  16   .19  0  
reducercommutativity/rangesum.yml timeout .938 prog tests 19 inspect 900   900   210 13000 210    0      true prog tests 1 inspect
93.8 100   96     96     6000   .38  0  
reducercommutativity/rangesum05.yml error .857 prog tests 8 inspect 890   900   150 12000 12000    0      true prog tests 1 inspect
85.7 96.3 .14  .14  16   .20  0  
reducercommutativity/rangesum10.yml error .857 prog tests 8 inspect 890   900   150 12000 12000    0      true prog tests 1 inspect
85.7 96.3 .15  .14  16   .20  0  
reducercommutativity/rangesum20.yml error .857 prog tests 8 inspect 870   900   150 13000 9000    0      true prog tests 1 inspect
85.7 96.3 .15  .14  16   .20  0  
reducercommutativity/rangesum40.yml error .857 prog tests 8 inspect 890   900   150 11000 9800    0      true prog tests 1 inspect
85.7 96.3 .16  .15  16   .20  0  
reducercommutativity/rangesum60.yml error .857 prog tests 8 inspect 890   900   150 12000 12000    0      true prog tests 1 inspect
85.7 96.3 .16  .15  17   .20  0  
reducercommutativity/sep.yml timeout .833 prog tests 22 inspect 900   910   150 13000 1.4  .34   unknown prog tests 0 inspect
83.3 95.7 .18  .17  17   .41  0  
reducercommutativity/sep05-1.yml timeout .833 prog tests 14 inspect 900   920   150 11000 .94 0      unknown prog tests 0 inspect
83.3 95.2 .16  .15  16   .29  0  
reducercommutativity/sep10-2.yml timeout .833 prog tests 17 inspect 900   920   150 14000 1.1  0      unknown prog tests 0 inspect
83.3 95.2 .17  .18  16   .34  0  
reducercommutativity/sep20-1.yml timeout .833 prog tests 20 inspect 900   920   150 14000 1.1  0      unknown prog tests 0 inspect
83.3 95.2 .22  .22  16   .39  0  
reducercommutativity/sep40-1.yml timeout .833 prog tests 25 inspect 900   920   150 12000 1.3  0      unknown prog tests 0 inspect
83.3 95.2 .22  .21  17   .47  0  
reducercommutativity/sep60-2.yml timeout .833 prog tests 23 inspect 900   920   150 11000 1.2  0      unknown prog tests 0 inspect
83.3 95.2 .23  .22  16   .44  0  
reducercommutativity/sum.yml timeout .8   prog tests 16 inspect 900   910   150 11000 1.2  .27   unknown prog tests 0 inspect
80.0 95.2 .19  .18  16   .31  0  
reducercommutativity/sum05-2.yml timeout .8   prog tests 8 inspect 900   920   150 11000 .99 0      unknown prog tests 0 inspect
80.0 94.7 .14  .14  16   .19  0  
reducercommutativity/sum10-1.yml timeout .8   prog tests 8 inspect 900   920   150 13000 .99 0      unknown prog tests 0 inspect
80.0 94.7 .14  .13  17   .19  0  
reducercommutativity/sum20-2.yml timeout .8   prog tests 8 inspect 900   920   150 11000 .99 0      unknown prog tests 0 inspect
80.0 94.7 .14  .13  17   .19  0  
reducercommutativity/sum40-2.yml timeout .8   prog tests 8 inspect 900   920   150 12000 .96 0      unknown prog tests 0 inspect
80.0 94.7 .15  .17  17   .19  0  
reducercommutativity/sum60-2.yml timeout .8   prog tests 8 inspect 900   920   150 11000 1.1  0      unknown prog tests 0 inspect
80.0 94.7 .16  .16  16   .19  0  
array-tiling/mbpr2.yml timeout .8   prog tests 17 inspect 900   910   150 12000 1.6  0      unknown prog tests 0 inspect
80.0 91.7 .17  .16  17   .34  0  
array-tiling/mbpr3.yml timeout .792 prog tests 17 inspect 900   910   150 12000 1.4  0      unknown prog tests 0 inspect
79.2 90.9 .17  .16  16   .35  0  
array-tiling/mbpr4.yml timeout .786 prog tests 19 inspect 900   910   150 11000 1.6  0      unknown prog tests 0 inspect
78.6 90.9 .18  .21  16   .45  0  
array-tiling/mbpr5.yml timeout .781 prog tests 19 inspect 900   910   160 11000 1.3  0      unknown prog tests 0 inspect
78.1 91.2 .19  .18  16   .46  0  
array-tiling/mlceu.yml timeout .75  prog tests 13 inspect 900   920   150 12000 1.1  0      unknown prog tests 0 inspect
75.0 91.7 .16  .19  17   .27  0  
array-tiling/nr2.yml timeout .889 prog tests 15 inspect 900   910   150 12000 1.6  0      unknown prog tests 0 inspect
88.9 100   .16  .15  16   .31  0  
array-tiling/nr3.yml timeout .889 prog tests 19 inspect 900   910   150 12000 1.3  0      unknown prog tests 0 inspect
88.9 100   .17  .16  16   .38  0  
array-tiling/nr4.yml timeout .889 prog tests 18 inspect 900   910   150 11000 1.7  0      unknown prog tests 0 inspect
88.9 100   .17  .17  16   .36  0  
array-tiling/nr5.yml timeout .889 prog tests 19 inspect 900   910   150 13000 1.2  0      unknown prog tests 0 inspect
88.9 100   .19  .18  17   .38  0  
array-tiling/pnr2.yml timeout .875 prog tests 19 inspect 900   920   160 11000 3.4  0      unknown prog tests 0 inspect
87.5 100   1.4   1.4   130   .38  0  
array-tiling/pnr3.yml timeout .889 prog tests 34 inspect 900   920   150 11000 8.7  0      unknown prog tests 0 inspect
88.9 100   3.9   3.9   210   .62  0  
array-tiling/pnr4.yml error .9   prog tests 17 inspect 880   900   150 12000 .98 0      unknown prog tests 0 inspect
90.0 100   2.1   2.1   200   .34  0  
array-tiling/pnr5.yml error .909 prog tests 28 inspect 880   900   150 11000 1.0  0      unknown prog tests 0 inspect
90.9 100   14     14     270   .63  0  
array-tiling/poly1.yml timeout .8   prog tests 13 inspect 900   920   150 10000 1.2  0      unknown prog tests 0 inspect
80.0 100   .16  .15  16   .27  0  
array-tiling/poly2.yml timeout .833 prog tests 13 inspect 900   920   150 14000 1.2  0      unknown prog tests 0 inspect
83.3 100   .18  .17  16   .27  0  
array-tiling/pr2.yml timeout .667 prog tests 17 inspect 900   910   150 12000 1.5  0      unknown prog tests 0 inspect
66.7 90.0 .21  .28  17   .34  0  
array-tiling/pr3.yml timeout .65  prog tests 19 inspect 900   910   150 11000 1.4  0      unknown prog tests 0 inspect
65.0 87.5 .19  .18  17   .38  0  
array-tiling/pr4.yml timeout .636 prog tests 19 inspect 900   910   150 10000 1.7  0      unknown prog tests 0 inspect
63.6 85.7 .18  .17  16   .38  0  
array-tiling/pr5.yml timeout .625 prog tests 19 inspect 900   910   150 11000 1.2  0      unknown prog tests 0 inspect
62.5 84.4 .19  .18  16   .38  0  
array-tiling/revcpyswp2.yml error .938 prog tests 12 inspect 890   900   150 13000 1.0  0      unknown prog tests 0 inspect
93.8 100   5.4   5.4   500   .26  0  
array-tiling/rew.yml timeout .833 prog tests 13 inspect 900   920   150 13000 .99 0      unknown prog tests 0 inspect
83.3 100   .16  .16  16   .27  0  
array-tiling/rewnif.yml timeout .833 prog tests 13 inspect 900   920   150 12000 1.2  0      unknown prog tests 0 inspect
83.3 100   .15  .15  16   .27  0  
array-tiling/rewnifrev.yml timeout .833 prog tests 13 inspect 900   920   150 12000 1.0  0      unknown prog tests 0 inspect
83.3 100   .18  .17  16   .27  0  
array-tiling/rewnifrev2.yml timeout .8   prog tests 13 inspect 900   920   150 11000 1.0  0      unknown prog tests 0 inspect
80.0 100   .15  .20  16   .27  0  
array-tiling/rewrev.yml timeout .833 prog tests 13 inspect 900   920   150 11000 .98 0      unknown prog tests 0 inspect
83.3 100   .16  .15  16   .27  0  
array-tiling/skipped.yml timeout .944 prog tests 43 inspect 900   910   150 13000 24    0      unknown prog tests 0 inspect
94.4 100   9.4   9.4   290   .77  0  
array-tiling/skippedu.yml timeout 1.0   prog tests 41 inspect 900   900   150 14000 4.9  0      true prog tests 1 inspect
100   100   26     26     310   .74  0  
array-tiling/tcpy.yml timeout .929 prog tests 17 inspect 900   920   150 12000 7.7  0      unknown prog tests 0 inspect
92.9 100   4.4   4.3   280   .34  0  
array-programs/copysome1-1.yml timeout .917 prog tests 8 inspect 900   900   150 12000 .61 0      unknown prog tests 0 inspect
91.7 100   81     81     1700   .19  0  
array-programs/copysome1-2.yml timeout 1.0   prog tests 8 inspect 900   900   150 12000 330    0      true prog tests 1 inspect
100   100   78     78     1900   .19  0  
array-programs/copysome2-1.yml timeout .929 prog tests 1 inspect 900   900   4200 14000 .65 0      unknown prog tests 0 inspect
92.9 100   15     15     2400   .078 0  
array-programs/copysome2-2.yml timeout .929 prog tests 2 inspect 900   900   4200 11000 210    0      true prog tests 1 inspect
92.9 94.1 30     30     2700   .094 0  
array-crafted/bAnd1.yml timeout .8   prog tests 8 inspect 900   920   150 12000 .93 0      unknown prog tests 0 inspect
80.0 94.7 .16  .16  17   .19  0  
array-crafted/bAnd2.yml timeout .8   prog tests 8 inspect 900   920   150 12000 1.1  0      unknown prog tests 0 inspect
80.0 94.7 .33  .33  17   .19  0  
array-crafted/bAnd3.yml timeout .8   prog tests 8 inspect 900   900   150 13000 .64 0      unknown prog tests 0 inspect
80.0 94.7 2.1   2.1   52   .19  0  
array-crafted/bAnd4.yml timeout .8   prog tests 8 inspect 900   900   150 11000 .60 0      unknown prog tests 0 inspect
80.0 94.7 20     20     420   .19  0  
array-crafted/bAnd5.yml timeout .833 prog tests 14 inspect 900   900   160 15000 .85 0      unknown prog tests 0 inspect
83.3 95.7 7.5   7.5   560   .29  0  
array-crafted/bor1.yml timeout .8   prog tests 8 inspect 900   920   150 12000 .99 0      unknown prog tests 0 inspect
80.0 94.7 .19  .18  16   .19  0  
array-crafted/bor2.yml timeout .8   prog tests 8 inspect 900   920   150 13000 1.2  0      unknown prog tests 0 inspect
80.0 94.7 .34  .34  17   .19  0  
array-crafted/bor3.yml timeout .8   prog tests 8 inspect 900   900   150 12000 2.5  0      unknown prog tests 0 inspect
80.0 94.7 2.1   2.1   52   .19  0  
array-crafted/bor4.yml timeout .8   prog tests 8 inspect 900   900   150 12000 .63 0      unknown prog tests 0 inspect
80.0 94.7 20     20     420   .19  0  
array-crafted/bor5.yml timeout .833 prog tests 14 inspect 900   900   150 12000 2.7  0      unknown prog tests 0 inspect
83.3 95.7 1.2   1.2   140   .29  0  
array-crafted/mapavg1.yml timeout .8   prog tests 8 inspect 900   920   150 11000 .97 0      unknown prog tests 0 inspect
80.0 94.7 .16  .15  16   .19  0  
array-crafted/mapavg2.yml timeout .8   prog tests 8 inspect 900   920   150 13000 1.2  0      unknown prog tests 0 inspect
80.0 94.7 .37  .36  17   .19  0  
array-crafted/mapavg3.yml timeout .8   prog tests 8 inspect 900   900   150 12000 .63 0      unknown prog tests 0 inspect
80.0 94.7 2.1   2.1   52   .19  0  
array-crafted/mapavg4.yml timeout .8   prog tests 8 inspect 900   900   150 12000 .63 0      unknown prog tests 0 inspect
80.0 94.7 20     20     420   .19  0  
array-crafted/mapavg5.yml error .0   prog tests 1 inspect 3.6 2.4 150 42 .57 0      unknown prog tests 0 inspect
0   0   .057 .057 9.0 0     0  
array-crafted/mapsum1.yml timeout .8   prog tests 8 inspect 900   920   150 11000 1.0  0      unknown prog tests 0 inspect
80.0 94.7 .16  .16  17   .19  0  
array-crafted/mapsum2.yml timeout .8   prog tests 8 inspect 900   920   150 11000 1.2  0      unknown prog tests 0 inspect
80.0 94.7 .39  .39  17   .19  0  
array-crafted/mapsum3.yml timeout .8   prog tests 8 inspect 900   900   150 13000 .63 0      unknown prog tests 0 inspect
80.0 94.7 2.2   2.2   52   .19  0  
array-crafted/mapsum4.yml timeout .8   prog tests 8 inspect 900   900   150 12000 .63 0      unknown prog tests 0 inspect
80.0 94.7 20     20     420   .19  0  
array-crafted/mapsum5.yml timeout .833 prog tests 13 inspect 900   900   150 11000 .77 0      unknown prog tests 0 inspect
83.3 95.7 24     24     3700   .28  0  
array-crafted/xor1.yml timeout .8   prog tests 8 inspect 900   920   150 10000 1.0  0      unknown prog tests 0 inspect
80.0 94.7 .17  .16  17   .19  0  
array-crafted/xor2.yml timeout .8   prog tests 8 inspect 900   920   150 12000 1.2  0      unknown prog tests 0 inspect
80.0 94.7 .35  .34  17   .19  0  
array-crafted/xor3.yml timeout .8   prog tests 8 inspect 900   900   150 13000 2.8  0      unknown prog tests 0 inspect
80.0 94.7 1.9   1.9   55   .18  0  
array-crafted/xor4.yml timeout .8   prog tests 8 inspect 900   900   150 13000 .63 0      unknown prog tests 0 inspect
80.0 94.7 20     20     420   .19  0  
array-crafted/xor5.yml error .0   prog tests 1 inspect 3.7 2.2 150 37 .57 0      unknown prog tests 0 inspect
0   0   .063 .064 9.0 0     0  
array-crafted/zero_sum1.yml timeout .9   prog tests 10 inspect 900   910   150 12000 1.2  0      unknown prog tests 0 inspect
90.0 100   .34  .34  30   .23  0  
array-crafted/zero_sum2.yml timeout .929 prog tests 10 inspect 900   910   150 11000 1.2  0      unknown prog tests 0 inspect
92.9 100   .33  .33  29   .23  0  
array-crafted/zero_sum3.yml timeout .944 prog tests 10 inspect 900   910   150 15000 1.4  0      unknown prog tests 0 inspect
94.4 100   .45  .49  42   .23  0  
array-crafted/zero_sum4.yml timeout .955 prog tests 9 inspect 900   910   150 11000 1.1  0      unknown prog tests 0 inspect
95.5 100   .29  .30  29   .21  0  
array-crafted/zero_sum5.yml timeout .962 prog tests 9 inspect 900   910   150 12000 1.8  0      unknown prog tests 0 inspect
96.2 100   .72  .72  66   .21  0  
array-crafted/zero_sum_const1.yml timeout .833 prog tests 12 inspect 900   920   150 11000 1.2  0      unknown prog tests 0 inspect
83.3 100   .15  .15  16   .26  0  
array-crafted/zero_sum_const2.yml timeout .938 prog tests 10 inspect 900   920   150 12000 1.2  0      unknown prog tests 0 inspect
93.8 100   .14  .14  17   .23  0  
array-crafted/zero_sum_const3.yml timeout .9   prog tests 12 inspect 900   920   150 11000 .93 0      unknown prog tests 0 inspect
90.0 100   .15  .15  16   .26  0  
array-crafted/zero_sum_const4.yml timeout .917 prog tests 9 inspect 900   920   150 12000 1.1  0      unknown prog tests 0 inspect
91.7 100   .15  .15  16   .21  0  
array-crafted/zero_sum_const5.yml timeout .964 prog tests 10 inspect 900   920   150 11000 1.2  0      unknown prog tests 0 inspect
96.4 100   .15  .15  17   .23  0  
array-crafted/zero_sum_const_m2.yml timeout .938 prog tests 10 inspect 900   920   150 13000 1.1  0      unknown prog tests 0 inspect
93.8 100   .15  .14  16   .23  0  
array-crafted/zero_sum_const_m3.yml timeout .9   prog tests 12 inspect 900   920   150 12000 .95 0      unknown prog tests 0 inspect
90.0 100   .16  .15  16   .26  0  
array-crafted/zero_sum_const_m4.yml timeout .958 prog tests 10 inspect 900   920   150 13000 1.2  0      unknown prog tests 0 inspect
95.8 100   .15  .14  16   .23  0  
array-crafted/zero_sum_const_m5.yml timeout .929 prog tests 9 inspect 900   920   160 12000 1.1  0      unknown prog tests 0 inspect
92.9 100   .15  .14  17   .21  0  
array-crafted/zero_sum_m2.yml timeout .929 prog tests 9 inspect 900   910   150 12000 1.7  0      unknown prog tests 0 inspect
92.9 100   .60  .60  68   .21  0  
array-crafted/zero_sum_m3.yml timeout .944 prog tests 9 inspect 900   910   150 10000 1.9  0      unknown prog tests 0 inspect
94.4 100   .86  .86  120   .21  0  
array-crafted/zero_sum_m4.yml timeout .955 prog tests 9 inspect 900   910   150 12000 2.5  0      unknown prog tests 0 inspect
95.5 100   .99  .99  140   .21  0  
array-crafted/zero_sum_m5.yml timeout .962 prog tests 9 inspect 900   910   150 12000 1.6  0      unknown prog tests 0 inspect
96.2 100   .57  .58  69   .21  0  
array-multidimensional/add-2-n-u.yml out of memory .0   prog tests 0 inspect 15   13   15000 200 .47 0      error (0) prog tests 0 inspect
0   0   .059 .060 8.9 0     0  
array-multidimensional/add-3-n-u.yml timeout .0   prog tests 8 inspect 900   930   1600 14000 6.8  0      unknown prog tests 0 inspect
0   0   .062 .062 9.0 0     0  
array-multidimensional/copy-2-u.yml timeout .929 prog tests 8 inspect 900   900   300 12000 .61 0      unknown prog tests 0 inspect
92.9 97.1 200     200     4300   .20  0  
array-multidimensional/copy-3-n-u.yml timeout .0   prog tests 8 inspect 900   930   1600 12000 9.5  0      unknown prog tests 0 inspect
0   0   .086 .087 9.0 0     0  
array-multidimensional/copy-partial-2-n-u.yml timeout .0   prog tests 8 inspect 900   930   1600 14000 11    0      unknown prog tests 0 inspect
0   0   .059 .060 9.0 0     0  
array-multidimensional/copy-partial-3-u.yml timeout .0   prog tests 8 inspect 900   930   1600 10000 9.7  0      unknown prog tests 0 inspect
0   0   .057 .058 9.0 0     0  
array-multidimensional/diff-2-n-u.yml timeout .0   prog tests 8 inspect 900   930   1600 13000 31    0      unknown prog tests 0 inspect
0   0   .061 .062 9.0 0     0  
array-multidimensional/diff-3-n-u.yml timeout .0   prog tests 8 inspect 900   930   1600 11000 13    .0082 unknown prog tests 0 inspect
0   0   .060 .060 8.9 0     0  
array-multidimensional/init-2-n-u.yml timeout .9   prog tests 8 inspect 900   900   150 12000 .60 0      unknown prog tests 0 inspect
90.0 96.2 .24  .24  17   .19  0  
array-multidimensional/init-3-u.yml timeout .0   prog tests 8 inspect 900   930   1600 11000 10    .0082 unknown prog tests 0 inspect
0   0   .059 .059 9.0 0     0  
array-multidimensional/init-4-n-u.yml timeout .0   prog tests 8 inspect 900   930   1600 12000 8.5  0      unknown prog tests 0 inspect
0   0   .065 .065 8.9 0     0  
array-multidimensional/init-non-constant-2-n-u.yml timeout .9   prog tests 23 inspect 900   920   150 12000 1.1  0      unknown prog tests 0 inspect
90.0 96.7 .19  .18  16   .44  0  
array-multidimensional/init-non-constant-3-u.yml timeout .0   prog tests 8 inspect 900   930   1600 12000 10    .0082 unknown prog tests 0 inspect
0   0   .057 .058 9.0 0     0  
array-multidimensional/max-2-u.yml timeout .0   prog tests 8 inspect 900   930   1600 11000 9.7  0      unknown prog tests 0 inspect
0   0   .067 .068 9.0 0     0  
array-multidimensional/max-3-n-u.yml timeout .0   prog tests 8 inspect 900   930   1600 11000 1.0  .0082 unknown prog tests 0 inspect
0   0   .061 .061 9.0 0     0  
array-multidimensional/min-2-u.yml timeout .0   prog tests 8 inspect 900   930   1600 12000 10    0      unknown prog tests 0 inspect
0   0   .058 .059 9.0 0     0  
array-multidimensional/min-3-n-u.yml timeout .0   prog tests 8 inspect 900   930   1600 11000 7.5  .0082 unknown prog tests 0 inspect
0   0   .059 .059 9.0 0     0  
array-multidimensional/rev-2-n-u.yml timeout .0   prog tests 8 inspect 900   930   1600 11000 5.6  0      unknown prog tests 0 inspect
0   0   .060 .061 9.0 0     0  
array-multidimensional/rev-3-u.yml timeout .0   prog tests 8 inspect 900   930   1600 12000 .68 .0082 unknown prog tests 0 inspect
0   0   .087 .088 9.0 0     0  
array-multidimensional/transpose-u.yml timeout .929 prog tests 8 inspect 900   900   300 11000 .63 0      unknown prog tests 0 inspect
92.9 100   200     200     4300   .20  0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 169 130 150000 150000 80000 2000000 70000 1.2 169 13000 14700 2400 2400 57000 40 0  
Run set verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Arrays