Benchmark CPA/CoVeriTest TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30375 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon049; apollon085; apollon116]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-06 05:30:26 CET
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options -benchmark -heap 10000M -testcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/coveritest.2019-02-05_2105.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/sanfoundry_10_ground.yml timeout .0556 prog tests 1 inspect 900 880   1400 13000 .0082 0   unknown prog tests 0 inspect
5.56 40.0 .11  .11  17   .078 0  
array-examples/sanfoundry_24-1.yml done .917  prog tests 9 inspect 24 18   1300 310 .17   0   unknown prog tests 0 inspect
91.7  100   .15  .15  16   .21  0  
array-examples/standard_copy1_ground-1.yml timeout .125  prog tests 1 inspect 900 880   2600 11000 .0041 0   unknown prog tests 0 inspect
12.5  33.3 .11  .11  16   .078 0  
array-examples/standard_copy1_ground-2.yml timeout .125  prog tests 1 inspect 900 880   2700 12000 .0041 0   unknown prog tests 0 inspect
12.5  30.0 .12  .14  16   .078 0  
array-examples/standard_copy2_ground-1.yml timeout .1    prog tests 1 inspect 900 880   3000 10000 .0041 0   unknown prog tests 0 inspect
10.0  25.0 .11  .11  16   .078 0  
array-examples/standard_copy2_ground-2.yml timeout .1    prog tests 1 inspect 900 880   2500 12000 .0041 0   unknown prog tests 0 inspect
10.0  27.3 .13  .13  16   .078 0  
array-examples/standard_copy3_ground-1.yml timeout .0833 prog tests 1 inspect 900 880   3100 12000 .0041 0   unknown prog tests 0 inspect
8.33 23.1 .12  .12  16   .078 0  
array-examples/standard_copy3_ground-2.yml timeout .0833 prog tests 1 inspect 900 880   3100 13000 .0041 0   unknown prog tests 0 inspect
8.33 21.4 .12  .15  16   .078 0  
array-examples/standard_copy4_ground-1.yml timeout .0714 prog tests 1 inspect 900 880   3700 11000 .0041 0   unknown prog tests 0 inspect
7.14 20.0 .12  .12  17   .078 0  
array-examples/standard_copy4_ground-2.yml timeout .0714 prog tests 1 inspect 900 880   3300 12000 .0041 0   unknown prog tests 0 inspect
7.14 18.8 .12  .12  16   .078 0  
array-examples/standard_copy5_ground-1.yml timeout .0625 prog tests 1 inspect 900 880   3400 13000 .0041 0   unknown prog tests 0 inspect
6.25 17.6 .12  .12  17   .078 0  
array-examples/standard_copy5_ground-2.yml timeout .0625 prog tests 1 inspect 900 880   3200 12000 .0041 0   unknown prog tests 0 inspect
6.25 16.7 .11  .11  16   .078 0  
array-examples/standard_copy6_ground-1.yml timeout .0556 prog tests 1 inspect 900 880   3600 12000 .0041 0   unknown prog tests 0 inspect
5.56 15.0 .12  .12  16   .078 0  
array-examples/standard_copy6_ground-2.yml timeout .0556 prog tests 1 inspect 900 880   4200 12000 .0041 0   unknown prog tests 0 inspect
5.56 15.8 .12  .12  16   .078 0  
array-examples/standard_copy7_ground-1.yml timeout .05   prog tests 1 inspect 900 880   3600 11000 .0041 0   unknown prog tests 0 inspect
5.00 13.6 .12  .12  16   .082 0  
array-examples/standard_copy7_ground-2.yml timeout .05   prog tests 1 inspect 900 880   4000 13000 .0041 0   unknown prog tests 0 inspect
5.00 14.3 .12  .12  16   .082 0  
array-examples/standard_copy8_ground-1.yml timeout .0455 prog tests 1 inspect 900 880   4600 13000 .0041 0   unknown prog tests 0 inspect
4.55 13.0 .13  .13  16   .082 0  
array-examples/standard_copy8_ground-2.yml timeout .0455 prog tests 1 inspect 900 880   4700 10000 .0041 0   unknown prog tests 0 inspect
4.55 12.5 .12  .12  16   .082 0  
array-examples/standard_copy9_ground-1.yml timeout .0417 prog tests 1 inspect 900 890   5700 11000 .0041 0   unknown prog tests 0 inspect
4.17 11.5 .12  .12  17   .082 0  
array-examples/standard_copy9_ground-2.yml timeout .0417 prog tests 1 inspect 900 880   4600 11000 .0041 0   unknown prog tests 0 inspect
4.17 12.0 .12  .12  17   .082 0  
array-examples/standard_copyInitSum_ground.yml timeout .9    prog tests 1 inspect 900 890   2000 9800 .0041 0   unknown prog tests 0 inspect
90.0  100   .12  .12  16   .078 0  
array-examples/standard_find_ground-1.yml timeout .1    prog tests 1 inspect 900 880   2400 12000 .0082 0   unknown prog tests 0 inspect
10.0  45.5 .12  .12  16   .078 0  
array-examples/standard_partition_ground-1.yml timeout .214  prog tests 3 inspect 900 880   3700 11000 .025  0   unknown prog tests 0 inspect
21.4  45.5 .12  .12  17   .11  0  
array-examples/standard_sentinel-2.yml timeout .1    prog tests 1 inspect 900 880   4000 13000 .0041 0   unknown prog tests 0 inspect
10.0  38.5 .12  .12  16   .078 0  
array-examples/standard_sentinel.i.v+cfa-reducer.yml timeout .1    prog tests 1 inspect 900 880   2400 13000 .0041 0   unknown prog tests 0 inspect
10.0  22.7 .11  .12  17   .078 0  
array-examples/standard_strcpy_ground-1.yml timeout .1    prog tests 1 inspect 900 880   2700 12000 .0082 0   unknown prog tests 0 inspect
10.0  38.5 .12  .12  16   .078 0  
array-examples/standard_strcpy_original-2.yml timeout .0833 prog tests 1 inspect 900 880   2200 11000 .0082 0   unknown prog tests 0 inspect
8.33 33.3 .13  .13  16   .078 0  
array-examples/standard_two_index_01.yml timeout .125  prog tests 1 inspect 900 560   8500 9600 39      0   unknown prog tests 0 inspect
12.5  26.3 .12  .12  17   .078 0  
array-examples/standard_two_index_02.yml timeout .125  prog tests 1 inspect 900 880   2800 11000 .0082 0   unknown prog tests 0 inspect
12.5  26.3 .12  .12  17   .078 0  
array-examples/standard_two_index_03.yml timeout .125  prog tests 1 inspect 900 590   8300 8400 51      0   unknown prog tests 0 inspect
12.5  26.3 .11  .11  16   .078 0  
array-examples/standard_two_index_04.yml timeout .125  prog tests 1 inspect 900 880   2500 11000 .0082 0   unknown prog tests 0 inspect
12.5  26.3 .11  .11  16   .078 0  
array-examples/standard_two_index_05.yml timeout .125  prog tests 1 inspect 900 880   3000 9500 .0082 0   unknown prog tests 0 inspect
12.5  26.3 .13  .13  16   .078 0  
array-examples/standard_two_index_06.yml timeout .125  prog tests 1 inspect 900 600   5900 8900 52      0   unknown prog tests 0 inspect
12.5  26.3 .11  .11  16   .078 0  
array-examples/standard_two_index_07.yml timeout .125  prog tests 1 inspect 900 880   2900 13000 .0082 0   unknown prog tests 0 inspect
12.5  26.3 .12  .12  16   .078 0  
array-examples/standard_two_index_08.yml timeout .125  prog tests 1 inspect 900 880   2400 12000 .0082 0   unknown prog tests 0 inspect
12.5  26.3 .12  .12  16   .078 0  
array-examples/standard_two_index_09.yml timeout .125  prog tests 1 inspect 900 880   3000 11000 .0082 0   unknown prog tests 0 inspect
12.5  26.3 .12  .12  16   .078 0  
array-industry-pattern/array_monotonic.yml timeout .3    prog tests 3 inspect 900 880   3000 11000 .020  0   unknown prog tests 0 inspect
30.0  55.6 .12  .12  17   .11  0  
array-industry-pattern/array_mul_init.yml timeout .214  prog tests 1 inspect 900 890   2000 13000 .0041 0   unknown prog tests 0 inspect
21.4  50.0 .12  .12  17   .078 0  
array-industry-pattern/array_of_struct_break.yml timeout .0    prog tests 0 inspect 900 890   4300 5900 .0082 0   error (0) prog tests 0 inspect
0    0   .060 .061 9.0 0     0  
array-industry-pattern/array_of_struct_ptr_mul_init.yml timeout .0    prog tests 0 inspect 900 890   6400 12000 .0041 0   error (0) prog tests 0 inspect
0    0   .070 .071 9.0 0     0  
array-industry-pattern/array_of_struct_single_elem_init.yml timeout .0    prog tests 0 inspect 900 890   8000 11000 .0041 0   error (0) prog tests 0 inspect
0    0   .059 .060 9.0 0     0  
array-industry-pattern/array_ptr_single_elem_init-2.yml timeout .5    prog tests 6 inspect 900 880   3500 14000 .049  0   unknown prog tests 0 inspect
50.0  64.7 .14  .14  16   .16  0  
array-industry-pattern/array_shadowinit.yml timeout .875  prog tests 7 inspect 900 850   2800 9600 5.3    0   unknown prog tests 0 inspect
87.5  100   .14  .23  17   .18  0  
array-industry-pattern/array_single_elem_init.yml timeout .5    prog tests 6 inspect 900 880   3500 12000 .037  0   unknown prog tests 0 inspect
50.0  64.7 .14  .16  16   .16  0  
reducercommutativity/avg.yml segmentation fault .8    prog tests 6 inspect 200 150   6900 2200 1.6    0   unknown prog tests 0 inspect
80.0  95.2 .14  .14  16   .16  0  
reducercommutativity/avg05-1.yml timeout .8    prog tests 6 inspect 900 890   3200 8000 .13   0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/avg10-2.yml timeout .8    prog tests 6 inspect 900 880   2900 9100 .37   0   unknown prog tests 0 inspect
80.0  94.7 .14  .16  16   .16  0  
reducercommutativity/avg20-2.yml timeout .8    prog tests 6 inspect 900 870   4100 12000 1.1    0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  17   .16  0  
reducercommutativity/avg40-2.yml timeout .8    prog tests 6 inspect 900 860   7500 11000 2.0    0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  17   .16  0  
reducercommutativity/avg60-1.yml timeout .8    prog tests 4 inspect 900 860   9700 7500 1.7    0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .13  0  
reducercommutativity/max.yml timeout .8    prog tests 8 inspect 900 880   1000 10000 1.8    0   unknown prog tests 0 inspect
80.0  95.2 .14  .14  17   .19  0  
reducercommutativity/max05-1.yml timeout .8    prog tests 8 inspect 900 880   2600 7900 .43   0   unknown prog tests 0 inspect
80.0  94.7 .15  .14  16   .19  0  
reducercommutativity/max10-1.yml timeout .8    prog tests 8 inspect 900 890   2900 6000 .15   0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .19  0  
reducercommutativity/max20-1.yml timeout .8    prog tests 8 inspect 900 890   1100 5100 .16   0   unknown prog tests 0 inspect
80.0  94.7 .15  .15  16   .19  0  
reducercommutativity/max40-1.yml timeout .8    prog tests 6 inspect 900 880   1400 5500 .28   0   unknown prog tests 0 inspect
80.0  94.7 .15  .16  16   .16  0  
reducercommutativity/max60-2.yml timeout .8    prog tests 6 inspect 900 870   5100 7200 .86   0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/rangesum.yml timeout .875  prog tests 11 inspect 900 770   4700 10000 47      0   unknown prog tests 0 inspect
87.5  96.8 .16  .15  16   .25  0  
reducercommutativity/rangesum05.yml timeout .786  prog tests 7 inspect 900 880   2100 8500 .58   0   true prog tests 1 inspect
78.6  92.6 .15  .15  16   .18  0  
reducercommutativity/rangesum10.yml timeout .786  prog tests 7 inspect 900 870   3000 7500 .95   0   true prog tests 1 inspect
78.6  92.6 .15  .18  16   .18  0  
reducercommutativity/rangesum20.yml timeout .786  prog tests 7 inspect 900 860   4500 7300 1.7    0   true prog tests 1 inspect
78.6  92.6 .14  .14  16   .18  0  
reducercommutativity/rangesum40.yml timeout .786  prog tests 7 inspect 900 840   5200 9700 3.2    0   true prog tests 1 inspect
78.6  92.6 .15  .15  16   .18  0  
reducercommutativity/rangesum60.yml timeout .786  prog tests 6 inspect 900 850   5300 9900 3.5    0   true prog tests 1 inspect
78.6  92.6 .15  .18  17   .16  0  
reducercommutativity/sep.yml timeout .75   prog tests 7 inspect 900 790   4600 14000 48      0   unknown prog tests 0 inspect
75.0  91.3 .14  .14  16   .18  0  
reducercommutativity/sep05-1.yml timeout .833  prog tests 8 inspect 900 780   5400 8400 40      0   unknown prog tests 0 inspect
83.3  95.2 .14  .16  17   .19  0  
reducercommutativity/sep10-2.yml timeout .833  prog tests 7 inspect 900 830   5700 5600 18      0   unknown prog tests 0 inspect
83.3  95.2 .14  .15  17   .18  0  
reducercommutativity/sep20-1.yml timeout .833  prog tests 7 inspect 900 880   5700 7400 .14   0   unknown prog tests 0 inspect
83.3  95.2 .14  .14  16   .18  0  
reducercommutativity/sep40-1.yml timeout .833  prog tests 6 inspect 900 860   5800 10000 .14   0   unknown prog tests 0 inspect
83.3  95.2 .14  .14  16   .16  0  
reducercommutativity/sep60-2.yml timeout .833  prog tests 5 inspect 900 860   2700 13000 .19   0   unknown prog tests 0 inspect
83.3  95.2 .16  .16  16   .14  0  
reducercommutativity/sum.yml timeout .8    prog tests 6 inspect 900 880   2400 10000 1.8    0   unknown prog tests 0 inspect
80.0  95.2 .13  .13  16   .16  0  
reducercommutativity/sum05-2.yml timeout .8    prog tests 6 inspect 900 880   2400 11000 .36   0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/sum10-1.yml timeout .8    prog tests 6 inspect 900 890   4000 11000 .20   0   unknown prog tests 0 inspect
80.0  94.7 .15  .16  17   .16  0  
reducercommutativity/sum20-2.yml timeout .8    prog tests 6 inspect 900 880   4900 8000 .44   0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/sum40-2.yml timeout .8    prog tests 6 inspect 900 860   10000 13000 2.0    0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/sum60-2.yml timeout .8    prog tests 4 inspect 900 860   11000 11000 1.7    0   unknown prog tests 0 inspect
80.0  94.7 .13  .13  16   .13  0  
array-tiling/mbpr2.yml timeout .8    prog tests 10 inspect 900 790   5200 12000 49      0   unknown prog tests 0 inspect
80.0  91.7 .15  .15  17   .23  0  
array-tiling/mbpr3.yml timeout .792  prog tests 12 inspect 900 830   4400 10000 26      0   unknown prog tests 0 inspect
79.2  90.9 .16  .16  17   .27  0  
array-tiling/mbpr4.yml timeout .786  prog tests 14 inspect 900 770   5200 9200 40      0   unknown prog tests 0 inspect
78.6  90.9 .18  .17  16   .35  0  
array-tiling/mbpr5.yml timeout .781  prog tests 16 inspect 900 810   5200 13000 27      0   unknown prog tests 0 inspect
78.1  91.2 .19  .18  16   .40  0  
array-tiling/mlceu.yml timeout .833  prog tests 6 inspect 900 800   5100 11000 39      0   unknown prog tests 0 inspect
83.3  91.7 .13  .12  16   .16  0  
array-tiling/nr2.yml timeout .889  prog tests 11 inspect 900 810   5400 9900 36      0   unknown prog tests 0 inspect
88.9  100   100     100     16   .25  0  
array-tiling/nr3.yml timeout .889  prog tests 11 inspect 900 840   3100 10000 18      0   unknown prog tests 0 inspect
88.9  100   .15  .14  16   .25  0  
array-tiling/nr4.yml timeout .889  prog tests 11 inspect 900 810   4600 10000 40      0   unknown prog tests 0 inspect
88.9  100   100     100     16   .25  0  
array-tiling/nr5.yml timeout .889  prog tests 11 inspect 900 840   3500 12000 20      0   unknown prog tests 0 inspect
88.9  100   .16  .17  16   .25  0  
array-tiling/pnr2.yml timeout .938  prog tests 12 inspect 900 820   2700 13000 9.4    0   unknown prog tests 0 inspect
93.8  100   .16  .16  17   .26  0  
array-tiling/pnr3.yml timeout .944  prog tests 14 inspect 900 830   3100 12000 18      0   unknown prog tests 0 inspect
94.4  100   .16  .16  17   .29  0  
array-tiling/pnr4.yml timeout .95   prog tests 16 inspect 900 810   5100 13000 38      0   unknown prog tests 0 inspect
95.0  100   .18  .17  16   .33  0  
array-tiling/pnr5.yml timeout .955  prog tests 18 inspect 900 840   2800 9200 13      0   unknown prog tests 0 inspect
95.5  100   .19  .19  16   .36  0  
array-tiling/poly1.yml timeout .9    prog tests 6 inspect 900 810   5100 8500 37      0   unknown prog tests 0 inspect
90.0  100   .13  .14  16   .16  0  
array-tiling/poly2.yml timeout .917  prog tests 8 inspect 900 800   4500 7900 42      0   unknown prog tests 0 inspect
91.7  100   .15  .14  16   .19  0  
array-tiling/pr2.yml timeout .667  prog tests 12 inspect 900 860   2200 10000 2.1    0   unknown prog tests 0 inspect
66.7  90.0 100     100     16   .26  0  
array-tiling/pr3.yml timeout .65   prog tests 14 inspect 900 850   4200 11000 5.8    0   unknown prog tests 0 inspect
65.0  87.5 .17  .17  17   .29  0  
array-tiling/pr4.yml timeout .636  prog tests 16 inspect 900 860   3400 13000 2.5    0   unknown prog tests 0 inspect
63.6  85.7 180     180     17   .33  0  
array-tiling/pr5.yml timeout .625  prog tests 18 inspect 900 880   980 13000 .52   0   unknown prog tests 0 inspect
62.5  84.4 .17  .17  16   .36  0  
array-tiling/revcpyswp2.yml done .938  prog tests 15 inspect 24 16   810 220 .13   0   unknown prog tests 0 inspect
93.8  100   .20  .19  17   .31  0  
array-tiling/rew.yml timeout .917  prog tests 7 inspect 900 790   4700 10000 42      0   unknown prog tests 0 inspect
91.7  100   .14  .14  17   .18  0  
array-tiling/rewnif.yml timeout .917  prog tests 7 inspect 900 790   5600 12000 38      0   unknown prog tests 0 inspect
91.7  100   .14  .13  17   .18  0  
array-tiling/rewnifrev.yml out of memory .917  prog tests 4 inspect 100 84   15000 1100 2.5    0   unknown prog tests 0 inspect
91.7  100   .13  .13  16   .13  0  
array-tiling/rewnifrev2.yml out of memory .9    prog tests 4 inspect 98 93   15000 1300 .029  0   unknown prog tests 0 inspect
90.0  100   .13  .12  16   .13  0  
array-tiling/rewrev.yml out of memory .917  prog tests 4 inspect 97 80   15000 1300 2.1    0   unknown prog tests 0 inspect
91.7  100   .13  .13  16   .13  0  
array-tiling/skipped.yml timeout .944  prog tests 12 inspect 900 800   5100 12000 53      0   unknown prog tests 0 inspect
94.4  100   .16  .16  16   .26  0  
array-tiling/skippedu.yml done 1.0    prog tests 15 inspect 25 7.1 960 200 1.7    0   true prog tests 1 inspect
100    100   .19  .18  16   .31  0  
array-tiling/tcpy.yml timeout .929  prog tests 10 inspect 900 800   5000 13000 37      0   unknown prog tests 0 inspect
92.9  100   .15  .20  16   .20  0  
array-programs/copysome1-1.yml timeout .0833 prog tests 1 inspect 900 880   3400 12000 .0082 0   unknown prog tests 0 inspect
8.33 30.8 .11  .11  16   .078 0  
array-programs/copysome1-2.yml timeout .0833 prog tests 1 inspect 900 880   3900 10000 .0082 0   unknown prog tests 0 inspect
8.33 28.6 .12  .12  17   .078 0  
array-programs/copysome2-1.yml timeout .0714 prog tests 1 inspect 900 880   4100 11000 .0082 0   unknown prog tests 0 inspect
7.14 23.5 .12  .12  16   .078 0  
array-programs/copysome2-2.yml timeout .0714 prog tests 1 inspect 900 880   4200 11000 .0082 0   unknown prog tests 0 inspect
7.14 23.5 .12  .13  16   .078 0  
array-crafted/bAnd1.yml timeout .8    prog tests 3 inspect 900 860   3600 10000 1.9    0   unknown prog tests 0 inspect
80.0  94.7 .13  .13  16   .11  0  
array-crafted/bAnd2.yml timeout .1    prog tests 1 inspect 900 820   5600 13000 9.1    0   unknown prog tests 0 inspect
10.0  15.8 .11  .11  16   .078 0  
array-crafted/bAnd3.yml timeout .1    prog tests 1 inspect 900 650   9100 9000 65      0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  17   .078 0  
array-crafted/bAnd4.yml timeout .1    prog tests 1 inspect 900 880   2400 12000 .0041 0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/bAnd5.yml timeout .833  prog tests 8 inspect 900 880   1900 11000 1.9    0   unknown prog tests 0 inspect
83.3  95.7 .15  .14  17   .19  0  
array-crafted/bor1.yml timeout .8    prog tests 3 inspect 900 860   3800 12000 1.9    0   unknown prog tests 0 inspect
80.0  94.7 .13  .13  16   .11  0  
array-crafted/bor2.yml timeout .1    prog tests 1 inspect 900 810   6000 11000 8.6    0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/bor3.yml timeout .1    prog tests 1 inspect 900 640   9000 9200 72      0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/bor4.yml timeout .1    prog tests 1 inspect 900 880   2500 10000 .0041 0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/bor5.yml timeout .833  prog tests 8 inspect 900 790   5100 10000 51      0   unknown prog tests 0 inspect
83.3  95.7 .14  .13  16   .19  0  
array-crafted/mapavg1.yml timeout .8    prog tests 3 inspect 900 860   3800 11000 1.9    0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .11  0  
array-crafted/mapavg2.yml timeout .1    prog tests 1 inspect 900 810   5800 12000 8.9    0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapavg3.yml timeout .1    prog tests 1 inspect 900 640   5900 9200 73      0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapavg4.yml timeout .1    prog tests 1 inspect 900 880   2500 11000 .0041 0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapavg5.yml timeout .833  prog tests 8 inspect 900 810   5100 9100 29      0   unknown prog tests 0 inspect
83.3  95.7 .14  .14  16   .20  0  
array-crafted/mapsum1.yml timeout .8    prog tests 3 inspect 900 860   3100 10000 1.9    0   unknown prog tests 0 inspect
80.0  94.7 .13  .13  16   .11  0  
array-crafted/mapsum2.yml timeout .1    prog tests 1 inspect 900 810   5900 12000 9.0    0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapsum3.yml timeout .1    prog tests 1 inspect 900 550   8400 7300 52      0   unknown prog tests 0 inspect
10.0  15.8 .12  .13  16   .078 0  
array-crafted/mapsum4.yml timeout .1    prog tests 1 inspect 900 880   2600 8900 .0041 0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapsum5.yml timeout .833  prog tests 8 inspect 900 780   5300 11000 49      0   unknown prog tests 0 inspect
83.3  95.7 .15  .15  16   .20  0  
array-crafted/xor1.yml timeout .8    prog tests 3 inspect 900 860   3800 12000 1.9    0   unknown prog tests 0 inspect
80.0  94.7 .13  .13  16   .11  0  
array-crafted/xor2.yml timeout .1    prog tests 1 inspect 900 820   5800 11000 8.9    0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  16   .078 0  
array-crafted/xor3.yml timeout .1    prog tests 1 inspect 900 610   6700 8400 71      0   unknown prog tests 0 inspect
10.0  15.8 .12  .12  17   .078 0  
array-crafted/xor4.yml timeout .1    prog tests 1 inspect 900 880   2500 12000 .0041 0   unknown prog tests 0 inspect
10.0  15.8 .15  .15  16   .078 0  
array-crafted/xor5.yml timeout .833  prog tests 8 inspect 900 780   5500 12000 52      0   unknown prog tests 0 inspect
83.3  95.7 .15  .14  17   .19  0  
array-crafted/zero_sum1.yml timeout .9    prog tests 8 inspect 900 880   2000 6100 2.0    0   unknown prog tests 0 inspect
90.0  100   .14  .14  16   .19  0  
array-crafted/zero_sum2.yml exception .929  prog tests 12 inspect 29 9.3 930 250 2.0    0   unknown prog tests 0 inspect
92.9  100   .15  .17  16   .26  0  
array-crafted/zero_sum3.yml exception .944  prog tests 16 inspect 33 14   1100 330 2.1    0   unknown prog tests 0 inspect
94.4  100   .19  .18  16   .33  0  
array-crafted/zero_sum4.yml exception .955  prog tests 20 inspect 37 16   1200 360 2.0    0   unknown prog tests 0 inspect
95.5  100   .18  .17  16   .39  0  
array-crafted/zero_sum5.yml exception .962  prog tests 24 inspect 42 22   1200 400 2.1    0   unknown prog tests 0 inspect
96.2  100   .20  .19  17   .46  0  
array-crafted/zero_sum_const1.yml timeout .917  prog tests 9 inspect 900 890   950 14000 .11   0   unknown prog tests 0 inspect
91.7  100   .15  .14  17   .21  0  
array-crafted/zero_sum_const2.yml exception .938  prog tests 13 inspect 28 21   870 320 .11   0   unknown prog tests 0 inspect
93.8  100   .17  .17  16   .27  0  
array-crafted/zero_sum_const3.yml exception .95   prog tests 17 inspect 29 22   680 280 .11   0   unknown prog tests 0 inspect
95.0  100   .18  .17  16   .34  0  
array-crafted/zero_sum_const4.yml exception .958  prog tests 21 inspect 31 24   910 360 .11   0   unknown prog tests 0 inspect
95.8  100   .21  .20  16   .41  0  
array-crafted/zero_sum_const5.yml exception .964  prog tests 25 inspect 35 28   890 380 .11   0   unknown prog tests 0 inspect
96.4  100   .21  .20  16   .48  0  
array-crafted/zero_sum_const_m2.yml timeout .938  prog tests 13 inspect 900 890   1500 9900 .11   0   unknown prog tests 0 inspect
93.8  100   .16  .15  16   .27  0  
array-crafted/zero_sum_const_m3.yml exception .95   prog tests 17 inspect 48 40   1200 640 .11   0   unknown prog tests 0 inspect
95.0  100   .17  .18  16   .34  0  
array-crafted/zero_sum_const_m4.yml timeout .958  prog tests 21 inspect 900 860   3300 9800 3.9    0   unknown prog tests 0 inspect
95.8  100   .19  .22  16   .41  0  
array-crafted/zero_sum_const_m5.yml timeout .964  prog tests 25 inspect 900 890   1500 12000 .11   0   unknown prog tests 0 inspect
96.4  100   .21  .20  16   .48  0  
array-crafted/zero_sum_m2.yml timeout .929  prog tests 12 inspect 900 840   4900 9700 10      0   unknown prog tests 0 inspect
92.9  100   .15  .15  16   .26  0  
array-crafted/zero_sum_m3.yml timeout .944  prog tests 16 inspect 910 890   1800 9300 2.1    0   unknown prog tests 0 inspect
94.4  100   .17  .16  16   .33  0  
array-crafted/zero_sum_m4.yml timeout .955  prog tests 20 inspect 900 880   2200 11000 1.7    0   unknown prog tests 0 inspect
95.5  100   .19  .18  16   .39  0  
array-crafted/zero_sum_m5.yml timeout .962  prog tests 24 inspect 900 880   10000 12000 2.0    0   unknown prog tests 0 inspect
96.2  100   .20  .18  16   .46  0  
array-multidimensional/add-2-n-u.yml timeout .0    prog tests 2 inspect 900 790   6500 11000 15      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/add-3-n-u.yml timeout .0    prog tests 3 inspect 900 790   6400 11000 20      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .090 0  
array-multidimensional/copy-2-u.yml timeout .143  prog tests 2 inspect 900 820   6100 11000 8.7    0   unknown prog tests 0 inspect
14.3  32.4 .12  .12  16   .098 0  
array-multidimensional/copy-3-n-u.yml timeout .0    prog tests 3 inspect 900 790   6400 11000 21      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .086 0  
array-multidimensional/copy-partial-2-n-u.yml timeout .0    prog tests 3 inspect 900 790   6200 12000 15      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/copy-partial-3-u.yml timeout .0    prog tests 4 inspect 900 830   6300 11000 8.9    0   unknown prog tests 0 inspect
0    0   .12  .13  16   .086 0  
array-multidimensional/diff-2-n-u.yml timeout .0    prog tests 2 inspect 900 790   6200 11000 16      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .086 0  
array-multidimensional/diff-3-n-u.yml timeout .0    prog tests 3 inspect 900 800   6600 11000 21      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .090 0  
array-multidimensional/init-2-n-u.yml timeout .9    prog tests 2 inspect 900 790   6500 11000 16      0   unknown prog tests 0 inspect
90.0  96.2 .15  .15  17   .094 0  
array-multidimensional/init-3-u.yml timeout .0    prog tests 3 inspect 900 820   6500 11000 9.8    0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/init-4-n-u.yml timeout .0    prog tests 4 inspect 900 780   6700 11000 21      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/init-non-constant-2-n-u.yml timeout .9    prog tests 10 inspect 900 810   4700 10000 25      0   unknown prog tests 0 inspect
90.0  96.7 .15  .15  16   .23  0  
array-multidimensional/init-non-constant-3-u.yml timeout .0    prog tests 3 inspect 900 830   6500 12000 9.3    0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/max-2-u.yml timeout .0    prog tests 2 inspect 900 800   6200 12000 16      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/max-3-n-u.yml timeout .0    prog tests 3 inspect 900 790   6300 12000 22      0   unknown prog tests 0 inspect
0    0   .12  .12  17   .082 0  
array-multidimensional/min-2-u.yml timeout .0    prog tests 2 inspect 900 790   6300 11000 15      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/min-3-n-u.yml timeout .0    prog tests 3 inspect 900 790   6300 11000 23      0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/rev-2-n-u.yml timeout .0    prog tests 2 inspect 900 800   6200 11000 15      0   unknown prog tests 0 inspect
0    0   .12  .12  17   .082 0  
array-multidimensional/rev-3-u.yml timeout .0    prog tests 3 inspect 900 810   3100 11000 2.9    0   unknown prog tests 0 inspect
0    0   .12  .12  16   .086 0  
array-multidimensional/transpose-u.yml timeout .143  prog tests 2 inspect 900 820   6500 11000 9.3    0   unknown prog tests 0 inspect
14.3  40.9 .12  .12  17   .098 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 169 84.7 140000 130000 740000 1600000 1900 0   169 8470 10300 510 510 2800 27 0  
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays