Benchmark CPA/Tiger-MGP TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30541M Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:13:54 CET 2019-02-06 06:15:02 CET
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options -benchmark -heap 10000M -tigertestcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/cpa-tiger.2019-02-05_2113.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/sanfoundry_10_ground.yml timeout .0556 prog tests 1 inspect 900   880   5000 13000 .0041 0   unknown prog tests 0 inspect
5.56 40.0 .12  .12  16   .078 0  
array-examples/sanfoundry_24-1.yml unknown .917  prog tests 5 inspect 6.3 3.0 470 60 .0041 0   unknown prog tests 0 inspect
91.7  100   .13  .14  16   .15  0  
array-examples/standard_copy1_ground-1.yml timeout .0    prog tests 0 inspect 900   880   5900 11000 .0041 0   unknown prog tests 0 inspect
0    0   .057 .058 9.0 0     0  
array-examples/standard_copy1_ground-2.yml timeout .0    prog tests 0 inspect 900   880   7300 12000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .061 9.0 0     0  
array-examples/standard_copy2_ground-1.yml timeout .0    prog tests 0 inspect 900   880   7400 10000 .0041 0   unknown prog tests 0 inspect
0    0   .061 .062 9.0 0     0  
array-examples/standard_copy2_ground-2.yml timeout .0    prog tests 0 inspect 900   880   7300 11000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .063 9.1 0     0  
array-examples/standard_copy3_ground-1.yml timeout .0833 prog tests 1 inspect 900   880   8100 11000 .0041 0   unknown prog tests 0 inspect
8.33 23.1 .12  .12  16   .078 0  
array-examples/standard_copy3_ground-2.yml timeout .0833 prog tests 1 inspect 900   880   7900 11000 .0041 0   unknown prog tests 0 inspect
8.33 21.4 .13  .13  16   .078 0  
array-examples/standard_copy4_ground-1.yml timeout .0    prog tests 0 inspect 900   880   7000 11000 .0041 0   unknown prog tests 0 inspect
0    0   .061 .062 9.0 0     0  
array-examples/standard_copy4_ground-2.yml timeout .0    prog tests 0 inspect 900   880   8600 11000 .0041 0   unknown prog tests 0 inspect
0    0   .059 .060 9.0 0     0  
array-examples/standard_copy5_ground-1.yml timeout .0    prog tests 0 inspect 900   890   8200 14000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .063 9.0 0     0  
array-examples/standard_copy5_ground-2.yml timeout .0625 prog tests 1 inspect 900   890   7000 12000 .0041 0   unknown prog tests 0 inspect
6.25 16.7 .12  .12  16   .078 0  
array-examples/standard_copy6_ground-1.yml timeout .0556 prog tests 1 inspect 900   890   7000 12000 .0041 0   unknown prog tests 0 inspect
5.56 15.0 .12  .12  16   .078 0  
array-examples/standard_copy6_ground-2.yml timeout .0    prog tests 0 inspect 900   890   8600 10000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .061 9.0 0     0  
array-examples/standard_copy7_ground-1.yml timeout .05   prog tests 1 inspect 900   890   8900 11000 .0041 0   unknown prog tests 0 inspect
5.00 13.6 .12  .12  16   .082 0  
array-examples/standard_copy7_ground-2.yml timeout .0    prog tests 0 inspect 900   880   7500 13000 .0041 0   unknown prog tests 0 inspect
0    0   .061 .062 9.0 0     0  
array-examples/standard_copy8_ground-1.yml timeout .0    prog tests 0 inspect 900   890   7900 11000 .0041 0   unknown prog tests 0 inspect
0    0   .058 .059 9.0 0     0  
array-examples/standard_copy8_ground-2.yml timeout .0455 prog tests 1 inspect 900   890   9500 11000 .0041 0   unknown prog tests 0 inspect
4.55 12.5 .12  .16  16   .082 0  
array-examples/standard_copy9_ground-1.yml timeout .0    prog tests 0 inspect 900   890   11000 13000 .0041 0   unknown prog tests 0 inspect
0    0   .058 .059 9.0 0     0  
array-examples/standard_copy9_ground-2.yml timeout .0    prog tests 0 inspect 900   890   11000 11000 .0041 0   unknown prog tests 0 inspect
0    0   .061 .061 9.0 0     0  
array-examples/standard_copyInitSum_ground.yml timeout .9    prog tests 1 inspect 900   880   5800 11000 .0041 0   unknown prog tests 0 inspect
90.0  100   .12  .12  16   .078 0  
array-examples/standard_find_ground-1.yml timeout .0    prog tests 0 inspect 900   880   6600 11000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .062 9.0 0     0  
array-examples/standard_partition_ground-1.yml timeout .0714 prog tests 1 inspect 900   880   6200 11000 .0041 0   unknown prog tests 0 inspect
7.14 27.3 .11  .11  16   .078 0  
array-examples/standard_sentinel-2.yml timeout .0    prog tests 0 inspect 900   880   9600 10000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .060 9.0 0     0  
array-examples/standard_sentinel.i.v+cfa-reducer.yml timeout .0    prog tests 0 inspect 900   880   6800 13000 .0041 0   unknown prog tests 0 inspect
0    0   .061 .061 9.0 0     0  
array-examples/standard_strcpy_ground-1.yml timeout .0    prog tests 0 inspect 900   880   7200 13000 .0041 0   unknown prog tests 0 inspect
0    0   .061 .061 9.0 0     0  
array-examples/standard_strcpy_original-2.yml timeout .0    prog tests 0 inspect 900   880   6000 11000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .060 9.0 0     0  
array-examples/standard_two_index_01.yml timeout .0    prog tests 0 inspect 900   880   4900 11000 .0041 0   unknown prog tests 0 inspect
0    0   .064 .065 9.0 0     0  
array-examples/standard_two_index_02.yml timeout .0    prog tests 0 inspect 900   880   5800 12000 .0041 0   unknown prog tests 0 inspect
0    0   .057 .058 9.0 0     0  
array-examples/standard_two_index_03.yml timeout .0    prog tests 0 inspect 900   880   5200 11000 .0041 0   unknown prog tests 0 inspect
0    0   .056 .057 9.0 0     0  
array-examples/standard_two_index_04.yml timeout .0    prog tests 0 inspect 900   880   6100 11000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .060 9.0 0     0  
array-examples/standard_two_index_05.yml timeout .0    prog tests 0 inspect 900   880   5900 11000 .0041 0   unknown prog tests 0 inspect
0    0   .059 .059 9.0 0     0  
array-examples/standard_two_index_06.yml timeout .0    prog tests 0 inspect 900   880   5200 12000 .0041 0   unknown prog tests 0 inspect
0    0   .059 .060 9.1 0     0  
array-examples/standard_two_index_07.yml timeout .0    prog tests 0 inspect 900   880   5800 11000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .063 9.0 0     0  
array-examples/standard_two_index_08.yml timeout .0    prog tests 0 inspect 900   880   6000 13000 .0041 0   unknown prog tests 0 inspect
0    0   .057 .058 9.1 0     0  
array-examples/standard_two_index_09.yml timeout .0    prog tests 0 inspect 900   880   6100 12000 .0041 0   unknown prog tests 0 inspect
0    0   .063 .064 9.0 0     0  
array-industry-pattern/array_monotonic.yml timeout .0    prog tests 0 inspect 900   880   7000 12000 .0041 0   unknown prog tests 0 inspect
0    0   .058 .068 9.0 0     0  
array-industry-pattern/array_mul_init.yml timeout .0    prog tests 0 inspect 900   880   5700 13000 .0041 0   unknown prog tests 0 inspect
0    0   .063 .064 9.0 0     0  
array-industry-pattern/array_of_struct_break.yml timeout .0    prog tests 0 inspect 900   900   3800 6000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .062 9.0 0     0  
array-industry-pattern/array_of_struct_ptr_mul_init.yml timeout .0    prog tests 0 inspect 900   900   5700 10000 .0041 0   unknown prog tests 0 inspect
0    0   .057 .058 9.0 0     0  
array-industry-pattern/array_of_struct_single_elem_init.yml timeout .0    prog tests 0 inspect 900   900   7300 9200 .0041 0   unknown prog tests 0 inspect
0    0   .062 .063 8.9 0     0  
array-industry-pattern/array_ptr_single_elem_init-2.yml timeout .214  prog tests 1 inspect 900   880   5500 11000 .0041 0   unknown prog tests 0 inspect
21.4  35.3 .11  .12  16   .078 0  
array-industry-pattern/array_shadowinit.yml unknown .875  prog tests 3 inspect 3.5 1.5 280 29 .0041 0   unknown prog tests 0 inspect
87.5  100   .13  .13  16   .11  0  
array-industry-pattern/array_single_elem_init.yml timeout .214  prog tests 1 inspect 900   880   5400 11000 .0041 0   unknown prog tests 0 inspect
21.4  35.3 .11  .11  16   .078 0  
reducercommutativity/avg.yml segmentation fault .7    prog tests 1 inspect 170   130   6900 1900 .0041 0   unknown prog tests 0 inspect
70.0  95.2 .12  .12  16   .078 0  
reducercommutativity/avg05-1.yml timeout .8    prog tests 3 inspect 900   890   2300 8900 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .13  .13  16   .11  0  
reducercommutativity/avg10-2.yml unknown .8    prog tests 3 inspect 620   610   740 8300 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .11  0  
reducercommutativity/avg20-2.yml unknown .8    prog tests 3 inspect 680   670   1800 6200 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .13  .13  17   .11  0  
reducercommutativity/avg40-2.yml out of memory .8    prog tests 1 inspect 320   300   15000 4000 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .15  16   .078 0  
reducercommutativity/avg60-1.yml out of memory .8    prog tests 1 inspect 330   310   15000 4300 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
reducercommutativity/max.yml timeout .7    prog tests 2 inspect 900   900   400 12000 .0041 0   unknown prog tests 0 inspect
70.0  95.2 .12  .12  17   .094 0  
reducercommutativity/max05-1.yml unknown .8    prog tests 4 inspect 59   52   1900 610 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .13  .13  16   .13  0  
reducercommutativity/max10-1.yml timeout .8    prog tests 2 inspect 900   890   1400 7400 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .14  .14  16   .094 0  
reducercommutativity/max20-1.yml timeout .8    prog tests 2 inspect 900   890   1200 6400 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .094 0  
reducercommutativity/max40-1.yml timeout .8    prog tests 1 inspect 900   890   4100 6900 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
reducercommutativity/max60-2.yml out of memory .8    prog tests 1 inspect 830   810   15000 11000 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
reducercommutativity/rangesum.yml unknown .875  prog tests 9 inspect 57   49   520 620 .0041 0   unknown prog tests 0 inspect
87.5  96.8 .18  .18  16   .21  0  
reducercommutativity/rangesum05.yml unknown .786  prog tests 4 inspect 210   200   710 2100 .0041 0   unknown prog tests 0 inspect
78.6  92.6 .13  .19  16   .13  0  
reducercommutativity/rangesum10.yml timeout .786  prog tests 3 inspect 930   920   1900 9300 .0041 0   unknown prog tests 0 inspect
78.6  92.6 .14  .15  16   .11  0  
reducercommutativity/rangesum20.yml unknown .786  prog tests 3 inspect 730   720   1000 7800 .0041 0   unknown prog tests 0 inspect
78.6  92.6 .13  .13  16   .074 0  
reducercommutativity/rangesum40.yml unknown .786  prog tests 3 inspect 850   840   2300 11000 .0041 0   unknown prog tests 0 inspect
78.6  92.6 .12  .14  16   .11  0  
reducercommutativity/rangesum60.yml timeout .786  prog tests 2 inspect 900   880   3600 12000 .0041 0   unknown prog tests 0 inspect
78.6  92.6 .12  .12  16   .098 0  
reducercommutativity/sep.yml unknown .75   prog tests 4 inspect 470   460   620 6500 .0041 0   unknown prog tests 0 inspect
75.0  91.3 .13  .13  17   .13  0  
reducercommutativity/sep05-1.yml unknown .833  prog tests 5 inspect 23   15   540 260 .0041 0   unknown prog tests 0 inspect
83.3  95.2 .13  .13  17   .14  0  
reducercommutativity/sep10-2.yml unknown .833  prog tests 5 inspect 130   110   990 1300 .0041 0   unknown prog tests 0 inspect
83.3  95.2 .13  .16  16   .14  0  
reducercommutativity/sep20-1.yml out of memory .833  prog tests 2 inspect 310   300   15000 3400 .0041 0   unknown prog tests 0 inspect
83.3  95.2 .12  .12  16   .094 0  
reducercommutativity/sep40-1.yml timeout .833  prog tests 1 inspect 900   880   4000 11000 .0041 0   unknown prog tests 0 inspect
83.3  95.2 .12  .12  16   .078 0  
reducercommutativity/sep60-2.yml timeout .833  prog tests 1 inspect 900   880   4400 12000 .0041 0   unknown prog tests 0 inspect
83.3  95.2 .12  .12  17   .078 0  
reducercommutativity/sum.yml timeout .7    prog tests 1 inspect 900   900   750 11000 .0041 0   unknown prog tests 0 inspect
70.0  95.2 .12  .12  16   .078 0  
reducercommutativity/sum05-2.yml timeout .8    prog tests 1 inspect 900   900   3100 12000 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
reducercommutativity/sum10-1.yml timeout .8    prog tests 1 inspect 900   900   3400 7500 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
reducercommutativity/sum20-2.yml timeout .8    prog tests 1 inspect 900   890   3000 6800 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
reducercommutativity/sum40-2.yml timeout .8    prog tests 1 inspect 900   890   3200 5100 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
reducercommutativity/sum60-2.yml timeout .8    prog tests 1 inspect 900   890   6600 7100 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .15  16   .041 0  
array-tiling/mbpr2.yml true .8    prog tests 7 inspect 3.9 1.8 280 35 .0041 0   unknown prog tests 0 inspect
80.0  91.7 .14  .14  16   .18  0  
array-tiling/mbpr3.yml true .792  prog tests 7 inspect 7.2 4.6 300 75 .0041 0   unknown prog tests 0 inspect
79.2  90.9 .14  .14  17   .18  0  
array-tiling/mbpr4.yml true .786  prog tests 6 inspect 6.3 2.9 300 55 .0041 0   unknown prog tests 0 inspect
78.6  90.9 .14  .13  16   .19  0  
array-tiling/mbpr5.yml true .781  prog tests 6 inspect 10   6.5 310 110 .0041 0   unknown prog tests 0 inspect
78.1  91.2 .15  .15  17   .19  0  
array-tiling/mlceu.yml timeout .667  prog tests 2 inspect 900   890   610 13000 .0041 0   unknown prog tests 0 inspect
66.7  91.7 .12  .12  16   .094 0  
array-tiling/nr2.yml unknown .889  prog tests 8 inspect 4.2 1.9 290 42 .0041 0   unknown prog tests 0 inspect
88.9  100   20     20     17   .20  0  
array-tiling/nr3.yml unknown .889  prog tests 7 inspect 6.5 4.2 290 80 .0041 0   unknown prog tests 0 inspect
88.9  100   .14  .14  16   .18  0  
array-tiling/nr4.yml unknown .889  prog tests 7 inspect 5.2 2.5 280 52 .0041 0   unknown prog tests 0 inspect
88.9  100   20     20     16   .18  0  
array-tiling/nr5.yml unknown .889  prog tests 8 inspect 8.0 5.1 300 82 .0041 0   unknown prog tests 0 inspect
88.9  100   .14  .18  16   .20  0  
array-tiling/pnr2.yml unknown .938  prog tests 9 inspect 3.8 1.7 280 37 .0041 0   unknown prog tests 0 inspect
93.8  100   .14  .14  17   .21  0  
array-tiling/pnr3.yml unknown .944  prog tests 12 inspect 5.3 3.2 290 62 .0041 0   unknown prog tests 0 inspect
94.4  100   .16  .17  16   .26  0  
array-tiling/pnr4.yml unknown .95   prog tests 13 inspect 4.5 2.2 290 44 .0041 0   unknown prog tests 0 inspect
95.0  100   .17  .16  17   .28  0  
array-tiling/pnr5.yml unknown .955  prog tests 11 inspect 6.2 3.8 300 66 .0041 0   unknown prog tests 0 inspect
95.5  100   .16  .18  16   .25  0  
array-tiling/poly1.yml timeout .8    prog tests 2 inspect 900   890   570 13000 .0041 0   unknown prog tests 0 inspect
80.0  100   .12  .12  17   .094 0  
array-tiling/poly2.yml unknown .917  prog tests 4 inspect 4.7 2.7 320 48 .0041 0   unknown prog tests 0 inspect
91.7  100   .12  .12  16   .13  0  
array-tiling/pr2.yml unknown .667  prog tests 10 inspect 4.0 1.9 280 38 .0041 0   unknown prog tests 0 inspect
66.7  90.0 20     20     16   .23  0  
array-tiling/pr3.yml unknown .65   prog tests 6 inspect 4.8 2.8 280 53 .0041 0   unknown prog tests 0 inspect
65.0  87.5 .13  .13  16   .16  0  
array-tiling/pr4.yml unknown .636  prog tests 10 inspect 4.4 2.1 290 44 .0041 0   unknown prog tests 0 inspect
63.6  85.7 .17  .18  16   .23  0  
array-tiling/pr5.yml unknown .625  prog tests 11 inspect 6.7 4.3 300 76 .0041 0   unknown prog tests 0 inspect
62.5  84.4 .16  .15  16   .25  0  
array-tiling/revcpyswp2.yml unknown .938  prog tests 7 inspect 5.2 2.6 300 47 .0041 0   unknown prog tests 0 inspect
93.8  100   .14  .13  16   .18  0  
array-tiling/rew.yml unknown .917  prog tests 5 inspect 3.5 1.6 270 36 .0041 0   unknown prog tests 0 inspect
91.7  100   .13  .14  16   .14  0  
array-tiling/rewnif.yml unknown .917  prog tests 5 inspect 3.8 1.7 270 51 .0041 0   unknown prog tests 0 inspect
91.7  100   .14  .14  16   .14  0  
array-tiling/rewnifrev.yml out of memory .0    prog tests 0 inspect 79   77   15000 1000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .062 9.0 0     0  
array-tiling/rewnifrev2.yml unknown .9    prog tests 5 inspect 3.3 1.5 270 32 .0041 0   unknown prog tests 0 inspect
90.0  100   .13  .18  17   .14  0  
array-tiling/rewrev.yml out of memory .0    prog tests 0 inspect 81   79   15000 950 .0041 0   unknown prog tests 0 inspect
0    0   .062 .063 9.0 0     0  
array-tiling/skipped.yml unknown .944  prog tests 9 inspect 4.7 2.2 280 44 .0041 0   unknown prog tests 0 inspect
94.4  100   .15  .14  16   .21  0  
array-tiling/skippedu.yml unknown 1.0    prog tests 7 inspect 4.4 2.0 280 43 .0041 0   true prog tests 1 inspect
100    100   .14  .14  16   .18  0  
array-tiling/tcpy.yml unknown .929  prog tests 7 inspect 4.8 2.2 290 46 .0041 0   unknown prog tests 0 inspect
92.9  100   .14  .17  17   .18  0  
array-programs/copysome1-1.yml timeout .0    prog tests 0 inspect 930   910   3400 13000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .063 9.0 0     0  
array-programs/copysome1-2.yml timeout .0    prog tests 0 inspect 900   880   6900 11000 .0041 0   unknown prog tests 0 inspect
0    0   .063 .064 8.9 0     0  
array-programs/copysome2-1.yml timeout .0    prog tests 0 inspect 900   880   7200 13000 .0041 0   unknown prog tests 0 inspect
0    0   .059 .059 9.0 0     0  
array-programs/copysome2-2.yml timeout .0    prog tests 0 inspect 900   880   7300 13000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .063 9.0 0     0  
array-crafted/bAnd1.yml timeout .8    prog tests 1 inspect 900   880   3200 11000 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  16   .078 0  
array-crafted/bAnd2.yml timeout .0    prog tests 0 inspect 900   880   6300 12000 .0041 0   unknown prog tests 0 inspect
0    0   .061 .062 8.9 0     0  
array-crafted/bAnd3.yml timeout .0    prog tests 0 inspect 900   870   6400 11000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .062 9.0 0     0  
array-crafted/bAnd4.yml timeout .0    prog tests 0 inspect 900   880   6500 10000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .061 9.0 0     0  
array-crafted/bAnd5.yml timeout .833  prog tests 4 inspect 900   900   910 13000 .0041 0   unknown prog tests 0 inspect
83.3  95.7 .13  .12  16   .13  0  
array-crafted/bor1.yml timeout .8    prog tests 1 inspect 900   880   3300 8300 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
array-crafted/bor2.yml timeout .0    prog tests 0 inspect 900   880   6300 9800 .0041 0   unknown prog tests 0 inspect
0    0   .061 .061 8.9 0     0  
array-crafted/bor3.yml timeout .0    prog tests 0 inspect 900   880   6400 12000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .062 9.0 0     0  
array-crafted/bor4.yml timeout .0    prog tests 0 inspect 900   880   6500 13000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .061 8.9 0     0  
array-crafted/bor5.yml unknown .833  prog tests 5 inspect 5.0 2.4 300 47 .0041 0   unknown prog tests 0 inspect
83.3  95.7 .13  .13  17   .14  0  
array-crafted/mapavg1.yml out of memory .8    prog tests 1 inspect 330   310   15000 4200 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
array-crafted/mapavg2.yml timeout .0    prog tests 0 inspect 900   880   5100 13000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .062 9.0 0     0  
array-crafted/mapavg3.yml timeout .0    prog tests 0 inspect 900   880   5200 11000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .062 9.0 0     0  
array-crafted/mapavg4.yml timeout .0    prog tests 0 inspect 900   880   5300 13000 .0041 0   unknown prog tests 0 inspect
0    0   .058 .059 9.0 0     0  
array-crafted/mapavg5.yml unknown .75   prog tests 3 inspect 470   460   500 5000 .0041 0   unknown prog tests 0 inspect
75.0  95.7 .12  .12  16   .11  0  
array-crafted/mapsum1.yml timeout .8    prog tests 1 inspect 900   880   3900 9700 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
array-crafted/mapsum2.yml timeout .0    prog tests 0 inspect 900   880   6300 11000 .0041 0   unknown prog tests 0 inspect
0    0   .059 .060 9.0 0     0  
array-crafted/mapsum3.yml timeout .0    prog tests 0 inspect 930   900   37 11000 0      0   unknown prog tests 0 inspect
0    0   .062 .062 9.0 0     0  
array-crafted/mapsum4.yml timeout .0    prog tests 0 inspect 900   880   6500 13000 .0041 0   unknown prog tests 0 inspect
0    0   .059 .060 9.0 0     0  
array-crafted/mapsum5.yml unknown .833  prog tests 5 inspect 240   240   770 2800 .0041 0   unknown prog tests 0 inspect
83.3  95.7 .14  .16  16   .11  0  
array-crafted/xor1.yml timeout .8    prog tests 1 inspect 900   880   3000 7500 .0041 0   unknown prog tests 0 inspect
80.0  94.7 .12  .12  17   .078 0  
array-crafted/xor2.yml timeout .0    prog tests 0 inspect 900   880   6300 12000 .0041 0   unknown prog tests 0 inspect
0    0   .064 .065 8.9 0     0  
array-crafted/xor3.yml timeout .0    prog tests 0 inspect 900   880   6400 12000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .060 8.9 0     0  
array-crafted/xor4.yml timeout .0    prog tests 0 inspect 900   880   6500 12000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .063 9.0 0     0  
array-crafted/xor5.yml unknown .833  prog tests 5 inspect 5.2 2.4 290 52 .0041 0   unknown prog tests 0 inspect
83.3  95.7 .13  .13  16   .14  0  
array-crafted/zero_sum1.yml timeout .8    prog tests 3 inspect 900   900   950 7700 .0041 0   unknown prog tests 0 inspect
80.0  100   .13  .15  17   .11  0  
array-crafted/zero_sum2.yml unknown .929  prog tests 8 inspect 7.2 4.6 360 86 .0041 0   unknown prog tests 0 inspect
92.9  100   .15  .17  16   .19  0  
array-crafted/zero_sum3.yml unknown .944  prog tests 7 inspect 12   8.9 400 140 .0041 0   unknown prog tests 0 inspect
94.4  100   .14  .13  16   .18  0  
array-crafted/zero_sum4.yml unknown .955  prog tests 11 inspect 15   12   460 160 .0041 0   unknown prog tests 0 inspect
95.5  100   .15  .14  16   .25  0  
array-crafted/zero_sum5.yml unknown .962  prog tests 9 inspect 22   18   550 270 .0041 0   unknown prog tests 0 inspect
96.2  100   .17  .17  16   .21  0  
array-crafted/zero_sum_const1.yml timeout .75   prog tests 1 inspect 900   900   610 13000 .0041 0   unknown prog tests 0 inspect
75.0  100   .12  .12  16   .078 0  
array-crafted/zero_sum_const2.yml unknown .938  prog tests 5 inspect 8.8 6.4 320 110 .0041 0   unknown prog tests 0 inspect
93.8  100   .13  .13  16   .14  0  
array-crafted/zero_sum_const3.yml unknown .95   prog tests 6 inspect 9.7 7.2 330 120 .0041 0   unknown prog tests 0 inspect
95.0  100   .13  .13  16   .16  0  
array-crafted/zero_sum_const4.yml unknown .958  prog tests 9 inspect 15   11   360 180 .0041 0   unknown prog tests 0 inspect
95.8  100   .16  .16  16   .21  0  
array-crafted/zero_sum_const5.yml unknown .964  prog tests 8 inspect 18   14   400 190 .0041 0   unknown prog tests 0 inspect
96.4  100   .15  .14  16   .20  0  
array-crafted/zero_sum_const_m2.yml timeout .812  prog tests 2 inspect 900   900   1500 9800 .0041 0   unknown prog tests 0 inspect
81.2  100   .12  .12  16   .094 0  
array-crafted/zero_sum_const_m3.yml unknown .95   prog tests 6 inspect 28   26   710 400 .0041 0   unknown prog tests 0 inspect
95.0  100   .14  .14  16   .16  0  
array-crafted/zero_sum_const_m4.yml unknown .958  prog tests 9 inspect 300   300   1400 4000 .0041 0   unknown prog tests 0 inspect
95.8  100   .15  .17  16   .20  0  
array-crafted/zero_sum_const_m5.yml timeout .964  prog tests 8 inspect 900   900   970 12000 .0041 0   unknown prog tests 0 inspect
96.4  100   .16  .15  17   .20  0  
array-crafted/zero_sum_m2.yml unknown .857  prog tests 6 inspect 730   720   4200 8600 .0041 0   unknown prog tests 0 inspect
85.7  100   .14  .17  16   .16  0  
array-crafted/zero_sum_m3.yml timeout .889  prog tests 4 inspect 900   900   1100 7800 .0041 0   unknown prog tests 0 inspect
88.9  100   .12  .12  17   .13  0  
array-crafted/zero_sum_m4.yml timeout .909  prog tests 5 inspect 900   900   2000 9900 .0041 0   unknown prog tests 0 inspect
90.9  100   .14  .14  16   .15  0  
array-crafted/zero_sum_m5.yml timeout .962  prog tests 9 inspect 900   900   9500 9100 .0041 0   unknown prog tests 0 inspect
96.2  100   .14  .14  16   .21  0  
array-multidimensional/add-2-n-u.yml timeout .0    prog tests 1 inspect 900   880   6100 12000 .0041 0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/add-3-n-u.yml timeout .0    prog tests 1 inspect 900   870   6200 13000 .0041 0   unknown prog tests 0 inspect
0    0   .12  .13  16   .090 0  
array-multidimensional/copy-2-u.yml timeout .143  prog tests 1 inspect 900   870   6700 11000 .0041 0   unknown prog tests 0 inspect
14.3  32.4 .13  .13  17   .082 0  
array-multidimensional/copy-3-n-u.yml timeout .0    prog tests 0 inspect 900   880   6700 13000 .0041 0   unknown prog tests 0 inspect
0    0   .061 .062 9.0 0     0  
array-multidimensional/copy-partial-2-n-u.yml timeout .0    prog tests 0 inspect 900   870   6700 12000 .0041 0   unknown prog tests 0 inspect
0    0   .063 .063 9.0 0     0  
array-multidimensional/copy-partial-3-u.yml timeout .0    prog tests 1 inspect 900   880   6100 11000 .0041 0   unknown prog tests 0 inspect
0    0   .12  .12  17   .086 0  
array-multidimensional/diff-2-n-u.yml timeout .0    prog tests 1 inspect 900   870   6100 11000 .0041 0   unknown prog tests 0 inspect
0    0   .12  .12  16   .086 0  
array-multidimensional/diff-3-n-u.yml timeout .0    prog tests 1 inspect 900   870   6100 11000 .0041 0   unknown prog tests 0 inspect
0    0   .12  .12  17   .090 0  
array-multidimensional/init-2-n-u.yml timeout .9    prog tests 1 inspect 900   880   5700 12000 .0041 0   unknown prog tests 0 inspect
90.0  96.2 .13  .13  17   .078 0  
array-multidimensional/init-3-u.yml timeout .0    prog tests 1 inspect 900   870   6600 10000 .0041 0   unknown prog tests 0 inspect
0    0   .12  .12  16   .082 0  
array-multidimensional/init-4-n-u.yml timeout .0    prog tests 0 inspect 900   880   6500 11000 .0041 0   unknown prog tests 0 inspect
0    0   .070 .071 8.9 0     0  
array-multidimensional/init-non-constant-2-n-u.yml unknown .9    prog tests 6 inspect 5.4 2.4 290 49 .0041 0   unknown prog tests 0 inspect
90.0  96.7 .18  .22  17   .16  0  
array-multidimensional/init-non-constant-3-u.yml timeout .0    prog tests 1 inspect 900   880   6600 11000 .0041 0   unknown prog tests 0 inspect
0    0   .12  .12  17   .082 0  
array-multidimensional/max-2-u.yml timeout .0    prog tests 0 inspect 900   880   6200 11000 .0041 0   unknown prog tests 0 inspect
0    0   .061 .062 8.9 0     0  
array-multidimensional/max-3-n-u.yml timeout .0    prog tests 0 inspect 900   880   6100 12000 .0041 0   unknown prog tests 0 inspect
0    0   .064 .064 9.0 0     0  
array-multidimensional/min-2-u.yml timeout .0    prog tests 0 inspect 900   870   6200 11000 .0041 0   unknown prog tests 0 inspect
0    0   .060 .062 9.0 0     0  
array-multidimensional/min-3-n-u.yml timeout .0    prog tests 0 inspect 900   870   6100 12000 .0041 0   unknown prog tests 0 inspect
0    0   .071 .072 9.1 0     0  
array-multidimensional/rev-2-n-u.yml timeout .0    prog tests 1 inspect 900   880   6000 11000 .0041 0   unknown prog tests 0 inspect
0    0   .11  .11  16   .082 0  
array-multidimensional/rev-3-u.yml timeout .0    prog tests 0 inspect 900   880   6700 11000 .0041 0   unknown prog tests 0 inspect
0    0   .058 .059 9.0 0     0  
array-multidimensional/transpose-u.yml timeout .0    prog tests 0 inspect 900   880   6600 12000 .0041 0   unknown prog tests 0 inspect
0    0   .062 .062 9.0 0     0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 169 75.9  110000 100000 740000 1300000 .69  0   169 7590 8860 78 79 2300 14 0  
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Arrays