Benchmark CPA/CoVeriTest TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30375 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon049; apollon085; apollon116]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-06 05:30:26 CET
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options -benchmark -heap 10000M -testcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/coveritest.2019-02-05_2105.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/sanfoundry_10_ground.yml .0556 900 880   1400 13000 .0082 0   5.56 40.0 .11  .11  17   .078 0  
array-examples/sanfoundry_24-1.yml .917  24 18   1300 310 .17   0   91.7  100   .15  .15  16   .21  0  
array-examples/standard_copy1_ground-1.yml .125  900 880   2600 11000 .0041 0   12.5  33.3 .11  .11  16   .078 0  
array-examples/standard_copy1_ground-2.yml .125  900 880   2700 12000 .0041 0   12.5  30.0 .12  .14  16   .078 0  
array-examples/standard_copy2_ground-1.yml .1    900 880   3000 10000 .0041 0   10.0  25.0 .11  .11  16   .078 0  
array-examples/standard_copy2_ground-2.yml .1    900 880   2500 12000 .0041 0   10.0  27.3 .13  .13  16   .078 0  
array-examples/standard_copy3_ground-1.yml .0833 900 880   3100 12000 .0041 0   8.33 23.1 .12  .12  16   .078 0  
array-examples/standard_copy3_ground-2.yml .0833 900 880   3100 13000 .0041 0   8.33 21.4 .12  .15  16   .078 0  
array-examples/standard_copy4_ground-1.yml .0714 900 880   3700 11000 .0041 0   7.14 20.0 .12  .12  17   .078 0  
array-examples/standard_copy4_ground-2.yml .0714 900 880   3300 12000 .0041 0   7.14 18.8 .12  .12  16   .078 0  
array-examples/standard_copy5_ground-1.yml .0625 900 880   3400 13000 .0041 0   6.25 17.6 .12  .12  17   .078 0  
array-examples/standard_copy5_ground-2.yml .0625 900 880   3200 12000 .0041 0   6.25 16.7 .11  .11  16   .078 0  
array-examples/standard_copy6_ground-1.yml .0556 900 880   3600 12000 .0041 0   5.56 15.0 .12  .12  16   .078 0  
array-examples/standard_copy6_ground-2.yml .0556 900 880   4200 12000 .0041 0   5.56 15.8 .12  .12  16   .078 0  
array-examples/standard_copy7_ground-1.yml .05   900 880   3600 11000 .0041 0   5.00 13.6 .12  .12  16   .082 0  
array-examples/standard_copy7_ground-2.yml .05   900 880   4000 13000 .0041 0   5.00 14.3 .12  .12  16   .082 0  
array-examples/standard_copy8_ground-1.yml .0455 900 880   4600 13000 .0041 0   4.55 13.0 .13  .13  16   .082 0  
array-examples/standard_copy8_ground-2.yml .0455 900 880   4700 10000 .0041 0   4.55 12.5 .12  .12  16   .082 0  
array-examples/standard_copy9_ground-1.yml .0417 900 890   5700 11000 .0041 0   4.17 11.5 .12  .12  17   .082 0  
array-examples/standard_copy9_ground-2.yml .0417 900 880   4600 11000 .0041 0   4.17 12.0 .12  .12  17   .082 0  
array-examples/standard_copyInitSum_ground.yml .9    900 890   2000 9800 .0041 0   90.0  100   .12  .12  16   .078 0  
array-examples/standard_find_ground-1.yml .1    900 880   2400 12000 .0082 0   10.0  45.5 .12  .12  16   .078 0  
array-examples/standard_partition_ground-1.yml .214  900 880   3700 11000 .025  0   21.4  45.5 .12  .12  17   .11  0  
array-examples/standard_sentinel-2.yml .1    900 880   4000 13000 .0041 0   10.0  38.5 .12  .12  16   .078 0  
array-examples/standard_sentinel.i.v+cfa-reducer.yml .1    900 880   2400 13000 .0041 0   10.0  22.7 .11  .12  17   .078 0  
array-examples/standard_strcpy_ground-1.yml .1    900 880   2700 12000 .0082 0   10.0  38.5 .12  .12  16   .078 0  
array-examples/standard_strcpy_original-2.yml .0833 900 880   2200 11000 .0082 0   8.33 33.3 .13  .13  16   .078 0  
array-examples/standard_two_index_01.yml .125  900 560   8500 9600 39      0   12.5  26.3 .12  .12  17   .078 0  
array-examples/standard_two_index_02.yml .125  900 880   2800 11000 .0082 0   12.5  26.3 .12  .12  17   .078 0  
array-examples/standard_two_index_03.yml .125  900 590   8300 8400 51      0   12.5  26.3 .11  .11  16   .078 0  
array-examples/standard_two_index_04.yml .125  900 880   2500 11000 .0082 0   12.5  26.3 .11  .11  16   .078 0  
array-examples/standard_two_index_05.yml .125  900 880   3000 9500 .0082 0   12.5  26.3 .13  .13  16   .078 0  
array-examples/standard_two_index_06.yml .125  900 600   5900 8900 52      0   12.5  26.3 .11  .11  16   .078 0  
array-examples/standard_two_index_07.yml .125  900 880   2900 13000 .0082 0   12.5  26.3 .12  .12  16   .078 0  
array-examples/standard_two_index_08.yml .125  900 880   2400 12000 .0082 0   12.5  26.3 .12  .12  16   .078 0  
array-examples/standard_two_index_09.yml .125  900 880   3000 11000 .0082 0   12.5  26.3 .12  .12  16   .078 0  
array-industry-pattern/array_monotonic.yml .3    900 880   3000 11000 .020  0   30.0  55.6 .12  .12  17   .11  0  
array-industry-pattern/array_mul_init.yml .214  900 890   2000 13000 .0041 0   21.4  50.0 .12  .12  17   .078 0  
array-industry-pattern/array_of_struct_break.yml .0    900 890   4300 5900 .0082 0   0    0   .060 .061 9.0 0     0  
array-industry-pattern/array_of_struct_ptr_mul_init.yml .0    900 890   6400 12000 .0041 0   0    0   .070 .071 9.0 0     0  
array-industry-pattern/array_of_struct_single_elem_init.yml .0    900 890   8000 11000 .0041 0   0    0   .059 .060 9.0 0     0  
array-industry-pattern/array_ptr_single_elem_init-2.yml .5    900 880   3500 14000 .049  0   50.0  64.7 .14  .14  16   .16  0  
array-industry-pattern/array_shadowinit.yml .875  900 850   2800 9600 5.3    0   87.5  100   .14  .23  17   .18  0  
array-industry-pattern/array_single_elem_init.yml .5    900 880   3500 12000 .037  0   50.0  64.7 .14  .16  16   .16  0  
reducercommutativity/avg.yml .8    200 150   6900 2200 1.6    0   80.0  95.2 .14  .14  16   .16  0  
reducercommutativity/avg05-1.yml .8    900 890   3200 8000 .13   0   80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/avg10-2.yml .8    900 880   2900 9100 .37   0   80.0  94.7 .14  .16  16   .16  0  
reducercommutativity/avg20-2.yml .8    900 870   4100 12000 1.1    0   80.0  94.7 .14  .14  17   .16  0  
reducercommutativity/avg40-2.yml .8    900 860   7500 11000 2.0    0   80.0  94.7 .14  .14  17   .16  0  
reducercommutativity/avg60-1.yml .8    900 860   9700 7500 1.7    0   80.0  94.7 .14  .14  16   .13  0  
reducercommutativity/max.yml .8    900 880   1000 10000 1.8    0   80.0  95.2 .14  .14  17   .19  0  
reducercommutativity/max05-1.yml .8    900 880   2600 7900 .43   0   80.0  94.7 .15  .14  16   .19  0  
reducercommutativity/max10-1.yml .8    900 890   2900 6000 .15   0   80.0  94.7 .14  .14  16   .19  0  
reducercommutativity/max20-1.yml .8    900 890   1100 5100 .16   0   80.0  94.7 .15  .15  16   .19  0  
reducercommutativity/max40-1.yml .8    900 880   1400 5500 .28   0   80.0  94.7 .15  .16  16   .16  0  
reducercommutativity/max60-2.yml .8    900 870   5100 7200 .86   0   80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/rangesum.yml .875  900 770   4700 10000 47      0   87.5  96.8 .16  .15  16   .25  0  
reducercommutativity/rangesum05.yml .786  900 880   2100 8500 .58   0   78.6  92.6 .15  .15  16   .18  0  
reducercommutativity/rangesum10.yml .786  900 870   3000 7500 .95   0   78.6  92.6 .15  .18  16   .18  0  
reducercommutativity/rangesum20.yml .786  900 860   4500 7300 1.7    0   78.6  92.6 .14  .14  16   .18  0  
reducercommutativity/rangesum40.yml .786  900 840   5200 9700 3.2    0   78.6  92.6 .15  .15  16   .18  0  
reducercommutativity/rangesum60.yml .786  900 850   5300 9900 3.5    0   78.6  92.6 .15  .18  17   .16  0  
reducercommutativity/sep.yml .75   900 790   4600 14000 48      0   75.0  91.3 .14  .14  16   .18  0  
reducercommutativity/sep05-1.yml .833  900 780   5400 8400 40      0   83.3  95.2 .14  .16  17   .19  0  
reducercommutativity/sep10-2.yml .833  900 830   5700 5600 18      0   83.3  95.2 .14  .15  17   .18  0  
reducercommutativity/sep20-1.yml .833  900 880   5700 7400 .14   0   83.3  95.2 .14  .14  16   .18  0  
reducercommutativity/sep40-1.yml .833  900 860   5800 10000 .14   0   83.3  95.2 .14  .14  16   .16  0  
reducercommutativity/sep60-2.yml .833  900 860   2700 13000 .19   0   83.3  95.2 .16  .16  16   .14  0  
reducercommutativity/sum.yml .8    900 880   2400 10000 1.8    0   80.0  95.2 .13  .13  16   .16  0  
reducercommutativity/sum05-2.yml .8    900 880   2400 11000 .36   0   80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/sum10-1.yml .8    900 890   4000 11000 .20   0   80.0  94.7 .15  .16  17   .16  0  
reducercommutativity/sum20-2.yml .8    900 880   4900 8000 .44   0   80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/sum40-2.yml .8    900 860   10000 13000 2.0    0   80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/sum60-2.yml .8    900 860   11000 11000 1.7    0   80.0  94.7 .13  .13  16   .13  0  
array-tiling/mbpr2.yml .8    900 790   5200 12000 49      0   80.0  91.7 .15  .15  17   .23  0  
array-tiling/mbpr3.yml .792  900 830   4400 10000 26      0   79.2  90.9 .16  .16  17   .27  0  
array-tiling/mbpr4.yml .786  900 770   5200 9200 40      0   78.6  90.9 .18  .17  16   .35  0  
array-tiling/mbpr5.yml .781  900 810   5200 13000 27      0   78.1  91.2 .19  .18  16   .40  0  
array-tiling/mlceu.yml .833  900 800   5100 11000 39      0   83.3  91.7 .13  .12  16   .16  0  
array-tiling/nr2.yml .889  900 810   5400 9900 36      0   88.9  100   100     100     16   .25  0  
array-tiling/nr3.yml .889  900 840   3100 10000 18      0   88.9  100   .15  .14  16   .25  0  
array-tiling/nr4.yml .889  900 810   4600 10000 40      0   88.9  100   100     100     16   .25  0  
array-tiling/nr5.yml .889  900 840   3500 12000 20      0   88.9  100   .16  .17  16   .25  0  
array-tiling/pnr2.yml .938  900 820   2700 13000 9.4    0   93.8  100   .16  .16  17   .26  0  
array-tiling/pnr3.yml .944  900 830   3100 12000 18      0   94.4  100   .16  .16  17   .29  0  
array-tiling/pnr4.yml .95   900 810   5100 13000 38      0   95.0  100   .18  .17  16   .33  0  
array-tiling/pnr5.yml .955  900 840   2800 9200 13      0   95.5  100   .19  .19  16   .36  0  
array-tiling/poly1.yml .9    900 810   5100 8500 37      0   90.0  100   .13  .14  16   .16  0  
array-tiling/poly2.yml .917  900 800   4500 7900 42      0   91.7  100   .15  .14  16   .19  0  
array-tiling/pr2.yml .667  900 860   2200 10000 2.1    0   66.7  90.0 100     100     16   .26  0  
array-tiling/pr3.yml .65   900 850   4200 11000 5.8    0   65.0  87.5 .17  .17  17   .29  0  
array-tiling/pr4.yml .636  900 860   3400 13000 2.5    0   63.6  85.7 180     180     17   .33  0  
array-tiling/pr5.yml .625  900 880   980 13000 .52   0   62.5  84.4 .17  .17  16   .36  0  
array-tiling/revcpyswp2.yml .938  24 16   810 220 .13   0   93.8  100   .20  .19  17   .31  0  
array-tiling/rew.yml .917  900 790   4700 10000 42      0   91.7  100   .14  .14  17   .18  0  
array-tiling/rewnif.yml .917  900 790   5600 12000 38      0   91.7  100   .14  .13  17   .18  0  
array-tiling/rewnifrev.yml .917  100 84   15000 1100 2.5    0   91.7  100   .13  .13  16   .13  0  
array-tiling/rewnifrev2.yml .9    98 93   15000 1300 .029  0   90.0  100   .13  .12  16   .13  0  
array-tiling/rewrev.yml .917  97 80   15000 1300 2.1    0   91.7  100   .13  .13  16   .13  0  
array-tiling/skipped.yml .944  900 800   5100 12000 53      0   94.4  100   .16  .16  16   .26  0  
array-tiling/skippedu.yml 1.0    25 7.1 960 200 1.7    0   100    100   .19  .18  16   .31  0  
array-tiling/tcpy.yml .929  900 800   5000 13000 37      0   92.9  100   .15  .20  16   .20  0  
array-programs/copysome1-1.yml .0833 900 880   3400 12000 .0082 0   8.33 30.8 .11  .11  16   .078 0  
array-programs/copysome1-2.yml .0833 900 880   3900 10000 .0082 0   8.33 28.6 .12  .12  17   .078 0  
array-programs/copysome2-1.yml .0714 900 880   4100 11000 .0082 0   7.14 23.5 .12  .12  16   .078 0  
array-programs/copysome2-2.yml .0714 900 880   4200 11000 .0082 0   7.14 23.5 .12  .13  16   .078 0  
array-crafted/bAnd1.yml .8    900 860   3600 10000 1.9    0   80.0  94.7 .13  .13  16   .11  0  
array-crafted/bAnd2.yml .1    900 820   5600 13000 9.1    0   10.0  15.8 .11  .11  16   .078 0  
array-crafted/bAnd3.yml .1    900 650   9100 9000 65      0   10.0  15.8 .12  .12  17   .078 0  
array-crafted/bAnd4.yml .1    900 880   2400 12000 .0041 0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/bAnd5.yml .833  900 880   1900 11000 1.9    0   83.3  95.7 .15  .14  17   .19  0  
array-crafted/bor1.yml .8    900 860   3800 12000 1.9    0   80.0  94.7 .13  .13  16   .11  0  
array-crafted/bor2.yml .1    900 810   6000 11000 8.6    0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/bor3.yml .1    900 640   9000 9200 72      0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/bor4.yml .1    900 880   2500 10000 .0041 0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/bor5.yml .833  900 790   5100 10000 51      0   83.3  95.7 .14  .13  16   .19  0  
array-crafted/mapavg1.yml .8    900 860   3800 11000 1.9    0   80.0  94.7 .12  .12  16   .11  0  
array-crafted/mapavg2.yml .1    900 810   5800 12000 8.9    0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapavg3.yml .1    900 640   5900 9200 73      0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapavg4.yml .1    900 880   2500 11000 .0041 0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapavg5.yml .833  900 810   5100 9100 29      0   83.3  95.7 .14  .14  16   .20  0  
array-crafted/mapsum1.yml .8    900 860   3100 10000 1.9    0   80.0  94.7 .13  .13  16   .11  0  
array-crafted/mapsum2.yml .1    900 810   5900 12000 9.0    0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapsum3.yml .1    900 550   8400 7300 52      0   10.0  15.8 .12  .13  16   .078 0  
array-crafted/mapsum4.yml .1    900 880   2600 8900 .0041 0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/mapsum5.yml .833  900 780   5300 11000 49      0   83.3  95.7 .15  .15  16   .20  0  
array-crafted/xor1.yml .8    900 860   3800 12000 1.9    0   80.0  94.7 .13  .13  16   .11  0  
array-crafted/xor2.yml .1    900 820   5800 11000 8.9    0   10.0  15.8 .12  .12  16   .078 0  
array-crafted/xor3.yml .1    900 610   6700 8400 71      0   10.0  15.8 .12  .12  17   .078 0  
array-crafted/xor4.yml .1    900 880   2500 12000 .0041 0   10.0  15.8 .15  .15  16   .078 0  
array-crafted/xor5.yml .833  900 780   5500 12000 52      0   83.3  95.7 .15  .14  17   .19  0  
array-crafted/zero_sum1.yml .9    900 880   2000 6100 2.0    0   90.0  100   .14  .14  16   .19  0  
array-crafted/zero_sum2.yml .929  29 9.3 930 250 2.0    0   92.9  100   .15  .17  16   .26  0  
array-crafted/zero_sum3.yml .944  33 14   1100 330 2.1    0   94.4  100   .19  .18  16   .33  0  
array-crafted/zero_sum4.yml .955  37 16   1200 360 2.0    0   95.5  100   .18  .17  16   .39  0  
array-crafted/zero_sum5.yml .962  42 22   1200 400 2.1    0   96.2  100   .20  .19  17   .46  0  
array-crafted/zero_sum_const1.yml .917  900 890   950 14000 .11   0   91.7  100   .15  .14  17   .21  0  
array-crafted/zero_sum_const2.yml .938  28 21   870 320 .11   0   93.8  100   .17  .17  16   .27  0  
array-crafted/zero_sum_const3.yml .95   29 22   680 280 .11   0   95.0  100   .18  .17  16   .34  0  
array-crafted/zero_sum_const4.yml .958  31 24   910 360 .11   0   95.8  100   .21  .20  16   .41  0  
array-crafted/zero_sum_const5.yml .964  35 28   890 380 .11   0   96.4  100   .21  .20  16   .48  0  
array-crafted/zero_sum_const_m2.yml .938  900 890   1500 9900 .11   0   93.8  100   .16  .15  16   .27  0  
array-crafted/zero_sum_const_m3.yml .95   48 40   1200 640 .11   0   95.0  100   .17  .18  16   .34  0  
array-crafted/zero_sum_const_m4.yml .958  900 860   3300 9800 3.9    0   95.8  100   .19  .22  16   .41  0  
array-crafted/zero_sum_const_m5.yml .964  900 890   1500 12000 .11   0   96.4  100   .21  .20  16   .48  0  
array-crafted/zero_sum_m2.yml .929  900 840   4900 9700 10      0   92.9  100   .15  .15  16   .26  0  
array-crafted/zero_sum_m3.yml .944  910 890   1800 9300 2.1    0   94.4  100   .17  .16  16   .33  0  
array-crafted/zero_sum_m4.yml .955  900 880   2200 11000 1.7    0   95.5  100   .19  .18  16   .39  0  
array-crafted/zero_sum_m5.yml .962  900 880   10000 12000 2.0    0   96.2  100   .20  .18  16   .46  0  
array-multidimensional/add-2-n-u.yml .0    900 790   6500 11000 15      0   0    0   .12  .12  16   .082 0  
array-multidimensional/add-3-n-u.yml .0    900 790   6400 11000 20      0   0    0   .12  .12  16   .090 0  
array-multidimensional/copy-2-u.yml .143  900 820   6100 11000 8.7    0   14.3  32.4 .12  .12  16   .098 0  
array-multidimensional/copy-3-n-u.yml .0    900 790   6400 11000 21      0   0    0   .12  .12  16   .086 0  
array-multidimensional/copy-partial-2-n-u.yml .0    900 790   6200 12000 15      0   0    0   .12  .12  16   .082 0  
array-multidimensional/copy-partial-3-u.yml .0    900 830   6300 11000 8.9    0   0    0   .12  .13  16   .086 0  
array-multidimensional/diff-2-n-u.yml .0    900 790   6200 11000 16      0   0    0   .12  .12  16   .086 0  
array-multidimensional/diff-3-n-u.yml .0    900 800   6600 11000 21      0   0    0   .12  .12  16   .090 0  
array-multidimensional/init-2-n-u.yml .9    900 790   6500 11000 16      0   90.0  96.2 .15  .15  17   .094 0  
array-multidimensional/init-3-u.yml .0    900 820   6500 11000 9.8    0   0    0   .12  .12  16   .082 0  
array-multidimensional/init-4-n-u.yml .0    900 780   6700 11000 21      0   0    0   .12  .12  16   .082 0  
array-multidimensional/init-non-constant-2-n-u.yml .9    900 810   4700 10000 25      0   90.0  96.7 .15  .15  16   .23  0  
array-multidimensional/init-non-constant-3-u.yml .0    900 830   6500 12000 9.3    0   0    0   .12  .12  16   .082 0  
array-multidimensional/max-2-u.yml .0    900 800   6200 12000 16      0   0    0   .12  .12  16   .082 0  
array-multidimensional/max-3-n-u.yml .0    900 790   6300 12000 22      0   0    0   .12  .12  17   .082 0  
array-multidimensional/min-2-u.yml .0    900 790   6300 11000 15      0   0    0   .12  .12  16   .082 0  
array-multidimensional/min-3-n-u.yml .0    900 790   6300 11000 23      0   0    0   .12  .12  16   .082 0  
array-multidimensional/rev-2-n-u.yml .0    900 800   6200 11000 15      0   0    0   .12  .12  17   .082 0  
array-multidimensional/rev-3-u.yml .0    900 810   3100 11000 2.9    0   0    0   .12  .12  16   .086 0  
array-multidimensional/transpose-u.yml .143  900 820   6500 11000 9.3    0   14.3  40.9 .12  .12  17   .098 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 169 84.7 140000 130000 740000 1600000 1900 0   169 8470 10300 510 510 2800 27 0  
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays