Benchmark CPA/CoVeriTest TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30375 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon049; apollon085; apollon116]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-06 05:30:26 CET
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options -benchmark -heap 10000M -testcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/coveritest.2019-02-05_2105.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/sanfoundry_10_ground.yml .0556 900 880   1400 13000 .0082 0   5.56 40.0 .11  .11  17   .078 0  
array-examples/sanfoundry_24-1.yml .917  24 18   1300 310 .17   0   91.7  100   .15  .15  16   .21  0  
array-examples/standard_copy1_ground-1.yml .125  900 880   2600 11000 .0041 0   12.5  33.3 .11  .11  16   .078 0  
array-examples/standard_copy1_ground-2.yml .125  900 880   2700 12000 .0041 0   12.5  30.0 .12  .14  16   .078 0  
array-examples/standard_copy2_ground-1.yml .1    900 880   3000 10000 .0041 0   10.0  25.0 .11  .11  16   .078 0  
array-examples/standard_copy2_ground-2.yml .1    900 880   2500 12000 .0041 0   10.0  27.3 .13  .13  16   .078 0  
array-examples/standard_copy3_ground-1.yml .0833 900 880   3100 12000 .0041 0   8.33 23.1 .12  .12  16   .078 0  
array-examples/standard_copy3_ground-2.yml .0833 900 880   3100 13000 .0041 0   8.33 21.4 .12  .15  16   .078 0  
array-examples/standard_copy4_ground-1.yml .0714 900 880   3700 11000 .0041 0   7.14 20.0 .12  .12  17   .078 0  
array-examples/standard_copy4_ground-2.yml .0714 900 880   3300 12000 .0041 0   7.14 18.8 .12  .12  16   .078 0  
array-examples/standard_copy5_ground-1.yml .0625 900 880   3400 13000 .0041 0   6.25 17.6 .12  .12  17   .078 0  
array-examples/standard_copy5_ground-2.yml .0625 900 880   3200 12000 .0041 0   6.25 16.7 .11  .11  16   .078 0  
array-examples/standard_copy6_ground-1.yml .0556 900 880   3600 12000 .0041 0   5.56 15.0 .12  .12  16   .078 0  
array-examples/standard_copy6_ground-2.yml .0556 900 880   4200 12000 .0041 0   5.56 15.8 .12  .12  16   .078 0  
array-examples/standard_copy7_ground-1.yml .05   900 880   3600 11000 .0041 0   5.00 13.6 .12  .12  16   .082 0  
array-examples/standard_copy7_ground-2.yml .05   900 880   4000 13000 .0041 0   5.00 14.3 .12  .12  16   .082 0  
array-examples/standard_copy8_ground-1.yml .0455 900 880   4600 13000 .0041 0   4.55 13.0 .13  .13  16   .082 0  
array-examples/standard_copy8_ground-2.yml .0455 900 880   4700 10000 .0041 0   4.55 12.5 .12  .12  16   .082 0  
array-examples/standard_copy9_ground-1.yml .0417 900 890   5700 11000 .0041 0   4.17 11.5 .12  .12  17   .082 0  
array-examples/standard_copy9_ground-2.yml .0417 900 880   4600 11000 .0041 0   4.17 12.0 .12  .12  17   .082 0  
array-examples/standard_copyInitSum_ground.yml .9    900 890   2000 9800 .0041 0   90.0  100   .12  .12  16   .078 0  
array-examples/standard_find_ground-1.yml .1    900 880   2400 12000 .0082 0   10.0  45.5 .12  .12  16   .078 0  
array-examples/standard_partition_ground-1.yml .214  900 880   3700 11000 .025  0   21.4  45.5 .12  .12  17   .11  0  
array-examples/standard_sentinel-2.yml .1    900 880   4000 13000 .0041 0   10.0  38.5 .12  .12  16   .078 0  
array-examples/standard_sentinel.i.v+cfa-reducer.yml .1    900 880   2400 13000 .0041 0   10.0  22.7 .11  .12  17   .078 0  
array-examples/standard_strcpy_ground-1.yml .1    900 880   2700 12000 .0082 0   10.0  38.5 .12  .12  16   .078 0  
array-examples/standard_strcpy_original-2.yml .0833 900 880   2200 11000 .0082 0   8.33 33.3 .13  .13  16   .078 0  
array-examples/standard_two_index_01.yml .125  900 560   8500 9600 39      0   12.5  26.3 .12  .12  17   .078 0  
array-examples/standard_two_index_02.yml .125  900 880   2800 11000 .0082 0   12.5  26.3 .12  .12  17   .078 0  
array-examples/standard_two_index_03.yml .125  900 590   8300 8400 51      0   12.5  26.3 .11  .11  16   .078 0  
array-examples/standard_two_index_04.yml .125  900 880   2500 11000 .0082 0   12.5  26.3 .11  .11  16   .078 0  
array-examples/standard_two_index_05.yml .125  900 880   3000 9500 .0082 0   12.5  26.3 .13  .13  16   .078 0  
array-examples/standard_two_index_06.yml .125  900 600   5900 8900 52      0   12.5  26.3 .11  .11  16   .078 0  
array-examples/standard_two_index_07.yml .125  900 880   2900 13000 .0082 0   12.5  26.3 .12  .12  16   .078 0  
array-examples/standard_two_index_08.yml .125  900 880   2400 12000 .0082 0   12.5  26.3 .12  .12  16   .078 0  
array-examples/standard_two_index_09.yml .125  900 880   3000 11000 .0082 0   12.5  26.3 .12  .12  16   .078 0  
array-industry-pattern/array_monotonic.yml .3    900 880   3000 11000 .020  0   30.0  55.6 .12  .12  17   .11  0  
array-industry-pattern/array_mul_init.yml .214  900 890   2000 13000 .0041 0   21.4  50.0 .12  .12  17   .078 0  
array-industry-pattern/array_of_struct_break.yml .0    900 890   4300 5900 .0082 0   0    0   .060 .061 9.0 0     0  
array-industry-pattern/array_of_struct_ptr_mul_init.yml .0    900 890   6400 12000 .0041 0   0    0   .070 .071 9.0 0     0  
array-industry-pattern/array_of_struct_single_elem_init.yml .0    900 890   8000 11000 .0041 0   0    0   .059 .060 9.0 0     0  
array-industry-pattern/array_ptr_single_elem_init-2.yml .5    900 880   3500 14000 .049  0   50.0  64.7 .14  .14  16   .16  0  
array-industry-pattern/array_shadowinit.yml .875  900 850   2800 9600 5.3    0   87.5  100   .14  .23  17   .18  0  
array-industry-pattern/array_single_elem_init.yml .5    900 880   3500 12000 .037  0   50.0  64.7 .14  .16  16   .16  0  
reducercommutativity/avg.yml .8    200 150   6900 2200 1.6    0   80.0  95.2 .14  .14  16   .16  0  
reducercommutativity/avg05-1.yml .8    900 890   3200 8000 .13   0   80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/avg10-2.yml .8    900 880   2900 9100 .37   0   80.0  94.7 .14  .16  16   .16  0  
reducercommutativity/avg20-2.yml .8    900 870   4100 12000 1.1    0   80.0  94.7 .14  .14  17   .16  0  
reducercommutativity/avg40-2.yml .8    900 860   7500 11000 2.0    0   80.0  94.7 .14  .14  17   .16  0  
reducercommutativity/avg60-1.yml .8    900 860   9700 7500 1.7    0   80.0  94.7 .14  .14  16   .13  0  
reducercommutativity/max.yml .8    900 880   1000 10000 1.8    0   80.0  95.2 .14  .14  17   .19  0  
reducercommutativity/max05-1.yml .8    900 880   2600 7900 .43   0   80.0  94.7 .15  .14  16   .19  0  
reducercommutativity/max10-1.yml .8    900 890   2900 6000 .15   0   80.0  94.7 .14  .14  16   .19  0  
reducercommutativity/max20-1.yml .8    900 890   1100 5100 .16   0   80.0  94.7 .15  .15  16   .19  0  
reducercommutativity/max40-1.yml .8    900 880   1400 5500 .28   0   80.0  94.7 .15  .16  16   .16  0  
reducercommutativity/max60-2.yml .8    900 870   5100 7200 .86   0   80.0  94.7 .14  .14  16   .16  0  
reducercommutativity/rangesum.yml .875  900 770   4700 10000 47      0   87.5  96.8 .16  .15  16   .25  0  
reducercommutativity/rangesum05.yml .786  900 880   2100 8500 .58   0