Benchmark KLEE TBF Test-Suite Validator
Tool KLEE 2.0.0-pre-test-comp Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:09:47 CET 2019-02-06 06:16:47 CET
Run set klee.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-klee.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/klee.2019-02-05_2109.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/sanfoundry_10_ground.yml .944  900    900    10000 9800    .037 0   94.4  100   13     13     440   .14  0  
array-examples/sanfoundry_24-1.yml .917  900    900    5900 10000    .070 0   91.7  100   .15  .20  16   .23  0  
array-examples/standard_copy1_ground-1.yml .875  2.0  2.1  110 26    .016 0   87.5  100   2.6   2.6   440   .078 0  
array-examples/standard_copy1_ground-2.yml .75   900    900    240 8600    .049 0   75.0  90.0 11     11     920   .094 0  
array-examples/standard_copy2_ground-1.yml .8    900    900    250 9700    .037 0   80.0  91.7 10     10     920   .094 0  
array-examples/standard_copy2_ground-2.yml .9    2.5  2.5  110 32    .016 0   90.0  100   2.6   2.6   440   .078 0  
array-examples/standard_copy3_ground-1.yml .917  2.9  2.9  110 38    .016 0   91.7  100   2.7   2.7   440   .078 0  
array-examples/standard_copy3_ground-2.yml .833  900    900    250 9500    .049 0   83.3  92.9 11     11     920   .090 0  
array-examples/standard_copy4_ground-1.yml .929  3.3  3.3  120 46    .016 0   92.9  100   2.7   2.7   440   .078 0  
array-examples/standard_copy4_ground-2.yml .857  900    900    250 9400    .049 0   85.7  93.8 11     11     920   .094 0  
array-examples/standard_copy5_ground-1.yml .938  3.8  3.8  120 50    .016 0   93.8  100   2.7   2.7   440   .078 0  
array-examples/standard_copy5_ground-2.yml .875  900    900    260 11000    .049 0   87.5  94.4 11     11     920   .094 0  
array-examples/standard_copy6_ground-1.yml .889  900    900    260 7900    .049 0   88.9  95.0 11     11     920   .094 0  
array-examples/standard_copy6_ground-2.yml .944  4.2  4.2  120 51    .016 0   94.4  100   2.6   2.6   440   .078 0  
array-examples/standard_copy7_ground-1.yml .9    900    900    270 9300    .045 0   90.0  95.5 10     10     920   .098 0  
array-examples/standard_copy7_ground-2.yml .95   4.7  4.7  130 60    .016 0   95.0  100   2.6   2.6   440   .082 0  
array-examples/standard_copy8_ground-1.yml .955  5.1  5.1  130 76    .016 0   95.5  100   2.7   2.8   440   .074 0  
array-examples/standard_copy8_ground-2.yml .909  900    900    270 11000    .049 0   90.9  95.8 11     11     920   .098 0  
array-examples/standard_copy9_ground-1.yml .917  900    900    270 9200    .045 0   91.7  96.2 11     11     920   .098 0  
array-examples/standard_copy9_ground-2.yml .958  5.6  5.7  140 94    .016 0   95.8  100   2.6   2.6   440   .082 0  
array-examples/standard_copyInitSum_ground.yml .9    2.0  2.0  56 30    .016 0   90.0  100   .11  .11  17   .078 0  
array-examples/standard_find_ground-1.yml .9    900    900    1600 11000    .070 0   90.0  100   13     13     440   .14  0  
array-examples/standard_partition_ground-1.yml .143  8.3  7.9  15000 110    .074 0   14.3  36.4 .14  .14  16   .078 0  
array-examples/standard_sentinel-2.yml .8    .93 .95 170 12    .016 0   80.0  92.3 10     10     440   .13  0  
array-examples/standard_sentinel.i.v+cfa-reducer.yml .8    .95 .95 170 11    .016 0   80.0  81.8 10     10     440   .13  0  
array-examples/standard_strcpy_ground-1.yml .8    900    900    5400 12000    .045 0   80.0  100   10     10     440   .13  0  
array-examples/standard_strcpy_original-2.yml .75   900    900    2000 12000    .066 0   75.0  100   13     13     440   .14  0  
array-examples/standard_two_index_01.yml .875  .32 .34 27 3.8  .016 0   87.5  100   .37  .37  44   .078 0  
array-examples/standard_two_index_02.yml .875  1.5  1.5  110 21    .016 0   87.5  100   2.6   2.6   440   .078 0  
array-examples/standard_two_index_03.yml .875  .24 .25 28 3.2  .016 0   87.5  100   .37  .37  44   .078 0  
array-examples/standard_two_index_04.yml .875  1.2  1.2  110 20    .016 0   87.5  100   2.6   2.6   440   .078 0  
array-examples/standard_two_index_05.yml .875  1.1  1.1  110 16    .016 0   87.5  100   2.5   2.5   440   .078 0  
array-examples/standard_two_index_06.yml .875  .22 .23 27 2.4  .016 0   87.5  100   .36  .36  44   .078 0  
array-examples/standard_two_index_07.yml .875  1.1  1.1  110 14    .016 0   87.5  100   2.7   2.7   440   .078 0  
array-examples/standard_two_index_08.yml .875  1.0  1.0  110 15    .016 0   87.5  100   2.6   2.6   440   .078 0  
array-examples/standard_two_index_09.yml .875  1.0  1.0  110 13    .016 0   87.5  100   2.6   2.6   440   .078 0  
array-industry-pattern/array_monotonic.yml .3    900    900    14000 7000    .066 0   30.0  55.6 .13  .17  16   .11  0  
array-industry-pattern/array_mul_init.yml .286  8.3  7.9  15000 99    .066 0   28.6  50.0 .12  .12  16   .078 0  
array-industry-pattern/array_of_struct_break.yml .9    2.4  2.5  21 42    .016 0   90.0  100   .13  .13  16   .14  0  
array-industry-pattern/array_of_struct_ptr_mul_init.yml .357  9.5  9.2  15000 120    .074 0   35.7  53.9 .12  .12  17   .094 0  
array-industry-pattern/array_of_struct_single_elem_init.yml .25   900    900    11000 6700    .057 0   25.0  50.0 .13  .19  17   .11  0  
array-industry-pattern/array_ptr_single_elem_init-2.yml .5    900    900    11000 6600    .070 0   50.0  64.7 .13  .13  16   .13  0  
array-industry-pattern/array_shadowinit.yml .875  .13 .15 21 1.6  .016 0   87.5  100   .14  .17  16   .14  0  
array-industry-pattern/array_single_elem_init.yml .5    900    900    11000 7000    .070 0   50.0  64.7 .13  .13  16   .13  0  
reducercommutativity/avg.yml .8    .14 .16 21 1.5  .016 0   80.0  95.2 .14  .14  16   .18  0  
reducercommutativity/avg05-1.yml .8    .12 .14 21 1.3  .016 0   80.0  94.7 .12  .13  16   .078 0  
reducercommutativity/avg10-2.yml .8    .13 .16 21 1.2  .016 0