Benchmark ESBMC-falsif TBF Test-Suite Validator
Tool ESBMC version 6.0.0 64-bit x86_64 linux Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:11:17 CET 2019-02-06 06:16:01 CET
Run set esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options -s falsi --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/esbmc-falsi.2019-02-05_2111.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/sanfoundry_10_ground.yml .0  .041 .042 5.7 .085 0   0   0 0 .059 .060 9.0 0   0  
array-examples/sanfoundry_24-1.yml .0  .024 .025 5.6 .12  0   0   0 0 .061 .062 9.0 0   0  
array-examples/standard_copy1_ground-1.yml .0  .028 .030 5.8 .19  0   0   0 0 .060 .060 8.9 0   0  
array-examples/standard_copy1_ground-2.yml .0  .040 .041 5.7 .14  0   0   0 0 .060 .061 8.9 0   0  
array-examples/standard_copy2_ground-1.yml .0  .026 .027 5.7 .15  0   0   0 0 .061 .061 9.0 0   0  
array-examples/standard_copy2_ground-2.yml .0  .025 .026 5.7 .10  0   0   0 0 .059 .062 8.9 0   0  
array-examples/standard_copy3_ground-1.yml .0  .027 .028 5.7 .12  0   0   0 0 .059 .060 8.9 0   0  
array-examples/standard_copy3_ground-2.yml .0  .048 .050 5.7 .099 0   0   0 0 .060 .061 8.9 0   0  
array-examples/standard_copy4_ground-1.yml .0  .020 .021 5.6 .24  0   0   0 0 .058 .059 8.9 0   0  
array-examples/standard_copy4_ground-2.yml .0  .052 .055 5.5 .13  0   0   0 0 .064 .066 9.0 0   0  
array-examples/standard_copy5_ground-1.yml .0  .024 .024 5.7 .12  0   0   0 0 .058 .059 8.9 0   0  
array-examples/standard_copy5_ground-2.yml .0  .044 .045 5.7 .10  0   0   0 0 .057 .058 8.9 0   0  
array-examples/standard_copy6_ground-1.yml .0  .050 .051 5.6 .10  0   0   0 0 .060 .060 8.9 0   0  
array-examples/standard_copy6_ground-2.yml .0  .026 .027 5.6 .11  0   0   0 0 .061 .062 8.9 0   0  
array-examples/standard_copy7_ground-1.yml .0  .024 .025 5.6 .12  0   0   0 0 .060 .061 8.9 0   0  
array-examples/standard_copy7_ground-2.yml .0  .024 .025 5.6 .13  0   0   0 0 .063 .064 8.9 0   0  
array-examples/standard_copy8_ground-1.yml .0  .028 .029 5.6 .19  0   0   0 0 .061 .061 8.9 0   0  
array-examples/standard_copy8_ground-2.yml .0  .030 .031 5.7 .091 0   0   0 0 .061 .062 8.9 0   0  
array-examples/standard_copy9_ground-1.yml .0  .023 .024 5.6 .11  0   0   0 0 .058 .059 8.9 0   0  
array-examples/standard_copy9_ground-2.yml .0  .025 .025 5.8 .16  0   0   0 0 .083 .083 8.9 0   0  
array-examples/standard_copyInitSum_ground.yml .0  .032 .035 5.7 .15  0   0   0 0 .061 .062 8.9 0   0  
array-examples/standard_find_ground-1.yml .0  .025 .026 5.7 .12  0   0   0 0 .058 .058 8.9 0   0  
array-examples/standard_partition_ground-1.yml .0  .031 .033 5.6 .14  0   0   0 0 .060 .061 9.0 0   0  
array-examples/standard_sentinel-2.yml .0  .050 .051 5.6 .091 0   0   0 0 .059 .060 8.9 0   0  
array-examples/standard_sentinel.i.v+cfa-reducer.yml .0  .032 .033 5.7 .13  0   0   0 0 .058 .059 8.9 0   0  
array-examples/standard_strcpy_ground-1.yml .0  .024 .025 5.7 .030 0   0   0 0 .058 .059 8.9 0   0  
array-examples/standard_strcpy_original-2.yml .0  .024 .025 5.7 .077 0   0   0 0 .060 .061 8.9 0   0  
array-examples/standard_two_index_01.yml .0  .027 .028 5.7 .088 0   0   0 0 .060 .061 8.9 0   0  
array-examples/standard_two_index_02.yml .0  .029 .031 5.7 .18  0   0   0 0 .061 .061 8.9 0   0  
array-examples/standard_two_index_03.yml .0  .025 .026 5.7 .061 0   0   0 0 .059 .059 8.9 0   0  
array-examples/standard_two_index_04.yml .0  .035 .040 5.6 .13  0   0   0 0 .056 .057 9.0 0   0  
array-examples/standard_two_index_05.yml .0  .027 .028 5.7 .096 0   0   0 0 .060 .062 9.0 0   0  
array-examples/standard_two_index_06.yml .0  .019 .020 5.7 .15  0   0   0 0 .060 .061 8.9 0   0  
array-examples/standard_two_index_07.yml .0  .021 .022 5.7 .069 0   0   0 0 .059 .060 9.0 0   0  
array-examples/standard_two_index_08.yml .0  .026 .026 5.7 .11  0   0   0 0 .060 .060 8.9 0   0  
array-examples/standard_two_index_09.yml .0  .040 .041 5.7 .082 0   0   0 0 .059 .060 8.9 0   0  
array-industry-pattern/array_monotonic.yml .0  .026 .027 5.7 .11  0   0   0 0 .060 .061 8.9 0   0  
array-industry-pattern/array_mul_init.yml .0  .025 .026 5.7 .096 0   0   0 0 .060 .061 9.0 0   0  
array-industry-pattern/array_of_struct_break.yml .0  .040 .040 5.7 .068 0   0   0 0 .060 .061 8.9 0   0  
array-industry-pattern/array_of_struct_ptr_mul_init.yml .0  .023 .024 5.7 .079 0   0   0 0 .057 .058 8.9 0   0  
array-industry-pattern/array_of_struct_single_elem_init.yml .0  .026 .028 5.7 .087 0   0   0 0 .064 .064 8.9 0   0  
array-industry-pattern/array_ptr_single_elem_init-2.yml .0  .031 .032 5.7 .079 0   0   0 0 .061 .062 9.0 0   0  
array-industry-pattern/array_shadowinit.yml .0  .029 .030 5.7 .11  0   0   0 0 .060 .061 9.0 0   0  
array-industry-pattern/array_single_elem_init.yml .0  .023 .024 5.7 .14  0   0   0 0 .059 .059 8.9 0   0  
reducercommutativity/avg.yml .0  .023 .024 5.7 .16  0   0   0 0 .060 .060 8.9 0   0  
reducercommutativity/avg05-1.yml .0  .023 .024 5.7 .083 0   0   0 0 .059 .060 9.0 0   0  
reducercommutativity/avg10-2.yml .0  .027 .030 5.8 .18  0   0   0 0 .062 .064 8.9 0   0  
reducercommutativity/avg20-2.yml .0  .023 .024 5.7 .13  0   0   0 0 .060 .063 9.0 0   0  
reducercommutativity/avg40-2.yml .0  .024 .025 5.7 .11  0   0   0 0 .060 .062 9.0 0   0  
reducercommutativity/avg60-1.yml .0  .027 .028 5.7 .14  0   0   0 0 .066 .067 9.0 0   0  
reducercommutativity/max.yml .0  .024 .025 5.7 .098 0   0   0 0 .057 .057 8.9 0   0  
reducercommutativity/max05-1.yml .0  .020 .020 5.7 .20  0   0   0 0 .060 .061 9.0 0   0  
reducercommutativity/max10-1.yml .0  .023 .024 5.7 .13  0   0   0 0 .060 .060 8.9 0   0  
reducercommutativity/max20-1.yml .0  .023 .024 5.7 .096 0   0   0 0 .058 .060 9.0 0   0  
reducercommutativity/max40-1.yml .0  .025 .026 5.7 .10  0   0   0 0 .062 .062 8.9 0   0  
reducercommutativity/max60-2.yml .0  .045 .046 5.7 .071 0   0   0 0 .060 .060 8.9 0   0  
reducercommutativity/rangesum.yml .0  .023 .024 5.7 .085 0   0   0 0 .058 .059 8.9 0   0  
reducercommutativity/rangesum05.yml .0  .029 .030 5.7 .11  0   0   0 0 .060 .060 8.9 0   0  
reducercommutativity/rangesum10.yml .0  .037 .038 5.7 .062 0   0   0 0 .059 .060 9.0 0   0  
reducercommutativity/rangesum20.yml .0  .021 .023 5.6 .074 0   0   0 0 .056 .057 8.9 0   0  
reducercommutativity/rangesum40.yml .0  .024 .025 5.6 .096 0   0   0 0 .058 .058 8.9 0   0  
reducercommutativity/rangesum60.yml .0  .040 .041 5.7 .12  0   0   0 0 .066 .067 8.9 0   0  
reducercommutativity/sep.yml .0  .024 .025 5.6 .14  0   0   0 0 .059 .059 8.9 0   0  
reducercommutativity/sep05-1.yml .0  .026 .027 5.7 .077 0   0   0 0 .061 .062 8.9 0   0  
reducercommutativity/sep10-2.yml .0  .050 .053 5.6 .14  0   0   0 0 .058 .059 9.0 0   0  
reducercommutativity/sep20-1.yml .0  .023 .025 5.7 .12  0   0   0 0 .062 .062 8.9 0   0  
reducercommutativity/sep40-1.yml .0  .040 .040 5.5 .082 0   0   0 0 .063 .063 8.9 0   0  
reducercommutativity/sep60-2.yml .0  .029 .029 5.7 .069 0   0   0 0 .060 .060 8.9 0   0  
reducercommutativity/sum.yml .0  .040 .041 5.5 .11  0   0   0 0 .058 .059 8.9 0   0  
reducercommutativity/sum05-2.yml .0  .020 .020 5.7 .13  0   0   0 0 .061 .062 9.0 0   0  
reducercommutativity/sum10-1.yml .0  .039 .041 5.7 .080 0   0   0 0 .063 .064 8.9 0   0  
reducercommutativity/sum20-2.yml .0  .024 .026 5.7 .15  0   0   0 0 .060 .060 8.9 0   0  
reducercommutativity/sum40-2.yml .0  .023 .024 5.6 .081 0   0   0 0 .058 .058 8.9 0   0  
reducercommutativity/sum60-2.yml .0  .028 .030 5.7 .18  0   0   0 0 .060 .061 9.0 0   0  
array-tiling/mbpr2.yml .0  .049 .051 6.0 .090 0   0   0 0 .061 .062 8.9 0   0  
array-tiling/mbpr3.yml .0  .035 .038 5.7 .069 0   0   0 0 .058 .059 8.9 0   0  
array-tiling/mbpr4.yml .0  .024 .025 5.7 .10  0   0   0 0 .060 .061 8.9 0   0  
array-tiling/mbpr5.yml .0  .025 .026 5.7 .13  0   0   0 0 .063 .064 8.9 0   0  
array-tiling/mlceu.yml .0  .023 .024 5.7 .12  0   0   0 0 .060 .060 8.9 0   0  
array-tiling/nr2.yml .0  .023 .023 5.7 .11  0   0   0 0 .063 .064 9.0 0   0  
array-tiling/nr3.yml .0  .037 .037 5.6 .082 0   0   0 0 .057 .057 9.0 0   0  
array-tiling/nr4.yml .0  .027 .028 5.7 .070 0   0   0 0 .060 .060 8.9 0   0  
array-tiling/nr5.yml .0  .031 .033 5.7 .18  0   0   0 0 .064 .065 8.9 0   0  
array-tiling/pnr2.yml .0  .038 .039 5.7 .11  0   0   0 0 .062 .063 8.9 0   0  
array-tiling/pnr3.yml .0  .023 .024 5.7 .15  0   0   0 0 .064 .065 8.9 0   0  
array-tiling/pnr4.yml .0  .035 .036 5.7 .090 0   0   0 0 .060 .061 8.9 0   0  
array-tiling/pnr5.yml .0  .046 .048 5.6 .15  0   0   0 0 .061 .062 9.0 0   0  
array-tiling/poly1.yml .0  .024 .025 5.7 .074 0   0   0 0 .059 .060 8.9 0   0  
array-tiling/poly2.yml .0  .023 .023 5.7 .13  0   0   0 0 .062 .063 9.0 0   0  
array-tiling/pr2.yml .0  .047 .048 5.7 .075 0   0   0 0 .059 .067 8.9 0   0  
array-tiling/pr3.yml .0  .022 .023 5.7 .11  0   0   0 0 .059 .060 9.0 0   0  
array-tiling/pr4.yml .0  .036 .037 5.7 .13  0   0   0 0 .065 .066 9.0 0   0  
array-tiling/pr5.yml .0  .028 .029 5.6 .15  0   0   0 0 .060 .061 8.9 0   0  
array-tiling/revcpyswp2.yml .0  .024 .024 5.7 .15  0   0   0 0 .061 .062 8.9 0   0  
array-tiling/rew.yml .0  .044 .045 5.7 .087 0   0   0 0 .060 .061 8.9 0   0  
array-tiling/rewnif.yml .0  .045 .046 5.7 .097 0   0   0 0 .058 .060 9.0 0   0  
array-tiling/rewnifrev.yml .0  .023 .023 5.7 .095 0   0   0 0 .059 .059 9.0 0   0  
array-tiling/rewnifrev2.yml .0  .023 .024 5.7 .074 0   0   0 0 .057 .058 9.0 0   0  
array-tiling/rewrev.yml .0  .027 .028 5.6 .10  0   0   0 0 .059 .060 9.0 0   0  
array-tiling/skipped.yml .0  .029 .029 5.7 .074 0   0   0 0 .060 .060 8.9 0   0  
array-tiling/skippedu.yml .0  .029 .030 5.7 .18  0   0   0 0 .067 .067 8.9 0   0  
array-tiling/tcpy.yml .0  .034 .036 5.7 .16  0   0   0 0 .057 .058 8.9 0   0  
array-programs/copysome1-1.yml .0  .027 .028 5.7 .12  0   0   0 0 .057 .058 8.9 0   0  
array-programs/copysome1-2.yml .0  .052 .055 5.5 .18  0   0   0 0 .058 .059 9.0 0   0  
array-programs/copysome2-1.yml .0  .024 .025 5.7 .092 0   0   0 0 .060 .061 9.0 0   0  
array-programs/copysome2-2.yml .0  .020 .021 5.7 .056 0   0   0 0 .058 .059 9.0 0   0  
array-crafted/bAnd1.yml .0  .030 .032 5.6 .18  0   0   0 0 .057 .058 8.9 0   0  
array-crafted/bAnd2.yml .0  .026 .027 5.6 .13  0   0   0 0 .065 .066 8.9 0   0  
array-crafted/bAnd3.yml .0  .022 .023 5.7 .054 0   0   0 0 .062 .063 8.9 0   0  
array-crafted/bAnd4.yml .0  .023 .024 5.7 .088 0   0   0 0 .057 .058 8.9 0   0  
array-crafted/bAnd5.yml .0  .028 .029 5.7 .073 0   0   0 0 .057 .058 8.9 0   0  
array-crafted/bor1.yml .0  .023 .023 5.7 .16  0   0   0 0 .061 .062 9.0 0   0  
array-crafted/bor2.yml .0  .022 .027 5.7 .13  0   0   0 0 .057 .058 8.9 0   0  
array-crafted/bor3.yml .0  .037 .039 5.7 .090 0   0   0 0 .061 .062 8.9 0   0  
array-crafted/bor4.yml .0  .029 .030 5.7 .12  0   0   0 0 .057 .058 8.9 0   0  
array-crafted/bor5.yml .0  .021 .022 5.7 .13  0   0   0 0 .058 .059 8.9 0   0  
array-crafted/mapavg1.yml .0  .023 .023 5.7 .15  0   0   0 0 .059 .067 8.9 0   0  
array-crafted/mapavg2.yml .0  .037 .038 5.7 .092 0   0   0 0 .061 .062 9.0 0   0  
array-crafted/mapavg3.yml .0  .027 .028 5.6 .12  0   0   0 0 .058 .059 8.9 0   0  
array-crafted/mapavg4.yml .0  .023 .024 5.7 .11  0   0   0 0 .060 .061 8.9 0   0  
array-crafted/mapavg5.yml .0  .048 .049 5.5 .11  0   0   0 0 .062 .064 9.0 0   0  
array-crafted/mapsum1.yml .0  .029 .030 5.7 .12  0   0   0 0 .060 .061 8.9 0   0  
array-crafted/mapsum2.yml .0  .039 .040 5.6 .086 0   0   0 0 .059 .061 8.9 0   0  
array-crafted/mapsum3.yml .0  .024 .025 5.7 .063 0   0   0 0 .058 .059 8.9 0   0  
array-crafted/mapsum4.yml .0  .027 .028 5.7 .040 0   0   0 0 .061 .062 8.9 0   0  
array-crafted/mapsum5.yml .0  .021 .021 5.7 .14  0   0   0 0 .057 .058 8.9 0   0  
array-crafted/xor1.yml .0  .025 .026 5.7 .095 0   0   0 0 .062 .063 9.0 0   0  
array-crafted/xor2.yml .0  .024 .025 5.7 .15  0   0   0 0 .062 .063 8.9 0   0  
array-crafted/xor3.yml .0  .050 .051 5.5 .092 0   0   0 0 .059 .061 8.9 0   0  
array-crafted/xor4.yml .0  .027 .028 5.7 .087 0   0   0 0 .070 .071 8.9 0   0  
array-crafted/xor5.yml .0  .022 .022 5.7 .13  0   0   0 0 .059 .060 8.9 0   0  
array-crafted/zero_sum1.yml .0  .029 .031 5.7 .19  0   0   0 0 .059 .060 8.9 0   0  
array-crafted/zero_sum2.yml .0  .027 .028 5.7 .11  0   0   0 0 .057 .057 8.9 0   0  
array-crafted/zero_sum3.yml .0  .026 .027 5.7 .13  0   0   0 0 .059 .059 8.9 0   0  
array-crafted/zero_sum4.yml .0  .029 .031 5.7 .18  0   0   0 0 .061 .062 8.9 0   0  
array-crafted/zero_sum5.yml .0  .024 .025 5.7 .067 0   0   0 0 .058 .064 8.9 0   0  
array-crafted/zero_sum_const1.yml .0  .025 .029 5.7 .11  0   0   0 0 .088 .089 8.9 0   0  
array-crafted/zero_sum_const2.yml .0  .023 .024 5.6 .21  0   0   0 0 .061 .062 8.9 0   0  
array-crafted/zero_sum_const3.yml .0  .022 .023 5.6 .14  0   0   0 0 .059 .059 9.0 0   0  
array-crafted/zero_sum_const4.yml .0  .040 .042 5.8 .065 0   0   0 0 .061 .061 8.9 0   0  
array-crafted/zero_sum_const5.yml .0  .022 .023 5.5 .094 0   0   0 0 .062 .064 8.9 0   0  
array-crafted/zero_sum_const_m2.yml .0  .027 .029 5.6 .19  0   0   0 0 .058 .058 8.9 0   0  
array-crafted/zero_sum_const_m3.yml .0  .026 .027 5.7 .14  0   0   0 0 .057 .058 9.0 0   0  
array-crafted/zero_sum_const_m4.yml .0  .036 .037 5.5 .074 0   0   0 0 .059 .060 8.9 0   0  
array-crafted/zero_sum_const_m5.yml .0  .029 .031 5.6 .19  0   0   0 0 .058 .059 9.0 0   0  
array-crafted/zero_sum_m2.yml .0  .025 .027 5.7 .10  0   0   0 0 .062 .063 9.0 0   0  
array-crafted/zero_sum_m3.yml .0  .034 .035 5.7 .13  0   0   0 0 .058 .060 9.0 0   0  
array-crafted/zero_sum_m4.yml .0  .051 .052 5.5 .092 0   0   0 0 .058 .059 8.9 0   0  
array-crafted/zero_sum_m5.yml .0  .025 .026 5.7 .12  0   0   0 0 .060 .062 8.9 0   0  
array-multidimensional/add-2-n-u.yml .0  .026 .027 5.7 .10  0   0   0 0 .060 .064 8.9 0   0  
array-multidimensional/add-3-n-u.yml .0  .021 .022 5.6 .13  0   0   0 0 .063 .063 8.9 0   0  
array-multidimensional/copy-2-u.yml .0  .031 .034 5.7 .078 0   0   0 0 .061 .062 8.9 0   0  
array-multidimensional/copy-3-n-u.yml .0  .027 .028 5.7 .072 0   0   0 0 .074 .075 9.0 0   0  
array-multidimensional/copy-partial-2-n-u.yml .0  .023 .025 5.7 .12  0   0   0 0 .057 .058 9.0 0   0  
array-multidimensional/copy-partial-3-u.yml .0  .022 .023 5.7 .14  0   0   0 0 .062 .063 9.0 0   0  
array-multidimensional/diff-2-n-u.yml .0  .021 .022 5.7 .095 0   0   0 0 .061 .061 8.9 0   0  
array-multidimensional/diff-3-n-u.yml .0  .024 .025 5.8 .076 0   0   0 0 .065 .066 9.0 0   0  
array-multidimensional/init-2-n-u.yml .0  .022 .023 5.7 .12  0   0   0 0 .059 .060 9.0 0   0  
array-multidimensional/init-3-u.yml .0  .052 .055 5.6 .14  0   0   0 0 .059 .059 8.9 0   0  
array-multidimensional/init-4-n-u.yml .0  .022 .025 5.7 .13  0   0   0 0 .057 .058 8.9 0   0  
array-multidimensional/init-non-constant-2-n-u.yml .0  .022 .022 5.7 .12  0   0   0 0 .064 .064 9.0 0   0  
array-multidimensional/init-non-constant-3-u.yml .0  .023 .024 5.7 .097 0   0   0 0 .060 .061 9.0 0   0  
array-multidimensional/max-2-u.yml .0  .024 .025 5.7 .11  0   0   0 0 .059 .060 8.9 0   0  
array-multidimensional/max-3-n-u.yml .0  .024 .025 5.7 .13  0   0   0 0 .058 .059 9.0 0   0  
array-multidimensional/min-2-u.yml .0  .023 .024 5.7 .074 0   0   0 0 .060 .061 8.9 0   0  
array-multidimensional/min-3-n-u.yml .0  .025 .026 5.7 .087 0   0   0 0 .058 .059 8.9 0   0  
array-multidimensional/rev-2-n-u.yml .0  .034 .036 5.7 .12  0   0   0 0 .079 .080 8.9 0   0  
array-multidimensional/rev-3-u.yml .0  .023 .025 5.7 .079 0   0   0 0 .059 .059 8.9 0   0  
array-multidimensional/transpose-u.yml .0  .023 .023 5.7 .078 0   0   0 0 .063 .064 8.9 0   0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 169 .0  4.9 5.1 960 19 0   0   169 0 0 10 10 1500 0   0  
Run set esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Arrays tbf-testsuite-validator-esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Arrays