Benchmark ESBMC-bkind TBF Test-Suite Validator
Tool ESBMC version 6.0.0 64-bit x86_64 linux Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:13:25 CET 2019-02-06 06:16:10 CET
Run set esbmc-kind.test-comp19_prop-coverage-branches.ReachSafety-Loops tbf-testsuite-validator-esbmc-kind.test-comp19_prop-coverage-branches.ReachSafety-Loops
Options -s kinduction --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/esbmc-kind.2019-02-05_2113.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-1.yml .0  .045 .047 5.7 .081 0   0   0 0 .061 .062 8.9 0   0  
loops/array-2.yml .0  .030 .032 5.7 .16  0   0   0 0 .064 .065 8.9 0   0  
loops/bubble_sort-1.yml .0  .027 .028 5.7 .22  0   0   0 0 .057 .058 8.9 0   0  
loops/compact.yml .0  .031 .032 5.7 .13  0   0   0 0 .063 .063 9.0 0   0  
loops/count_up_down-1.yml .0  .031 .033 5.7 .16  0   0   0 0 .057 .063 8.9 0   0  
loops/count_up_down-2.yml .0  .025 .026 5.7 .11  0   0   0 0 .092 .094 8.9 0   0  
loops/eureka_01-1.yml .0  .024 .026 5.6 .12  0   0   0 0 .063 .064 8.9 0   0  
loops/for_bounded_loop1.yml .0  .019 .020 5.7 .072 0   0   0 0 .059 .059 9.0 0   0  
loops/insertion_sort-1.yml .0  .025 .026 5.7 .081 0   0   0 0 .061 .061 8.9 0   0  
loops/insertion_sort-2.yml .0  .024 .025 5.7 .11  0   0   0 0 .059 .060 8.9 0   0  
loops/invert_string-1.yml .0  .025 .026 5.7 .12  0   0   0 0 .059 .059 8.9 0   0  
loops/invert_string-3.yml .0  .026 .028 5.7 .23  0   0   0 0 .058 .059 8.9 0   0  
loops/linear_sea.ch.yml .0  .023 .023 5.7 .13  0   0   0 0 .059 .060 8.9 0   0  
loops/linear_search.yml .0  .026 .027 5.7 .25  0   0   0 0 .059 .059 9.0 0   0  
loops/matrix-1.yml .0  .030 .033 5.6 .18  0   0   0 0 .061 .062 9.0 0   0  
loops/matrix-2.yml .0  .024 .024 5.7 .083 0   0   0 0 .062 .064 8.9 0   0  
loops/n.c40.yml .0  .025 .026 5.7 .11  0   0   0 0 .061 .061 8.9 0   0  
loops/nec20.yml .0  .023 .023 5.7 .13  0   0   0 0 .060 .061 9.0 0   0  
loops/nec40.yml .0  .036 .037 5.6 .14  0   0   0 0 .066 .068 8.9 0   0  
loops/string-1.yml .0  .053 .054 5.6 .14  0   0   0 0 .061 .063 9.0 0   0  
loops/string-2.yml .0  .021 .022 5.7 .12  0   0   0 0 .061 .063 9.0 0   0  
loops/sum01-1.yml .0  .047 .048 5.6 .094 0   0   0 0 .060 .061 8.9 0   0  
loops/sum01-2.yml .0  .024 .025 5.7 .12  0   0   0 0 .058 .059 9.0 0   0  
loops/sum01_bug02.yml .0  .029 .031 5.9 .16  0   0   0 0 .067 .069 8.9 0   0  
loops/sum01_bug02_sum01_bug02_base.case.yml .0  .022 .026 5.8 .11  0   0   0 0 .058 .059 9.0 0   0  
loops/sum03-1.yml .0  .025 .025 5.7 .12  0   0   0 0 .068 .069 8.9 0   0  
loops/sum_array-1.yml .0  .028 .029 5.7 .18  0   0   0 0 .069 .070 8.9 0   0  
loops/sum_array-2.yml .0  .026 .028 5.7 .16  0   0   0 0 .062 .063 9.0 0   0  
loops/terminator_01.yml .0  .023 .024 5.7 .32  0   0   0 0 .059 .060 9.0 0   0  
loops/terminator_02-1.yml .0  .027 .029 5.7 .16  0   0   0 0 .057 .057 9.0 0   0  
loops/terminator_02-2.yml .0  .028 .030 5.7 .17  0   0   0 0 .059 .059 8.9 0   0  
loops/terminator_03-1.yml .0  .022 .023 5.6 .17  0   0   0 0 .065 .066 8.9 0   0  
loops/terminator_03-2.yml .0  .022 .023 5.7 .077 0   0   0 0 .058 .059 8.9 0   0  
loops/trex01-1.yml .0  .025 .027 5.7 .12  0   0   0 0 .060 .061 8.9 0   0  
loops/trex01-2.yml .0  .025 .026 5.7 .051 0   0   0 0 .058 .060 8.9 0   0  
loops/trex02-1.yml .0  .048 .049 5.7 .077 0   0   0 0 .061 .062 8.9 0   0  
loops/trex02-2.yml .0  .019 .019 5.7 .047 0   0   0 0 .077 .079 9.0 0   0  
loops/trex03-1.yml .0  .024 .025 5.7 .16  0   0   0 0 .061 .061 8.9 0   0  
loops/trex03-2.yml .0  .024 .025 5.7 .085 0   0   0 0 .066 .068 8.9 0   0  
loops/veris.c_sendmail_tTflag_arr_one_loop.yml .0  .025 .026 5.7 .11  0   0   0 0 .059 .060 8.9 0   0  
loops/vogal-1.yml .0  .024 .025 5.6 .075 0   0   0 0 .059 .060 8.9 0   0  
loops/vogal-2.yml .0  .025 .026 5.7 .11  0   0   0 0 .059 .060 8.9 0   0  
loop-acceleration/array_3-1.yml .0  .025 .026 5.7 .059 0   0   0 0 .057 .058 9.0 0   0  
loop-acceleration/array_3-2.yml .0  .025 .026 5.9 .062 0   0   0 0 .059 .059 9.0 0   0  
loop-acceleration/array_4.yml .0  .024 .024 5.7 .075 0   0   0 0 .057 .058 8.9 0   0  
loop-acceleration/diamond_1-1.yml .0  .024 .025 5.7 .12  0   0   0 0 .073 .074 8.9 0   0  
loop-acceleration/diamond_1-2.yml .0  .029 .029 5.7 .091 0   0   0 0 .066 .067 8.9 0   0  
loop-acceleration/diamond_2-2.yml .0  .024 .025 5.7 .10  0   0   0 0 .059 .060 8.9 0   0  
loop-acceleration/multivar_1-1.yml .0  .028 .028 5.7 .18  0   0   0 0 .064 .065 8.9 0   0  
loop-acceleration/multivar_1-2.yml .0  .027 .028 5.7 .13  0   0   0 0 .061 .062 8.9 0   0  
loop-acceleration/simple_3-2.yml .0  .022 .023 5.7 .093 0   0   0 0 .061 .062 9.0 0   0  
loop-crafted/simple_array_index_value_2.yml .0  .021 .023 5.7 .10  0   0   0 0 .062 .063 9.0 0   0  
loop-crafted/simple_array_index_value_4.i.v+lhb-reducer.yml .0  .019 .020 5.7 .14  0   0   0 0 .062 .064 9.0 0   0  
loop-crafted/simple_array_index_value_4.i.v+nlh-reducer.yml .0  .026 .028 5.7 .24  0   0   0 0 .060 .062 9.0 0   0  
loop-crafted/simple_array_index_value_4.yml .0  .026 .028 5.6 .24  0   0   0 0 .059 .060 9.0 0   0  
loop-invgen/MADWiFi-encode_ie_ok.yml .0  .023 .024 5.7 .12  0   0   0 0 .065 .066 8.9 0   0  
loop-invgen/NetBSD_loop.yml .0  .023 .026 5.8 .17  0   0   0 0 .061 .061 8.9 0   0  
loop-invgen/SpamAssassin-loop.i.v+cfa-reducer.yml .0  .023 .025 5.7 .15  0   0   0 0 .060 .061 8.9 0   0  
loop-invgen/apache-escape-absolute.i.v+cfa-reducer.yml .0  .029 .030 5.7 .083 0   0   0 0 .057 .058 8.9 0   0  
loop-invgen/apache-escape-absolute.yml .0  .022 .023 5.6 .13  0   0   0 0 .060 .061 8.9 0   0  
loop-invgen/apache-get-tag.i.p+lhb-reducer.yml .0  .025 .026 5.8 .067 0   0   0 0 .058 .059 9.0 0   0  
loop-invgen/apache-get-tag.i.p+nlh-reducer.yml .0  .042 .043 5.7 .069 0   0   0 0 .057 .058 8.9 0   0  
loop-invgen/apache-get-tag.i.p+sep-reducer.yml .0  .025 .026 5.7 .10  0   0   0 0 .087 .089 9.0 0   0  
loop-invgen/apache-get-tag.i.v+lhb-reducer.yml .0  .024 .025 5.7 .11  0   0   0 0 .059 .060 9.0 0   0  
loop-invgen/apache-get-tag.i.v+nlh-reducer.yml .0  .025 .026 5.7 .12  0   0   0 0 .061 .061 8.9 0   0  
loop-invgen/apache-get-tag.yml .0  .028 .031 5.7 .15  0   0   0 0 .061 .062 9.0 0   0  
loop-invgen/down.yml .0  .023 .024 5.7 .082 0   0   0 0 .057 .058 8.9 0   0  
loop-invgen/fragtest_simple.yml .0  .025 .026 5.7 .14  0   0   0 0 .061 .061 8.9 0   0  
loop-invgen/half_2.yml .0  .029 .029 5.7 .12  0   0   0 0 .058 .058 8.9 0   0  
loop-invgen/heapsort.yml .0  .027 .028 5.7 .11  0   0   0 0 .061 .062 9.0 0   0  
loop-invgen/id_build.i.p+nlh-reducer.yml .0  .019 .020 5.6 .13  0   0   0 0 .059 .059 8.9 0   0  
loop-invgen/id_build.i.p+sep-reducer.yml .0  .038 .039 5.5 .090 0   0   0 0 .060 .060 8.9 0   0  
loop-invgen/id_build.i.v+lhb-reducer.yml .0  .028 .030 5.7 .20  0   0   0 0 .061 .062 9.0 0   0  
loop-invgen/id_build.yml .0  .048 .049 5.7 .092 0   0   0 0 .059 .059 8.9 0   0  
loop-invgen/id_trans.yml .0  .022 .023 5.6 .078 0   0   0 0 .066 .067 9.0 0   0  
loop-invgen/large_const.yml .0  .024 .025 5.6 .074 0   0   0 0 .058 .059 8.9 0   0  
loop-invgen/nest-if3.yml .0  .018 .019 5.6 .23  0   0   0 0 .063 .064 9.0 0   0  
loop-invgen/nested6.yml .0  .027 .029 5.7 .093 0   0   0 0 .063 .063 8.9 0   0  
loop-invgen/nested9.yml .0  .030 .032 5.7 .16  0   0   0 0 .059 .060 8.9 0   0  
loop-invgen/sendmail-close-angle.yml .0  .023 .024 5.7 .13  0   0   0 0 .063 .063 9.0 0   0  
loop-invgen/seq-3.yml .0  .024 .025 5.7 .11  0   0   0 0 .073 .073 8.9 0   0  
loop-invgen/up.yml .0  .025 .030 5.7 .077 0   0   0 0 .056 .057 8.9 0   0  
loop-lit/afnp2014.yml .0  .028 .030 5.6 .16  0   0   0 0 .064 .064 8.9 0   0  
loop-lit/bhmr2007.yml .0  .023 .024 5.7 .14  0   0   0 0 .057 .057 9.0 0   0  
loop-lit/cggmp2005.yml .0  .025 .027 5.6 .14  0   0   0 0 .057 .058 9.1 0   0  
loop-lit/cggmp2005_variant.yml .0  .037 .038 5.5 .11  0   0   0 0 .060 .061 9.0 0   0  
loop-lit/cggmp2005b.yml .0  .040 .041 5.5 .11  0   0   0 0 .059 .060 8.9 0   0  
loop-lit/css2003.yml .0  .023 .028 5.7 .12  0   0   0 0 .061 .062 8.9 0   0  
loop-lit/ddlm2013.yml .0  .047 .049 5.6 .13  0   0   0 0 .061 .061 8.9 0   0  
loop-lit/gj2007.c.i.p+lhb-reducer.yml .0  .046 .047 5.7 .11  0   0   0 0 .062 .062 9.0 0   0  
loop-lit/gj2007.c.i.p+nlh-reducer.yml .0  .041 .044 5.7 .16  0   0   0 0 .066 .066 8.9 0   0  
loop-lit/gj2007.yml .0  .027 .028 5.7 .22  0   0   0 0 .057 .059 9.0 0   0  
loop-lit/gj2007b.yml .0  .029 .030 5.7 .084 0   0   0 0 .059 .060 8.9 0   0  
loop-lit/gr2006.yml .0  .024 .025 5.7 .11  0   0   0 0 .058 .059 8.9 0   0  
loop-lit/gsv2008.c.i.p+cfa-reducer.yml .0  .028 .029 5.9 .20  0   0   0 0 .059 .059 8.9 0   0  
loop-lit/gsv2008.c.i.v+cfa-reducer.yml .0  .024 .025 5.7 .11  0   0   0 0 .064 .065 9.0 0   0  
loop-lit/gsv2008.c.i.v+lhb-reducer.yml .0  .022 .023 5.7 .052 0   0   0 0 .060 .065 8.9 0   0  
loop-lit/gsv2008.yml .0  .045 .046 5.7 .11  0   0   0 0 .063 .064 8.9 0   0  
loop-lit/hhk2008.yml .0  .023 .025 5.7 .17  0   0   0 0 .059 .061 9.0 0   0  
loop-lit/jm2006.c.i.v+cfa-reducer.yml .0  .025 .026 5.7 .12  0   0   0 0 .059 .060 8.9 0   0  
loop-lit/jm2006.yml .0  .022 .023 5.7 .14  0   0   0 0 .060 .060 8.9 0   0  
loop-lit/jm2006_variant.yml .0  .024 .025 5.6 .099 0   0   0 0 .060 .060 9.0 0   0  
loop-new/count_by_1.yml .0  .030 .031 5.7 .14  0   0   0 0 .062 .062 9.0 0   0  
loop-new/count_by_1_variant.yml .0  .025 .026 5.7 .13  0   0   0 0 .057 .064 9.0 0   0  
loop-new/count_by_2.yml .0  .025 .026 5.7 .11  0   0   0 0 .061 .062 8.9 0   0  
loop-new/count_by_k.yml .0  .026 .028 5.7 .11  0   0   0 0 .060 .061 9.0 0   0  
loop-new/count_by_nondet.yml .0  .021 .022 5.6 .084 0   0   0 0 .060 .062 8.9 0   0  
loop-new/gauss_sum.i.p+cfa-reducer.yml .0  .022 .023 5.7 .13  0   0   0 0 .057 .058 8.9 0   0  
loop-new/gauss_sum.i.p+lhb-reducer.yml .0  .023 .024 5.6 .089 0   0   0 0 .062 .063 8.9 0   0  
loop-new/gauss_sum.i.v+cfa-reducer.yml .0  .022 .022 5.6 .055 0   0   0 0 .059 .060 8.9 0   0  
loop-new/gauss_sum.yml .0  .049 .051 5.7 .15  0   0   0 0 .070 .071 9.0 0   0  
loop-new/half.yml .0  .029 .031 5.6 .18  0   0   0 0 .060 .060 8.9 0   0  
loop-new/nested-1.yml .0  .024 .024 5.7 .14  0   0   0 0 .057 .057 8.9 0   0  
loop-industry-pattern/mod3.c.v+cfa-reducer.yml .0  .035 .037 5.7 .11  0   0   0 0 .064 .065 9.0 0   0  
loop-industry-pattern/mod3.c.v+lhb-reducer.yml .0  .027 .028 5.6 .091 0   0   0 0 .058 .058 8.9 0   0  
loop-industry-pattern/mod3.c.v+sep-reducer.yml .0  .038 .041 5.7 .16  0   0   0 0 .061 .062 8.9 0   0  
loop-industry-pattern/mod3.yml .0  .024 .025 5.7 .064 0   0   0 0 .057 .058 8.9 0   0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 117 .0  3.2 3.4 670 15 0   0   117 0 0 7.2 7.3 1000 0   0  
Run set esbmc-kind.test-comp19_prop-coverage-branches.ReachSafety-Loops tbf-testsuite-validator-esbmc-kind.test-comp19_prop-coverage-branches.ReachSafety-Loops