Benchmark ESBMC-falsif TBF Test-Suite Validator
Tool ESBMC version 6.0.0 64-bit x86_64 linux Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:11:17 CET 2019-02-06 06:16:01 CET
Run set esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Loops tbf-testsuite-validator-esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Loops
Options -s falsi --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/esbmc-falsi.2019-02-05_2111.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-1.yml .0  .030 .031 5.8 .20  0   0   0 0 .057 .058 9.0 0   0  
loops/array-2.yml .0  .024 .025 5.6 .074 0   0   0 0 .057 .058 9.0 0   0  
loops/bubble_sort-1.yml .0  .031 .033 5.7 .11  0   0   0 0 .060 .060 8.9 0   0  
loops/compact.yml .0  .022 .025 5.7 .16  0   0   0 0 .058 .059 8.9 0   0  
loops/count_up_down-1.yml .0  .027 .028 5.7 .13  0   0   0 0 .058 .059 9.0 0   0  
loops/count_up_down-2.yml .0  .026 .028 5.6 .18  0   0   0 0 .063 .064 8.9 0   0  
loops/eureka_01-1.yml .0  .026 .028 5.7 .16  0   0   0 0 .059 .060 9.0 0   0  
loops/for_bounded_loop1.yml .0  .031 .033 5.7 .15  0   0   0 0 .060 .060 9.0 0   0  
loops/insertion_sort-1.yml .0  .050 .051 5.6 .083 0   0   0 0 .058 .059 8.9 0   0  
loops/insertion_sort-2.yml .0  .025 .027 5.6 .078 0   0   0 0 .062 .063 9.0 0   0  
loops/invert_string-1.yml .0  .036 .037 5.6 .12  0   0   0 0 .062 .063 9.0 0   0  
loops/invert_string-3.yml .0  .024 .025 5.7 .12  0   0   0 0 .059 .060 9.0 0   0  
loops/linear_sea.ch.yml .0  .029 .030 5.7 .13  0   0   0 0 .059 .059 8.9 0   0  
loops/linear_search.yml .0  .044 .045 5.7 .10  0   0   0 0 .060 .060 9.0 0   0  
loops/matrix-1.yml .0  .024 .025 5.7 .071 0   0   0 0 .056 .057 8.9 0   0  
loops/matrix-2.yml .0  .022 .023 5.7 .084 0   0   0 0 .061 .062 8.9 0   0  
loops/n.c40.yml .0  .024 .025 5.7 .15  0   0   0 0 .059 .059 8.9 0   0  
loops/nec20.yml .0  .026 .026 5.7 .10  0   0   0 0 .069 .070 9.0 0   0  
loops/nec40.yml .0  .036 .038 5.5 .14  0   0   0 0 .066 .073 8.9 0   0  
loops/string-1.yml .0  .022 .022 5.6 .13  0   0   0 0 .062 .063 8.9 0   0  
loops/string-2.yml .0  .025 .026 5.6 .12  0   0   0 0 .059 .059 8.9 0   0  
loops/sum01-1.yml .0  .024 .026 5.7 .14  0   0   0 0 .058 .060 8.9 0   0  
loops/sum01-2.yml .0  .025 .026 5.6 .18  0   0   0 0 .060 .061 8.9 0   0  
loops/sum01_bug02.yml .0  .026 .028 5.7 .11  0   0   0 0 .059 .060 8.9 0   0  
loops/sum01_bug02_sum01_bug02_base.case.yml .0  .023 .024 5.7 .16  0   0   0 0 .059 .060 8.9 0   0  
loops/sum03-1.yml .0  .024 .025 5.7 .090 0   0   0 0 .056 .057 8.9 0   0  
loops/sum_array-1.yml .0  .028 .030 5.7 .19  0   0   0 0 .056 .057 8.9 0   0  
loops/sum_array-2.yml .0  .022 .023 5.6 .12  0   0   0 0 .059 .060 9.0 0   0  
loops/terminator_01.yml .0  .038 .038 5.6 .12  0   0   0 0 .058 .060 9.0 0   0  
loops/terminator_02-1.yml .0  .048 .050 5.8 .16  0   0   0 0 .059 .059 8.9 0   0  
loops/terminator_02-2.yml .0  .024 .025 5.7 .11  0   0   0 0 .074 .075 9.0 0   0  
loops/terminator_03-1.yml .0  .027 .029 5.7 .25  0   0   0 0 .063 .063 9.0 0   0  
loops/terminator_03-2.yml .0  .033 .034 5.7 .12  0   0   0 0 .065 .066 9.0 0   0  
loops/trex01-1.yml .0  .027 .028 5.6 .13  0   0   0 0 .058 .059 8.9 0   0  
loops/trex01-2.yml .0  .021 .021 5.6 .13  0   0   0 0 .066 .068 9.0 0   0  
loops/trex02-1.yml .0  .029 .029 5.7 .079 0   0   0 0 .056 .057 8.9 0   0  
loops/trex02-2.yml .0  .032 .034 5.7 .15  0   0   0 0 .063 .064 8.9 0   0  
loops/trex03-1.yml .0  .024 .025 5.7 .087 0   0   0 0 .059 .061 9.0 0   0  
loops/trex03-2.yml .0  .035 .036 5.5 .091 0   0   0 0 .066 .067 8.9 0   0  
loops/veris.c_sendmail_tTflag_arr_one_loop.yml .0  .028 .030 5.6 .21  0   0   0 0 .059 .060 8.9 0   0  
loops/vogal-1.yml .0  .047 .048 5.7 .078 0   0   0 0 .060 .061 8.9 0   0  
loops/vogal-2.yml .0  .048 .049 5.7 .096 0   0   0 0 .062 .063 9.0 0   0  
loop-acceleration/array_3-1.yml .0  .036 .037 5.7 .15  0   0   0 0 .064 .065 9.0 0   0  
loop-acceleration/array_3-2.yml .0  .037 .038 5.7 .13  0   0   0 0 .059 .060 9.0 0   0  
loop-acceleration/array_4.yml .0  .040 .041 5.7 .084 0   0   0 0 .059 .061 9.0 0   0  
loop-acceleration/diamond_1-1.yml .0  .026 .027 5.7 .085 0   0   0 0 .061 .062 9.0 0   0  
loop-acceleration/diamond_1-2.yml .0  .017 .018 5.6 .079 0   0   0 0 .068 .069 8.9 0   0  
loop-acceleration/diamond_2-2.yml .0  .022 .022 5.7 .078 0   0   0 0 .066 .066 8.9 0   0  
loop-acceleration/multivar_1-1.yml .0  .024 .025 5.7 .15  0   0   0 0 .058 .059 8.9 0   0  
loop-acceleration/multivar_1-2.yml .0  .025 .026 5.7 .090 0   0   0 0 .059 .060 8.9 0   0  
loop-acceleration/simple_3-2.yml .0  .025 .028 5.7 .082 0   0   0 0 .059 .060 9.0 0   0  
loop-crafted/simple_array_index_value_2.yml .0  .028 .029 5.7 .14  0   0   0 0 .059 .060 9.0 0   0  
loop-crafted/simple_array_index_value_4.i.v+lhb-reducer.yml .0  .022 .023 5.8 .054 0   0   0 0 .057 .058 8.9 0   0  
loop-crafted/simple_array_index_value_4.i.v+nlh-reducer.yml .0  .027 .029 5.7 .098 0   0   0 0 .060 .062 9.0 0   0  
loop-crafted/simple_array_index_value_4.yml .0  .029 .030 5.8 .12  0   0   0 0 .061 .062 8.9 0   0  
loop-invgen/MADWiFi-encode_ie_ok.yml .0  .037 .038 5.7 .12  0   0   0 0 .057 .057 9.0 0   0  
loop-invgen/NetBSD_loop.yml .0  .025 .027 5.7 .096 0   0   0 0 .057 .058 9.0 0   0  
loop-invgen/SpamAssassin-loop.i.v+cfa-reducer.yml .0  .022 .023 5.7 .083 0   0   0 0 .065 .065 8.9 0   0  
loop-invgen/apache-escape-absolute.i.v+cfa-reducer.yml .0  .027 .028 5.6 .12  0   0   0 0 .057 .058 8.9 0   0  
loop-invgen/apache-escape-absolute.yml .0  .025 .026 5.7 .12  0   0   0 0 .060 .060 8.9 0   0  
loop-invgen/apache-get-tag.i.p+lhb-reducer.yml .0  .036 .038 5.7 .11  0   0   0 0 .062 .063 9.0 0   0  
loop-invgen/apache-get-tag.i.p+nlh-reducer.yml .0  .041 .041 5.7 .10  0   0   0 0 .059 .060 9.0 0   0  
loop-invgen/apache-get-tag.i.p+sep-reducer.yml .0  .023 .024 5.6 .12  0   0   0 0 .059 .060 8.9 0   0  
loop-invgen/apache-get-tag.i.v+lhb-reducer.yml .0  .024 .024 5.6 .12  0   0   0 0 .064 .065 8.9 0   0  
loop-invgen/apache-get-tag.i.v+nlh-reducer.yml .0  .024 .025 5.7 .16  0   0   0 0 .058 .059 8.9 0   0  
loop-invgen/apache-get-tag.yml .0  .026 .027 5.7 .099 0   0   0 0 .057 .058 9.0 0   0  
loop-invgen/down.yml .0  .052 .055 5.7 .16  0   0   0 0 .059 .062 8.9 0   0  
loop-invgen/fragtest_simple.yml .0  .031 .032 5.7 .14  0   0   0 0 .060 .061 8.9 0   0  
loop-invgen/half_2.yml .0  .046 .047 5.5 .097 0   0   0 0 .060 .060 8.9 0   0  
loop-invgen/heapsort.yml .0  .054 .057 5.6 .14  0   0   0 0 .068 .069 9.0 0   0  
loop-invgen/id_build.i.p+nlh-reducer.yml .0  .025 .026 5.7 .092 0   0   0 0 .059 .060 9.0 0   0  
loop-invgen/id_build.i.p+sep-reducer.yml .0  .037 .038 5.6 .089 0   0   0 0 .056 .057 8.9 0   0  
loop-invgen/id_build.i.v+lhb-reducer.yml .0  .021 .022 5.7 .17  0   0   0 0 .060 .066 8.9 0   0  
loop-invgen/id_build.yml .0  .022 .022 5.7 .089 0   0   0 0 .063 .064 8.9 0   0  
loop-invgen/id_trans.yml .0  .024 .025 5.7 .13  0   0   0 0 .059 .060 8.9 0   0  
loop-invgen/large_const.yml .0  .025 .026 5.7 .084 0   0   0 0 .061 .062 8.9 0   0  
loop-invgen/nest-if3.yml .0  .021 .022 5.7 .17  0   0   0 0 .058 .068 8.9 0   0  
loop-invgen/nested6.yml .0  .022 .023 5.7 .14  0   0   0 0 .057 .057 8.9 0   0  
loop-invgen/nested9.yml .0  .023 .024 5.7 .12  0   0   0 0 .060 .061 9.0 0   0  
loop-invgen/sendmail-close-angle.yml .0  .034 .035 5.6 .16  0   0   0 0 .060 .061 8.9 0   0  
loop-invgen/seq-3.yml .0  .025 .027 5.6 .086 0   0   0 0 .058 .059 8.9 0   0  
loop-invgen/up.yml .0  .057 .058 5.8 .085 0   0   0 0 .058 .059 8.9 0   0  
loop-lit/afnp2014.yml .0  .021 .022 5.7 .15  0   0