Benchmark Symbiotic TBF Test-Suite Validator
Tool symbiotic 6.0.3-dev-fd3f777b Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:07:32 CET 2019-02-06 14:52:39 CET
Run set symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Loops
Options --test-comp --verifier klee-testcomp --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/symbiotic.2019-02-06_0707.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-2.yml done 1 prog tests 1 inspect .51 .51 19 6.2 0     0   true prog tests 1 inspect
66.7  86.7 .12  .12  17   .078 0  
loops/compact.yml timeout (verification) prog tests 0 inspect 900    900    320 10000   .025 0   error (0) prog tests 0 inspect
0    0   .069 .070 8.8 0     0  
loops/count_up_down-2.yml done 1 prog tests 1 inspect .45 .45 16 5.7 0     0   true prog tests 1 inspect
50.0  72.7 .11  .11  16   .078 0  
loops/eureka_01-1.yml done 1 prog tests 1 inspect 1.0  1.0  19 16   0     0   true prog tests 1 inspect
76.9  93.5 .15  .15  16   .082 0  
loops/for_bounded_loop1.yml done 1 prog tests 1 inspect .58 .58 19 6.8 0     0   true prog tests 1 inspect
75.0  100   .12  .12  16   .078 0  
loops/insertion_sort-1.yml timeout (verification) prog tests 0 inspect 900    900    1500 11000   .025 0   error (0) prog tests 0 inspect
0    0   .079 .080 8.9 0     0  
loops/invert_string-1.yml done 1 prog tests 1 inspect .90 .89 20 11   0     0   true prog tests 1 inspect
87.5  100   .15  .15  16   .078 0  
loops/linear_search.yml done 1 prog tests 1 inspect 3.8  3.8  21 48   0     0   true prog tests 1 inspect
64.3  94.1 .12  .15  17   .078 0  
loops/matrix-2.yml done 1 prog tests 1 inspect 12    12    30 170   0     0   true prog tests 1 inspect
66.7  88.9 .13  .13  17   .082 0  
loops/nec20.yml done 1 prog tests 1 inspect .56 .56 19 7.1 0     0   true prog tests 1 inspect
41.7  62.5 .11  .11  17   .078 0  
loops/string-2.yml done 1 prog tests 1 inspect .78 .78 19 9.1 0     0   true prog tests 1 inspect
69.2  86.2 .12  .12  16   .082 0  
loops/sum01-1.yml done 1 prog tests 1 inspect .72 .72 20 9.5 0     0   true prog tests 1 inspect
70.0  90.0 .14  .14  16   .078 0  
loops/sum01_bug02.yml done 1 prog tests 1 inspect .66 .65 20 8.9 0     0   true prog tests 1 inspect
70.0  90.9 .12  .12  16   .078 0  
loops/sum01_bug02_sum01_bug02_base.case.yml done 1 prog tests 1 inspect .61 .60 20 8.4 0     0   true prog tests 1 inspect
70.0  90.0 .12  .12  17   .078 0  
loops/sum03-1.yml done 1 prog tests 1 inspect .51 .51 16 6.1 0     0   true prog tests 1 inspect
87.5  100   .11  .11  16   .078 0  
loops/sum_array-1.yml done 1 prog tests 1 inspect .75 .75 19 9.3 0     0   true prog tests 1 inspect
80.0  93.8 .11  .11  16   .078 0  
loops/terminator_01.yml done 1 prog tests 1 inspect .44 .44 17 6.5 0     0   true prog tests 1 inspect
75.0  81.8 .11  .11  16   .078 0  
loops/terminator_02-1.yml done 1 prog tests 1 inspect .58 .58 19 9.4 0     0   true prog tests 1 inspect
37.5  56.2 .12  .12  16   .078 0  
loops/terminator_03-1.yml done prog tests 1 inspect .49 .48 19 7.2 0     0   unknown prog tests 0 inspect
.00 25.0 .11  .13  16   .078 0  
loops/trex01-1.yml done prog tests 1 inspect .64 .64 19 8.7 0     0   unknown prog tests 0 inspect
7.14 23.1 .12  .12  17   .082 0  
loops/trex02-2.yml done 1 prog tests 1 inspect .56 .55 19 6.4 0     0   true prog tests 1 inspect
33.3  50.0 .13  .13  16   .078 0  
loops/trex03-1.yml done 1 prog tests 1 inspect .66 .66 19 7.6 0     0   true prog tests 1 inspect
27.8  56.2 .12  .12  17   .078 0  
loops/vogal-2.yml done 1 prog tests 1 inspect .78 .78 19 11   0     0   true prog tests 1 inspect
88.9  88.5 .12  .12  16   .078 0  
loop-acceleration/array_3-2.yml done 1 prog tests 1 inspect 6.5  6.5  21 87   0     0   true prog tests 1 inspect
75.0  88.9 .14  .14  17   .078 0  
loop-acceleration/diamond_1-2.yml done 1 prog tests 1 inspect .49 .49 19 6.6 0     0   true prog tests 1 inspect
66.7  83.3 .12  .12  17   .078 0  
loop-acceleration/multivar_1-2.yml done 1 prog tests 1 inspect .46 .46 16 5.7 0     0   true prog tests 1 inspect
75.0  90.9 .12  .12  16   .078 0  
loop-invgen/id_trans.yml done 1 prog tests 1 inspect .60 .59 24 7.5 0     0   true prog tests 1 inspect
62.5  93.3 .15  .15  17   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 27 23 1800 1800 2300 22000 .049 0   27 1520 1990 3.2 3.3 430 2.0 0  
Run set symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Loops