Benchmark Symbiotic TBF Test-Suite Validator
Tool symbiotic 6.0.3-dev-fd3f777b Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:07:32 CET 2019-02-06 14:52:39 CET
Run set symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Arrays tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Arrays
Options --test-comp --verifier klee-testcomp --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/symbiotic.2019-02-06_0707.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/standard_copy1_ground-2.yml done 1 prog tests 1 inspect 6.9  6.9  420 100 0     0   true prog tests 1 inspect
75.0 90.0 5.1   5.1   760   .078 0  
array-examples/standard_copy2_ground-1.yml done 1 prog tests 1 inspect 9.3  9.3  530 120 0     0   true prog tests 1 inspect
80.0 91.7 5.1   5.1   760   .078 0  
array-examples/standard_copy3_ground-2.yml done 1 prog tests 1 inspect 10    10    580 150 0     0   true prog tests 1 inspect
83.3 92.9 5.2   5.2   760   .078 0  
array-examples/standard_copy4_ground-2.yml done 1 prog tests 1 inspect 11    11    640 160 0     0   true prog tests 1 inspect
85.7 93.8 5.2   5.2   760   .078 0  
array-examples/standard_copy5_ground-2.yml done 1 prog tests 1 inspect 13    13    700 170 0     0   true prog tests 1 inspect
87.5 94.4 5.4   5.4   760   .078 0  
array-examples/standard_copy6_ground-1.yml done 1 prog tests 1 inspect 13    13    770 220 0     0   true prog tests 1 inspect
88.9 95.0 5.0   5.0   760   .078 0  
array-examples/standard_copy7_ground-1.yml done 1 prog tests 1 inspect 15    15    850 190 0     0   true prog tests 1 inspect
90.0 95.5 5.0   5.0   760   .082 0  
array-examples/standard_copy8_ground-2.yml done 1 prog tests 1 inspect 16    16    930 200 0     0   true prog tests 1 inspect
90.9 95.8 5.1   5.1   760   .082 0  
array-examples/standard_copy9_ground-1.yml done 1 prog tests 1 inspect 17    17    1000 210 0     0   true prog tests 1 inspect
91.7 96.2 5.1   5.1   760   .082 0  
array-examples/standard_partition_ground-1.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 45    45    15000 540 .020 0   error (0) prog tests 0 inspect
0   0   .058 .059 9.0 0     0  
array-industry-pattern/array_ptr_single_elem_init-2.yml done 1 prog tests 1 inspect 2.0  2.0  190 21 0     0   true prog tests 1 inspect
71.4 94.1 2.7   2.7   380   .078 0  
array-industry-pattern/array_single_elem_init.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 15    14    15000 220 .082 0   error (0) prog tests 0 inspect
0   0   .060 .061 9.0 0     0  
reducercommutativity/rangesum.yml done 1 prog tests 1 inspect 1.3  1.3  23 21 0     0   true prog tests 1 inspect
75.0 93.5 .12  .12  16   .082 0  
reducercommutativity/rangesum05.yml done 1 prog tests 1 inspect .88 .88 64 10 0     0   true prog tests 1 inspect
78.6 92.6 .12  .12  16   .082 0  
reducercommutativity/rangesum10.yml done 1 prog tests 1 inspect .91 .90 63 11 0     0   true prog tests 1 inspect
78.6 92.6 .12  .12  16   .082 0  
reducercommutativity/rangesum20.yml done 1 prog tests 1 inspect 1.8  1.8  65 21 0     0   true prog tests 1 inspect
78.6 92.6 .12  .12  16   .082 0  
reducercommutativity/rangesum40.yml done 1 prog tests 1 inspect 7.3  7.3  70 100 0     0   true prog tests 1 inspect
78.6 92.6 .12  .14  16   .082 0  
reducercommutativity/rangesum60.yml done 1 prog tests 1 inspect 50    50    86 620 0     0   true prog tests 1 inspect
78.6 92.6 .12  .12  16   .082 0  
array-tiling/mlceu.yml timeout (verification) prog tests 0 inspect 900    900    2200 12000 .025 0   error (0) prog tests 0 inspect
0   0   .058 .059 8.9 0     0  
array-tiling/skippedu.yml done prog tests 1 inspect 1.0  1.0  24 14 0     0   unknown prog tests 0 inspect
66.7 88.2 .11  .11  16   .082 0  
array-programs/copysome1-2.yml done 1 prog tests 1 inspect 25    25    1200 220 0     0   true prog tests 1 inspect
83.3 92.9 10     10     1500   .078 0  
array-programs/copysome2-2.yml done 1 prog tests 1 inspect 44    44    1500 360 0     0   true prog tests 1 inspect
92.9 94.1 15     15     2300   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 22 18 1200 1200 42000 16000 .13 0   22 1560 1770 75 75 11000 1.5 0  
Run set symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Arrays tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Arrays