Benchmark KLEE TBF Test-Suite Validator
Tool KLEE 2.0.0-pre-test-comp Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:09:47 CET 2019-02-06 06:16:47 CET
Run set klee.test-comp19_prop-coverage-error-call.ReachSafety-Arrays tbf-testsuite-validator-klee.test-comp19_prop-coverage-error-call.ReachSafety-Arrays
Options --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/klee.2019-02-05_2109.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/standard_copy1_ground-2.yml false(unreach-call) 1 prog tests 1 inspect 1.9  1.9  180 28   .016 0   true prog tests 1 inspect
75.0 90.0 5.4   5.5   860   .078 0  
array-examples/standard_copy2_ground-1.yml false(unreach-call) 1 prog tests 1 inspect 2.2  2.2  190 35   .016 0   true prog tests 1 inspect
80.0 91.7 5.5   5.6   860   .078 0  
array-examples/standard_copy3_ground-2.yml false(unreach-call) 1 prog tests 1 inspect 2.6  2.6  190 34   .016 0   true prog tests 1 inspect
83.3 92.9 5.5   5.6   860   .078 0  
array-examples/standard_copy4_ground-2.yml false(unreach-call) 1 prog tests 1 inspect 3.1  3.1  200 44   .016 0   true prog tests 1 inspect
85.7 93.8 5.6   5.7   860   .078 0  
array-examples/standard_copy5_ground-2.yml false(unreach-call) 1 prog tests 1 inspect 3.5  3.5  200 46   .016 0   true prog tests 1 inspect
87.5 94.4 5.4   5.4   860   .078 0  
array-examples/standard_copy6_ground-1.yml false(unreach-call) 1 prog tests 1 inspect 3.9  3.9  200 52   .016 0   true prog tests 1 inspect
88.9 95.0 5.4   5.4   860   .078 0  
array-examples/standard_copy7_ground-1.yml false(unreach-call) 1 prog tests 1 inspect 4.4  4.4  210 66   .016 0   true prog tests 1 inspect
90.0 95.5 5.5   5.6   860   .082 0  
array-examples/standard_copy8_ground-2.yml false(unreach-call) 1 prog tests 1 inspect 4.8  4.9  210 68   .016 0   true prog tests 1 inspect
90.9 95.8 5.4   5.4   860   .082 0  
array-examples/standard_copy9_ground-1.yml false(unreach-call) 1 prog tests 1 inspect 5.4  5.4  210 86   .016 0   true prog tests 1 inspect
91.7 96.2 5.4   5.4   860   .082 0  
array-examples/standard_partition_ground-1.yml out of memory prog tests 0 inspect 8.3  7.9  15000 99   .061 0   unknown prog tests 0 inspect
0   0   .070 .071 9.0 0     0  
array-industry-pattern/array_ptr_single_elem_init-2.yml timeout prog tests 0 inspect 900    900    11000 9400   .016 0   unknown prog tests 0 inspect
0   0   .057 .058 8.9 0     0  
array-industry-pattern/array_single_elem_init.yml timeout prog tests 0 inspect 900    900    11000 8700   .016 0   unknown prog tests 0 inspect
0   0   .061 .062 8.9 0     0  
reducercommutativity/rangesum.yml false(valid-deref) 1 prog tests 1 inspect .26 .28 41 2.9 .016 0   true prog tests 1 inspect
75.0 93.5 .12  .12  16   .082 0  
reducercommutativity/rangesum05.yml false(unreach-call) 1 prog tests 1 inspect .14 .17 21 1.2 .016 0   true prog tests 1 inspect
78.6 92.6 .13  .13  16   .082 0  
reducercommutativity/rangesum10.yml false(unreach-call) 1 prog tests 1 inspect .14 .15 22 2.7 .016 0   true prog tests 1 inspect
78.6 92.6 .12  .12  16   .082 0  
reducercommutativity/rangesum20.yml false(unreach-call) 1 prog tests 1 inspect .18 .20 36 3.1 .016 0   true prog tests 1 inspect
78.6 92.6 .12  .12  16   .082 0  
reducercommutativity/rangesum40.yml false(unreach-call) 1 prog tests 1 inspect .21 .23 41 2.2 .016 0   true prog tests 1 inspect
78.6 92.6 .12  .12  17   .082 0  
reducercommutativity/rangesum60.yml false(unreach-call) 1 prog tests 1 inspect .23 .25 48 2.7 .016 0   true prog tests 1 inspect
78.6 92.6 .12  .14  16   .082 0  
array-tiling/mlceu.yml done prog tests 0 inspect .16 .18 21 1.2 .016 0   unknown prog tests 0 inspect
0   0   .064 .064 8.9 0     0  
array-tiling/skippedu.yml false(unreach-call) 1 prog tests 1 inspect .17 .18 21 1.5 .016 0   true prog tests 1 inspect
72.2 94.1 .14  .14  16   .082 0  
array-programs/copysome1-2.yml false(unreach-call) 1 prog tests 1 inspect 5.1  5.1  350 74   .016 0   true prog tests 1 inspect
83.3 92.9 11     11     1700   .078 0  
array-programs/copysome2-2.yml false(unreach-call) 1 prog tests 1 inspect 7.2  7.2  530 110   .016 0   true prog tests 1 inspect
92.9 94.1 16     16     2600   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 22 18 1900 1900 41000 19000 .41 0   22 1490 1680 77 78 12000 1.4 0  
Run set klee.test-comp19_prop-coverage-error-call.ReachSafety-Arrays tbf-testsuite-validator-klee.test-comp19_prop-coverage-error-call.ReachSafety-Arrays