Benchmark KLEE TBF Test-Suite Validator
Tool KLEE 2.0.0-pre-test-comp Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:09:47 CET 2019-02-06 06:16:47 CET
Run set klee.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-klee.test-comp19_prop-coverage-error-call.ReachSafety-Loops
Options --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/klee.2019-02-05_2109.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-2.yml false(unreach-call) 1 prog tests 1 inspect .12 .14 21 1.3  .016 0   true prog tests 1 inspect
66.7 86.7 .12  .17  16   .078 0  
loops/compact.yml timeout prog tests 0 inspect 900    900    2800 11000    .041 0   unknown prog tests 0 inspect
0   0   .073 .074 9.0 0     0  
loops/count_up_down-2.yml false(unreach-call) 1 prog tests 1 inspect .12 .14 21 1.2  .016 0   true prog tests 1 inspect
50.0 72.7 .12  .12  16   .078 0  
loops/eureka_01-1.yml false(unreach-call) 1 prog tests 1 inspect .13 .15 21 1.6  .016 0   true prog tests 1 inspect
76.9 93.5 .12  .12  17   .082 0  
loops/for_bounded_loop1.yml false(unreach-call) 1 prog tests 1 inspect .14 .16 21 1.2  .016 0   true prog tests 1 inspect
75.0 100   .12  .12  17   .078 0  
loops/insertion_sort-1.yml false(valid-deref) prog tests 0 inspect .12 .12 21 1.4  .016 0   unknown prog tests 0 inspect
0   0   .060 .060 9.0 0     0  
loops/invert_string-1.yml false(unreach-call) 1 prog tests 1 inspect .13 .15 21 1.4  .016 0   true prog tests 1 inspect
87.5 100   .12  .12  17   .078 0  
loops/linear_search.yml done prog tests 0 inspect .17 .20 21 1.6  .016 0   unknown prog tests 0 inspect
0   0   .058 .059 9.0 0     0  
loops/matrix-2.yml false(valid-deref) 1 prog tests 1 inspect 39    39    120 590    .016 0   true prog tests 1 inspect
91.7 100   .12  .12  16   .082 0  
loops/nec20.yml false(unreach-call) 1 prog tests 1 inspect .14 .16 21 1.2  .016 0   true prog tests 1 inspect
41.7 62.5 .12  .12  16   .078 0  
loops/string-2.yml false(unreach-call) 1 prog tests 1 inspect .15 .16 21 .84 .016 0   true prog tests 1 inspect
69.2 86.2 .12  .12  16   .082 0  
loops/sum01-1.yml false(unreach-call) 1 prog tests 1 inspect .14 .16 21 1.1  .016 0   true prog tests 1 inspect
70.0 90.0 .12  .14  16   .078 0  
loops/sum01_bug02.yml false(unreach-call) 1 prog tests 1 inspect .13 .14 21 1.2  .016 0   true prog tests 1 inspect
70.0 90.9 .12  .12  16   .078 0  
loops/sum01_bug02_sum01_bug02_base.case.yml false(unreach-call) 1 prog tests 1 inspect .12 .12 21 1.3  .016 0   true prog tests 1 inspect
70.0 90.0 .12  .12  16   .078 0  
loops/sum03-1.yml false(unreach-call) 1 prog tests 1 inspect .13 .15 21 1.1  .016 0   true prog tests 1 inspect
87.5 100   .11  .11  16   .078 0  
loops/sum_array-1.yml false(valid-deref) 1 prog tests 1 inspect .14 .16 21 1.5  .016 0   true prog tests 1 inspect
80.0 93.8 .13  .15  16   .070 0  
loops/terminator_01.yml false(unreach-call) 1 prog tests 1 inspect .13 .15 22 1.3  .016 0   true prog tests 1 inspect
50.0 72.7 .12  .12  16   .078 0  
loops/terminator_02-1.yml false(unreach-call) 1 prog tests 1 inspect .14 .16 21 1.0  .016 0   true prog tests 1 inspect
25.0 56.2 .12  .12  16   .078 0  
loops/terminator_03-1.yml false(unreach-call) 1 prog tests 1 inspect .13 .15 21 1.3  .016 0   true prog tests 1 inspect
41.7 75.0 .11  .11  16   .078 0  
loops/trex01-1.yml false(unreach-call) 1 prog tests 1 inspect .15 .16 21 1.1  .016 0   true prog tests 1 inspect
28.6 50.0 .12  .12  17   .082 0  
loops/trex02-2.yml false(unreach-call) 1 prog tests 1 inspect .16 .18 21 .98 .016 0   true prog tests 1 inspect
33.3 50.0 .12  .12  16   .078 0  
loops/trex03-1.yml false(unreach-call) 1 prog tests 1 inspect .13 .15 21 1.1  .016 0   true prog tests 1 inspect
22.2 56.2 .12  .12  16   .078 0  
loops/vogal-2.yml false(unreach-call) 1 prog tests 1 inspect .15 .17 21 1.1  .016 0   true prog tests 1 inspect
88.9 88.5 .12  .12  16   .078 0  
loop-acceleration/array_3-2.yml false(unreach-call) 1 prog tests 1 inspect .93 .95 21 14    .016 0   true prog tests 1 inspect
75.0 88.9 .16  .16  17   .078 0  
loop-acceleration/diamond_1-2.yml false(unreach-call) 1 prog tests 1 inspect .13 .15 21 1.2  .016 0   true prog tests 1 inspect
66.7 83.3 .12  .12  16   .078 0  
loop-acceleration/multivar_1-2.yml false(unreach-call) 1 prog tests 1 inspect .12 .14 21 1.1  .016 0   true prog tests 1 inspect
50.0 72.7 .11  .12  17   .078 0  
loop-invgen/id_trans.yml false(unreach-call) 1 prog tests 1 inspect .13 .15 21 1.2  .016 0   true prog tests 1 inspect
62.5 93.3 .12  .12  16   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 27 24 940 940 3400 11000 .47 0   27 1480 1950 3.1 3.2 420 1.9 0  
Run set klee.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-klee.test-comp19_prop-coverage-error-call.ReachSafety-Loops