Benchmark KLEE TBF Test-Suite Validator
Tool KLEE 2.0.0-pre-test-comp Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:09:47 CET 2019-02-06 06:16:47 CET
Run set klee.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-klee.test-comp19_prop-coverage-branches.ReachSafety-Recursive
Options --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/klee.2019-02-05_2109.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
recursive/Ackermann01-2.yml timeout .833 prog tests 14 inspect 900    900    71 12000   .016 0   unknown prog tests 0 inspect
83.3 94.1 .16 .15 16 .29 0  
recursive/Ackermann02.yml timeout (false(unreach-call)) 1.0   prog tests 15 inspect 900    900    67 11000   .016 0   true prog tests 1 inspect
100   100   .16 .16 16 .31 0  
recursive/Ackermann03.yml timeout .944 prog tests 15 inspect 900    900    72 13000   .016 0   unknown prog tests 0 inspect
94.4 94.1 .17 .16 16 .31 0  
recursive/Ackermann04.yml timeout .944 prog tests 15 inspect 900    900    71 13000   .016 0   unknown prog tests 0 inspect
94.4 94.1 .18 .17 16 .31 0  
recursive/Addition01-2.yml timeout .75  prog tests 11 inspect 900    900    320 13000   .016 0   unknown prog tests 0 inspect
75.0 79.0 .15 .14 17 .24 0  
recursive/Addition02.yml timeout (false(unreach-call)) .812 prog tests 12 inspect 900    900    320 12000   .041 0   true prog tests 1 inspect
81.2 84.2 .16 .19 16 .26 0  
recursive/Addition03-1.yml timeout .833 prog tests 7 inspect 900    900    830 14000   .049 0   unknown prog tests 0 inspect
83.3 86.7 .14 .13 16 .18 0  
recursive/BallRajamani-SPIN2000-Fig1.yml false(unreach-call) 1.0   prog tests 4 inspect .12 .13 21 1.2 .016 0   true prog tests 1 inspect
100   100   .13 .13 16 .13 0  
recursive/EvenOdd01-1.yml timeout .786 prog tests 12 inspect 900    900    3900 13000   .029 0   unknown prog tests 0 inspect
78.6 90.5 .16 .20 19 .26 0  
recursive/EvenOdd03.yml timeout (false(unreach-call)) .786 prog tests 11 inspect 900    900    3900 12000   .049 0   true prog tests 1 inspect
78.6 90.5 .16 .16 20 .24 0  
recursive/Fibonacci01-1.yml timeout .9   prog tests 8 inspect 900    900    22 12000   .016 0   unknown prog tests 0 inspect
90.0 92.9 .14 .14 17 .19 0  
recursive/Fibonacci03.yml timeout .9   prog tests 9 inspect 900    900    21 12000   .016 0   unknown prog tests 0 inspect
90.0 92.9 .14 .14 16 .21 0  
recursive/Fibonacci04.yml timeout (false(unreach-call)) .875 prog tests 8 inspect 900    900    1100 11000   .049 0   true prog tests 1 inspect
87.5 100   .14 .14 16 .19 0  
recursive/Fibonacci05.yml timeout (false(unreach-call)) 1.0   prog tests 8 inspect 900    900    1100 14000   .049 0   true prog tests 1 inspect
100   100   .14 .14 17 .19 0  
recursive/McCarthy91-1.yml timeout (false(unreach-call)) .875 prog tests 8 inspect 900    900    350 11000   .016 0   true prog tests 1 inspect
87.5 100   .17 .16 16 .19 0  
recursive/McCarthy91-2.yml timeout .75  prog tests 7 inspect 900    900    47 11000   .016 0   unknown prog tests 0 inspect
75.0 90.0 .14 .15 16 .16 0  
recursive/MultCommutative-2.yml timeout .667 prog tests 11 inspect 900    900    830 11000   .049 0   unknown prog tests 0 inspect
66.7 88.9 .15 .14 16 .24 0  
recursive/gcd01-1.yml timeout .611 prog tests 11 inspect 900    900    190 14000   .016 0   unknown prog tests 0 inspect
61.1 89.5 .15 .14 16 .24 0  
recursive/gcd02.yml timeout .727 prog tests 11 inspect 900    900    74 14000   .020 0   unknown prog tests 0 inspect
72.7 88.5 .15 .15 16 .25 0  
recursive/recHanoi01.yml false(valid-deref) .9   prog tests 10 inspect 860    860    21 12000   .016 0   unknown prog tests 0 inspect
90.0 95.0 20    20    16 .21 0  
recursive/recHanoi02-2.yml done .875 prog tests 8 inspect .13 .15 21 1.6 .016 0   unknown prog tests 0 inspect
87.5 91.7 .14 .16 16 .19 0  
recursive/recHanoi03-2.yml done .875 prog tests 8 inspect .17 .19 21 1.4 .016 0   unknown prog tests 0 inspect
87.5 91.7 .14 .14 17 .19 0  
recursive-simple/id2_b2_o3.yml timeout .9   prog tests 8 inspect 900    900    500 13000   .016 0   unknown prog tests 0 inspect
90.0 93.3 .15 .15 20 .19 0  
recursive-simple/id2_b3_o2.yml timeout (false(unreach-call)) 1.0   prog tests 9 inspect 900    900    650 12000   .045 0   true prog tests 1 inspect
100   100   .15 .22 19 .21 0  
recursive-simple/id2_b3_o5.yml timeout .9   prog tests 8 inspect 900    900    650 12000   .045 0   unknown prog tests 0 inspect
90.0 93.3 .14 .14 19 .19 0  
recursive-simple/id2_b5_o10.yml timeout .9   prog tests 8 inspect 900    900    650 12000   .049 0   unknown prog tests 0 inspect
90.0 93.3 .14 .14 19 .19 0  
recursive-simple/id_b2_o3.yml timeout .833 prog tests 5 inspect 900    900    650 12000   .037 0   unknown prog tests 0 inspect
83.3 90.0 .12 .12 17 .14 0  
recursive-simple/id_b3_o2-2.yml timeout (false(unreach-call)) 1.0   prog tests 6 inspect 900    900    3900 11000   .049 0   true prog tests 1 inspect
100   100   .13 .13 17 .16 0  
recursive-simple/id_b3_o5-2.yml timeout .833 prog tests 5 inspect 900    900    3600 11000   .049 0   unknown prog tests 0 inspect
83.3 90.0 .13 .13 17 .14 0  
recursive-simple/id_b5_o10-2.yml timeout .833 prog tests 5 inspect 900    900    3700 12000   .049 0   unknown prog tests 0 inspect
83.3 90.0 .13 .16 16 .14 0  
recursive-simple/id_o10.yml timeout (false(unreach-call)) 1.0   prog tests 6 inspect 900    900    650 11000   .037 0   true prog tests 1 inspect
100   100   .14 .16 17 .16 0  
recursive-simple/id_o100.yml timeout (false(unreach-call)) 1.0   prog tests 6 inspect 900    900    660 11000   .045 0   true prog tests 1 inspect
100   100   .13 .13 16 .16 0  
recursive-simple/id_o1000.yml timeout (false(unreach-call)) 1.0   prog tests 6 inspect 900    900    660 13000   .025 0   true prog tests 1 inspect
100   100   .13 .15 16 .16 0  
recursive-simple/id_o20.yml timeout (false(unreach-call)) 1.0   prog tests 6 inspect 900    900    650 13000   .041 0   true prog tests 1 inspect
100   100   .14 .14 16 .16 0  
recursive-simple/id_o200.yml timeout (false(unreach-call)) 1.0   prog tests 6 inspect 900    900    660 12000   .049 0   true prog tests 1 inspect
100   100   .15 .15 16 .16 0  
recursive-simple/id_o3.yml timeout (false(unreach-call)) 1.0   prog tests 6 inspect 900    900    650 12000   .049 0   true prog tests 1 inspect
100   100   .13 .13 16 .16 0  
recursive-simple/sum_non_eq-2.yml timeout .75  prog tests 4 inspect 900    900    660 12000   .045 0   unknown prog tests 0 inspect
75.0 90.0 .13 .14 17 .13 0  
recursive-simple/sum_non_eq-3.yml timeout (false(unreach-call)) .75  prog tests 5 inspect 900    900    660 11000   .049 0   true prog tests 1 inspect
75.0 100   .13 .13 17 .14 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 38 33.3  31000 31000 33000 430000 1.2   0   38 3330 3570 26 26 640 7.6 0  
Run set klee.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-klee.test-comp19_prop-coverage-branches.ReachSafety-Recursive