Benchmark Symbiotic TBF Test-Suite Validator
Tool symbiotic 6.0.3-dev-fd3f777b Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:07:32 CET 2019-02-06 14:52:39 CET
Run set symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Recursive
Options --test-comp --verifier klee-testcomp --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/symbiotic.2019-02-06_0707.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
recursive/Ackermann01-2.yml done .722 prog tests 5 inspect 840    840    12000 13000   0      0      unknown prog tests 0 inspect
72.2 94.1 .13  .13  16   .14  0  
recursive/Ackermann02.yml done .812 prog tests 6 inspect 840    840    12000 13000   0      0      true prog tests 1 inspect
81.2 100   .13  .16  16   .16  0  
recursive/Ackermann03.yml done .611 prog tests 5 inspect 840    840    12000 12000   0      0      unknown prog tests 0 inspect
61.1 94.1 .14  .13  17   .14  0  
recursive/Ackermann04.yml done .611 prog tests 5 inspect 840    840    12000 12000   0      0      unknown prog tests 0 inspect
61.1 94.1 .13  .13  16   .14  0  
recursive/Addition01-2.yml timeout (verification) .0   prog tests 0 inspect 900    900    120 8100   .0041 0      error (0) prog tests 0 inspect
0   0   .058 .059 8.9 0     0  
recursive/Addition02.yml timeout (verification) .0   prog tests 0 inspect 900    900    120 8100   .012  0      error (0) prog tests 0 inspect
0   0   .074 .075 9.0 0     0  
recursive/Addition03-1.yml done .417 prog tests 2 inspect 890    890    130 9700   0      0      unknown prog tests 0 inspect
41.7 80.0 .12  .12  16   .094 0  
recursive/BallRajamani-SPIN2000-Fig1.yml done 1.0   prog tests 2 inspect .33 .33 18 3.4 0      0      true prog tests 1 inspect
100   100   .12  .12  17   .094 0  
recursive/EvenOdd01-1.yml done .786 prog tests 5 inspect 840    840    1800 8700   0      0      unknown prog tests 0 inspect
78.6 90.5 .13  .13  17   .14  0  
recursive/EvenOdd03.yml done .357 prog tests 2 inspect 840    840    2200 8600   0      0      true prog tests 1 inspect
35.7 52.4 .12  .12  17   .094 0  
recursive/Fibonacci01-1.yml probably out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 780    780    15000 13000   .045  0      error (0) prog tests 0 inspect
0   0   .064 .065 9.0 0     0  
recursive/Fibonacci03.yml probably out of memory (killed (signal 9, verification)) .0   prog tests 0 inspect 780    780    15000 13000   .049  .0041 error (0) prog tests 0 inspect
0   0   .069 .070 8.9 0     0  
recursive/Fibonacci04.yml done .875 prog tests 4 inspect 840    840    2400 11000   0      0      true prog tests 1 inspect
87.5 100   .12  .12  16   .13  0  
recursive/Fibonacci05.yml done .875 prog tests 4 inspect 840    840    3100 11000   0      0      true prog tests 1 inspect
87.5 100   .12  .12  16   .13  0  
recursive/McCarthy91-1.yml done .875 prog tests 4 inspect 840    840    230 10000   0      0      true prog tests 1 inspect
87.5 100   .12  .12  16   .13  0  
recursive/McCarthy91-2.yml done .75  prog tests 3 inspect 840    840    230 12000   0      0      unknown prog tests 0 inspect
75.0 90.0 .12  .12  16   .11  0  
recursive/MultCommutative-2.yml done .556 prog tests 4 inspect 840    840    46 13000   0      0      unknown prog tests 0 inspect
55.6 88.9 .14  .14  16   .13  0  
recursive/gcd01-1.yml done .611 prog tests 5 inspect 860    860    79 10000   0      0      unknown prog tests 0 inspect
61.1 89.5 .13  .12  16   .14  0  
recursive/gcd02.yml timeout (verification) .0   prog tests 0 inspect 900    900    77 11000   .012  0      error (0) prog tests 0 inspect
0   0   .086 .088 8.9 0     0  
recursive/recHanoi01.yml done .8   prog tests 3 inspect 840    840    13000 11000   0      0      unknown prog tests 0 inspect
80.0 95.0 .13  .15  17   .11  0  
recursive/recHanoi02-2.yml done .75  prog tests 4 inspect .63 .63 19 7.2 0      0      unknown prog tests 0 inspect
75.0 91.7 .15  .15  17   .13  0  
recursive/recHanoi03-2.yml done .75  prog tests 4 inspect .62 .62 19 8.1 0      0      unknown prog tests 0 inspect
75.0 91.7 .13  .13  17   .13  0  
recursive-simple/id2_b2_o3.yml done .7   prog tests 3 inspect 840    840    860 10000   0      0      unknown prog tests 0 inspect
70.0 93.3 .12  .12  16   .11  0  
recursive-simple/id2_b3_o2.yml done .8   prog tests 3 inspect 840    840    980 9600   0      0      true prog tests 1 inspect
80.0 100   .12  .12  16   .11  0  
recursive-simple/id2_b3_o5.yml done .7   prog tests 3 inspect 840    840    840 9600   0      0      unknown prog tests 0 inspect
70.0 93.3 .13  .13  16   .11  0  
recursive-simple/id2_b5_o10.yml done .7   prog tests 3 inspect 840    840    840 9000   0      0      unknown prog tests 0 inspect
70.0 93.3 .12  .13  16   .11  0  
recursive-simple/id_b2_o3.yml done .667 prog tests 2 inspect 840    840    1900 8100   0      0      unknown prog tests 0 inspect
66.7 90.0 .11  .13  17   .094 0  
recursive-simple/id_b3_o2-2.yml done .833 prog tests 3 inspect 840    840    2500 9300   0      0      true prog tests 1 inspect
83.3 100   .12  .15  16   .11  0  
recursive-simple/id_b3_o5-2.yml done .667 prog tests 2 inspect 840    840    2000 9900   0      0      unknown prog tests 0 inspect
66.7 90.0 .11  .11  16   .094 0  
recursive-simple/id_b5_o10-2.yml done .667 prog tests 3 inspect 840    840    2000 8900   0      0      unknown prog tests 0 inspect
66.7 90.0 .12  .12  17   .11  0  
recursive-simple/id_o10.yml done 1.0   prog tests 2 inspect .31 .31 18 3.9 0      0      true prog tests 1 inspect
100   100   .12  .12  16   .094 0  
recursive-simple/id_o100.yml done 1.0   prog tests 2 inspect .32 .31 18 3.2 0      0      true prog tests 1 inspect
100   100   .12  .14  16   .090 0  
recursive-simple/id_o1000.yml done 1.0   prog tests 2 inspect .31 .30 19 3.3 0      0      true prog tests 1 inspect
100   100   .11  .11  16   .094 0  
recursive-simple/id_o20.yml done 1.0   prog tests 2 inspect .31 .31 18 4.0 0      0      true prog tests 1 inspect
100   100   .15  .15  16   .094 0  
recursive-simple/id_o200.yml done 1.0   prog tests 2 inspect .32 .31 18 3.8 0      0      true prog tests 1 inspect
100   100   .11  .11  16   .094 0  
recursive-simple/id_o3.yml done 1.0   prog tests 2 inspect .33 .33 19 3.5 0      0      true prog tests 1 inspect
100   100   .11  .12  16   .094 0  
recursive-simple/sum_non_eq-2.yml done .5   prog tests 1 inspect .31 .31 16 3.5 0      0      unknown prog tests 0 inspect
50.0 80.0 .12  .12  16   .078 0  
recursive-simple/sum_non_eq-3.yml done .5   prog tests 1 inspect .32 .32 16 3.5 0      0      true prog tests 1 inspect
50.0 90.0 .12  .12  16   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 38 24.9 23000 23000 110000 280000 .12 .0041 38 2490 3070 4.5 4.6 590 3.7 0  
Run set symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Recursive