Benchmark Symbiotic TBF Test-Suite Validator
Tool symbiotic 6.0.3-dev-fd3f777b Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:07:32 CET 2019-02-06 14:52:39 CET
Run set symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized
Options --test-comp --verifier klee-testcomp --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/symbiotic.2019-02-06_0707.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml .0   710    710    15000 7300 .025 .0082 0   0   .057 .058 8.9 0    0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml .0   900    900    15000 7900 .041 7500      0   0   .060 .061 8.9 0    0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml .0   900    900    11000 8800 .033 0      0   0   .056 .057 8.9 0    0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml .0   780    780    15000 5400 .020 .0082 0   0   .056 .056 8.9 0    0  
pals_STARTPALS_ActiveStandby.ufo.BOUNDED-10.pals.yml .0   760    760    15000 6100 .020 .0082 0   0   .061 .062 8.9 0    0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml .0   760    760    15000 6900 .020 .0082 0   0   .087 .088 8.9 0    0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml .0   660    660    15000 8400 .029 .0041 0   0   .059 .060 8.9 0    0  
pals_STARTPALS_Triplicated.ufo.BOUNDED-10.pals.yml .0   740    740    15000 6000 .020 .0082 0   0   .084 .085 8.9 0    0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml .758 68    68    39 990 0     0      75.8 87.5 .19  .21  17   .45 0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml .490 7.8  7.8  22 120 0     0      49.0 73.6 .17  .17  17   .19 0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml .520 36    36    27 500 0     0      52.0 75.0 .17  .18  17   .16 0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml .748 43    43    29 680 0     0      74.8 86.3 .24  .23  17   .73 0  
pals_floodmax.3.ufo.BOUNDED-6.pals.yml .738 43    43    29 570 0     0      73.8 85.6 .22  .22  17   .77 0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml .0   900    900    3000 13000 .053 0      0   0   .059 .059 8.9 0    0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml .342 850    850    1100 10000 0     0      34.2 55.2 .23  .24  20   .29 0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml .539 850    850    1200 14000 0     0      54.0 69.1 .25  .25  20   .53 0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml .648 850    850    1200 10000 0     0      64.8 76.5 .38  .36  20   2.8  0  
pals_floodmax.4.ufo.BOUNDED-8.pals.yml .640 850    850    1200 11000 0     0      64.0 76.2 .36  .41  20   2.8  0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml .0   270    270    15000 4000 .016 .0041 0   0   .059 .059 8.9 0    0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml .0   66    65    15000 770 .016 0      0   0   .086 .087 8.9 0    0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml .0   65    65    15000 780 .016 0      0   0   .056 .057 8.9 0    0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml .0   65    65    15000 790 .016 0      0   0   .060 .060 8.9 0    0  
pals_floodmax.5.ufo.BOUNDED-10.pals.yml .0   65    65    15000 910 .016 0      0   0   .056 .057 8.9 0    0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml .736 1.1  1.1  20 18 0     0      73.6 88.7 .18  .18  17   .48 0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml .740 1.1  1.1  20 16 0     0      74.0 88.4 .16  .16  17   .31 0  
pals_lcr-var-start-time.3.ufo.BOUNDED-6.pals.yml .718 1.1  1.1  20 14 0     0      71.8 87.2 .17  .16  17   .41 0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml .726 2.0  2.0  23 30 0     0      72.6 87.6 .21  .22  17   .65 0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml .729 2.0  2.0  22 30 0     0      72.9 87.4 .19  .19  17   .46 0  
pals_lcr-var-start-time.4.ufo.BOUNDED-8.pals.yml .712 2.0  2.0  23 25 0     0      71.2 86.5 .20  .19  17   .68 0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml .717 6.0  6.0  35 77 0     0      71.7 86.5 .23  .23  17   .91 0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml .713 5.7  5.7  33 85 0     0      71.3 86.0 .22  .25  17   .64 0  
pals_lcr-var-start-time.5.ufo.BOUNDED-10.pals.yml .707 5.8  5.8  33 85 0     0      70.7 85.7 .24  .23  17   1.0  0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml .710 31    31    100 420 0     0      71.0 85.6 .30  .29  17   1.3  0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml .711 27    27    87 350 0     0      71.1 85.5 .25  .25  17   .84 0  
pals_lcr-var-start-time.6.ufo.BOUNDED-12.pals.yml .701 27    27    93 410 0     0      70.1 84.9 .27  .26  17   1.5  0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml .683 1.0  1.0  20 13 0     0      68.3 87.4 .17  .16  17   .23 0  
pals_lcr.3.ufo.BOUNDED-6.pals.yml .658 .98 .98 20 15 0     0      65.8 85.8 .16  .16  17   .28 0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml .667 2.4  2.4  21 26 0     0      66.7 86.0 .17  .16  17   .38 0  
pals_lcr.4.ufo.BOUNDED-8.pals.yml .648 1.9  1.9  20 27 0     0      64.8 84.8 .17  .21  17   .38 0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml .654 8.3  8.3  25 110 0     0      65.4 84.8 .21  .21  17   .62 0  
pals_lcr.5.ufo.BOUNDED-10.pals.yml .640 6.1  6.1  24 91 0     0      64.0 83.8 .20  .19  17   .70 0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml .645 37    37    43 410 0     0      64.5 83.7 .25  .24  17   .86 0  
pals_lcr.6.ufo.BOUNDED-12.pals.yml .632 24    24    38 340 0     0      63.2 82.9 .21  .27  17   .59 0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml .636 170    170    140 2600 0     0      63.6 82.7 .29  .30  17   1.2  0  
pals_lcr.7.ufo.BOUNDED-14.pals.yml .626 110    110    100 1400 0     0      62.6 82.0 .26  .32  17   1.2  0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml .629 840    840    560 9200 0     0      62.9 81.8 .35  .33  18   1.6  0  
pals_lcr.8.ufo.BOUNDED-16.pals.yml .621 510    510    370 5900 0     0      62.1 81.1 .33  .33  18   1.5  0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml .774 60    60    38 820 0     0      77.4 88.6 .19  .19  17   .51 0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml .482 7.1  7.1  23 92 0     0      48.2 73.0 .17  .17  17   .20 0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml .523 37    37    27 490 0     0      52.3 74.3 .17  .22  17   .20 0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml .745 45    45    31 590 0     0      74.5 86.5 .23  .31  17   .79 0  
pals_opt-floodmax.3.ufo.BOUNDED-6.pals.yml .745 45    45    30 580 0     0      74.5 85.8 .22  .21  17   .93 0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml .720 890    890    3200 11000 0     0      72.0 82.6 .25  .26  20   .92 0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml .422 850    850    1200 12000 0     0      42.2 63.5 .24  .24  20   .32 0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml .446 850    850    1200 11000 0     0      44.6 64.4 .24  .24  20   .32 0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml .718 850    850    1300 11000 0     0      71.8 82.4 .45  .43  20   3.4  0  
pals_opt-floodmax.4.ufo.BOUNDED-8.pals.yml .660 850    850    1300 12000 0     0      66.0 77.5 .42  .48  20   3.8  0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml .0   270    270    15000 3900 .016 .0041 0   0   .060 .061 9.0 0    0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml .0   63    62    15000 730 .041 .0041 0   0   .056 .056 8.9 0    0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml .0   63    62    15000 900 .041 0      0   0   .063 .064 8.9 0    0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml .0   63    63    15000 780 .041 .0041 0   0   .057 .058 8.9 0    0  
pals_opt-floodmax.5.ufo.BOUNDED-10.pals.yml .0   62    62    15000 790 .041 .0041 0   0   .081 .082 8.9 0    0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 62 28.0 18000 18000 280000 210000 .52 7500 62 2800 3510 11 12 930 39 0  
Run set symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized