Benchmark Symbiotic TBF Test-Suite Validator
Tool symbiotic 6.0.3-dev-fd3f777b Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:07:32 CET 2019-02-06 14:52:39 CET
Run set symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized
Options --test-comp --verifier klee-testcomp --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/symbiotic.2019-02-06_0707.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml 1 1.8 1.8 25 26 0     0      31.9  61.2  .19  .19  17   .17  0  
pals_STARTPALS_ActiveStandby.1.ufo.UNBOUNDED.pals.yml 1 1.8 1.8 26 23 0     0      31.7  61.5  .18  .18  17   .17  0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml 1 1.8 1.8 25 22 0     0      34.3  63.4  .17  .17  17   .17  0  
pals_STARTPALS_ActiveStandby.4_1.ufo.UNBOUNDED.pals.yml 1 1.8 1.8 26 22 0     0      37.5  68.5  .16  .16  17   .17  0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml 1 1.8 1.8 25 27 0     0      36.3  64.3  .16  .16  17   .17  0  
pals_STARTPALS_ActiveStandby.4_2.ufo.UNBOUNDED.pals.yml 1 1.8 1.8 26 22 0     0      36.1  64.3  .15  .15  17   .17  0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml 1 8.3 8.3 260 100 0     0      62.2  85.7  .16  .16  17   .17  0  
pals_STARTPALS_ActiveStandby.5.ufo.UNBOUNDED.pals.yml 1 8.1 8.1 250 110 0     0      62.4  84.6  .16  .16  17   .17  0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml 1 1.8 1.8 26 23 0     0      43.8  69.3  .15  .15  17   .16  0  
pals_STARTPALS_Triplicated.1.ufo.UNBOUNDED.pals.yml 1 1.8 1.8 26 29 0     0      43.7  69.3  .15  .15  17   .16  0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml 1 2.0 2.0 26 26 0     0      53.2  75.5  .15  .17  17   .16  0  
pals_STARTPALS_Triplicated.2.ufo.UNBOUNDED.pals.yml 1 2.0 2.0 26 25 0     0      53.2  75.7  .15  .15  17   .15  0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml 2.5 2.5 27 32 0     0      .00 9.93 .15  .17  17   .14  0  
pals_floodmax.3.1.ufo.UNBOUNDED.pals.yml 2.4 2.4 27 32 0     0      .00 9.82 .15  .15  17   .14  0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml 4.6 4.6 22 59 0     0      .00 9.51 .15  .15  17   .14  0  
pals_floodmax.3.2.ufo.UNBOUNDED.pals.yml 6.4 6.4 22 89 0     0      .00 9.41 .15  .20  17   .11  0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml 5.0 5.0 23 73 0     0      .00 9.51 .16  .22  17   .090 0  
pals_floodmax.3.3.ufo.UNBOUNDED.pals.yml 4.3 4.2 23 58 0     0      .00 9.41 .15  .15  17   .14  0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml 29   29   27 390 0     0      .00 9.51 .15  .18  17   .14  0  
pals_floodmax.3.4.ufo.UNBOUNDED.pals.yml 29   29   27 410 0     0      .00 9.41 .17  .18  17   .14  0  
pals_floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 200   200   110 3100 0     0      .00 9.61 .15  .15  17   .14  0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml 79   79   1700 960 0     0      .00 5.97 .17  .19  20   .17  0  
pals_floodmax.4.1.ufo.UNBOUNDED.pals.yml 90   90   1800 1100 0     0      .00 5.93 .18  .21  20   .19  0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml 21   21   160 280 0     0      .00 5.76 .20  .20  20   .22  0  
pals_floodmax.4.2.ufo.UNBOUNDED.pals.yml 20   20   160 320 0     0      .00 5.72 .18  .18  20   .22  0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml 35   35   280 440 0     0      .00 5.76 .18  .18  20   .22  0  
pals_floodmax.4.3.ufo.UNBOUNDED.pals.yml 34   34   270 450 0     0      .00 5.72 .19  .23  20   .082 0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml 91   91   650 1100 0     0      .00 5.76 .22  .22  20   .22  0  
pals_floodmax.4.4.ufo.UNBOUNDED.pals.yml 120   120   700 1500 0     0      .00 5.72 .18  .20  20   .090 0  
pals_floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 900   900   1300 11000 .025 0      0    0    .064 .064 9.0 0     0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml 290   290   15000 3700 .016 0      0    0    .056 .056 9.0 0     0  
pals_floodmax.5.1.ufo.UNBOUNDED.pals.yml 290   290   15000 3700 .016 .0041 0    0    .060 .061 9.0 0     0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml 76   75   15000 1000 .016 0      0    0    .058 .058 9.0 0     0  
pals_floodmax.5.2.ufo.UNBOUNDED.pals.yml 77   77   15000 1100 .016 .0041 0    0    .058 .058 9.0 0     0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml 75   75   15000 900 .016 .0041 0    0    .058 .059 8.9 0     0  
pals_floodmax.5.3.ufo.UNBOUNDED.pals.yml 77   76   15000 980 .016 .0041 0    0    .081 .082 9.0 0     0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml 75   75   15000 950 .016 0      0    0    .057 .058 8.9 0     0  
pals_floodmax.5.4.ufo.UNBOUNDED.pals.yml 77   76   15000 980 .016 .0041 0    0    .063 .064 9.0 0     0  
pals_floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 77   76   15000 1000 .016 .0041 0    0    .063 .063 9.0 0     0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml 1 1.6 1.6 20 24 0     0      48.2  78.0  .14  .15  17   .11  0  
pals_lcr-var-start-time.3.1.ufo.UNBOUNDED.pals.yml 1 1.6 1.6 20 22 0     0      48.2  77.8  .14  .14  17   .11  0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml 1 1.4 1.4 20 20 0     0      38.5  72.1  .17  .18  17   .11  0  
pals_lcr-var-start-time.3.2.ufo.UNBOUNDED.pals.yml 1 1.5 1.5 20 21 0     0      38.5  71.9  .14  .13  17   .11  0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml 1 2.4 2.4 22 29 0     0      48.0  76.7  .15  .15  17   .13  0  
pals_lcr-var-start-time.4.1.ufo.UNBOUNDED.pals.yml 1 2.5 2.5 23 36 0     0      48.0  76.6  .16  .17  17   .13  0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml 1 1.9 1.9 21 29 0     0      37.1  70.5  .15  .15  17   .13  0  
pals_lcr-var-start-time.4.2.ufo.UNBOUNDED.pals.yml 1 2.0 2.0 21 26 0     0      37.1  70.4  .14  .15  17   .13  0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml 1 4.6 4.6 28 63 0     0      47.8  75.6  .16  .16  17   .14  0  
pals_lcr-var-start-time.5.1.ufo.UNBOUNDED.pals.yml 1 4.8 4.8 29 61 0     0      47.8  75.5  .17  .20  17   .14  0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml 1 2.8 2.8 24 40 0     0      36.5  69.4  .16  .17  17   .14  0  
pals_lcr-var-start-time.5.2.ufo.UNBOUNDED.pals.yml 1 2.9 2.9 24 47 0     0      36.5  69.2  .17  .19  17   .14  0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml 1 10   10   49 130 0     0      47.8  74.7  .19  .19  17   .16  0  
pals_lcr-var-start-time.6.1.ufo.UNBOUNDED.pals.yml 1 11   11   52 170 0     0      47.8  74.7  .18  .18  17   .16  0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml 1 4.6 4.6 32 67 0     0      36.2  68.4  .18  .18  17   .15  0  
pals_lcr-var-start-time.6.2.ufo.UNBOUNDED.pals.yml 1 4.7 4.7 32 69 0     0      36.2  68.3  .18  .20  17   .15  0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml 1 1.5 1.5 20 21 0     0      57.3  81.5  .14  .14  17   .11  0  
pals_lcr.3.1.ufo.UNBOUNDED.pals.yml 1 1.4 1.4 20 22 0     0      57.3  81.3  .16  .17  17   .11  0  
pals_lcr.3_overflow.ufo.UNBOUNDED.pals.yml 1 2.0 2.0 26 28 0     0      57.5  82.4  .16  .16  17   .11  0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml 1 2.7 2.7 20 36 0     0      57.4  80.8  .17  .17  17   .12  0  
pals_lcr.4.1.ufo.UNBOUNDED.pals.yml 1 2.7 2.7 21 36 0     0      55.6  80.1  .15  .17  17   .12  0  
pals_lcr.4_overflow.ufo.UNBOUNDED.pals.yml 1 5.0 5.0 37 64 0     0      59.4  82.1  .15  .15  17   .11  0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml 1 6.8 6.8 24 100 0     0      57.4  80.1  .16  .18  17   .13  0  
pals_lcr.5.1.ufo.UNBOUNDED.pals.yml 1 6.5 6.5 24 97 0     0      57.4  80.0  .16  .16  17   .13  0  
pals_lcr.5_overflow.ufo.UNBOUNDED.pals.yml 1 16   16   64 220 0     0      54.5  79.7  .15  .15  17   .13  0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml 1 19   19   35 260 0     0      53.6  78.2  .17  .17  17   .14  0  
pals_lcr.6.1.ufo.UNBOUNDED.pals.yml 1 20   20   35 260 0     0      53.6  78.1  .21  .24  17   .14  0  
pals_lcr.6_overflow.ufo.UNBOUNDED.pals.yml 1 49   49   130 650 0     0      58.5  80.2  .17  .17  17   .14  0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml 1 55   55   74 710 0     0      53.0  77.3  .20  .21  17   .15  0  
pals_lcr.7.1.ufo.UNBOUNDED.pals.yml 1 55   55   71 740 0     0      53.0  77.2  .20  .20  17   .15  0  
pals_lcr.7_overflow.ufo.UNBOUNDED.pals.yml 1 180   180   300 2700 0     0      53.1  77.7  .21  .21  17   .15  0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml 1 160   160   190 2500 0     0      52.6  76.5  .24  .24  18   .16  0  
pals_lcr.8.1.ufo.UNBOUNDED.pals.yml 1 170   170   190 2500 0     0      52.6  76.4  .24  .24  18   .16  0  
pals_lcr.8_overflow.ufo.UNBOUNDED.pals.yml 1 670   670   790 11000 0     0      52.6  76.8  .24  .27  18   .16  0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml 2.6 2.6 27 32 0     0      .00 10.0  .15  .15  17   .15  0  
pals_opt-floodmax.3.1.ufo.UNBOUNDED.pals.yml 2.6 2.6 27 37 0     0      .00 9.93 .15  .15  17   .15  0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml 5.1 5.1 23 63 0     0      .00 9.65 .18  .18  17   .15  0  
pals_opt-floodmax.3.2.ufo.UNBOUNDED.pals.yml 5.0 5.0 23 69 0     0      .00 9.55 .15  .19  17   .15  0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml 4.5 4.5 24 61 0     0      .00 9.65 .15  .15  17   .15  0  
pals_opt-floodmax.3.3.ufo.UNBOUNDED.pals.yml 3.7 3.7 23 56 0     0      .00 9.55 .18  .18  17   .15  0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml 27   27   27 360 0     0      .00 9.65 .15  .15  17   .15  0  
pals_opt-floodmax.3.4.ufo.UNBOUNDED.pals.yml 26   26   27 350 0     0      .00 9.55 .16  .16  17   .15  0  
pals_opt-floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 200   200   110 2900 0     0      .00 9.74 .15  .15  17   .15  0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml 87   87   1800 1400 0     0      .00 6.17 .18  .18  20   .22  0  
pals_opt-floodmax.4.1.ufo.UNBOUNDED.pals.yml 97   97   1900 1400 0     0      .00 6.13 .18  .18  20   .22  0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml 22   22   170 290 0     0      .00 5.96 .22  .22  20   .23  0  
pals_opt-floodmax.4.2.ufo.UNBOUNDED.pals.yml 24   24   170 310 0     0      .00 5.92 .19  .19  20   .23  0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml 34   34   270 430 0     0      .00 5.96 .19  .19  20   .23  0  
pals_opt-floodmax.4.3.ufo.UNBOUNDED.pals.yml 32   32   270 410 0     0      .00 5.92 .21  .21  20   .23  0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml 98   99   670 1200 0     0      .00 5.96 .20  .20  20   .23  0  
pals_opt-floodmax.4.4.ufo.UNBOUNDED.pals.yml 120   120   710 1400 0     0      .00 5.92 .19  .19  20   .23  0  
pals_opt-floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 900   900   1400 12000 .025 0      0    0    .056 .057 9.0 0     0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml 290   290   15000 3800 .016 .0041 0    0    .063 .064 9.0 0     0  
pals_opt-floodmax.5.1.ufo.UNBOUNDED.pals.yml 290   290   15000 3500 .016 .0041 0    0    .056 .056 9.0 0     0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml 76   76   15000 980 .016 .0041 0    0    .068 .069 8.9 0     0  
pals_opt-floodmax.5.2.ufo.UNBOUNDED.pals.yml 73   73   15000 940 .025 0      0    0    .059 .060 8.9 0     0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml 73   72   15000 840 .016 0      0    0    .056 .057 9.0 0     0  
pals_opt-floodmax.5.3.ufo.UNBOUNDED.pals.yml 73   73   15000 860 .020 0      0    0    .069 .070 9.0 0     0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml 73   73   15000 880 .016 .0041 0    0    .060 .071 8.9 0     0  
pals_opt-floodmax.5.4.ufo.UNBOUNDED.pals.yml 73   73   15000 920 .016 0      0    0    .057 .058 8.9 0     0  
pals_opt-floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 73   73   15000 900 .020 0      0    0    .059 .059 9.0 0     0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 100 46 7100 7100 290000 95000 .36 .041 100 2200 3710 15 15 1600 12 0  
Run set symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized