Benchmark KLEE TBF Test-Suite Validator
Tool KLEE 2.0.0-pre-test-comp Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:09:47 CET 2019-02-06 06:16:47 CET
Run set klee.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-klee.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized
Options --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/klee.2019-02-05_2109.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml 1 .16 .17 21 2.2 .041 0   30.8 61.2 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.1.ufo.UNBOUNDED.pals.yml 1 .18 .20 21 2.1 .041 0   31.7 61.5 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml 1 .18 .20 22 2.5 .041 0   46.6 73.1 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.4_1.ufo.UNBOUNDED.pals.yml 1 .30 .31 23 3.3 .041 0   38.6 68.5 .18  .18  17   .17 0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml 1 .23 .25 25 2.5 .041 0   47.8 74.5 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.4_2.ufo.UNBOUNDED.pals.yml 1 .17 .19 21 2.0 .041 0   33.9 64.3 .17  .17  17   .17 0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml 1 .84 .86 41 9.3 .041 0   65.6 87.9 .16  .18  17   .17 0  
pals_STARTPALS_ActiveStandby.5.ufo.UNBOUNDED.pals.yml 1 8.8  8.8  170 120   .041 0   65.7 88.1 .16  .18  17   .17 0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml 1 .37 .39 40 4.3 .037 0   50.0 74.4 .15  .16  17   .16 0  
pals_STARTPALS_Triplicated.1.ufo.UNBOUNDED.pals.yml 1 .37 .39 39 4.6 .033 0   48.7 73.7 .16  .16  17   .16 0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml 1 1.1  1.2  67 15   .033 0   63.3 80.7 .15  .16  17   .16 0  
pals_STARTPALS_Triplicated.2.ufo.UNBOUNDED.pals.yml 1 .54 .56 48 6.7 .033 0   66.0 82.7 .16  .24  17   .15 0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml 1 .89 .91 38 11   .033 0   43.7 69.1 .15  .16  17   .14 0  
pals_floodmax.3.1.ufo.UNBOUNDED.pals.yml 1 .87 .89 38 10   .033 0   44.3 69.1 .16  .17  17   .14 0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml 1 .60 .61 33 6.9 .033 0   43.6 69.7 .16  .16  17   .14 0  
pals_floodmax.3.2.ufo.UNBOUNDED.pals.yml 1 .35 .36 28 3.8 .033 0   44.2 70.0 .16  .16  17   .14 0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml 1 .61 .63 33 9.1 .033 0   48.0 71.8 .17  .17  17   .14 0  
pals_floodmax.3.3.ufo.UNBOUNDED.pals.yml 1 .36 .38 29 4.1 .033 0   48.1 71.8 .16  .16  17   .14 0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml 1 .68 .70 33 8.9 .033 0   47.5 71.5 .16  .19  17   .14 0  
pals_floodmax.3.4.ufo.UNBOUNDED.pals.yml 1 1.1  1.1  34 15   .033 0   46.6 69.7 .17  .17  17   .14 0  
pals_floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 1 1.6  1.6  33 20   .033 0   51.5 73.3 .16  .16  17   .14 0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml 900    900    3100 8800   .086 0   0   0   .064 .077 9.0 0    0  
pals_floodmax.4.1.ufo.UNBOUNDED.pals.yml 900    900    3300 8900   .090 0   0   0   .064 .065 9.0 0    0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml 900    900    3100 9300   .086 0   0   0   .060 .060 9.0 0    0  
pals_floodmax.4.2.ufo.UNBOUNDED.pals.yml 1 .27 .28 30 3.1 .057 0   32.8 53.8 .22  .22  20   .22 0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml 900    900    3100 8300   .090 0   0   0   .061 .061 9.0 0    0  
pals_floodmax.4.3.ufo.UNBOUNDED.pals.yml 1 .29 .30 30 3.4 .057 0   34.4 54.8 .22  .22  20   .22 0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml 900    900    3100 11000   .078 0   0   0   .062 .063 9.0 0    0  
pals_floodmax.4.4.ufo.UNBOUNDED.pals.yml 1 .26 .28 31 3.8 .057 0   34.4 54.7 .22  .22  20   .22 0  
pals_floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 900    900    3100 9700   .082 0   0   0   .060 .062 9.0 0    0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml 900    900    15000 5600   .14  0   0   0   .062 .062 9.0 0    0  
pals_floodmax.5.1.ufo.UNBOUNDED.pals.yml 1 19    19    940 180   .10  0   27.5 46.0 .30  .30  27   .37 0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml 900    900    15000 6300   .14  0   0   0   .071 .072 9.0 0    0  
pals_floodmax.5.2.ufo.UNBOUNDED.pals.yml 1 160    160    5700 1500   .10  0   21.6 37.5 .36  .36  27   .38 0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml 1 180    180    6000 1300   .10  0   22.3 38.3 .35  .35  27   .38 0  
pals_floodmax.5.3.ufo.UNBOUNDED.pals.yml 1 160    160    5600 1300   .10  0   24.6 41.2 .36  .36  27   .38 0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml 900    900    15000 5400   .14  0   0   0   .057 .058 9.0 0    0  
pals_floodmax.5.4.ufo.UNBOUNDED.pals.yml 900    900    15000 5300   .14  0   0   0   .061 .062 9.0 0    0  
pals_floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 900    900    15000 4200   .13  0   0   0   .059 .060 9.0 0    0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml 1 .20 .22 21 2.5 .025 0   47.3 78.0 .14  .14  17   .11 0  
pals_lcr-var-start-time.3.1.ufo.UNBOUNDED.pals.yml 1 .20 .22 20 2.2 .025 0   48.2 77.8 .14  .14  17   .11 0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml 1 .17 .19 21 1.6 .025 0   41.4 74.2 .14  .14  17   .11 0  
pals_lcr-var-start-time.3.2.ufo.UNBOUNDED.pals.yml 1 .17 .19 21 1.8 .025 0   38.5 71.9 .14  .14  17   .11 0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml 1 .42 .44 23 5.7 .029 0   47.3 77.2 .16  .18  17   .13 0  
pals_lcr-var-start-time.4.1.ufo.UNBOUNDED.pals.yml 1 .50 .52 23 6.1 .029 0   48.0 76.6 .15  .15  17   .13 0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml 1 .23 .25 23 2.3 .029 0   37.1 70.5 .15  .15  17   .13 0  
pals_lcr-var-start-time.4.2.ufo.UNBOUNDED.pals.yml 1 .37 .39 23 4.4 .029 0   37.1 70.4 .15  .17  17   .13 0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml 1 .98 .99 32 12   .033 0   47.3 75.6 .16  .18  17   .14 0  
pals_lcr-var-start-time.5.1.ufo.UNBOUNDED.pals.yml 1 1.9  1.9  33 45   .033 0   46.2 76.0 .17  .17  17   .14 0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml 1 .46 .48 29 8.5 .033 0   39.3 70.6 .17  .17  17   .14 0  
pals_lcr-var-start-time.5.2.ufo.UNBOUNDED.pals.yml 1 .48 .50 29 5.4 .033 0   38.2 70.5 .16  .17  17   .14 0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml 1 4.1  4.1  70 65   .037 0   47.3 75.1 .19  .19  17   .16 0  
pals_lcr-var-start-time.6.1.ufo.UNBOUNDED.pals.yml 1 11    11    76 130   .037 0   47.8 74.7 .19  .19  17   .16 0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml 1 .65 .67 47 8.0 .037 0   43.6 73.0 .18  .18  17   .15 0  
pals_lcr-var-start-time.6.2.ufo.UNBOUNDED.pals.yml 1 4.7  4.7  72 62   .037 0   45.0 72.6 .19  .19  17   .15 0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml 1 .23 .25 21 2.0 .025 0   57.3 81.5 .14  .14  17   .11 0  
pals_lcr.3.1.ufo.UNBOUNDED.pals.yml 1 .18 .20 21 2.4 .025 0   57.3 81.3 .14  .14  17   .11 0  
pals_lcr.3_overflow.ufo.UNBOUNDED.pals.yml 1 .48 .48 21 6.1 .025 0   57.5 82.4 .13  .13  17   .11 0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml 1 .37 .39 21 4.3 .029 0   57.4 80.8 .14  .14  17   .12 0  
pals_lcr.4.1.ufo.UNBOUNDED.pals.yml 1 .51 .53 21 5.6 .029 0   55.6 80.1 .15  .15  17   .12 0  
pals_lcr.4_overflow.ufo.UNBOUNDED.pals.yml 1 .91 .93 21 11   .029 0   57.5 81.5 .15  .15  17   .11 0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml 1 .90 .92 23 12   .029 0   55.9 79.6 .16  .16  17   .13 0  
pals_lcr.5.1.ufo.UNBOUNDED.pals.yml 1 1.8  1.9  24 22   .029 0   54.4 79.0 .16  .16  17   .13 0  
pals_lcr.5_overflow.ufo.UNBOUNDED.pals.yml 1 2.4  2.4  25 37   .029 0   57.5 80.7 .15  .15  17   .13 0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml 1 .95 .97 26 13   .033 0   56.0 79.0 .17  .19  17   .13 0  
pals_lcr.6.1.ufo.UNBOUNDED.pals.yml 1 1.4  1.4  25 18   .033 0   56.0 78.9 .17  .20  17   .14 0  
pals_lcr.6_overflow.ufo.UNBOUNDED.pals.yml 1 9.2  9.2  39 130   .033 0   56.1 79.4 .18  .19  17   .14 0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml 1 8.2  8.2  43 100   .037 0   55.0 78.0 .21  .23  17   .15 0  
pals_lcr.7.1.ufo.UNBOUNDED.pals.yml 1 7.4  7.4  41 100   .037 0   54.0 77.5 .21  .21  17   .15 0  
pals_lcr.7_overflow.ufo.UNBOUNDED.pals.yml 1 39    39    96 480   .037 0   55.1 78.3 .20  .20  17   .15 0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml 1 3.3  3.3  32 44   .041 0   54.3 77.1 .24  .24  18   .16 0  
pals_lcr.8.1.ufo.UNBOUNDED.pals.yml 1 14    14    56 190   .041 0   55.2 77.3 .25  .25  18   .16 0  
pals_lcr.8_overflow.ufo.UNBOUNDED.pals.yml 1 190    200    340 2300   .041 0   54.4 77.4 .24  .26  18   .16 0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml 1 .63 .65 64 7.9 .037 0   47.1 70.9 .16  .16  17   .15 0  
pals_opt-floodmax.3.1.ufo.UNBOUNDED.pals.yml 1 20    20    170 250   .037 0   43.9 67.9 .17  .17  17   .15 0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml 1 .60 .62 60 7.5 .037 0   43.2 69.5 .17  .22  17   .15 0  
pals_opt-floodmax.3.2.ufo.UNBOUNDED.pals.yml 1 .64 .67 65 7.5 .037 0   44.2 70.7 .17  .19  17   .15 0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml 1 .61 .61 60 7.3 .037 0   47.3 71.4 .17  .16  17   .15 0  
pals_opt-floodmax.3.3.ufo.UNBOUNDED.pals.yml 1 .74 .77 70 9.5 .037 0   48.2 71.0 .17  .17  17   .15 0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml 1 .66 .68 62 8.4 .037 0   48.2 70.7 .16  .17  17   .15 0  
pals_opt-floodmax.3.4.ufo.UNBOUNDED.pals.yml 1 5.6  5.7  130 77   .037 0   47.3 69.8 .17  .18  17   .15 0  
pals_opt-floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 1 9.6  9.7  130 110   .037 0   51.4 72.7 .17  .17  17   .15 0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml 1 290    290    11000 1700   .057 0   36.0 58.1 .21  .21  20   .22 0  
pals_opt-floodmax.4.1.ufo.UNBOUNDED.pals.yml 1 280    280    11000 1800   .057 0   36.5 58.1 .22  .22  20   .22 0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml 1 280    280    11000 1800   .057 0   33.6 54.8 .23  .25  20   .23 0  
pals_opt-floodmax.4.2.ufo.UNBOUNDED.pals.yml 1 280    280    11000 1900   .057 0   33.1 53.3 .23  .23  20   .23 0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml 1 290    290    11000 1500   .057 0   35.1 55.3 .23  .23  20   .23 0  
pals_opt-floodmax.4.3.ufo.UNBOUNDED.pals.yml 1 280    280    11000 2200   .057 0   35.3 55.5 .24  .26  20   .23 0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml 1 320    320    11000 1900   .057 0   35.1 55.5 .24  .24  20   .23 0  
pals_opt-floodmax.4.4.ufo.UNBOUNDED.pals.yml 900    900    13000 5900   .082 0   0   0   .062 .063 9.0 0    0  
pals_opt-floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 1 290    290    11000 1700   .057 0   36.9 56.3 .24  .25  20   .23 0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml 900    900    15000 6200   .13  0   0   0   .059 .060 9.0 0    0  
pals_opt-floodmax.5.1.ufo.UNBOUNDED.pals.yml 900    900    15000 6500   .14  0   0   0   .061 .061 9.0 0    0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml 900    900    14000 5300   .13  0   0   0   .060 .061 9.1 0    0  
pals_opt-floodmax.5.2.ufo.UNBOUNDED.pals.yml 900    900    14000 5500   .14  0   0   0   .061 .061 9.0 0    0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml 900    900    14000 5100   .14  0   0   0   .059 .061 9.1 0    0  
pals_opt-floodmax.5.3.ufo.UNBOUNDED.pals.yml 900    900    14000 6200   .14  0   0   0   .064 .065 9.0 0    0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml 900    900    14000 5800   .14  0   0   0   .058 .059 9.0 0    0  
pals_opt-floodmax.5.4.ufo.UNBOUNDED.pals.yml 900    900    14000 5500   .15  0   0   0   .063 .063 9.0 0    0  
pals_opt-floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 900    900    14000 6300   .14  0   0   0   .060 .061 9.0 0    0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 100 79 22000 22000 340000 160000 5.7 0   100 3610 5550 16 16 1600 13 0  
Run set klee.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-klee.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized