Benchmark CPA/CoVeriTest TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30375 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon049; apollon085; apollon116]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-06 05:30:26 CET
Run set coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized
Options -benchmark -heap 10000M -testcomp19 --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/coveritest.2019-02-05_2105.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml 1 29 6.9 1100 220 1.7  0   31.9 61.2 .16  .16  17   .17  0  
pals_STARTPALS_ActiveStandby.1.ufo.UNBOUNDED.pals.yml 1 25 6.4 870 190 1.5  0   31.7 61.5 .16  .22  17   .11  0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml 1 26 6.7 870 230 1.5  0   33.1 63.4 .16  .16  17   .17  0  
pals_STARTPALS_ActiveStandby.4_1.ufo.UNBOUNDED.pals.yml 1 25 6.6 890 200 1.5  0   33.0 63.4 .16  .16  17   .17  0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml 1 26 6.8 890 210 1.5  0   35.2 64.3 .17  .17  17   .17  0  
pals_STARTPALS_ActiveStandby.4_2.ufo.UNBOUNDED.pals.yml 1 31 7.4 1100 230 1.7  0   35.0 64.3 .16  .16  17   .17  0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml 1 130 91   2200 1500 6.2  0   61.1 84.5 .17  .17  17   .17  0  
pals_STARTPALS_ActiveStandby.5.ufo.UNBOUNDED.pals.yml 1 42 18   1100 410 1.5  0   61.2 84.6 .17  .17  17   .17  0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml 1 39 16   1200 340 1.6  0   51.2 76.2 .16  .16  17   .16  0  
pals_STARTPALS_Triplicated.1.ufo.UNBOUNDED.pals.yml 1 39 16   1300 350 1.1  0   52.5 77.0 .16  .16  17   .16  0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml 1 43 17   1400 370 1.5  0   54.4 75.9 .16  .17  17   .16  0  
pals_STARTPALS_Triplicated.2.ufo.UNBOUNDED.pals.yml 1 40 16   1400 420 1.5  0   54.5 76.4 .16  .16  17   .15  0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml 1 27 16   1000 300 0    0   42.6 68.0 .16  .18  17   .14  0  
pals_floodmax.3.1.ufo.UNBOUNDED.pals.yml 1 26 17   1000 290 0    0   42.8 67.6 .16  .16  17   .14  0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml 1 25 11   810 240 .52 0   44.5 71.5 .16  .16  17   .14  0  
pals_floodmax.3.2.ufo.UNBOUNDED.pals.yml 1 26 10   790 230 .53 0   43.7 69.3 .17  .19  17   .14  0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml 1 27 18   1100 270 0    0   48.5 72.5 .16  .16  17   .14  0  
pals_floodmax.3.3.ufo.UNBOUNDED.pals.yml 1 27 18   1300 250 0    0   48.5 72.5 .17  .17  17   .14  0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml 1 28 18   920 300 0    0   46.5 70.1 .16  .16  17   .14  0  
pals_floodmax.3.4.ufo.UNBOUNDED.pals.yml 1 26 18   1100 290 0    0   46.6 69.7 .17  .17  17   .14  0  
pals_floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 900 890   1500 8800 0    0   0   0   .062 .063 8.9 0     0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml 1 62 52   890 550 0    0   35.7 58.0 .23  .23  20   .21  0  
pals_floodmax.4.1.ufo.UNBOUNDED.pals.yml 1 32 22   900 380 0    0   35.0 57.8 .20  .20  20   .21  0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml 1 30 23   840 340 0    0   33.0 54.2 .22  .22  20   .22  0  
pals_floodmax.4.2.ufo.UNBOUNDED.pals.yml 1 30 22   910 330 0    0   32.2 53.1 .22  .22  20   .22  0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml 1 36 26   860 360 0    0   35.4 56.6 .22  .23  20   .22  0  
pals_floodmax.4.3.ufo.UNBOUNDED.pals.yml 1 42 32   940 450 0    0   34.0 54.8 .22  .22  20   .22  0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml 1 58 48   780 500 0    0   33.4 53.6 .22  .22  20   .22  0  
pals_floodmax.4.4.ufo.UNBOUNDED.pals.yml 1 85 74   850 700 0    0   33.4 53.4 .22  .22  20   .22  0  
pals_floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 900 890   1600 8700 0    0   0   0   .072 .073 8.9 0     0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml 1 160 140   1300 1100 0    0   25.5 43.6 .30  .30  27   .37  0  
pals_floodmax.5.1.ufo.UNBOUNDED.pals.yml 1 190 180   1200 1500 0    0   26.0 44.0 .32  .32  27   .37  0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml 1 41 28   880 440 0    0   21.2 37.3 .36  .36  27   .38  0  
pals_floodmax.5.2.ufo.UNBOUNDED.pals.yml 1 39 26   1100 400 0    0   22.0 38.1 .36  .36  27   .38  0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml 1 70 58   1100 620 0    0   21.9 37.8 .36  .36  27   .38  0  
pals_floodmax.5.3.ufo.UNBOUNDED.pals.yml 1 160 150   1200 1200 0    0   21.9 37.5 .36  .36  27   .38  0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml 900 890   1500 5300 0    0   0   0   .061 .062 8.9 0     0  
pals_floodmax.5.4.ufo.UNBOUNDED.pals.yml 900 890   1500 5700 0    0   0   0   .069 .070 9.0 0     0  
pals_floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 900 890   1700 5800 0    0   0   0   .059 .060 8.9 0     0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml 1 35 15   1100 330 1.7  0   47.3 78.0 .14  .14  17   .11  0  
pals_lcr-var-start-time.3.1.ufo.UNBOUNDED.pals.yml 1 30 9.6 850 250 1.6  0   47.3 77.8 .14  .14  17   .11  0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml 900 880   2000 14000 1.7  0   0   0   .060 .061 9.0 0     0  
pals_lcr-var-start-time.3.2.ufo.UNBOUNDED.pals.yml 1 41 21   1100 420 1.7  0   42.3 74.0 .14  .14  17   .11  0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml 900 820   4800 11000 21    0   0   0   .061 .063 9.0 0     0  
pals_lcr-var-start-time.4.1.ufo.UNBOUNDED.pals.yml 900 880   2000 11000 1.3  0   0   0   .057 .058 9.0 0     0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml 900 880   2100 9800 1.4  0   0   0   .061 .062 9.0 0     0  
pals_lcr-var-start-time.4.2.ufo.UNBOUNDED.pals.yml 900 880   2000 12000 1.6  0   0   0   .061 .062 9.0 0     0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml 900 820   4900 11000 22    0   0   0   .058 .059 8.9 0     0  
pals_lcr-var-start-time.5.1.ufo.UNBOUNDED.pals.yml 900 850   3200 14000 8.9  0   0   0   .061 .061 9.0 0     0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml 900 840   4500 12000 15    0   0   0   .061 .061 8.8 0     0  
pals_lcr-var-start-time.5.2.ufo.UNBOUNDED.pals.yml 900 880   1600 14000 1.0  0   0   0   .059 .060 8.9 0     0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml 900 890   1300 14000 0    0   0   0   .060 .061 9.1 0     0  
pals_lcr-var-start-time.6.1.ufo.UNBOUNDED.pals.yml 900 890   1200 12000 0    0   0   0   .060 .061 9.0 0     0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml 900 840   2900 11000 5.8  0   0   0   .063 .064 9.0 0     0  
pals_lcr-var-start-time.6.2.ufo.UNBOUNDED.pals.yml 900 890   1400 12000 0    0   0   0   .062 .063 8.9 0     0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml 1 26 7.0 850 230 1.8  0   57.3 81.5 .14  .14  17   .11  0  
pals_lcr.3.1.ufo.UNBOUNDED.pals.yml 1 230 190   4000 2800 14    0   57.3 81.3 .14  .14  17   .11  0  
pals_lcr.3_overflow.ufo.UNBOUNDED.pals.yml 900 880   1800 12000 1.9  0   0   0   .058 .059 9.0 0     0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml 900 880   1800 9300 1.6  0   0   0   .063 .064 8.9 0     0  
pals_lcr.4.1.ufo.UNBOUNDED.pals.yml 900 880   2000 12000 1.6  0   0   0   .070 .070 9.0 0     0  
pals_lcr.4_overflow.ufo.UNBOUNDED.pals.yml 900 870   2900 6600 5.9  0   0   0   .061 .061 9.0 0     0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml 900 860   3600 11000 5.9  0   0   0   .060 .061 9.0 0     0  
pals_lcr.5.1.ufo.UNBOUNDED.pals.yml 900 860   3900 10000 5.6  0   0   0   .062 .063 9.0 0     0  
pals_lcr.5_overflow.ufo.UNBOUNDED.pals.yml 900 830   4400 8500 18    0   0   0   .059 .060 9.0 0     0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml 900 870   2500 11000 3.9  0   0   0   .061 .061 9.0 0     0  
pals_lcr.6.1.ufo.UNBOUNDED.pals.yml 900 850   1800 10000 7.9  0   0   0   .062 .063 8.9 0     0  
pals_lcr.6_overflow.ufo.UNBOUNDED.pals.yml 900 860   2400 10000 3.2  0   0   0   .064 .064 9.0 0     0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml 900 890   1100 11000 0    0   0   0   .062 .078 8.9 0     0  
pals_lcr.7.1.ufo.UNBOUNDED.pals.yml 900 890   1200 13000 0    0   0   0   .062 .063 9.0 0     0  
pals_lcr.7_overflow.ufo.UNBOUNDED.pals.yml 900 870   1800 12000 .99 0   0   0   .059 .060 9.0 0     0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml 900 880   1300 11000 0    0   0   0   .059 .068 9.0 0     0  
pals_lcr.8.1.ufo.UNBOUNDED.pals.yml 900 880   1100 11000 0    0   0   0   .060 .060 9.0 0     0  
pals_lcr.8_overflow.ufo.UNBOUNDED.pals.yml 900 890   1100 14000 0    0   0   0   .059 .061 8.9 0     0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml 1 26 17   890 270 0    0   46.1 70.6 .17  .21  17   .053 0  
pals_opt-floodmax.3.1.ufo.UNBOUNDED.pals.yml 1 27 17   1000 280 0    0   43.4 67.2 .16  .16  17   .15  0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml 1 25 17   890 260 0    0   43.2 68.8 .17  .17  17   .15  0  
pals_opt-floodmax.3.2.ufo.UNBOUNDED.pals.yml 1 26 17   1300 260 0    0   44.2 70.7 .17  .17  17   .15  0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml 1 27 17   1200 280 0    0   45.5 69.8 .16  .18  17   .10  0  
pals_opt-floodmax.3.3.ufo.UNBOUNDED.pals.yml 1 27 17   1100 290 0    0   48.7 72.0 .17  .17  17   .15  0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml 1 29 19   1000 290 0    0   46.4 69.1 .17  .17  17   .15  0  
pals_opt-floodmax.3.4.ufo.UNBOUNDED.pals.yml 1 28 18   990 300 0    0   47.3 69.8 .17  .17  17   .15  0  
pals_opt-floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 900 880   2000 9200 0    0   0   0   .059 .059 9.0 0     0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml 1 33 23   810 350 0    0   34.8 56.8 .21  .22  20   .22  0  
pals_opt-floodmax.4.1.ufo.UNBOUNDED.pals.yml 1 44 35   810 480 0    0   35.8 57.0 .21  .21  20   .22  0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml 1 30 21   740 320 0    0   32.5 53.8 .24  .24  20   .23  0  
pals_opt-floodmax.4.2.ufo.UNBOUNDED.pals.yml 1 32 25   870 330 0    0   34.0 54.8 .23  .24  20   .090 0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml 1 40 29   970 440 0    0   34.2 54.4 .24  .24  20   .23  0  
pals_opt-floodmax.4.3.ufo.UNBOUNDED.pals.yml 1 32 23   950 370 0    0   35.9 55.5 .24  .24  20   .23  0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml 1 99 89   970 730 0    0   35.1 55.6 .24  .26  20   .23  0  
pals_opt-floodmax.4.4.ufo.UNBOUNDED.pals.yml 1 150 140   1100 1500 0    0   34.9 54.3 .25  .25  20   .23  0  
pals_opt-floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 900 890   1600 7100 0    0   0   0   .062 .063 9.0 0     0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml 1 620 610   1600 4600 0    0   27.9 45.8 .36  .36  27   .39  0  
pals_opt-floodmax.5.1.ufo.UNBOUNDED.pals.yml 1 380 370   1600 3200 0    0   24.6 41.0 .31  .31  27   .39  0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml 1 82 70   1100 670 0    0   22.9 38.6 .38  .38  27   .39  0  
pals_opt-floodmax.5.2.ufo.UNBOUNDED.pals.yml 1 110 99   1100 930 0    0   23.1 39.8 .42  .42  27   .39  0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml 1 71 57   1400 630 0    0   25.0 41.4 .38  .39  27   .39  0  
pals_opt-floodmax.5.3.ufo.UNBOUNDED.pals.yml 1 260 240   1500 2000 0    0   24.6 39.8 .39  .39  27   .39  0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml 900 890   1800 5800 0    0   0   0   .061 .062 9.0 0     0  
pals_opt-floodmax.5.4.ufo.UNBOUNDED.pals.yml 900 890   1500 5800 0    0   0   0   .062 .063 9.0 0     0  
pals_opt-floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 900 890   1400 6000 0    0   0   0   .061 .062 9.0 0     0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 100 61 39000 37000 150000 440000 180 0   100 2350 3730 16 16 1600 13 0  
Run set coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized