Benchmark CPA/Tiger-MGP TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30541M Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:13:54 CET 2019-02-06 06:15:02 CET
Run set cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized
Options -benchmark -heap 10000M -tigertestcomp19 --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/cpa-tiger.2019-02-05_2113.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml 1 5.0 1.9 300 44 .0041 0   31.9 61.2 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.1.ufo.UNBOUNDED.pals.yml 1 4.9 1.9 310 44 .0041 0   31.7 61.5 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml 1 6.7 2.6 330 64 .0041 0   33.1 63.4 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.4_1.ufo.UNBOUNDED.pals.yml 1 6.2 2.4 320 53 .0041 0   33.0 63.4 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml 1 6.8 2.5 330 55 .0041 0   35.2 64.3 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.4_2.ufo.UNBOUNDED.pals.yml 1 6.6 2.5 330 62 .0041 0   35.0 64.3 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml 1 89   80   550 1100 .0041 0   62.2 84.5 .16  .16  17   .17 0  
pals_STARTPALS_ActiveStandby.5.ufo.UNBOUNDED.pals.yml 1 22   14   410 240 .0041 0   61.2 84.6 .16  .16  17   .17 0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml 1 24   12   860 240 .0041 0   51.2 76.2 .16  .17  17   .16 0  
pals_STARTPALS_Triplicated.1.ufo.UNBOUNDED.pals.yml 1 23   12   880 250 .0041 0   52.5 77.0 .15  .16  17   .16 0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml 1 25   12   780 220 .0041 0   54.4 75.9 .16  .16  17   .16 0  
pals_STARTPALS_Triplicated.2.ufo.UNBOUNDED.pals.yml 1 24   12   900 250 .0041 0   54.5 76.4 .15  .15  17   .15 0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml 1 5.8 2.6 300 62 .0041 0   42.6 68.0 .16  .16  17   .14 0  
pals_floodmax.3.1.ufo.UNBOUNDED.pals.yml 1 5.6 2.2 300 52 .0041 0   42.8 67.6 .16  .16  17   .14 0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml 1 4.5 1.9 280 44 .0041 0   44.5 71.5 .16  .16  17   .14 0  
pals_floodmax.3.2.ufo.UNBOUNDED.pals.yml 1 4.7 1.9 290 42 .0041 0   43.7 69.3 .16  .16  17   .14 0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml 1 6.1 2.8 310 64 .0041 0   48.5 72.5 .17  .17  17   .14 0  
pals_floodmax.3.3.ufo.UNBOUNDED.pals.yml 1 6.1 2.8 300 61 .0041 0   48.5 72.5 .16  .16  17   .14 0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml 1 7.7 3.9 320 81 .0041 0   46.5 70.1 .16  .16  17   .14 0  
pals_floodmax.3.4.ufo.UNBOUNDED.pals.yml 1 6.5 3.0 300 71 .0041 0   46.6 69.7 .17  .17  17   .14 0  
pals_floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 900   900   800 6100 .0041 0   0   0   .058 .058 9.0 0    0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml 1 40   34   430 290 .0041 0   35.7 58.0 .20  .20  20   .21 0  
pals_floodmax.4.1.ufo.UNBOUNDED.pals.yml 1 10   4.5 380 88 .0041 0   35.0 57.8 .20  .20  20   .21 0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml 1 10   5.2 340 95 .0041 0   33.0 54.2 .22  .26  20   .22 0  
pals_floodmax.4.2.ufo.UNBOUNDED.pals.yml 1 9.0 4.1 370 85 .0041 0   32.2 53.1 .22  .22  20   .22 0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml 1 15   8.7 390 120 .0041 0   35.4 56.6 .22  .22  20   .22 0  
pals_floodmax.4.3.ufo.UNBOUNDED.pals.yml 1 21   15   500 190 .0041 0   34.0 54.8 .22  .22  20   .22 0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml 1 38   31   440 280 .0041 0   33.4 53.6 .22  .22  20   .22 0  
pals_floodmax.4.4.ufo.UNBOUNDED.pals.yml 1 63   57   530 460 .0041 0   33.4 53.4 .22  .22  20   .22 0  
pals_floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 900   890   1200 5800 .0041 0   0   0   .060 .060 9.0 0    0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml 1 130   120   710 1100 .0041 0   25.5 43.6 .32  .33  27   .35 0  
pals_floodmax.5.1.ufo.UNBOUNDED.pals.yml 1 170   160   740 1100 .0041 0   26.0 44.0 .30  .30  27   .37 0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml 1 20   11   440 180 .0041 0   21.2 37.3 .37  .37  27   .38 0  
pals_floodmax.5.2.ufo.UNBOUNDED.pals.yml 1 18   9.0 450 160 .0041 0   22.0 38.1 .39  .39  27   .38 0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml 1 50   40   560 480 .0041 0   21.9 37.8 .36  .36  27   .38 0  
pals_floodmax.5.3.ufo.UNBOUNDED.pals.yml 1 140   130   680 1300 .0041 0   21.9 37.5 .35  .35  27   .38 0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml 900   890   950 5700 .0041 0   0   0   .062 .062 9.0 0    0  
pals_floodmax.5.4.ufo.UNBOUNDED.pals.yml 900   890   1100 5900 .0041 0   0   0   .060 .061 9.0 0    0  
pals_floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 900   890   1000 8200 .0041 0   0   0   .058 .059 9.1 0    0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml 1 15   11   340 150 .0041 0   47.3 78.0 .14  .14  17   .11 0  
pals_lcr-var-start-time.3.1.ufo.UNBOUNDED.pals.yml 1 9.7 5.4 380 110 .0041 0   47.3 77.8 .14  .14  17   .11 0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml 900   890   1000 12000 .0041 0   0   0   .059 .059 9.0 0    0  
pals_lcr-var-start-time.3.2.ufo.UNBOUNDED.pals.yml 1 21   17   440 250 .0041 0   42.3 74.0 .14  .14  17   .11 0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml 900   890   480 10000 .0041 0   0   0   .057 .058 9.0 0    0  
pals_lcr-var-start-time.4.1.ufo.UNBOUNDED.pals.yml 900   890   970 13000 .0041 0   0   0   .058 .058 8.9 0    0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml 900   900   760 9400 .0041 0   0   0   .063 .063 9.0 0    0  
pals_lcr-var-start-time.4.2.ufo.UNBOUNDED.pals.yml 900   890   860 13000 .0041 0   0   0   .060 .061 9.0 0    0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml 930   920   740 13000 .0041 0   0   0   .059 .060 9.0 0    0  
pals_lcr-var-start-time.5.1.ufo.UNBOUNDED.pals.yml 900   890   500 13000 .0041 0   0   0   .060 .062 9.0 0    0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml 900   890   710 14000 .0041 0   0   0   .063 .065 9.0 0    0  
pals_lcr-var-start-time.5.2.ufo.UNBOUNDED.pals.yml 900   890   930 12000 .0041 0   0   0   .059 .060 9.0 0    0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml 900   890   1100 11000 .0041 0   0   0   .057 .058 9.1 0    0  
pals_lcr-var-start-time.6.1.ufo.UNBOUNDED.pals.yml 900   900   750 14000 .0041 0   0   0   .058 .058 9.1 0    0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml 900   890   2400 12000 .0041 0   0   0   .058 .058 9.0 0    0  
pals_lcr-var-start-time.6.2.ufo.UNBOUNDED.pals.yml 900   890   1000 12000 .0041 0   0   0   .067 .068 9.0 0    0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml 1 6.2 2.6 300 55 .0041 0   57.3 81.5 .13  .13  17   .11 0  
pals_lcr.3.1.ufo.UNBOUNDED.pals.yml 1 170   160   750 2100 .0041 0   57.3 81.3 .14  .14  17   .11 0  
pals_lcr.3_overflow.ufo.UNBOUNDED.pals.yml 900   890   950 9300 .0041 0   0   0   .070 .073 9.0 0    0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml 900   890   1000 9400 .0041 0   0   0   .057 .058 9.0 0    0  
pals_lcr.4.1.ufo.UNBOUNDED.pals.yml 900   890   1300 13000 .0041 0   0   0   .061 .062 9.0 0    0  
pals_lcr.4_overflow.ufo.UNBOUNDED.pals.yml 900   890   1000 6700 .0041 0   0   0   .060 .061 9.0 0    0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml 900   900   1900 12000 .0041 0   0   0   .065 .066 9.0 0    0  
pals_lcr.5.1.ufo.UNBOUNDED.pals.yml 900   890   990 8000 .0041 0   0   0   .057 .059 9.0 0    0  
pals_lcr.5_overflow.ufo.UNBOUNDED.pals.yml 900   890   870 9500 .0041 0   0   0   .061 .061 9.0 0    0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml 900   890   600 11000 .0041 0   0   0   .057 .058 9.0 0    0  
pals_lcr.6.1.ufo.UNBOUNDED.pals.yml 900   890   600 11000 .0041 0   0   0   .060 .062 9.0 0    0  
pals_lcr.6_overflow.ufo.UNBOUNDED.pals.yml 900   890   540 12000 .0041 0   0   0   .062 .062 9.0 0    0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml 900   890   610 14000 .0041 0   0   0   .059 .060 9.0 0    0  
pals_lcr.7.1.ufo.UNBOUNDED.pals.yml 900   890   470 13000 .0041 0   0   0   .060 .061 9.0 0    0  
pals_lcr.7_overflow.ufo.UNBOUNDED.pals.yml 900   890   600 13000 .0041 0   0   0   .061 .062 9.0 0    0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml 900   890   600 12000 .0041 0   0   0   .060 .062 8.9 0    0  
pals_lcr.8.1.ufo.UNBOUNDED.pals.yml 900   890   720 13000 .0041 0   0   0   .061 .062 9.1 0    0  
pals_lcr.8_overflow.ufo.UNBOUNDED.pals.yml 900   890   760 11000 .0041 0   0   0   .059 .059 9.0 0    0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml 1 5.8 2.4 300 53 .0041 0   46.1 70.6 .16  .16  17   .15 0  
pals_opt-floodmax.3.1.ufo.UNBOUNDED.pals.yml 1 5.9 2.4 300 55 .0041 0   43.4 67.2 .16  .16  17   .15 0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml 1 5.2 2.0 300 57 .0041 0   43.2 68.8 .17  .17  17   .15 0  
pals_opt-floodmax.3.2.ufo.UNBOUNDED.pals.yml 1 4.8 2.0 290 42 .0041 0   44.2 70.7 .17  .17  17   .15 0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml 1 5.9 2.5 310 63 .0041 0   45.5 69.8 .17  .16  17   .15 0  
pals_opt-floodmax.3.3.ufo.UNBOUNDED.pals.yml 1 6.3 2.7 310 56 .0041 0   48.7 72.0 .17  .17  17   .15 0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml 1 7.5 3.6 320 75 .0041 0   46.4 69.1 .17  .17  17   .15 0  
pals_opt-floodmax.3.4.ufo.UNBOUNDED.pals.yml 1 6.6 3.0 310 66 .0041 0   47.3 69.8 .17  .17  17   .15 0  
pals_opt-floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 900   890   1300 10000 .0041 0   0   0   .060 .061 9.0 0    0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml 1 12   5.5 500 120 .0041 0   34.8 56.8 .21  .21  20   .22 0  
pals_opt-floodmax.4.1.ufo.UNBOUNDED.pals.yml 1 24   18   420 180 .0041 0   35.8 57.0 .25  .25  20   .22 0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml 1 10   4.1 360 98 .0041 0   32.5 53.8 .25  .25  20   .23 0  
pals_opt-floodmax.4.2.ufo.UNBOUNDED.pals.yml 1 12   7.2 350 100 .0041 0   34.0 54.8 .24  .24  20   .23 0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml 1 18   11   410 170 .0041 0   34.2 54.4 .23  .24  20   .23 0  
pals_opt-floodmax.4.3.ufo.UNBOUNDED.pals.yml 1 12   6.0 490 120 .0041 0   35.9 55.5 .23  .23  20   .23 0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml 1 76   69   580 710 .0041 0   35.1 55.6 .23  .23  20   .23 0  
pals_opt-floodmax.4.4.ufo.UNBOUNDED.pals.yml 1 140   130   500 1100 .0041 0   34.9 54.3 .26  .27  20   .23 0  
pals_opt-floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 900   890   1100 7600 .0041 0   0   0   .064 .065 8.9 0    0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml 1 610   600   1100 4000 .0041 0   27.9 45.8 .32  .33  27   .39 0  
pals_opt-floodmax.5.1.ufo.UNBOUNDED.pals.yml 1 360   350   1000 2500 .0041 0   24.6 41.0 .36  .36  27   .39 0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml 1 62   52   490 450 .0041 0   22.9 38.6 .39  .39  27   .39 0  
pals_opt-floodmax.5.2.ufo.UNBOUNDED.pals.yml 1 92   83   530 680 .0041 0   23.1 39.8 .40  .40  27   .39 0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml 1 50   41   550 480 .0041 0   25.0 41.4 .38  .39  27   .15 0  
pals_opt-floodmax.5.3.ufo.UNBOUNDED.pals.yml 1 230   220   800 2100 .0041 0   24.6 39.8 .39  .39  27   .39 0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml 900   890   1200 6100 .0041 0   0   0   .060 .060 9.0 0    0  
pals_opt-floodmax.5.4.ufo.UNBOUNDED.pals.yml 900   890   1000 5600 .0041 0   0   0   .057 .059 9.0 0    0  
pals_opt-floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 900   890   970 4400 .0041 0   0   0   .059 .060 9.0 0    0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 100 61 38000 38000 65000 430000 .41 0   100 2350 3730 15 16 1600 13 0  
Run set cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized