Benchmark CPA/CoVeriTest TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30375 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon049; apollon085; apollon116]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-06 05:30:26 CET
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized
Options -benchmark -heap 10000M -testcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/coveritest.2019-02-05_2105.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml .819 680 540 6400 6900 39    0   81.9 93.8 .68 .68 17 5.7 0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml .820 270 210 4600 3300 10    0   82.0 94.1 .75 .68 17 5.6 0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml .813 570 480 5200 7800 40    0   81.3 93.8 .67 .65 19 5.6 0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml .822 900 780 6800 11000 35    0   82.2 93.8 .71 .68 17 5.6 0  
pals_STARTPALS_ActiveStandby.ufo.BOUNDED-10.pals.yml .808 280 220 3900 3400 9.1  0   80.8 93.2 .75 .68 17 5.6 0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml .838 490 400 5200 4900 22    0   83.8 92.8 .64 .73 17 4.9 0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml .823 380 310 4800 4400 18    0   82.3 91.2 .64 .68 17 4.8 0  
pals_STARTPALS_Triplicated.ufo.BOUNDED-10.pals.yml .821 510 420 5600 5500 21    0   82.1 90.7 .66 .60 17 4.8 0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml .9   900 870 1600 7000 .86 0   90.0 97.4 .76 .69 17 5.0 0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml .817 36 12 940 320 .71 0   81.7 92.6 .73 .73 17 5.0 0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml .861 900 870 1200 7200 .87 0   86.1 95.4 .75 .68 17 5.2 0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml .896 900 870 1600 11000 .87 0   89.6 96.8 .82 .75 17 5.3 0  
pals_floodmax.3.ufo.BOUNDED-6.pals.yml .886 900 880 1500 10000 .67 0   88.6 96.1 .69 .66 17 5.1 0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml .934 900 870 1200 10000 .69 0   93.4 98.8 1.9  1.8  20 23   0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml .887 320 290 1300 3200 .69 0   88.7 95.7 1.9  1.8  20 25   0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml .909 900 870 1500 9000 .66 0   90.9 97.3 2.0  2.0  20 25   0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml .925 900 870 1600 10000 .66 0   92.5 97.9 2.0  2.1  20 26   0  
pals_floodmax.4.ufo.BOUNDED-8.pals.yml .921 900 870 1300 8500 .66 0   92.1 97.6 2.0  1.9  20 25   0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml .957 900 860 1200 12000 .32 0   95.7 99.3 5.3  4.9  27 100   0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml .930 900 860 1300 11000 .29 0   93.0 97.5 5.4  5.6  28 110   0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml .939 900 860 1400 12000 .39 0   93.9 98.1 5.3  5.6  28 110   0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml .949 900 860 1300 12000 .30 0   94.9 98.6 5.3  5.6  27 110   0  
pals_floodmax.5.ufo.BOUNDED-10.pals.yml .947 900 860 1600 11000 .32 0   94.7 98.4 5.5  5.5  28 110   0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml .882 900 870 1800 10000 1.9  0   88.2 99.3 .39 .36 17 1.9 0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml .894 900 870 1800 11000 2.0  0   89.4 99.3 .40 .36 17 1.8 0  
pals_lcr-var-start-time.3.ufo.BOUNDED-6.pals.yml .864 900 840 3100 12000 11    0   86.4 98.0 .37 .34 17 1.8 0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml .884 900 840 4200 11000 22    0   88.4 99.5 .46 .42 17 2.6 0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml .886 900 860 2600 10000 5.5  0   88.6 99.0 .46 .42 17 2.6 0  
pals_lcr-var-start-time.4.ufo.BOUNDED-8.pals.yml .870 900 860 4000 11000 7.8  0   87.0 98.4 .44 .44 17 2.6 0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml .886 900 840 4500 13000 26    0   88.6 99.6 .62 .57 17 4.0 0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml .882 900 850 4400 11000 17    0   88.2 98.7 .55 .60 17 3.9 0  
pals_lcr-var-start-time.5.ufo.BOUNDED-10.pals.yml .875 900 860 2900 12000 6.8  0   87.5 98.7 .58 .53 17 4.0 0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml .888 900 840 4600 12000 36    0   88.8 99.7 .74 .75 17 5.3 0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml .881 900 830 4500 11000 33    0   88.1 98.6 .80 .74 17 5.2 0  
pals_lcr-var-start-time.6.ufo.BOUNDED-12.pals.yml .880 900 820 4800 12000 44    0   88.0 98.9 .67 .62 17 5.3 0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml .866 41 15 1100 380 1.9  0   86.6 98.5 .31 .29 17 1.4 0  
pals_lcr.3.ufo.BOUNDED-6.pals.yml .842 310 260 3300 3700 7.9  0   84.2 97.0 .31 .29 17 1.3 0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml .870 900 840 4700 8300 12    0   87.0 98.8 .37 .34 17 2.1 0  
pals_lcr.4.ufo.BOUNDED-8.pals.yml .852 900 860 4600 12000 7.0  0   85.2 97.7 .36 .42 18 2.1 0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml .875 900 830 4700 11000 26    0   87.5 99.0 .44 .40 17 2.6 0  
pals_lcr.5.ufo.BOUNDED-10.pals.yml .860 900 810 4700 13000 55    0   86.0 98.1 .46 .46 17 2.6 0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml .880 900 820 4600 12000 43    0   88.0 99.2 .52 .48 17 3.5 0  
pals_lcr.6.ufo.BOUNDED-12.pals.yml .868 900 830 4700 12000 30    0   86.8 98.4 .51 .48 17 3.5 0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml .864 900 840 4300 11000 22    0   86.4 98.0 .60 .63 17 4.9 0  
pals_lcr.7.ufo.BOUNDED-14.pals.yml .874 900 840 4400 13000 28    0   87.4 98.6 .59 .58 17 4.9 0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml .871 900 830 4700 14000 42    0   87.1 98.2 .83 .76 18 6.7 0  
pals_lcr.8.ufo.BOUNDED-16.pals.yml .871 900 840 4200 12000 23    0   87.1 98.2 .71 .66 18 6.7 0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml .909 900 870 1600 11000 .77 0   90.9 97.7 .69 .66 17 5.5 0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml .804 37 13 1000 320 .83 0   80.5 93.2 .73 .71 17 5.6 0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml .873 900 870 1500 11000 .71 0   87.3 95.8 .82 .75 17 6.1 0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml .895 900 860 2100 11000 3.0  0   89.5 97.1 .73 .67 17 6.1 0  
pals_opt-floodmax.3.ufo.BOUNDED-6.pals.yml .895 900 870 1600 7700 .83 0   89.5 96.5 .72 .70 17 6.0 0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml .938 900 870 1300 12000 .65 0   93.8 98.8 2.1  1.9  20 24   0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml .894 780 750 1300 11000 .60 0   89.4 96.0 2.1  2.0  20 28   0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml .914 900 870 1700 12000 .84 0   91.5 97.5 2.0  1.9  20 28   0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml .929 900 870 1300 12000 .65 0   92.9 98.1 2.1  1.9  20 28   0  
pals_opt-floodmax.4.ufo.BOUNDED-8.pals.yml .926 900 870 1600 13000 .65 0   92.6 97.8 2.0  1.8  20 28   0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml .958 900 860 1300 12000 .35 0   95.8 99.1 5.5  5.5  28 100   0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml .933 900 860 1300 12000 .30 0   93.3 97.5 5.3  5.0  28 110   0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml .942 900 860 1400 12000 .40 0   94.2 98.2 6.3  5.9  28 120   0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml .951 900 860 1600 12000 .29 0   95.1 98.6 5.7  5.9  28 110   0  
pals_opt-floodmax.5.ufo.BOUNDED-10.pals.yml .949 900 860 1400 11000 .35 0   94.9 98.5 5.7  5.4  28 120   0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 62 54.9 49000 46000 180000 600000 720 0   62 5490 6030 100 98 1200 1500 0  
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized