Benchmark CPA/CoVeriTest TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30375 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon049; apollon085; apollon116]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-06 05:30:26 CET
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized
Options -benchmark -heap 10000M -testcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/coveritest.2019-02-05_2105.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml done .819 prog tests 113 inspect 680 540 6400 6900 39    0   true prog tests 1 inspect
81.9 93.8 .68 .68 17 5.7 0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml done .820 prog tests 111 inspect 270 210 4600 3300 10    0   true prog tests 1 inspect
82.0 94.1 .75 .68 17 5.6 0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml done .813 prog tests 112 inspect 570 480 5200 7800 40    0   true prog tests 1 inspect
81.3 93.8 .67 .65 19 5.6 0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml timeout .822 prog tests 112 inspect 900 780 6800 11000 35    0   true prog tests 1 inspect
82.2 93.8 .71 .68 17 5.6 0  
pals_STARTPALS_ActiveStandby.ufo.BOUNDED-10.pals.yml done .808 prog tests 111 inspect 280 220 3900 3400 9.1  0   unknown prog tests 0 inspect
80.8 93.2 .75 .68 17 5.6 0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml done .838 prog tests 107 inspect 490 400 5200 4900 22    0   true prog tests 1 inspect
83.8 92.8 .64 .73 17 4.9 0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml done .823 prog tests 103 inspect 380 310 4800 4400 18    0   true prog tests 1 inspect
82.3 91.2 .64 .68 17 4.8 0  
pals_STARTPALS_Triplicated.ufo.BOUNDED-10.pals.yml done .821 prog tests 105 inspect 510 420 5600 5500 21    0   unknown prog tests 0 inspect
82.1 90.7 .66 .60 17 4.8 0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml timeout .9   prog tests 110 inspect 900 870 1600 7000 .86 0   true prog tests 1 inspect
90.0 97.4 .76 .69 17 5.0 0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml done .817 prog tests 109 inspect 36 12 940 320 .71 0   true prog tests 1 inspect
81.7 92.6 .73 .73 17 5.0 0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml timeout .861 prog tests 113 inspect 900 870 1200 7200 .87 0   true prog tests 1 inspect
86.1 95.4 .75 .68 17 5.2 0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml timeout .896 prog tests 115 inspect 900 870 1600 11000 .87 0   true prog tests 1 inspect
89.6 96.8 .82 .75 17 5.3 0  
pals_floodmax.3.ufo.BOUNDED-6.pals.yml timeout .886 prog tests 111 inspect 900 880 1500 10000 .67 0   unknown prog tests 0 inspect
88.6 96.1 .69 .66 17 5.1 0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml timeout .934 prog tests 309 inspect 900 870 1200 10000 .69 0   true prog tests 1 inspect
93.4 98.8 1.9  1.8  20 23   0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml done .887 prog tests 309 inspect 320 290 1300 3200 .69 0   true prog tests 1 inspect
88.7 95.7 1.9  1.8  20 25   0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml timeout .909 prog tests 314 inspect 900 870 1500 9000 .66 0   true prog tests 1 inspect
90.9 97.3 2.0  2.0  20 25   0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml timeout .925 prog tests 316 inspect 900 870 1600 10000 .66 0   true prog tests 1 inspect
92.5 97.9 2.0  2.1  20 26   0  
pals_floodmax.4.ufo.BOUNDED-8.pals.yml timeout .921 prog tests 312 inspect 900 870 1300 8500 .66 0   unknown prog tests 0 inspect
92.1 97.6 2.0  1.9  20 25   0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml timeout .957 prog tests 693 inspect 900 860 1200 12000 .32 0   true prog tests 1 inspect
95.7 99.3 5.3  4.9  27 100   0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml timeout .930 prog tests 701 inspect 900 860 1300 11000 .29 0   true prog tests 1 inspect
93.0 97.5 5.4  5.6  28 110   0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml timeout .939 prog tests 701 inspect 900 860 1400 12000 .39 0   true prog tests 1 inspect
93.9 98.1 5.3  5.6  28 110   0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml timeout .949 prog tests 701 inspect 900 860 1300 12000 .30 0   true prog tests 1 inspect
94.9 98.6 5.3  5.6  27 110   0  
pals_floodmax.5.ufo.BOUNDED-10.pals.yml timeout .947 prog tests 701 inspect 900 860 1600 11000 .32 0   unknown prog tests 0 inspect
94.7 98.4 5.5  5.5  28 110   0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml timeout .882 prog tests 57 inspect 900 870 1800 10000 1.9  0   true prog tests 1 inspect
88.2 99.3 .39 .36 17 1.9 0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml timeout .894 prog tests 53 inspect 900 870 1800 11000 2.0  0   true prog tests 1 inspect
89.4 99.3 .40 .36 17 1.8 0  
pals_lcr-var-start-time.3.ufo.BOUNDED-6.pals.yml timeout .864 prog tests 52 inspect 900 840 3100 12000 11    0   unknown prog tests 0 inspect
86.4 98.0 .37 .34 17 1.8 0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml timeout .884 prog tests 69 inspect 900 840 4200 11000 22    0   true prog tests 1 inspect
88.4 99.5 .46 .42 17 2.6 0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml timeout .886 prog tests 67 inspect 900 860 2600 10000 5.5  0   true prog tests 1 inspect
88.6 99.0 .46 .42 17 2.6 0  
pals_lcr-var-start-time.4.ufo.BOUNDED-8.pals.yml timeout .870 prog tests 69 inspect 900 860 4000 11000 7.8  0   unknown prog tests 0 inspect
87.0 98.4 .44 .44 17 2.6 0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml timeout .886 prog tests 87 inspect 900 840 4500 13000 26    0   true prog tests 1 inspect
88.6 99.6 .62 .57 17 4.0 0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml timeout .882 prog tests 85 inspect 900 850 4400 11000 17    0   true prog tests 1 inspect
88.2 98.7 .55 .60 17 3.9 0  
pals_lcr-var-start-time.5.ufo.BOUNDED-10.pals.yml timeout .875 prog tests 87 inspect 900 860 2900 12000 6.8  0   unknown prog tests 0 inspect
87.5 98.7 .58 .53 17 4.0 0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml timeout .888 prog tests 106 inspect 900 840 4600 12000 36    0   true prog tests 1 inspect
88.8 99.7 .74 .75 17 5.3 0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml timeout .881 prog tests 104 inspect 900 830 4500 11000 33    0   true prog tests 1 inspect
88.1 98.6 .80 .74 17 5.2 0  
pals_lcr-var-start-time.6.ufo.BOUNDED-12.pals.yml timeout .880 prog tests 106 inspect 900 820 4800 12000 44    0   unknown prog tests 0 inspect
88.0 98.9 .67 .62 17 5.3 0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml done .866 prog tests 45 inspect 41 15 1100 380 1.9  0   true prog tests 1 inspect
86.6 98.5 .31 .29 17 1.4 0  
pals_lcr.3.ufo.BOUNDED-6.pals.yml done .842 prog tests 43 inspect 310 260 3300 3700 7.9  0   unknown prog tests 0 inspect
84.2 97.0 .31 .29 17 1.3 0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml timeout .870 prog tests 56 inspect 900 840 4700 8300 12    0   true prog tests 1 inspect
87.0 98.8 .37 .34 17 2.1 0  
pals_lcr.4.ufo.BOUNDED-8.pals.yml timeout .852 prog tests 55 inspect 900 860 4600 12000 7.0  0   unknown prog tests 0 inspect
85.2 97.7 .36 .42 18 2.1 0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml timeout .875 prog tests 62 inspect 900 830 4700 11000 26    0   true prog tests 1 inspect
87.5 99.0 .44 .40 17 2.6 0  
pals_lcr.5.ufo.BOUNDED-10.pals.yml timeout .860 prog tests 62 inspect 900 810 4700 13000 55    0   unknown prog tests 0 inspect
86.0 98.1 .46 .46 17 2.6 0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml timeout .880 prog tests 76 inspect 900 820 4600 12000 43    0   true prog tests 1 inspect
88.0 99.2 .52 .48 17 3.5 0  
pals_lcr.6.ufo.BOUNDED-12.pals.yml timeout .868 prog tests 76 inspect 900 830 4700 12000 30    0   unknown prog tests 0 inspect
86.8 98.4 .51 .48 17 3.5 0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml timeout .864 prog tests 91 inspect 900 840 4300 11000 22    0   unknown prog tests 0 inspect
86.4 98.0 .60 .63 17 4.9 0  
pals_lcr.7.ufo.BOUNDED-14.pals.yml timeout .874 prog tests 91 inspect 900 840 4400 13000 28    0   unknown prog tests 0 inspect
87.4 98.6 .59 .58 17 4.9 0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml timeout .871 prog tests 107 inspect 900 830 4700 14000 42    0   unknown prog tests 0 inspect
87.1 98.2 .83 .76 18 6.7 0  
pals_lcr.8.ufo.BOUNDED-16.pals.yml timeout .871 prog tests 107 inspect 900 840 4200 12000 23    0   unknown prog tests 0 inspect
87.1 98.2 .71 .66 18 6.7 0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml timeout .909 prog tests 119 inspect 900 870 1600 11000 .77 0   true prog tests 1 inspect
90.9 97.7 .69 .66 17 5.5 0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml done .804 prog tests 112 inspect 37 13 1000 320 .83 0   true prog tests 1 inspect
80.5 93.2 .73 .71 17 5.6 0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml timeout .873 prog tests 122 inspect 900 870 1500 11000 .71 0   true prog tests 1 inspect
87.3 95.8 .82 .75 17 6.1 0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml timeout .895 prog tests 122 inspect 900 860 2100 11000 3.0  0   true prog tests 1 inspect
89.5 97.1 .73 .67 17 6.1 0  
pals_opt-floodmax.3.ufo.BOUNDED-6.pals.yml timeout .895 prog tests 120 inspect 900 870 1600 7700 .83 0   unknown prog tests 0 inspect
89.5 96.5 .72 .70 17 6.0 0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml timeout .938 prog tests 303 inspect 900 870 1300 12000 .65 0   true prog tests 1 inspect
93.8 98.8 2.1  1.9  20 24   0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml done .894 prog tests 325 inspect 780 750 1300 11000 .60 0   true prog tests 1 inspect
89.4 96.0 2.1  2.0  20 28   0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml timeout .914 prog tests 320 inspect 900 870 1700 12000 .84 0   true prog tests 1 inspect
91.5 97.5 2.0  1.9  20 28   0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml timeout .929 prog tests 321 inspect 900 870 1300 12000 .65 0   true prog tests 1 inspect
92.9 98.1 2.1  1.9  20 28   0  
pals_opt-floodmax.4.ufo.BOUNDED-8.pals.yml timeout .926 prog tests 320 inspect 900 870 1600 13000 .65 0   unknown prog tests 0 inspect
92.6 97.8 2.0  1.8  20 28   0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml timeout .958 prog tests 691 inspect 900 860 1300 12000 .35 0   true prog tests 1 inspect
95.8 99.1 5.5  5.5  28 100   0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml timeout .933 prog tests 701 inspect 900 860 1300 12000 .30 0   true prog tests 1 inspect
93.3 97.5 5.3  5.0  28 110   0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml timeout .942 prog tests 701 inspect 900 860 1400 12000 .40 0   true prog tests 1 inspect
94.2 98.2 6.3  5.9  28 120   0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml timeout .951 prog tests 701 inspect 900 860 1600 12000 .29 0   true prog tests 1 inspect
95.1 98.6 5.7  5.9  28 110   0  
pals_opt-floodmax.5.ufo.BOUNDED-10.pals.yml timeout .949 prog tests 701 inspect 900 860 1400 11000 .35 0   unknown prog tests 0 inspect
94.9 98.5 5.7  5.4  28 120   0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 62 54.9 49000 46000 180000 600000 720 0   62 5490 6030 100 98 1200 1500 0  
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized