Benchmark VeriFuzz TBF Test-Suite Validator
Tool VeriFuzz 1.0.1 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:17:17 CET 2019-02-06 14:51:38 CET
Run set verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized
Options --testcomp --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/verifuzz.2019-02-06_0717.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml error .819 prog tests 90 inspect 880 900 170 10000 350    0   true prog tests 1 inspect
81.9 93.8 .59 .54 17 4.5  0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml error .815 prog tests 91 inspect 880 900 170 10000 860    0   true prog tests 1 inspect
81.5 94.1 .61 .71 17 4.6  0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml error .813 prog tests 87 inspect 880 900 170 9700 940    0   true prog tests 1 inspect
81.3 93.8 .56 .52 17 4.4  0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml error .828 prog tests 92 inspect 880 900 170 12000 46    0   true prog tests 1 inspect
82.8 94.1 .60 .55 17 4.6  0  
pals_STARTPALS_ActiveStandby.ufo.BOUNDED-10.pals.yml error .808 prog tests 89 inspect 880 900 170 13000 1.8  0   unknown prog tests 0 inspect
80.8 93.2 .61 .58 17 4.5  0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml error .838 prog tests 118 inspect 890 900 170 10000 420    0   true prog tests 1 inspect
83.8 92.8 .79 .72 17 5.4  0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml error .823 prog tests 110 inspect 890 900 170 12000 270    0   true prog tests 1 inspect
82.3 91.2 .68 .62 17 5.1  0  
pals_STARTPALS_Triplicated.ufo.BOUNDED-10.pals.yml error .821 prog tests 109 inspect 890 900 170 13000 1.8  0   unknown prog tests 0 inspect
82.1 90.7 .68 .62 17 5.0  0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml error .816 prog tests 46 inspect 880 900 170 11000 190    0   true prog tests 1 inspect
81.6 91.5 .36 .34 17 2.1  0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml error .738 prog tests 35 inspect 880 900 170 9700 180    0   true prog tests 1 inspect
73.8 87.0 .32 .36 17 1.7  0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml error .782 prog tests 41 inspect 880 900 180 13000 210    0   true prog tests 1 inspect
78.2 89.8 .36 .37 17 1.9  0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml error .822 prog tests 43 inspect 880 900 170 10000 48    0   true prog tests 1 inspect
82.2 91.5 .34 .34 17 2.0  0  
pals_floodmax.3.ufo.BOUNDED-6.pals.yml error .802 prog tests 36 inspect 880 900 180 12000 1.0  0   unknown prog tests 0 inspect
80.2 90.1 .30 .28 17 1.7  0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml error .896 prog tests 256 inspect 880 900 180 12000 700    0   true prog tests 1 inspect
89.6 96.0 1.5  1.5  20 19    0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml error .848 prog tests 235 inspect 880 900 190 13000 680    0   true prog tests 1 inspect
84.8 92.8 1.4  1.3  20 19    0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml error .875 prog tests 251 inspect 890 900 190 12000 830    0   true prog tests 1 inspect
87.5 94.8 1.6  1.6  20 20    0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml error .887 prog tests 269 inspect 890 900 190 12000 110    0   true prog tests 1 inspect
88.7 95.1 1.7  1.5  20 22    0  
pals_floodmax.4.ufo.BOUNDED-8.pals.yml error .883 prog tests 241 inspect 890 900 190 9600 2.5  0   unknown prog tests 0 inspect
88.3 94.8 1.5  1.5  20 20    0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml error .942 prog tests 878 inspect 890 900 220 12000 1300    0   true prog tests 1 inspect
94.2 98.2 6.6  6.5  27 130    0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml error .913 prog tests 833 inspect 890 900 230 13000 2100    0   true prog tests 1 inspect
91.3 96.1 6.2  5.7  28 130    0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml error .921 prog tests 858 inspect 890 900 220 12000 2500    0   true prog tests 1 inspect
92.1 96.8 6.2  6.1  27 140    0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml error .933 prog tests 855 inspect 890 900 230 11000 37    0   true prog tests 1 inspect
93.3 97.4 6.4  6.0  28 140    0  
pals_floodmax.5.ufo.BOUNDED-10.pals.yml error .931 prog tests 829 inspect 890 900 220 13000 5.7  0   unknown prog tests 0 inspect
93.1 97.2 5.9  5.4  28 130    0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml error .736 prog tests 12 inspect 880 900 170 13000 59    0   true prog tests 1 inspect
73.6 88.7 .22 .21 17 .48 0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml error .740 prog tests 13 inspect 880 900 160 11000 53    0   true prog tests 1 inspect
74.0 88.4 .19 .19 17 .51 0  
pals_lcr-var-start-time.3.ufo.BOUNDED-6.pals.yml error .718 prog tests 12 inspect 880 900 160 11000 1.0  0   unknown prog tests 0 inspect
71.8 87.2 .17 .17 17 .48 0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml error .726 prog tests 24 inspect 880 900 170 11000 38    0   true prog tests 1 inspect
72.6 87.6 .24 .23 17 .98 0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml error .729 prog tests 23 inspect 880 900 170 10000 65    0   true prog tests 1 inspect
72.9 87.4 .25 .24 17 .94 0  
pals_lcr-var-start-time.4.ufo.BOUNDED-8.pals.yml error .719 prog tests 25 inspect 880 900 170 11000 1.2  0   unknown prog tests 0 inspect
71.9 87.0 .24 .23 17 1.0  0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml error .717 prog tests 35 inspect 880 900 170 10000 59    0   true prog tests 1 inspect
71.7 86.5 .33 .31 17 1.7  0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml error .719 prog tests 33 inspect 880 900 170 11000 61    0   true prog tests 1 inspect
71.9 86.4 .32 .31 17 1.6  0  
pals_lcr-var-start-time.5.ufo.BOUNDED-10.pals.yml error .707 prog tests 34 inspect 880 900 170 11000 1.2  0   unknown prog tests 0 inspect
70.7 85.7 .29 .28 17 1.6  0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml error .710 prog tests 47 inspect 880 900 180 13000 89    0   true prog tests 1 inspect
71.0 85.6 .43 .40 17 2.4  0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml error .711 prog tests 41 inspect 880 900 170 12000 73    0   true prog tests 1 inspect
71.1 85.5 .36 .36 17 2.1  0  
pals_lcr-var-start-time.6.ufo.BOUNDED-12.pals.yml error .701 prog tests 44 inspect 880 900 170 11000 1.2  0   unknown prog tests 0 inspect
70.1 84.9 .34 .32 17 2.3  0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml error .683 prog tests 6 inspect 880 900 160 12000 20    0   true prog tests 1 inspect
68.3 87.4 .15 .15 17 .25 0  
pals_lcr.3.ufo.BOUNDED-6.pals.yml error .658 prog tests 4 inspect 880 900 160 13000 .79 0   unknown prog tests 0 inspect
65.8 85.8 .17 .16 17 .20 0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml error .667 prog tests 12 inspect 880 900 170 11000 20    0   true prog tests 1 inspect
66.7 86.0 .19 .18 17 .52 0  
pals_lcr.4.ufo.BOUNDED-8.pals.yml error .648 prog tests 11 inspect 880 900 170 10000 .91 0   unknown prog tests 0 inspect
64.8 84.8 .17 .16 17 .45 0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml error .654 prog tests 16 inspect 880 900 170 13000 19    0   true prog tests 1 inspect
65.4 84.8 .22 .21 17 .75 0  
pals_lcr.5.ufo.BOUNDED-10.pals.yml error .640 prog tests 12 inspect 880 900 170 12000 1.3  0   unknown prog tests 0 inspect
64.0 83.8 .22 .22 17 .58 0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml error .645 prog tests 31 inspect 880 900 180 10000 23    0   true prog tests 1 inspect
64.5 83.7 .35 .35 17 1.5  0  
pals_lcr.6.ufo.BOUNDED-12.pals.yml error .632 prog tests 22 inspect 880 900 170 11000 1.3  0   unknown prog tests 0 inspect
63.2 82.9 .24 .23 17 1.1  0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml error .636 prog tests 35 inspect 880 900 180 11000 28    0   true prog tests 1 inspect
63.6 82.7 .39 .37 17 2.0  0  
pals_lcr.7.ufo.BOUNDED-14.pals.yml error .626 prog tests 30 inspect 880 900 180 11000 1.6  0   unknown prog tests 0 inspect
62.6 82.0 .29 .27 17 1.7  0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml error .629 prog tests 41 inspect 890 900 190 9600 5.4  0   true prog tests 1 inspect
62.9 81.8 .43 .46 18 2.6  0  
pals_lcr.8.ufo.BOUNDED-16.pals.yml error .625 prog tests 32 inspect 880 900 190 12000 1.9  0   unknown prog tests 0 inspect
62.5 81.4 .34 .32 18 2.1  0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml error .808 prog tests 49 inspect 880 900 170 11000 200    0   true prog tests 1 inspect
80.8 90.6 .39 .36 17 2.3  0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml error .714 prog tests 35 inspect 880 900 180 12000 200    0   true prog tests 1 inspect
71.4 86.8 .32 .36 17 1.8  0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml error .791 prog tests 45 inspect 880 900 170 11000 270    0   true prog tests 1 inspect
79.1 90.0 .38 .36 17 2.3  0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml error .804 prog tests 46 inspect 880 900 180 13000 50    0   true prog tests 1 inspect
80.5 90.7 .36 .34 17 2.4  0  
pals_opt-floodmax.3.ufo.BOUNDED-6.pals.yml error .809 prog tests 44 inspect 880 900 180 12000 1.4  0   unknown prog tests 0 inspect
80.9 90.3 .34 .32 17 2.3  0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml error .895 prog tests 292 inspect 890 900 190 10000 830    0   true prog tests 1 inspect
89.5 95.7 1.8  1.6  20 23    0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml error .849 prog tests 242 inspect 890 900 190 11000 830    0   true prog tests 1 inspect
84.9 92.7 1.5  1.5  21 21    0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml error .870 prog tests 266 inspect 890 900 200 13000 990    0   true prog tests 1 inspect
87.0 94.2 1.7  1.5  20 23    0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml error .887 prog tests 281 inspect 890 900 190 11000 110    0   true prog tests 1 inspect
88.7 94.9 1.7  1.6  21 24    0  
pals_opt-floodmax.4.ufo.BOUNDED-8.pals.yml error .881 prog tests 275 inspect 890 900 200 8700 2.8  0   unknown prog tests 0 inspect
88.1 94.5 1.7  1.7  20 24    0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml error .941 prog tests 977 inspect 890 900 220 13000 1300    0   true prog tests 1 inspect
94.1 98.0 7.4  6.9  28 150    0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml error .914 prog tests 868 inspect 890 900 230 11000 2700    0   true prog tests 1 inspect
91.4 96.1 6.3  5.8  28 140    0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml error .917 prog tests 836 inspect 890 900 230 11000 2400    0   true prog tests 1 inspect
91.7 96.3 6.5  7.7  28 140    0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml error .927 prog tests 885 inspect 890 900 250 11000 81    0   true prog tests 1 inspect
92.8 96.8 6.5  6.1  28 150    0  
pals_opt-floodmax.5.ufo.BOUNDED-10.pals.yml error .927 prog tests 906 inspect 890 900 230 11000 5.8  0   unknown prog tests 0 inspect
92.8 96.8 6.9  6.5  28 150    0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 62 48.9 55000 56000 11000 710000 22000 0   62 4890 5610 96 93 1200 1700 0  
Run set verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized