Benchmark PRtest TBF Test-Suite Validator
Tool tbf v0.3.0-testcomp19 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon010; apollon052; apollon080; apollon107; apollon135; apollon167]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 06:02:44 CET 2019-02-06 13:26:19 CET
Run set prtest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-prtest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized
Options --stats -i random --write-xml --svcomp-nondets --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/prtest.2019-02-06_0602.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml timeout .00550 prog tests 7 inspect 900 830 31 12000 .012  0   unknown prog tests 0 inspect
.55 7.08 .18 .21 17 .47 0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml timeout .00560 prog tests 7 inspect 900 830 31 12000 .012  0   unknown prog tests 0 inspect
.56 7.19 .17 .17 17 .47 0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml timeout .00550 prog tests 7 inspect 900 830 31 10000 .012  0   unknown prog tests 0 inspect
.55 7.08 .18 .24 17 .47 0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml timeout .00560 prog tests 7 inspect 900 830 31 13000 .012  0   unknown prog tests 0 inspect
.56 7.14 .19 .19 17 .47 0  
pals_STARTPALS_ActiveStandby.ufo.BOUNDED-10.pals.yml timeout .00550 prog tests 7 inspect 900 830 31 12000 .012  0   unknown prog tests 0 inspect
.55 7.08 .17 .17 17 .47 0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml timeout .0375  prog tests 20 inspect 900 810 31 12000 .012  0   unknown prog tests 0 inspect
3.75 14.1  .25 .24 17 1.0  0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml timeout .038   prog tests 20 inspect 900 810 30 14000 .025  0   unknown prog tests 0 inspect
3.80 14.2  .23 .25 17 1.0  0  
pals_STARTPALS_Triplicated.ufo.BOUNDED-10.pals.yml timeout .0370  prog tests 20 inspect 900 810 31 12000 .012  0   unknown prog tests 0 inspect
3.70 14.0  .23 .25 17 .92 0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml timeout .132   prog tests 16 inspect 900 820 31 12000 .012  0   unknown prog tests 0 inspect
13.2  28.3  .22 .21 17 .76 0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml timeout .153   prog tests 16 inspect 900 820 31 13000 .012  0   unknown prog tests 0 inspect
15.3  29.2  .22 .21 17 .82 0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml timeout .153   prog tests 16 inspect 900 820 31 13000 .012  0   unknown prog tests 0 inspect
15.3  29.2  .21 .21 17 .82 0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml timeout .153   prog tests 16 inspect 900 820 31 13000 .012  0   unknown prog tests 0 inspect
15.3  29.2  .22 .21 17 .82 0  
pals_floodmax.3.ufo.BOUNDED-6.pals.yml timeout .153   prog tests 16 inspect 900 820 30 12000 .012  0   unknown prog tests 0 inspect
15.3  29.2  .22 .21 17 .82 0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml timeout .131   prog tests 44 inspect 900 780 31 12000 .012  0   unknown prog tests 0 inspect
13.1  26.0  .42 .40 20 3.4  0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml timeout .124   prog tests 44 inspect 900 780 31 12000 .012  0   unknown prog tests 0 inspect
12.4  25.1  .43 .41 20 3.6  0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml timeout .124   prog tests 44 inspect 900 780 31 11000 .012  0   unknown prog tests 0 inspect
12.4  25.1  .49 .46 20 3.6  0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml timeout .124   prog tests 44 inspect 900 780 31 13000 .012  0   unknown prog tests 0 inspect
12.4  25.1  .42 .40 20 3.6  0  
pals_floodmax.4.ufo.BOUNDED-8.pals.yml timeout .124   prog tests 44 inspect 900 780 31 12000 .012  0   unknown prog tests 0 inspect
12.4  25.1  .50 .48 20 3.6  0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml timeout .110   prog tests 120 inspect 900 710 34 12000 .012  0   unknown prog tests 0 inspect
11.0  21.3  1.0  .97 27 17    0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml timeout .106   prog tests 120 inspect 900 710 34 12000 .012  0   unknown prog tests 0 inspect
10.6  20.7  1.2  1.1  27 19    0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml timeout .106   prog tests 120 inspect 900 710 34 11000 .0041 0   unknown prog tests 0 inspect
10.6  20.7  1.1  .99 27 19    0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml timeout .106   prog tests 120 inspect 900 710 34 12000 .012  0   unknown prog tests 0 inspect
10.6  20.7  1.2  1.1  27 19    0  
pals_floodmax.5.ufo.BOUNDED-10.pals.yml timeout .106   prog tests 120 inspect 900 710 34 11000 .012  0   unknown prog tests 0 inspect
10.6  20.7  1.2  1.1  27 19    0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml timeout .0909  prog tests 6 inspect 900 840 31 12000 .012  0   unknown prog tests 0 inspect
9.09 22.0  .15 .14 17 .28 0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml timeout .0962  prog tests 6 inspect 900 840 31 11000 .012  0   unknown prog tests 0 inspect
9.62 22.4  .17 .16 17 .28 0  
pals_lcr-var-start-time.3.ufo.BOUNDED-6.pals.yml timeout .0909  prog tests 6 inspect 900 840 30 12000 .012  0   unknown prog tests 0 inspect
9.09 22.1  .15 .16 17 .28 0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml timeout .0548  prog tests 5 inspect 900 840 31 11000 .012  0   unknown prog tests 0 inspect
5.48 18.6  .16 .16 17 .28 0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml timeout .0571  prog tests 5 inspect 900 840 30 11000 .012  0   unknown prog tests 0 inspect
5.71 18.9  .19 .18 17 .27 0  
pals_lcr-var-start-time.4.ufo.BOUNDED-8.pals.yml timeout .0548  prog tests 5 inspect 900 840 31 12000 .012  0   unknown prog tests 0 inspect
5.48 18.8  .15 .15 17 .28 0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml timeout .0543  prog tests 8 inspect 900 830 31 13000 .012  0   unknown prog tests 0 inspect
5.43 18.1  .18 .18 17 .46 0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml timeout .0562  prog tests 8 inspect 900 830 31 13000 .012  0   unknown prog tests 0 inspect
5.62 18.3  .19 .18 17 .46 0  
pals_lcr-var-start-time.5.ufo.BOUNDED-10.pals.yml timeout .0543  prog tests 8 inspect 900 830 31 14000 .012  0   unknown prog tests 0 inspect
5.43 18.1  .18 .18 17 .46 0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml timeout .0446  prog tests 7 inspect 900 830 31 11000 .012  0   unknown prog tests 0 inspect
4.46 16.8  .19 .19 17 .45 0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml timeout .0459  prog tests 7 inspect 900 830 31 12000 .012  0   unknown prog tests 0 inspect
4.59 17.0  .19 .19 17 .45 0  
pals_lcr-var-start-time.6.ufo.BOUNDED-12.pals.yml timeout .0446  prog tests 7 inspect 900 830 31 12000 .012  0   unknown prog tests 0 inspect
4.46 16.9  .18 .18 17 .45 0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml timeout .110   prog tests 5 inspect 900 840 31 13000 .029  0   unknown prog tests 0 inspect
11.0  21.5  .16 .19 17 .23 0  
pals_lcr.3.ufo.BOUNDED-6.pals.yml timeout .110   prog tests 5 inspect 900 840 30 13000 .0041 0   unknown prog tests 0 inspect
11.0  21.6  .14 .14 17 .23 0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml timeout .0833  prog tests 7 inspect 900 830 31 10000 .012  0   unknown prog tests 0 inspect
8.33 19.2  .17 .17 17 .32 0  
pals_lcr.4.ufo.BOUNDED-8.pals.yml timeout .0833  prog tests 7 inspect 900 830 31 11000 .012  0   unknown prog tests 0 inspect
8.33 19.3  .16 .16 17 .32 0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml timeout .0515  prog tests 4 inspect 900 840 31 15000 .012  0   unknown prog tests 0 inspect
5.15 16.6  .16 .16 17 .25 0  
pals_lcr.5.ufo.BOUNDED-10.pals.yml timeout .0515  prog tests 4 inspect 900 840 30 11000 .012  0   unknown prog tests 0 inspect
5.15 16.7  .17 .17 17 .25 0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml timeout .0542  prog tests 6 inspect 900 840 31 13000 .012  0   unknown prog tests 0 inspect
5.42 16.3  .19 .19 17 .37 0  
pals_lcr.6.ufo.BOUNDED-12.pals.yml timeout .0542  prog tests 6 inspect 900 840 31 10000 .012  0   unknown prog tests 0 inspect
5.42 16.3  .18 .18 17 .37 0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml timeout .0455  prog tests 5 inspect 900 840 31 12000 .012  0   unknown prog tests 0 inspect
4.55 15.2  .19 .19 17 .36 0  
pals_lcr.7.ufo.BOUNDED-14.pals.yml timeout .0455  prog tests 5 inspect 900 840 31 12000 .012  0   unknown prog tests 0 inspect
4.55 15.3  .19 .19 17 .36 0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml timeout .0388  prog tests 5 inspect 900 840 31 12000 .012  0   unknown prog tests 0 inspect
3.88 14.4  .21 .24 18 .41 0  
pals_lcr.8.ufo.BOUNDED-16.pals.yml timeout .0388  prog tests 5 inspect 900 840 31 14000 .012  0   unknown prog tests 0 inspect
3.88 14.4  .21 .21 18 .41 0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml timeout .120   prog tests 20 inspect 900 810 31 11000 .012  0   unknown prog tests 0 inspect
12.0  26.8  .24 .23 17 1.0  0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml timeout .141   prog tests 20 inspect 900 810 31 12000 .012  0   unknown prog tests 0 inspect
14.1  27.6  .24 .23 17 1.1  0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml timeout .141   prog tests 20 inspect 900 810 31 15000 .012  0   unknown prog tests 0 inspect
14.1  27.6  .23 .23 17 1.1  0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml timeout .141   prog tests 20 inspect 900 810 31 12000 .020  0   unknown prog tests 0 inspect
14.1  27.6  .24 .23 17 1.1  0  
pals_opt-floodmax.3.ufo.BOUNDED-6.pals.yml timeout .141   prog tests 20 inspect 900 810 30 11000 .012  0   unknown prog tests 0 inspect
14.1  27.6  .25 .24 17 1.1  0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml timeout .107   prog tests 49 inspect 900 770 31 13000 .012  0   unknown prog tests 0 inspect
10.7  23.8  .47 .47 20 3.9  0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml timeout .102   prog tests 49 inspect 900 770 31 14000 .012  0   unknown prog tests 0 inspect
10.2  23.0  .48 .47 20 4.4  0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml timeout .102   prog tests 49 inspect 900 770 31 13000 .012  0   unknown prog tests 0 inspect
10.2  23.0  .48 .45 20 4.4  0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml timeout .102   prog tests 49 inspect 900 770 31 11000 .012  0   unknown prog tests 0 inspect
10.2  23.0  .52 .49 20 4.4  0  
pals_opt-floodmax.4.ufo.BOUNDED-8.pals.yml timeout .102   prog tests 49 inspect 900 770 31 12000 .012  0   unknown prog tests 0 inspect
10.2  23.0  .51 .50 20 4.3  0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml timeout .0958  prog tests 122 inspect 900 710 34 12000 .012  0   unknown prog tests 0 inspect
9.58 20.0  1.2  1.1  27 19    0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml timeout .0928  prog tests 122 inspect 900 710 35 13000 .0041 0   unknown prog tests 0 inspect
9.28 19.5  1.1  1.1  27 20    0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml timeout .0928  prog tests 122 inspect 900 710 35 11000 .012  0   unknown prog tests 0 inspect
9.28 19.5  1.2  1.1  27 20    0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml timeout .0928  prog tests 122 inspect 900 710 35 11000 .0041 0   unknown prog tests 0 inspect
9.28 19.5  1.2  1.1  27 20    0  
pals_opt-floodmax.5.ufo.BOUNDED-10.pals.yml timeout .0928  prog tests 122 inspect 900 710 35 11000 .012  0   unknown prog tests 0 inspect
9.28 19.5  1.2  1.2  27 20    0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 62 5.23 56000 50000 1900 750000 .77 0   62 523 1240 24 24 1200 250 0  
Run set prtest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-prtest.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized