Benchmark CPA/Tiger-MGP TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30541M Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:13:54 CET 2019-02-06 06:15:02 CET
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized
Options -benchmark -heap 10000M -tigertestcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/cpa-tiger.2019-02-05_2113.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml timeout .681 prog tests 30 inspect 900 880   540 11000 .0041 0   true prog tests 1 inspect
68.1 86.5 .28 .27 17 1.6  0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml unknown .792 prog tests 45 inspect 560 550   900 6500 .0041 0   true prog tests 1 inspect
79.2 92.5 .36 .34 17 2.3  0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml true .813 prog tests 49 inspect 140 130   950 1800 .0041 0   true prog tests 1 inspect
81.3 93.8 .38 .41 17 2.5  0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml unknown .744 prog tests 34 inspect 800 780   630 9400 .0041 0   true prog tests 1 inspect
74.4 91.0 .31 .37 17 1.8  0  
pals_STARTPALS_ActiveStandby.ufo.BOUNDED-10.pals.yml unknown .802 prog tests 51 inspect 420 410   580 5600 .0041 0   unknown prog tests 0 inspect
80.2 92.9 .38 .35 17 2.6  0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml timeout .156 prog tests 6 inspect 900 880   550 12000 .0041 0   unknown prog tests 0 inspect
15.6 22.0 .17 .17 17 .38 0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml unknown .760 prog tests 27 inspect 900 870   600 12000 .0041 0   true prog tests 1 inspect
76.0 88.3 .28 .32 17 1.3  0  
pals_STARTPALS_Triplicated.ufo.BOUNDED-10.pals.yml unknown .747 prog tests 29 inspect 780 760   650 9200 .0041 0   unknown prog tests 0 inspect
74.7 86.7 .30 .30 17 1.4  0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml timeout .853 prog tests 40 inspect 900 890   960 8500 .0041 0   true prog tests 1 inspect
85.3 94.1 .33 .38 17 1.9  0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml true .817 prog tests 57 inspect 19 9.3 480 200 .0041 0   true prog tests 1 inspect
81.7 92.6 .42 .42 17 2.7  0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml timeout .772 prog tests 32 inspect 900 890   830 6300 .0041 0   true prog tests 1 inspect
77.2 89.1 .32 .33 17 1.4  0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml timeout .807 prog tests 34 inspect 900 890   1400 14000 .0041 0   true prog tests 1 inspect
80.7 90.5 .31 .30 17 1.6  0  
pals_floodmax.3.ufo.BOUNDED-6.pals.yml timeout .797 prog tests 33 inspect 900 890   680 12000 .0041 0   unknown prog tests 0 inspect
79.7 89.8 .30 .31 17 1.5  0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml unknown .89  prog tests 107 inspect 790 770   840 9400 .0041 0   true prog tests 1 inspect
89.0 95.6 .79 .85 20 8.0  0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml true .887 prog tests 131 inspect 88 74   660 1000 .0041 0   true prog tests 1 inspect
88.7 95.7 .97 1.0  20 10    0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml timeout .828 prog tests 87 inspect 900 890   1300 7000 .0041 0   true prog tests 1 inspect
82.8 91.3 .69 .74 20 6.9  0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml timeout .870 prog tests 103 inspect 900 890   1200 12000 .0041 0   true prog tests 1 inspect
87.0 93.8 .78 .77 20 8.2  0  
pals_floodmax.4.ufo.BOUNDED-8.pals.yml timeout .862 prog tests 102 inspect 900 890   1300 7800 .0041 0   unknown prog tests 0 inspect
86.2 93.2 .76 .78 20 8.1  0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml timeout .900 prog tests 210 inspect 900 880   1100 14000 .0041 0   true prog tests 1 inspect
90.0 95.0 1.7  1.6  27 31    0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml unknown .907 prog tests 239 inspect 780 750   960 9700 .0041 0   true prog tests 1 inspect
90.8 95.7 2.1  2.1  27 37    0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml timeout .911 prog tests 222 inspect 900 880   1500 6700 .0041 0   true prog tests 1 inspect
91.1 96.0 1.9  2.0  27 35    0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml timeout .917 prog tests 223 inspect 900 870   1300 10000 .0041 0   true prog tests 1 inspect
91.7 96.1 2.0  2.1  27 35    0  
pals_floodmax.5.ufo.BOUNDED-10.pals.yml timeout .916 prog tests 224 inspect 900 880   1100 10000 .0041 0   unknown prog tests 0 inspect
91.6 96.1 1.9  2.0  27 35    0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml timeout .836 prog tests 27 inspect 900 890   1200 11000 .0041 0   true prog tests 1 inspect
83.6 96.0 .27 .29 17 .97 0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml true .894 prog tests 39 inspect 140 130   750 1800 .0041 0   true prog tests 1 inspect
89.4 99.3 .30 .30 17 1.4  0  
pals_lcr-var-start-time.3.ufo.BOUNDED-6.pals.yml timeout .8   prog tests 20 inspect 900 890   1500 11000 .0041 0   unknown prog tests 0 inspect
80.0 93.3 .22 .25 17 .74 0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml timeout .774 prog tests 22 inspect 900 880   900 11000 .0041 0   true prog tests 1 inspect
77.4 91.2 .25 .25 17 .91 0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml timeout .779 prog tests 31 inspect 900 890   800 12000 .0041 0   true prog tests 1 inspect
77.9 91.0 .29 .34 17 1.2  0  
pals_lcr-var-start-time.4.ufo.BOUNDED-8.pals.yml timeout .760 prog tests 23 inspect 900 890   470 12000 .0041 0   unknown prog tests 0 inspect
76.0 90.1 .23 .22 17 .94 0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml timeout .755 prog tests 21 inspect 900 890   780 12000 .0041 0   true prog tests 1 inspect
75.5 89.5 .25 .25 17 .96 0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml timeout .770 prog tests 28 inspect 900 890   1000 12000 .0041 0   true prog tests 1 inspect
77.0 90.2 .31 .30 17 1.4  0  
pals_lcr-var-start-time.5.ufo.BOUNDED-10.pals.yml timeout .75  prog tests 25 inspect 900 890   510 13000 .0041 0   unknown prog tests 0 inspect
75.0 89.5 .26 .25 17 1.2  0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml timeout .737 prog tests 30 inspect 900 890   760 13000 .0041 0   unknown prog tests 0 inspect
73.7 88.1 .30 .34 17 1.6  0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml timeout .734 prog tests 32 inspect 900 890   510 12000 .0041 0   true prog tests 1 inspect
73.4 87.2 .34 .32 17 1.7  0  
pals_lcr-var-start-time.6.ufo.BOUNDED-12.pals.yml timeout .755 prog tests 34 inspect 900 890   780 12000 .0041 0   unknown prog tests 0 inspect
75.5 89.1 .31 .33 17 1.7  0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml true .866 prog tests 29 inspect 20 13   480 200 .0041 0   true prog tests 1 inspect
86.6 98.5 .25 .23 17 .91 0  
pals_lcr.3.ufo.BOUNDED-6.pals.yml true .842 prog tests 32 inspect 34 24   600 450 .0041 0   unknown prog tests 0 inspect
84.2 97.0 .27 .27 16 1.0  0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml timeout .732 prog tests 15 inspect 900 890   1100 11000 .0041 0   true prog tests 1 inspect
73.2 90.1 .21 .20 17 .63 0  
pals_lcr.4.ufo.BOUNDED-8.pals.yml timeout .787 prog tests 25 inspect 900 890   1100 13000 .0041 0   unknown prog tests 0 inspect
78.7 93.6 .24 .28 17 .96 0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml timeout .662 prog tests 17 inspect 900 890   840 9500 .0041 0   unknown prog tests 0 inspect
66.2 85.3 .22 .21 17 .79 0  
pals_lcr.5.ufo.BOUNDED-10.pals.yml timeout .698 prog tests 18 inspect 900 890   2200 11000 .0041 0   unknown prog tests 0 inspect
69.8 87.6 .22 .22 17 .83 0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml timeout .711 prog tests 24 inspect 900 890   520 11000 .0041 0   true prog tests 1 inspect
71.1 88.1 .28 .27 17 1.2  0  
pals_lcr.6.ufo.BOUNDED-12.pals.yml timeout .705 prog tests 27 inspect 900 890   820 12000 .0041 0   unknown prog tests 0 inspect
70.5 87.7 .28 .32 17 1.3  0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml timeout .712 prog tests 30 inspect 900 890   620 13000 .0041 0   true prog tests 1 inspect
71.2 87.8 .33 .32 17 1.7  0  
pals_lcr.7.ufo.BOUNDED-14.pals.yml timeout .702 prog tests 28 inspect 900 890   680 7000 .0041 0   unknown prog tests 0 inspect
70.2 87.1 .30 .29 17 1.6  0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml timeout .681 prog tests 34 inspect 900 890   690 11000 .0041 0   unknown prog tests 0 inspect
68.1 85.3 .36 .34 18 2.2  0  
pals_lcr.8.ufo.BOUNDED-16.pals.yml timeout .694 prog tests 33 inspect 900 890   510 11000 .0041 0   unknown prog tests 0 inspect
69.4 86.1 .35 .37 18 2.1  0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml timeout .880 prog tests 47 inspect 900 890   1000 10000 .0041 0   true prog tests 1 inspect
88.0 95.7 .38 .40 17 2.2  0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml true .804 prog tests 63 inspect 18 7.8 500 190 .0041 0   true prog tests 1 inspect
80.5 93.2 .46 .50 17 3.2  0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml timeout .773 prog tests 33 inspect 900 890   920 11000 .0041 0   true prog tests 1 inspect
77.3 88.8 .32 .31 17 1.7  0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml timeout .795 prog tests 32 inspect 900 890   1000 9700 .0041 0   true prog tests 1 inspect
79.5 90.0 .32 .30 17 1.7  0  
pals_opt-floodmax.3.ufo.BOUNDED-6.pals.yml timeout .795 prog tests 32 inspect 900 890   1100 9600 .0041 0   unknown prog tests 0 inspect
79.5 89.4 .30 .31 17 1.7  0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml timeout .872 prog tests 90 inspect 900 880   660 11000 .0041 0   true prog tests 1 inspect
87.2 94.0 .72 .67 20 7.1  0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml true .894 prog tests 130 inspect 380 370   570 4800 .0041 0   true prog tests 1 inspect
89.4 96.0 .98 .94 20 11    0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml timeout .840 prog tests 84 inspect 900 880   800 12000 .0041 0   true prog tests 1 inspect
84.0 92.0 .72 .67 20 7.4  0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml timeout .857 prog tests 89 inspect 900 890   1300 11000 .0041 0   true prog tests 1 inspect
85.7 92.7 .79 .77 20 7.8  0  
pals_opt-floodmax.4.ufo.BOUNDED-8.pals.yml timeout .855 prog tests 85 inspect 900 880   610 9900 .0041 0   unknown prog tests 0 inspect
85.5 92.5 .67 .64 20 7.5  0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml timeout .903 prog tests 222 inspect 900 870   1100 9100 .0041 0   true prog tests 1 inspect
90.3 95.0 1.9  2.3  27 34    0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml timeout .891 prog tests 227 inspect 900 880   1000 10000 .0041 0   true prog tests 1 inspect
89.1 94.3 2.1  2.0  27 37    0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml timeout .902 prog tests 226 inspect 900 880   1300 7000 .0041 0   true prog tests 1 inspect
90.2 95.2 2.0  2.4  28 37    0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml timeout .909 prog tests 227 inspect 900 880   1000 11000 .0041 0   true prog tests 1 inspect
91.0 95.5 2.1  2.0  28 37    0  
pals_opt-floodmax.5.ufo.BOUNDED-10.pals.yml timeout .907 prog tests 226 inspect 900 880   1300 8200 .0041 0   unknown prog tests 0 inspect
90.7 95.3 2.0  1.9  27 37    0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 62 49.4  48000 47000 55000 570000 .25  0   62 4940 5630 40 41 1200 500 0  
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized