Benchmark FairFuzz TBF Test-Suite Validator
Tool FairFuzz TC-0.0.2 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-08 09:39:09 CET 2019-02-08 13:22:04 CET
Run set fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized
Options --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 41 .29 0     unknown prog tests 0 inspect
0 0 .058 .058 9.0 0   0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 39 .29 0     unknown prog tests 0 inspect
0 0 .061 .062 9.0 0   0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 39 .29 0     unknown prog tests 0 inspect
0 0 .062 .063 9.0 0   0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 44 .30 .061 unknown prog tests 0 inspect
0 0 .059 .059 9.0 0   0  
pals_STARTPALS_ActiveStandby.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 42 .29 0     unknown prog tests 0 inspect
0 0 .059 .060 8.9 0   0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 42 .29 0     unknown prog tests 0 inspect
0 0 .070 .071 9.0 0   0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 50 .29 0     unknown prog tests 0 inspect
0 0 .078 .079 9.0 0   0  
pals_STARTPALS_Triplicated.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 46 .29 0     unknown prog tests 0 inspect
0 0 .062 .063 9.0 0   0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 44 .25 0     unknown prog tests 0 inspect
0 0 .060 .060 9.0 0   0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 44 .27 0     unknown prog tests 0 inspect
0 0 .066 .067 9.0 0   0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 46 .27 0     unknown prog tests 0 inspect
0 0 .062 .063 8.9 0   0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 37 .27 0     unknown prog tests 0 inspect
0 0 .063 .064 9.0 0   0  
pals_floodmax.3.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 40 .27 0     unknown prog tests 0 inspect
0 0 .061 .061 8.9 0   0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 41 .27 0     unknown prog tests 0 inspect
0 0 .059 .060 9.0 0   0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 12 50 .36 .061 unknown prog tests 0 inspect
0 0 .061 .062 9.0 0   0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 12 41 .36 0     unknown prog tests 0 inspect
0 0 .061 .061 9.0 0   0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.3 3.3 12 38 .36 0     unknown prog tests 0 inspect
0 0 .058 .059 8.9 0   0  
pals_floodmax.4.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 12 47 .36 0     unknown prog tests 0 inspect
0 0 .057 .058 9.1 0   0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.3 12 43 .33 0     unknown prog tests 0 inspect
0 0 .065 .065 9.0 0   0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.4 3.4 21 48 .58 0     unknown prog tests 0 inspect
0 0 .065 .067 8.9 0   0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.4 3.4 20 43 .58 .061 unknown prog tests 0 inspect
0 0 .064 .064 9.0 0   0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.4 3.4 20 45 .58 0     unknown prog tests 0 inspect
0 0 .068 .068 9.0 0   0  
pals_floodmax.5.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.4 3.4 20 42 .58 0     unknown prog tests 0 inspect
0 0 .059 .060 8.9 0   0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 48 .25 .061 unknown prog tests 0 inspect
0 0 .070 .072 9.0 0   0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 41 .25 0     unknown prog tests 0 inspect
0 0 .058 .059 8.9 0   0  
pals_lcr-var-start-time.3.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 39 .25 0     unknown prog tests 0 inspect
0 0 .058 .059 8.9 0   0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 46 .26 0     unknown prog tests 0 inspect
0 0 .062 .062 8.9 0   0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 45 .26 0     unknown prog tests 0 inspect
0 0 .060 .061 9.0 0   0  
pals_lcr-var-start-time.4.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 42 .26 0     unknown prog tests 0 inspect
0 0 .058 .059 9.0 0   0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 47 .26 0     unknown prog tests 0 inspect
0 0 .064 .065 8.9 0   0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 38 .26 0     unknown prog tests 0 inspect
0 0 .060 .062 9.0 0   0  
pals_lcr-var-start-time.5.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 43 .26 0     unknown prog tests 0 inspect
0 0 .063 .063 9.0 0   0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 37 .25 0     unknown prog tests 0 inspect
0 0 .061 .061 9.0 0   0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 37 .26 0     unknown prog tests 0 inspect
0 0 .066 .067 8.9 0   0  
pals_lcr-var-start-time.6.ufo.BOUNDED-12.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 39 .25 0     unknown prog tests 0 inspect
0 0 .059 .060 8.9 0   0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 44 .25 0     unknown prog tests 0 inspect
0 0 .057 .058 9.0 0   0  
pals_lcr.3.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 41 .25 0     unknown prog tests 0 inspect
0 0 .059 .059 9.0 0   0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 51 .25 0     unknown prog tests 0 inspect
0 0 .059 .060 9.0 0   0  
pals_lcr.4.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 44 .25 0     unknown prog tests 0 inspect
0 0 .066 .067 9.0 0   0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 43 .27 0     unknown prog tests 0 inspect
0 0 .059 .060 9.0 0   0  
pals_lcr.5.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 41 .26 0     unknown prog tests 0 inspect
0 0 .063 .064 9.0 0   0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.3 12 38 .28 0     unknown prog tests 0 inspect
0 0 .059 .059 9.0 0   0  
pals_lcr.6.ufo.BOUNDED-12.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 12 41 .28 0     unknown prog tests 0 inspect
0 0 .059 .060 9.0 0   0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.3 13 43 .29 0     unknown prog tests 0 inspect
0 0 .058 .059 9.0 0   0  
pals_lcr.7.ufo.BOUNDED-14.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.3 3.3 13 49 .29 .061 unknown prog tests 0 inspect
0 0 .063 .064 9.0 0   0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.3 3.3 14 43 .31 0     unknown prog tests 0 inspect
0 0 .060 .060 9.0 0   0  
pals_lcr.8.ufo.BOUNDED-16.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.3 3.3 14 50 .31 0     unknown prog tests 0 inspect
0 0 .059 .060 9.0 0   0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 43 .26 0     unknown prog tests 0 inspect
0 0 .060 .061 9.0 0   0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 46 .28 0     unknown prog tests 0 inspect
0 0 .061 .061 8.9 0   0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 39 .28 0     unknown prog tests 0 inspect
0 0 .061 .062 9.0 0   0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 40 .28 0     unknown prog tests 0 inspect
0 0 .057 .058 9.0 0   0  
pals_opt-floodmax.3.ufo.BOUNDED-6.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 10 42 .28 0     unknown prog tests 0 inspect
0 0 .059 .060 9.0 0   0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.2 11 37 .30 0     unknown prog tests 0 inspect
0 0 .057 .058 9.0 0   0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.3 12 42 .39 0     unknown prog tests 0 inspect
0 0 .059 .060 9.0 0   0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.3 13 43 .39 0     unknown prog tests 0 inspect
0 0 .063 .064 9.0 0   0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.3 13 44 .39 0     unknown prog tests 0 inspect
0 0 .061 .062 9.0 0   0  
pals_opt-floodmax.4.ufo.BOUNDED-8.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.2 3.3 13 38 .39 0     unknown prog tests 0 inspect
0 0 .062 .063 9.0 0   0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.3 3.3 13 49 .36 0     unknown prog tests 0 inspect
0 0 .067 .067 9.0 0   0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.4 3.4 21 47 .61 0     unknown prog tests 0 inspect
0 0 .057 .058 9.0 0   0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.4 3.4 21 43 .61 0     unknown prog tests 0 inspect
0 0 .059 .059 9.1 0   0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.4 3.4 21 43 .61 0     unknown prog tests 0 inspect
0 0 .061 .062 8.9 0   0  
pals_opt-floodmax.5.ufo.BOUNDED-10.pals.yml couldn't run: all seeds time out or crash .0  prog tests 0 inspect 3.4 3.4 21 43 .61 0     unknown prog tests 0 inspect
0 0 .061 .061 9.0 0   0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 62 .0  200 200 770 2700 20 .31 62 0 0 3.8 3.8 560 0   0  
Run set fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Sequentialized