Benchmark VeriFuzz TBF Test-Suite Validator
Tool VeriFuzz 1.0.1 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:17:17 CET 2019-02-06 14:51:38 CET
Run set verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized
Options --testcomp --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/verifuzz.2019-02-06_0717.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml 1 5.2 3.1 180 59 1.0  0   31.9 61.2 .16 .16 17 .17  0  
pals_STARTPALS_ActiveStandby.1.ufo.UNBOUNDED.pals.yml 1 5.3 3.0 170 57 .88 0   31.7 61.5 .16 .16 17 .17  0  
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml 1 5.0 2.8 170 51 .77 0   39.3 68.4 .16 .16 17 .17  0  
pals_STARTPALS_ActiveStandby.4_1.ufo.UNBOUNDED.pals.yml 1 5.7 3.4 170 62 .84 0   52.8 78.9 .16 .16 17 .17  0  
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml 1 4.9 2.9 170 50 .77 0   41.2 69.2 .17 .17 17 .17  0  
pals_STARTPALS_ActiveStandby.4_2.ufo.UNBOUNDED.pals.yml 1 5.1 2.7 170 49 .77 0   41.1 69.2 .16 .16 17 .17  0  
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml 1 14   13   170 150 .85 0   61.7 84.5 .16 .16 17 .17  0  
pals_STARTPALS_ActiveStandby.5.ufo.UNBOUNDED.pals.yml 1 14   12   170 210 .85 0   64.6 85.3 .16 .16 17 .17  0  
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml 1 5.6 3.5 170 52 .84 0   49.4 74.7 .15 .19 17 .074 0  
pals_STARTPALS_Triplicated.1.ufo.UNBOUNDED.pals.yml 1 5.6 3.3 170 59 .84 0   49.4 74.8 .15 .15 17 .16  0  
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml 1 15   13   170 180 .85 0   58.2 78.5 .18 .18 17 .16  0  
pals_STARTPALS_Triplicated.2.ufo.UNBOUNDED.pals.yml 1 12   10   170 130 .84 0   50.6 73.4 .15 .15 17 .15  0  
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml 1 4.7 2.7 170 43 1.1  0   42.6 68.0 .15 .15 17 .14  0  
pals_floodmax.3.1.ufo.UNBOUNDED.pals.yml 1 4.8 2.7 170 50 1.1  0   42.8 67.6 .15 .15 17 .14  0  
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml 1 4.9 2.8 170 53 .69 0   44.1 70.4 .16 .16 17 .14  0  
pals_floodmax.3.2.ufo.UNBOUNDED.pals.yml 1 4.8 2.7 170 47 .70 0   44.2 70.0 .16 .16 17 .14  0  
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml 1 4.9 2.8 170 57 .69 0   47.0 71.8 .16 .16 17 .14  0  
pals_floodmax.3.3.ufo.UNBOUNDED.pals.yml 1 5.0 2.8 170 47 .70 0   47.1 71.4 .16 .16 17 .14  0  
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml 1 5.2 3.0 170 48 .77 0   47.5 71.5 .19 .19 17 .14  0  
pals_floodmax.3.4.ufo.UNBOUNDED.pals.yml 1 4.9 2.7 170 52 .77 0   47.6 71.1 .16 .16 17 .14  0  
pals_floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 1 4.8 2.8 170 49 .70 0   52.0 74.0 .16 .16 17 .14  0  
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml 1 5.5 3.4 190 58 .88 0   34.6 57.4 .20 .20 20 .21  0  
pals_floodmax.4.1.ufo.UNBOUNDED.pals.yml 1 5.6 3.2 190 52 .89 0   34.8 57.3 .19 .19 20 .21  0  
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml 1 5.7 3.4 190 64 .91 0   32.2 53.5 .21 .21 20 .22  0  
pals_floodmax.4.2.ufo.UNBOUNDED.pals.yml 1 5.6 3.3 190 60 .91 0   32.2 53.2 .22 .22 20 .22  0  
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml 1 5.5 3.3 190 54 .91 0   33.2 54.2 .22 .25 20 .22  0  
pals_floodmax.4.3.ufo.UNBOUNDED.pals.yml 1 5.6 3.3 190 58 .91 0   33.4 54.1 .22 .22 20 .22  0  
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml 1 27   25   190 310 .99 0   33.2 53.8 .25 .25 20 .22  0  
pals_floodmax.4.4.ufo.UNBOUNDED.pals.yml 1 31   29   190 430 .99 0   33.4 53.7 .23 .23 20 .22  0  
pals_floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 1 5.5 3.2 190 65 .91 0   35.1 55.0 .21 .21 20 .22  0  
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml 1 8.7 5.9 210 110 1.3  0   26.6 45.3 .29 .29 27 .37  0  
pals_floodmax.5.1.ufo.UNBOUNDED.pals.yml 1 8.8 5.9 220 99 1.3  0   26.8 45.3 .29 .29 27 .37  0  
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml 1 8.8 6.1 220 97 1.3  0   21.3 37.4 .35 .37 27 .38  0  
pals_floodmax.5.2.ufo.UNBOUNDED.pals.yml 1 8.9 6.0 230 87 1.3  0   21.4 37.5 .39 .43 27 .12  0  
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml 1 8.8 6.1 230 96 1.3  0   22.0 38.0 .36 .36 27 .38  0  
pals_floodmax.5.3.ufo.UNBOUNDED.pals.yml 1 8.9 6.1 220 97 1.3  0   22.2 38.0 .35 .35 27 .38  0  
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml 1 300   300   230 4300 1.6  0   23.1 39.2 .36 .37 27 .38  0  
pals_floodmax.5.4.ufo.UNBOUNDED.pals.yml 1 420   420   220 5900 1.8  0   23.1 38.9 .35 .35 27 .38  0  
pals_floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 1 9.0 5.9 230 90 1.3  0   22.9 38.3 .36 .36 27 .38  0  
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml 1 4.5 2.7 170 44 .86 0   48.2 78.0 .14 .14 17 .11  0  
pals_lcr-var-start-time.3.1.ufo.UNBOUNDED.pals.yml 1 27   26   160 380 .70 0   48.2 77.8 .14 .14 17 .11  0  
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml 1 4.3 2.3 170 44 .63 0   38.5 72.1 .14 .16 17 .11  0  
pals_lcr-var-start-time.3.2.ufo.UNBOUNDED.pals.yml 1 4.6 2.6 160 54 .86 0   43.3 74.0 .14 .14 17 .11  0  
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml 1 6.8 4.7 170 75 .75 0   47.3 76.7 .16 .16 17 .13  0  
pals_lcr-var-start-time.4.1.ufo.UNBOUNDED.pals.yml 1 4.8 2.8 170 43 .90 0   48.0 76.6 .15 .15 17 .13  0  
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml 1 4.6 2.5 170 49 .65 0   37.1 70.5 .17 .17 17 .13  0  
pals_lcr-var-start-time.4.2.ufo.UNBOUNDED.pals.yml 1 4.7 2.6 170 47 .66 0   40.7 72.0 .16 .16 17 .13  0  
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml 1 5.0 2.8 170 49 .91 0   47.8 75.6 .16 .16 17 .14  0  
pals_lcr-var-start-time.5.1.ufo.UNBOUNDED.pals.yml 1 4.9 2.7 170 47 .93 0   47.8 75.5 .16 .16 17 .14  0  
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml 1 4.9 2.7 170 47 .68 0   36.5 69.4 .16 .16 17 .14  0  
pals_lcr-var-start-time.5.2.ufo.UNBOUNDED.pals.yml 1 4.7 2.6 180 54 .68 0   36.5 69.2 .16 .16 17 .14  0  
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml 1 4.9 2.8 180 48 .94 0   47.8 74.7 .18 .18 18 .16  0  
pals_lcr-var-start-time.6.1.ufo.UNBOUNDED.pals.yml 1 5.2 2.8 180 53 .95 0   47.8 74.7 .18 .18 17 .16  0  
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml 1 4.7 2.6 180 48 .70 0   36.2 68.4 .18 .18 17 .15  0  
pals_lcr-var-start-time.6.2.ufo.UNBOUNDED.pals.yml 1 5.0 2.7 180 47 .70 0   36.2 68.3 .18 .18 17 .15  0  
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml 1 4.2 2.3 160 40 .62 0   57.3 81.5 .13 .13 17 .11  0  
pals_lcr.3.1.ufo.UNBOUNDED.pals.yml 1 4.2 2.4 160 39 .62 0   57.3 81.3 .14 .14 17 .11  0  
pals_lcr.3_overflow.ufo.UNBOUNDED.pals.yml 1 4.4 2.3 170 44 .62 0   60.0 83.2 .13 .13 16 .11  0  
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml 1 8.8 6.9 170 110 .71 0   55.6 80.2 .15 .15 17 .12  0  
pals_lcr.4.1.ufo.UNBOUNDED.pals.yml 1 15   13   170 180 .72 0   55.6 80.1 .14 .14 17 .12  0  
pals_lcr.4_overflow.ufo.UNBOUNDED.pals.yml 1 4.2 2.4 170 45 .64 0   55.7 81.0 .15 .15 17 .11  0  
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml 1 370   370   170 4700 .99 0   55.9 79.6 .15 .15 17 .13  0  
pals_lcr.5.1.ufo.UNBOUNDED.pals.yml 1 27   26   170 350 .80 0   55.9 79.5 .15 .15 17 .13  0  
pals_lcr.5_overflow.ufo.UNBOUNDED.pals.yml 1 4.5 2.5 170 44 .67 0   57.5 80.7 .15 .15 17 .13  0  
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml 1 180   180   180 2400 .83 0   54.8 78.6 .18 .18 17 .14  0  
pals_lcr.6.1.ufo.UNBOUNDED.pals.yml 1 5.4 3.4 180 66 .82 0   56.0 78.9 .18 .18 17 .14  0  
pals_lcr.6_overflow.ufo.UNBOUNDED.pals.yml 1 4.9 2.7 180 48 .69 0   54.9 79.0 .17 .17 17 .14  0  
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml 1 110   110   180 1500 .86 0   56.1 78.3 .21 .21 17 .15  0  
pals_lcr.7.1.ufo.UNBOUNDED.pals.yml 1 4.8 2.7 190 48 .70 0   54.0 77.5 .22 .22 17 .15  0  
pals_lcr.7_overflow.ufo.UNBOUNDED.pals.yml 1 4.6 2.5 180 42 .70 0   55.1 78.3 .20 .20 17 .15  0  
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml 1 570   580   190 7200 1.5  0   54.3 77.1 .24 .24 18 .16  0  
pals_lcr.8.1.ufo.UNBOUNDED.pals.yml 1 5.0 2.7 190 50 .74 0   55.2 77.3 .24 .24 18 .16  0  
pals_lcr.8_overflow.ufo.UNBOUNDED.pals.yml 1 4.7 2.6 190 48 .74 0   54.4 77.4 .24 .24 18 .16  0  
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml 1 4.9 2.8 170 49 1.1  0   41.4 66.6 .16 .16 17 .15  0  
pals_opt-floodmax.3.1.ufo.UNBOUNDED.pals.yml 1 5.1 3.0 170 58 1.1  0   41.5 66.2 .16 .16 17 .15  0  
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml 1 4.8 2.7 170 47 .71 0   44.1 70.4 .17 .17 17 .15  0  
pals_opt-floodmax.3.2.ufo.UNBOUNDED.pals.yml 1 4.8 2.6 170 48 .72 0   44.2 70.1 .16 .16 17 .15  0  
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml 1 5.0 2.8 170 49 .71 0   47.3 71.7 .19 .19 17 .15  0  
pals_opt-floodmax.3.3.ufo.UNBOUNDED.pals.yml 1 4.6 2.5 180 48 .72 0   47.3 71.3 .16 .16 17 .15  0  
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml 1 4.9 2.8 170 50 .79 0   48.6 71.1 .17 .17 17 .15  0  
pals_opt-floodmax.3.4.ufo.UNBOUNDED.pals.yml 1 5.0 2.8 180 48 .79 0   48.7 70.7 .16 .16 17 .15  0  
pals_opt-floodmax.3_overflow.ufo.UNBOUNDED.pals.yml 1 4.7 2.7 180 52 .72 0   51.8 73.7 .16 .16 17 .15  0  
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml 1 5.6 3.3 180 63 .91 0   35.6 57.2 .21 .21 20 .22  0  
pals_opt-floodmax.4.1.ufo.UNBOUNDED.pals.yml 1 5.7 3.4 190 51 .91 0   35.8 57.1 .33 .35 20 .10  0  
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml 1 5.7 3.3 200 53 .93 0   33.8 54.6 .23 .23 20 .23  0  
pals_opt-floodmax.4.2.ufo.UNBOUNDED.pals.yml 1 5.9 3.6 200 61 .93 0   33.8 54.3 .23 .23 20 .23  0  
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml 1 5.7 3.5 190 64 .93 0   36.4 55.2 .23 .23 20 .23  0  
pals_opt-floodmax.4.3.ufo.UNBOUNDED.pals.yml 1 5.6 3.4 190 58 .93 0   36.6 55.1 .23 .23 20 .23  0  
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml 1 22   21   190 280 1.0  0   34.0 54.0 .22 .24 20 .14  0  
pals_opt-floodmax.4.4.ufo.UNBOUNDED.pals.yml 1 26   24   200 310 1.0  0   35.1 54.4 .23 .23 20 .23  0  
pals_opt-floodmax.4_overflow.ufo.UNBOUNDED.pals.yml 1 5.6 3.4 190 57 .93 0   38.2 56.0 .23 .23 20 .23  0  
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml 1 8.9 6.1 220 110 1.3  0   27.9 45.6 .31 .31 27 .39  0  
pals_opt-floodmax.5.1.ufo.UNBOUNDED.pals.yml 1 9.2 6.2 220 100 1.3  0   28.0 45.6 .31 .36 27 .39  0  
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml 1 8.9 6.1 220 110 1.3  0   23.9 38.6 .40 .40 27 .39  0  
pals_opt-floodmax.5.2.ufo.UNBOUNDED.pals.yml 1 9.4 6.2 230 100 1.3  0   24.1 38.6 .38 .38 27 .39  0  
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml 1 9.2 6.3 230 110 1.3  0   24.6 39.2 .39 .39 27 .39  0  
pals_opt-floodmax.5.3.ufo.UNBOUNDED.pals.yml 1 9.2 6.4 250 98 1.3  0   24.8 39.2 .38 .38 27 .39  0  
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml 1 380   390   230 4700 1.8  0   24.3 40.0 .38 .38 27 .39  0  
pals_opt-floodmax.5.4.ufo.UNBOUNDED.pals.yml 1 210   220   240 3000 1.6  0   24.2 40.0 .38 .38 27 .39  0  
pals_opt-floodmax.5_overflow.ufo.UNBOUNDED.pals.yml 1 9.4 6.4 250 120 1.3  0   25.5 39.5 .37 .37 27 .39  0  
sv-benchmarks/c/seq-mthreaded/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 100 100 3200 3100 19000 42000 93 0   100 4150 6460 21 21 1900 20 0  
Run set verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized tbf-testsuite-validator-verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized