Benchmark FairFuzz TBF Test-Suite Validator
Tool FairFuzz TC-0.0.2 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-08 09:39:09 CET 2019-02-08 13:22:04 CET
Run set fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-ControlFlow tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-ControlFlow
Options --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/fairfuzz.2019-02-08_0939.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
ntdrivers-simplified/cdaudio_simpl1.cil-1.yml done .0324 prog tests 3 inspect 19 17 16 62 .74 0   unknown prog tests 0 inspect
3.24 8.16 .24 .24 21 .55 0  
ntdrivers-simplified/cdaudio_simpl1.cil-2.yml timeout .530  prog tests 50 inspect 900 830 21 3200 1.5  0   unknown prog tests 0 inspect
53.0  71.3  .49 .50 20 6.7  0  
ntdrivers-simplified/diskperf_simpl1.cil.yml timeout .593  prog tests 31 inspect 900 840 19 2000 .99 0   unknown prog tests 0 inspect
59.3  78.3  .33 .31 18 2.3  0  
ntdrivers-simplified/floppy_simpl3.cil-1.yml false(unreach-call) .765  prog tests 32 inspect 490 450 19 1600 .63 0   true prog tests 1 inspect
76.5  90.4  .34 .33 18 2.4  0  
ntdrivers-simplified/floppy_simpl3.cil-2.yml done .765  prog tests 31 inspect 360 340 19 1500 .63 0   unknown prog tests 0 inspect
76.5  89.6  .33 .31 18 2.3  0  
ntdrivers-simplified/floppy_simpl4.cil-1.yml false(unreach-call) .806  prog tests 64 inspect 860 810 20 2600 .89 0   true prog tests 1 inspect
80.6  91.5  .58 .63 20 6.7  0  
ntdrivers-simplified/floppy_simpl4.cil-2.yml done .802  prog tests 57 inspect 740 690 20 4200 .95 0   unknown prog tests 0 inspect
80.2  91.1  .51 .49 19 6.0  0  
ntdrivers-simplified/kbfiltr_simpl1.cil.yml done .05   prog tests 2 inspect 27 25 16 80 .29 0   unknown prog tests 0 inspect
5.00 25.2  .15 .18 17 .18 0  
ntdrivers-simplified/kbfiltr_simpl2.cil-1.yml done .595  prog tests 23 inspect 220 200 18 770 .52 0   unknown prog tests 0 inspect
59.5  81.0  .27 .34 17 1.7  0  
ntdrivers-simplified/kbfiltr_simpl2.cil-2.yml false(unreach-call) .609  prog tests 25 inspect 290 270 18 890 .52 0   true prog tests 1 inspect
60.9  81.5  .31 .33 17 1.8  0  
ssh-simplified/s3_clnt_1.cil-1.yml done .0309 prog tests 1 inspect 35 33 13 120 .26 0   unknown prog tests 0 inspect
3.09 18.7  .19 .19 17 .12 0  
ssh-simplified/s3_clnt_1.cil-2.yml done .0309 prog tests 1 inspect 26 24 14 130 .26 0   unknown prog tests 0 inspect
3.09 18.7  .20 .20 17 .12 0  
ssh-simplified/s3_clnt_2.cil-1.yml done .0309 prog tests 1 inspect 26 24 13 130 .26 0   unknown prog tests 0 inspect
3.09 18.6  .19 .19 17 .12 0  
ssh-simplified/s3_clnt_2.cil-2.yml done .0309 prog tests 1 inspect 36 33 14 130 .26 0   unknown prog tests 0 inspect
3.09 18.6  .20 .20 17 .12 0  
ssh-simplified/s3_clnt_3.cil-1.yml done .025  prog tests 1 inspect 32 30 18 110 .23 0   unknown prog tests 0 inspect
2.50 13.5  .19 .19 17 .11 0  
ssh-simplified/s3_clnt_3.cil-2.yml done .0309 prog tests 1 inspect 42 39 15 130 .26 0   unknown prog tests 0 inspect
3.09 19.3  .20 .20 17 .12 0  
ssh-simplified/s3_clnt_3.cil-3.yml done .0309 prog tests 1 inspect 26 24 12 100 .26 0   unknown prog tests 0 inspect
3.09 18.1  .20 .23 17 .12 0  
ssh-simplified/s3_clnt_4.cil-1.yml done .0309 prog tests 1 inspect 39 36 14 98 .26 0   unknown prog tests 0 inspect
3.09 18.6  .20 .20 17 .12 0  
ssh-simplified/s3_clnt_4.cil-2.yml done .0309 prog tests 1 inspect 40 37 14 140 .26 0   unknown prog tests 0 inspect
3.09 19.1  .20 .20 17 .12 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 19 5.82 5100 4800 310 18000 10   0   19 582 871 5.3 5.5 340 32 0  
Run set fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-ControlFlow tbf-testsuite-validator-fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-ControlFlow