Benchmark CPA/Tiger-MGP TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30541M Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:13:54 CET 2019-02-06 06:15:02 CET
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-ControlFlow tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-ControlFlow
Options -benchmark -heap 10000M -tigertestcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/cpa-tiger.2019-02-05_2113.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
ntdrivers-simplified/cdaudio_simpl1.cil-1.yml true .738 prog tests 130 inspect 29   18   510 310 .0041 0   true prog tests 1 inspect
73.8 87.2 1.0  1.1  21 17    0  
ntdrivers-simplified/cdaudio_simpl1.cil-2.yml true .737 prog tests 120 inspect 29   17   510 290 .0041 0   unknown prog tests 0 inspect
73.7 87.2 .93 .86 21 16    0  
ntdrivers-simplified/diskperf_simpl1.cil.yml true .660 prog tests 43 inspect 20   12   430 230 .0041 0   unknown prog tests 0 inspect
66.0 84.5 .38 .35 18 3.1  0  
ntdrivers-simplified/floppy_simpl3.cil-1.yml true .784 prog tests 51 inspect 17   8.2 480 160 .0041 0   true prog tests 1 inspect
78.4 91.2 .44 .44 18 3.7  0  
ntdrivers-simplified/floppy_simpl3.cil-2.yml true .784 prog tests 51 inspect 17   8.4 390 200 .0041 0   unknown prog tests 0 inspect
78.4 89.8 .48 .48 18 3.7  0  
ntdrivers-simplified/floppy_simpl4.cil-1.yml true .839 prog tests 103 inspect 23   13   480 250 .0041 0   true prog tests 1 inspect
83.9 93.2 .80 .76 19 11    0  
ntdrivers-simplified/floppy_simpl4.cil-2.yml true .839 prog tests 94 inspect 21   12   520 200 .0041 0   unknown prog tests 0 inspect
83.9 92.7 .72 .66 20 9.8  0  
ntdrivers-simplified/kbfiltr_simpl1.cil.yml true .467 prog tests 19 inspect 7.4 2.8 310 64 .0041 0   unknown prog tests 0 inspect
46.7 76.9 .22 .21 17 .94 0  
ntdrivers-simplified/kbfiltr_simpl2.cil-1.yml true .553 prog tests 42 inspect 12   4.6 490 100 .0041 0   unknown prog tests 0 inspect
55.3 79.4 .36 .36 18 3.0  0  
ntdrivers-simplified/kbfiltr_simpl2.cil-2.yml true .557 prog tests 44 inspect 11   4.3 370 110 .0041 0   true prog tests 1 inspect
55.7 80.2 .39 .37 17 3.2  0  
ssh-simplified/s3_clnt_1.cil-1.yml true .784 prog tests 53 inspect 220   200   530 3000 .0041 0   unknown prog tests 0 inspect
78.4 88.6 .47 .49 17 3.5  0  
ssh-simplified/s3_clnt_1.cil-2.yml true .784 prog tests 54 inspect 160   150   490 1900 .0041 0   true prog tests 1 inspect
78.4 88.9 .52 .51 17 3.6  0  
ssh-simplified/s3_clnt_2.cil-1.yml true .784 prog tests 50 inspect 170   150   530 2300 .0041 0   true prog tests 1 inspect
78.4 90.1 .50 .56 17 3.3  0  
ssh-simplified/s3_clnt_2.cil-2.yml true .778 prog tests 49 inspect 170   160   530 2200 .0041 0   unknown prog tests 0 inspect
77.8 89.5 .45 .45 17 3.3  0  
ssh-simplified/s3_clnt_3.cil-1.yml true .556 prog tests 49 inspect 75   63   720 1000 .0041 0   unknown prog tests 0 inspect
55.6 68.2 .40 .43 17 3.3  0  
ssh-simplified/s3_clnt_3.cil-2.yml true .833 prog tests 53 inspect 130   110   890 1600 .0041 0   true prog tests 1 inspect
83.3 93.3 .54 .55 17 3.5  0  
ssh-simplified/s3_clnt_3.cil-3.yml true .778 prog tests 52 inspect 210   190   570 3100 .0041 0   unknown prog tests 0 inspect
77.8 89.0 .47 .44 17 3.5  0  
ssh-simplified/s3_clnt_4.cil-1.yml true .778 prog tests 54 inspect 120   110   590 1600 .0041 0   unknown prog tests 0 inspect
77.8 89.5 .45 .46 17 3.6  0  
ssh-simplified/s3_clnt_4.cil-2.yml true .833 prog tests 56 inspect 140   130   530 2000 .0041 0   true prog tests 1 inspect
83.3 93.1 .51 .53 17 3.7  0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 19 13.9 1600 1400 9900 21000 .078 0   19 1390 1650 10 10 340 100 0  
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-ControlFlow tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-ControlFlow