Benchmark CPA/Tiger-MGP TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30541M Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:13:54 CET 2019-02-06 06:15:02 CET
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Recursive
Options -benchmark -heap 10000M -tigertestcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/cpa-tiger.2019-02-05_2113.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
recursive/Ackermann01-2.yml error (recursion) .556 prog tests 3 inspect 2.9 1.3 270 30 .0041 0   unknown prog tests 0 inspect
55.6 70.6 .13  .12  17   .11  0  
recursive/Ackermann02.yml error (recursion) .438 prog tests 2 inspect 3.0 1.3 270 28 .0041 0   unknown prog tests 0 inspect
43.8 70.6 .11  .12  16   .094 0  
recursive/Ackermann03.yml error (recursion) .444 prog tests 3 inspect 2.9 1.3 270 27 .0041 0   unknown prog tests 0 inspect
44.4 70.6 .12  .15  17   .11  0  
recursive/Ackermann04.yml error (recursion) .444 prog tests 3 inspect 2.9 1.3 260 26 .0041 0   unknown prog tests 0 inspect
44.4 70.6 .13  .13  16   .11  0  
recursive/Addition01-2.yml error (recursion) .75  prog tests 7 inspect 3.3 1.4 270 33 .0041 0   unknown prog tests 0 inspect
75.0 79.0 .13  .15  16   .16  0  
recursive/Addition02.yml error (recursion) .812 prog tests 7 inspect 3.1 1.4 270 30 .0041 0   true prog tests 1 inspect
81.2 84.2 .15  .15  16   .18  0  
recursive/Addition03-1.yml error (recursion) .167 prog tests 1 inspect 3.0 1.3 270 26 .0041 0   unknown prog tests 0 inspect
16.7 60.0 .12  .12  16   .078 0  
recursive/BallRajamani-SPIN2000-Fig1.yml error (recursion) 1.0   prog tests 2 inspect 2.8 1.2 260 28 .0041 0   true prog tests 1 inspect
100   100   .12  .13  17   .094 0  
recursive/EvenOdd01-1.yml error (recursion) .643 prog tests 4 inspect 2.9 1.3 270 28 .0041 0   unknown prog tests 0 inspect
64.3 81.0 .13  .13  17   .13  0  
recursive/EvenOdd03.yml error (recursion) .714 prog tests 4 inspect 3.0 1.3 270 24 .0041 0   true prog tests 1 inspect
71.4 85.7 .13  .13  17   .13  0  
recursive/Fibonacci01-1.yml error (recursion) .2   prog tests 1 inspect 2.9 1.3 260 29 .0041 0   unknown prog tests 0 inspect
20.0 28.6 .12  .12  16   .078 0  
recursive/Fibonacci03.yml error (recursion) .6   prog tests 1 inspect 2.9 1.3 270 28 .0041 0   unknown prog tests 0 inspect
60.0 85.7 .11  .14  16   .078 0  
recursive/Fibonacci04.yml error (recursion) .0   prog tests 0 inspect 2.7 1.2 260 27 .0041 0   unknown prog tests 0 inspect
0   0   .061 .062 9.0 0     0  
recursive/Fibonacci05.yml error (recursion) .0   prog tests 0 inspect 2.9 1.2 260 28 .0041 0   unknown prog tests 0 inspect
0   0   .060 .060 9.0 0     0  
recursive/McCarthy91-1.yml error (recursion) .375 prog tests 1 inspect 2.9 1.3 270 28 .0041 0   unknown prog tests 0 inspect
37.5 90.0 .12  .12  16   .078 0  
recursive/McCarthy91-2.yml error (recursion) .375 prog tests 1 inspect 2.8 1.2 260 24 .0041 0   unknown prog tests 0 inspect
37.5 90.0 .11  .11  16   .078 0  
recursive/MultCommutative-2.yml error (recursion) .389 prog tests 1 inspect 2.9 1.3 260 22 .0041 0   unknown prog tests 0 inspect
38.9 72.2 .11  .11  16   .078 0  
recursive/gcd01-1.yml error (recursion) .389 prog tests 3 inspect 3.0 1.3 270 26 .0041 0   unknown prog tests 0 inspect
38.9 68.4 .12  .14  16   .11  0  
recursive/gcd02.yml error (recursion) .0   prog tests 0 inspect 3.0 1.3 260 30 .0041 0   unknown prog tests 0 inspect
0   0   .062 .063 8.9 0     0  
recursive/recHanoi01.yml error (recursion) .0   prog tests 0 inspect 2.9 1.2 270 27 .0041 0   unknown prog tests 0 inspect
0   0   .067 .068 9.1 0     0  
recursive/recHanoi02-2.yml error (recursion) .625 prog tests 1 inspect 2.8 1.2 270 28 .0041 0   unknown prog tests 0 inspect
62.5 83.3 .12  .12  16   .078 0  
recursive/recHanoi03-2.yml error (recursion) .625 prog tests 1 inspect 2.9 1.3 270 28 .0041 0   unknown prog tests 0 inspect
62.5 83.3 .11  .11  17   .078 0  
recursive-simple/id2_b2_o3.yml error (recursion) .4   prog tests 1 inspect 2.8 1.2 270 30 .0041 0   unknown prog tests 0 inspect
40.0 73.3 .11  .12  16   .078 0  
recursive-simple/id2_b3_o2.yml error (recursion) .4   prog tests 1 inspect 2.8 1.2 260 27 .0041 0   unknown prog tests 0 inspect
40.0 73.3 .12  .12  16   .078 0  
recursive-simple/id2_b3_o5.yml error (recursion) .4   prog tests 1 inspect 2.9 1.2 260 26 .0041 0   unknown prog tests 0 inspect
40.0 73.3 .12  .12  17   .078 0  
recursive-simple/id2_b5_o10.yml error (recursion) .4   prog tests 1 inspect 2.9 1.2 270 27 .0041 0   unknown prog tests 0 inspect
40.0 73.3 .12  .11  16   .078 0  
recursive-simple/id_b2_o3.yml error (recursion) .0   prog tests 0 inspect 2.8 1.2 260 24 .0041 0   unknown prog tests 0 inspect
0   0   .059 .061 9.0 0     0  
recursive-simple/id_b3_o2-2.yml error (recursion) .333 prog tests 1 inspect 2.9 1.2 270 28 .0041 0   unknown prog tests 0 inspect
33.3 60.0 .12  .12  16   .078 0  
recursive-simple/id_b3_o5-2.yml error (recursion) .333 prog tests 1 inspect 2.8 1.2 260 25 .0041 0   unknown prog tests 0 inspect
33.3 60.0 .12  .13  16   .078 0  
recursive-simple/id_b5_o10-2.yml error (recursion) .333 prog tests 1 inspect 3.0 1.3 260 24 .0041 0   unknown prog tests 0 inspect
33.3 60.0 .13  .13  16   .078 0  
recursive-simple/id_o10.yml error (recursion) .0   prog tests 0 inspect 2.7 1.2 260 25 .0041 0   unknown prog tests 0 inspect
0   0   .060 .062 9.1 0     0  
recursive-simple/id_o100.yml error (recursion) .0   prog tests 0 inspect 2.9 1.2 260 26 .0041 0   unknown prog tests 0 inspect
0   0   .061 .061 9.0 0     0  
recursive-simple/id_o1000.yml error (recursion) .0   prog tests 0 inspect 2.9 1.2 260 24 .0041 0   unknown prog tests 0 inspect
0   0   .059 .060 8.9 0     0  
recursive-simple/id_o20.yml error (recursion) .0   prog tests 0 inspect 2.9 1.2 260 26 .0041 0   unknown prog tests 0 inspect
0   0   .058 .059 9.0 0     0  
recursive-simple/id_o200.yml error (recursion) .0   prog tests 0 inspect 2.9 1.2 270 30 .0041 0   unknown prog tests 0 inspect
0   0   .060 .062 8.9 0     0  
recursive-simple/id_o3.yml error (recursion) .0   prog tests 0 inspect 3.0 1.3 260 39 .0041 0   unknown prog tests 0 inspect
0   0   .063 .064 9.0 0     0  
recursive-simple/sum_non_eq-2.yml error (recursion) .0   prog tests 0 inspect 2.8 1.2 260 25 .0041 0   unknown prog tests 0 inspect
0   0   .058 .059 9.0 0     0  
recursive-simple/sum_non_eq-3.yml error (recursion) .0   prog tests 0 inspect 2.8 1.2 260 25 .0041 0   unknown prog tests 0 inspect
0   0   .062 .063 9.0 0     0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 38 12.1 110 48 10000 1000 .16 0   38 1210 1850 3.8 3.9 530 2.4 0  
Run set cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Recursive