Benchmark CPA/CoVeriTest TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30375 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon049; apollon085; apollon116]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-06 05:30:26 CET
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Recursive
Options -benchmark -heap 10000M -testcomp19 --verbose --sequence-file cov-seq.txt -r --test-suite ../../results-verified/coveritest.2019-02-05_2105.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
recursive/Ackermann01-2.yml out of memory .833 prog tests 9 inspect 100 52 15000 880 31     0      unknown prog tests 0 inspect
83.3 94.1 .14 .14 16 .21  0  
recursive/Ackermann02.yml out of memory 1.0   prog tests 10 inspect 100 53 15000 920 30     0      true prog tests 1 inspect
100   100   .15 .17 16 .23  0  
recursive/Ackermann03.yml out of memory .944 prog tests 10 inspect 110 53 15000 970 31     0      unknown prog tests 0 inspect
94.4 94.1 .14 .18 16 .23  0  
recursive/Ackermann04.yml out of memory .944 prog tests 10 inspect 100 52 15000 990 30     0      unknown prog tests 0 inspect
94.4 94.1 .15 .14 16 .23  0  
recursive/Addition01-2.yml out of memory .75  prog tests 9 inspect 190 120 15000 2200 120     0      unknown prog tests 0 inspect
75.0 79.0 .14 .13 16 .21  0  
recursive/Addition02.yml out of memory .812 prog tests 9 inspect 190 130 15000 2100 120     0      true prog tests 1 inspect
81.2 84.2 .14 .14 16 .21  0  
recursive/Addition03-1.yml out of memory .5   prog tests 5 inspect 130 73 15000 1500 61     0      unknown prog tests 0 inspect
50.0 73.3 .15 .15 19 .13  0  
recursive/BallRajamani-SPIN2000-Fig1.yml out of memory 1.0   prog tests 3 inspect 110 54 15000 1000 30     0      true prog tests 1 inspect
100   100   .14 .14 16 .11  0  
recursive/EvenOdd01-1.yml timeout .786 prog tests 8 inspect 900 700 6400 11000 750     .0041 unknown prog tests 0 inspect
78.6 90.5 .14 .14 16 .19  0  
recursive/EvenOdd03.yml timeout .786 prog tests 7 inspect 900 690 6900 10000 730     .0041 true prog tests 1 inspect
78.6 90.5 .14 .14 16 .18  0  
recursive/Fibonacci01-1.yml out of memory .9   prog tests 7 inspect 200 130 15000 2100 120     0      unknown prog tests 0 inspect
90.0 92.9 .14 .14 17 .18  0  
recursive/Fibonacci03.yml out of memory .7   prog tests 6 inspect 250 130 15000 2200 110     0      unknown prog tests 0 inspect
70.0 92.9 .13 .13 16 .16  0  
recursive/Fibonacci04.yml out of memory .625 prog tests 4 inspect 200 120 15000 2000 120     0      unknown prog tests 0 inspect
62.5 91.7 .13 .13 16 .13  0  
recursive/Fibonacci05.yml out of memory .625 prog tests 4 inspect 200 120 15000 2100 120     0      unknown prog tests 0 inspect
62.5 91.7 .12 .12 16 .13  0  
recursive/McCarthy91-1.yml out of memory .875 prog tests 5 inspect 120 72 15000 1200 63     0      true prog tests 1 inspect
87.5 100   .13 .13 16 .14  0  
recursive/McCarthy91-2.yml out of memory .75  prog tests 4 inspect 170 120 15000 1900 130     0      unknown prog tests 0 inspect
75.0 90.0 .12 .12 16 .13  0  
recursive/MultCommutative-2.yml timeout .667 prog tests 8 inspect 900 870 2000 12000 .39  0      unknown prog tests 0 inspect
66.7 88.9 .14 .13 16 .19  0  
recursive/gcd01-1.yml timeout .611 prog tests 7 inspect 900 870 1900 12000 .061 0      unknown prog tests 0 inspect
61.1 89.5 .14 .14 17 .18  0  
recursive/gcd02.yml timeout .727 prog tests 8 inspect 900 870 1800 12000 .19  0      unknown prog tests 0 inspect
72.7 88.5 .15 .14 16 .20  0  
recursive/recHanoi01.yml timeout .9   prog tests 4 inspect 900 870 1500 12000 .38  0      unknown prog tests 0 inspect
90.0 95.0 .13 .15 16 .13  0  
recursive/recHanoi02-2.yml out of memory .875 prog tests 6 inspect 36 21 15000 370 .033 0      unknown prog tests 0 inspect
87.5 91.7 .13 .13 17 .16  0  
recursive/recHanoi03-2.yml out of memory .875 prog tests 6 inspect 150 78 15000 1500 60     0      unknown prog tests 0 inspect
87.5 91.7 .14 .14 16 .16  0  
recursive-simple/id2_b2_o3.yml out of memory .7   prog tests 6 inspect 35 21 15000 350 .041 0      unknown prog tests 0 inspect
70.0 93.3 .14 .13 16 .16  0  
recursive-simple/id2_b3_o2.yml out of memory .8   prog tests 6 inspect 36 21 15000 350 .041 0      true prog tests 1 inspect
80.0 100   .13 .13 16 .16  0  
recursive-simple/id2_b3_o5.yml out of memory .7   prog tests 6 inspect 36 21 15000 350 .041 0      unknown prog tests 0 inspect
70.0 93.3 .13 .13 16 .16  0  
recursive-simple/id2_b5_o10.yml out of memory .7   prog tests 6 inspect 36 21 15000 370 .041 0      unknown prog tests 0 inspect
70.0 93.3 .14 .14 16 .16  0  
recursive-simple/id_b2_o3.yml out of memory .667 prog tests 3 inspect 37 21 15000 400 .016 0      unknown prog tests 0 inspect
66.7 90.0 .12 .12 16 .11  0  
recursive-simple/id_b3_o2-2.yml out of memory .833 prog tests 3 inspect 36 21 15000 370 .016 0      true prog tests 1 inspect
83.3 100   .12 .12 16 .11  0  
recursive-simple/id_b3_o5-2.yml out of memory .667 prog tests 3 inspect 35 21 15000 420 .016 0      unknown prog tests 0 inspect
66.7 90.0 .12 .12 16 .11  0  
recursive-simple/id_b5_o10-2.yml out of memory .667 prog tests 3 inspect 35 21 15000 360 .016 0      unknown prog tests 0 inspect
66.7 90.0 .13 .12 16 .11  0  
recursive-simple/id_o10.yml out of memory .75  prog tests 3 inspect 35 21 15000 350 .016 0      unknown prog tests 0 inspect
75.0 87.5 .13 .13 16 .11  0  
recursive-simple/id_o100.yml out of memory .75  prog tests 3 inspect 36 21 15000 420 .016 0      unknown prog tests 0 inspect
75.0 87.5 .12 .12 16 .11  0  
recursive-simple/id_o1000.yml out of memory .75  prog tests 3 inspect 36 21 15000 330 .016 0      unknown prog tests 0 inspect
75.0 87.5 .12 .12 16 .11  0  
recursive-simple/id_o20.yml out of memory .75  prog tests 3 inspect 37 21 15000 360 .016 0      unknown prog tests 0 inspect
75.0 87.5 .12 .12 17 .11  0  
recursive-simple/id_o200.yml out of memory .75  prog tests 3 inspect 36 21 15000 410 .016 0      unknown prog tests 0 inspect
75.0 87.5 .12 .16 17 .11  0  
recursive-simple/id_o3.yml out of memory .75  prog tests 3 inspect 35 21 15000 440 .016 0      unknown prog tests 0 inspect
75.0 87.5 .12 .12 16 .11  0  
recursive-simple/sum_non_eq-2.yml out of memory .75  prog tests 2 inspect 140 75 15000 1400 60     0      unknown prog tests 0 inspect
75.0 90.0 .11 .11 16 .094 0  
recursive-simple/sum_non_eq-3.yml out of memory .75  prog tests 3 inspect 140 74 15000 1300 60     0      true prog tests 1 inspect
75.0 100   .12 .14 17 .11  0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 38 29.2 8600 6700 500000 100000 2800 .0082 38 2920 3470 5.0 5.1 630 5.7 0  
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Recursive tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-branches.ReachSafety-Recursive