Benchmark CPA/CoVeriTest TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30375 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon049; apollon085; apollon116]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-06 05:30:26 CET
Run set coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Loops
Options -benchmark -heap 10000M -testcomp19 --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/coveritest.2019-02-05_2105.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-2.yml done 1 prog tests 1 inspect 23   17   1600 280 .0082 0   true prog tests 1 inspect
66.7 86.7 .12  .12  16   .078 0  
loops/compact.yml timeout prog tests 0 inspect 900   890   2900 6200 0      0   error (0) prog tests 0 inspect
0   0   .062 .063 9.0 0     0  
loops/count_up_down-2.yml done 1 prog tests 1 inspect 3.3 1.5 260 30 .0082 0   true prog tests 1 inspect
50.0 72.7 .11  .11  16   .078 0  
loops/eureka_01-1.yml timeout prog tests 0 inspect 900   800   5100 13000 63      0   error (0) prog tests 0 inspect
0   0   .062 .062 9.0 0     0  
loops/for_bounded_loop1.yml done 1 prog tests 1 inspect 3.9 1.6 270 40 .020  0   true prog tests 1 inspect
75.0 100   .12  .12  16   .078 0  
loops/insertion_sort-1.yml done 1 prog tests 1 inspect 320   260   3900 4000 14      0   true prog tests 1 inspect
91.7 94.4 .12  .12  16   .078 0  
loops/invert_string-1.yml timeout prog tests 0 inspect 900   800   5300 13000 56      0   error (0) prog tests 0 inspect
0   0   .061 .062 9.0 0     0  
loops/linear_search.yml timeout prog tests 0 inspect 900   880   1500 11000 .074  0   error (0) prog tests 0 inspect
0   0   .068 .068 9.0 0     0  
loops/matrix-2.yml done 1 prog tests 1 inspect 25   6.6 880 200 1.8    0   true prog tests 1 inspect
66.7 88.9 .12  .12  17   .082 0  
loops/nec20.yml done 1 prog tests 1 inspect 3.6 1.6 270 35 .0082 0   true prog tests 1 inspect
41.7 62.5 .12  .12  17   .078 0  
loops/string-2.yml done 1 prog tests 1 inspect 4.6 1.9 280 44 .029  0   true prog tests 1 inspect
69.2 86.2 .12  .12  16   .082 0  
loops/sum01-1.yml done 1 prog tests 1 inspect 24   6.3 850 190 1.6    0   true prog tests 1 inspect
70.0 90.0 .13  .13  16   .078 0  
loops/sum01_bug02.yml done 1 prog tests 1 inspect 24   6.1 860 190 1.6    0   true prog tests 1 inspect
70.0 90.9 .13  .13  16   .078 0  
loops/sum01_bug02_sum01_bug02_base.case.yml done 1 prog tests 1 inspect 9.3 2.9 450 83 .36   0   true prog tests 1 inspect
70.0 90.0 .12  .12  17   .078 0  
loops/sum03-1.yml done 1 prog tests 1 inspect 4.9 1.9 280 40 .041  0   true prog tests 1 inspect
87.5 100   .11  .12  16   .078 0  
loops/sum_array-1.yml done 1 prog tests 1 inspect 23   6.1 820 220 1.7    0   true prog tests 1 inspect
80.0 93.8 .12  .12  16   .078 0  
loops/terminator_01.yml done 1 prog tests 1 inspect 3.4 1.5 260 29 .0082 0   true prog tests 1 inspect
50.0 72.7 .12  .12  16   .078 0  
loops/terminator_02-1.yml done 1 prog tests 1 inspect 3.4 1.5 260 31 .0082 0   true prog tests 1 inspect
25.0 56.2 .12  .12  17   .078 0  
loops/terminator_03-1.yml done 1 prog tests 1 inspect 23   18   1400 300 .0082 0   true prog tests 1 inspect
41.7 75.0 .13  .13  17   .078 0  
loops/trex01-1.yml done 1 prog tests 1 inspect 3.5 1.6 260 36 .0082 0   true prog tests 1 inspect
28.6 50.0 .12  .12  16   .082 0  
loops/trex02-2.yml done 1 prog tests 1 inspect 3.4 1.5 260 36 .0082 0   true prog tests 1 inspect
33.3 50.0 .12  .12  17   .078 0  
loops/trex03-1.yml done 1 prog tests 1 inspect 22   17   1500 240 .0082 0   true prog tests 1 inspect
22.2 56.2 .12  .12  16   .078 0  
loops/vogal-2.yml done 1 prog tests 1 inspect 72   48   900 700 1.1    0   true prog tests 1 inspect
88.9 88.5 .12  .12  16   .078 0  
loop-acceleration/array_3-2.yml timeout prog tests 0 inspect 900   790   5700 12000 14      0   error (0) prog tests 0 inspect
0   0   .065 .066 9.0 0     0  
loop-acceleration/diamond_1-2.yml done 1 prog tests 1 inspect 10   4.0 500 90 .078  0   true prog tests 1 inspect
66.7 83.3 .12  .12  17   .078 0  
loop-acceleration/multivar_1-2.yml done 1 prog tests 1 inspect 3.4 1.5 260 34 .0082 0   true prog tests 1 inspect
50.0 72.7 .12  .12  16   .078 0  
loop-invgen/id_trans.yml done 1 prog tests 1 inspect 3.8 1.6 270 40 .020  0   true prog tests 1 inspect
62.5 93.3 .12  .12  17   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 27 22 5100 4600 37000 61000 160 0   27 1310 1750 3.0 3.0 410 1.7 0  
Run set coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Loops