Benchmark PRtest TBF Test-Suite Validator
Tool tbf v0.3.0-testcomp19 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon010; apollon052; apollon080; apollon107; apollon135; apollon167]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 06:02:44 CET 2019-02-06 13:26:19 CET
Run set prtest.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-prtest.test-comp19_prop-coverage-error-call.ReachSafety-Loops
Options --stats -i random --write-xml --svcomp-nondets --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/prtest.2019-02-06_0602.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-2.yml unknown 1 prog tests 2 inspect .27 .45 31 3.5 0     0   true prog tests 1 inspect
100    100   .13  .13  17   .094 0  
loops/compact.yml timeout prog tests 1 inspect 900    840    35 12000   .012 0   unknown prog tests 0 inspect
16.7  50.0 .34  .34  45   .070 0  
loops/count_up_down-2.yml unknown 1 prog tests 1 inspect 7.6  7.4  30 110   0     0   true prog tests 1 inspect
75.0  90.9 5.1   5.1   16   .078 0  
loops/eureka_01-1.yml timeout prog tests 3 inspect 900    840    31 13000   .012 0   unknown prog tests 0 inspect
19.2  16.1 .13  .16  16   .090 0  
loops/for_bounded_loop1.yml unknown 1 prog tests 3 inspect 140    130    31 2200   0     0   true prog tests 1 inspect
75.0  100   .40  .39  45   .094 0  
loops/insertion_sort-1.yml error (0) prog tests 0 inspect .26 .45 31 4.0 0     0   unknown prog tests 0 inspect
0    0   .063 .064 9.0 0     0  
loops/invert_string-1.yml error (0) prog tests 1 inspect .25 .35 31 3.0 0     0   unknown prog tests 0 inspect
.00 15.0 .13  .13  16   .078 0  
loops/linear_search.yml error (0) prog tests 0 inspect .19 .33 31 2.9 0     0   unknown prog tests 0 inspect
0    0   .059 .060 8.9 0     0  
loops/matrix-2.yml error (0) prog tests 0 inspect .26 .45 31 4.3 0     0   unknown prog tests 0 inspect
0    0   .067 .069 9.0 0     0  
loops/nec20.yml unknown 1 prog tests 3 inspect .51 .63 31 6.1 0     0   true prog tests 1 inspect
41.7  62.5 .12  .12  16   .078 0  
loops/string-2.yml timeout prog tests 5 inspect 900    840    30 13000   .012 0   unknown prog tests 0 inspect
80.8  96.5 .13  .13  16   .15  0  
loops/sum01-1.yml unknown 1 prog tests 2 inspect 11    11    31 140   0     0   true prog tests 1 inspect
70.0  90.0 3.2   3.2   16   .078 0  
loops/sum01_bug02.yml unknown 1 prog tests 2 inspect 9.6  9.2  31 130   0     0   true prog tests 1 inspect
70.0  90.9 4.4   4.4   16   .078 0  
loops/sum01_bug02_sum01_bug02_base.case.yml unknown 1 prog tests 2 inspect 11    11    31 180   0     0   true prog tests 1 inspect
70.0  90.0 4.1   4.1   16   .078 0  
loops/sum03-1.yml unknown 1 prog tests 1 inspect .27 .46 31 3.1 0     0   true prog tests 1 inspect
87.5  100   .12  .12  17   .078 0  
loops/sum_array-1.yml error (0) prog tests 0 inspect .26 .45 31 3.0 0     0   unknown prog tests 0 inspect
0    0   .063 .064 9.0 0     0  
loops/terminator_01.yml unknown 1 prog tests 1 inspect 3.7  3.6  31 53   0     0   true prog tests 1 inspect
75.0  81.8 2.9   2.9   16   .078 0  
loops/terminator_02-1.yml unknown 1 prog tests 2 inspect .29 .45 31 3.3 0     0   true prog tests 1 inspect
25.0  56.2 .12  .12  16   .078 0  
loops/terminator_03-1.yml unknown 1 prog tests 2 inspect .24 .43 31 3.5 0     0   true prog tests 1 inspect
41.7  75.0 .12  .12  16   .078 0  
loops/trex01-1.yml unknown 1 prog tests 1 inspect .28 .37 31 2.9 0     0   true prog tests 1 inspect
28.6  50.0 .12  .12  16   .082 0  
loops/trex02-2.yml unknown 1 prog tests 1 inspect .24 .44 31 2.9 0     0   true prog tests 1 inspect
33.3  50.0 .11  .11  16   .078 0  
loops/trex03-1.yml timeout prog tests 1 inspect 900    840    35 14000   .012 0   unknown prog tests 0 inspect
33.3  56.2 .37  .38  45   .078 0  
loops/vogal-2.yml unknown 1 prog tests 2 inspect .25 .45 30 3.3 0     0   true prog tests 1 inspect
100    100   .14  .14  17   .094 0  
loop-acceleration/array_3-2.yml unknown 1 prog tests 1 inspect .26 .45 31 3.0 0     0   true prog tests 1 inspect
75.0  88.9 .15  .15  17   .078 0  
loop-acceleration/diamond_1-2.yml unknown 1 prog tests 1 inspect .26 .45 31 4.1 0     0   true prog tests 1 inspect
66.7  83.3 .11  .11  16   .078 0  
loop-acceleration/multivar_1-2.yml unknown 1 prog tests 1 inspect .25 .44 31 3.2 0     0   true prog tests 1 inspect
50.0  72.7 .12  .12  16   .078 0  
loop-invgen/id_trans.yml timeout prog tests 1 inspect 900    850    31 13000   .012 0   unknown prog tests 0 inspect
12.5  33.3 .12  .12  17   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 27 17 4700 4400 840 68000 .061 0   27 1250 1650 23 23 500 1.9 0  
Run set prtest.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-prtest.test-comp19_prop-coverage-error-call.ReachSafety-Loops