Benchmark PRtest TBF Test-Suite Validator
Tool tbf v0.3.0-testcomp19 Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon* [apollon010; apollon052; apollon080; apollon107; apollon135; apollon167]
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 06:02:44 CET 2019-02-06 13:26:19 CET
Run set prtest.test-comp19_prop-coverage-error-call.ReachSafety-Arrays tbf-testsuite-validator-prtest.test-comp19_prop-coverage-error-call.ReachSafety-Arrays
Options --stats -i random --write-xml --svcomp-nondets --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/prtest.2019-02-06_0602.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
array-examples/standard_copy1_ground-2.yml timeout prog tests 1 inspect 900    840    31 15000   .012 0   unknown prog tests 0 inspect
12.5  40.0 .37  .37  45   .078 0  
array-examples/standard_copy2_ground-1.yml timeout prog tests 1 inspect 900    840    31 13000   .012 0   unknown prog tests 0 inspect
10.0  33.3 .37  .37  45   .078 0  
array-examples/standard_copy3_ground-2.yml timeout prog tests 1 inspect 900    840    31 14000   .012 0   unknown prog tests 0 inspect
8.33 28.6 .36  .36  45   .078 0  
array-examples/standard_copy4_ground-2.yml timeout prog tests 1 inspect 900    840    31 12000   .012 0   unknown prog tests 0 inspect
7.14 25.0 .36  .36  45   .078 0  
array-examples/standard_copy5_ground-2.yml timeout prog tests 1 inspect 900    840    30 14000   .012 0   unknown prog tests 0 inspect
6.25 22.2 .37  .37  45   .078 0  
array-examples/standard_copy6_ground-1.yml timeout prog tests 1 inspect 900    840    31 12000   0     0   unknown prog tests 0 inspect
5.56 20.0 .37  .37  45   .078 0  
array-examples/standard_copy7_ground-1.yml timeout prog tests 1 inspect 900    840    31 13000   .012 0   unknown prog tests 0 inspect
5.00 18.2 .38  .38  45   .082 0  
array-examples/standard_copy8_ground-2.yml timeout prog tests 1 inspect 900    840    31 14000   .012 0   unknown prog tests 0 inspect
4.55 16.7 .37  .37  45   .082 0  
array-examples/standard_copy9_ground-1.yml timeout prog tests 1 inspect 900    840    31 14000   .012 0   unknown prog tests 0 inspect
4.17 15.4 .41  .41  45   .082 0  
array-examples/standard_partition_ground-1.yml timeout prog tests 1 inspect 900    840    31 14000   .012 0   unknown prog tests 0 inspect
21.4  45.5 .37  .37  45   .078 0  
array-industry-pattern/array_ptr_single_elem_init-2.yml timeout prog tests 3 inspect 900    840    35 13000   .025 0   unknown prog tests 0 inspect
50.0  64.7 .88  .88  48   .11  0  
array-industry-pattern/array_single_elem_init.yml timeout prog tests 3 inspect 900    840    35 13000   .025 0   unknown prog tests 0 inspect
50.0  64.7 .85  .88  48   .11  0  
reducercommutativity/rangesum.yml error (0) prog tests 1 inspect .26 .44 31 3.4 0     0   unknown prog tests 0 inspect
6.25 12.9 .12  .12  16   .082 0  
reducercommutativity/rangesum05.yml unknown 1 prog tests 1 inspect .28 .47 31 2.9 0     0   true prog tests 1 inspect
78.6  92.6 .12  .12  16   .082 0  
reducercommutativity/rangesum10.yml unknown 1 prog tests 1 inspect .28 .47 31 3.1 0     0   true prog tests 1 inspect
78.6  92.6 .13  .13  17   .082 0  
reducercommutativity/rangesum20.yml unknown 1 prog tests 1 inspect .26 .45 31 3.4 0     0   true prog tests 1 inspect
78.6  92.6 .13  .13  17   .082 0  
reducercommutativity/rangesum40.yml unknown 1 prog tests 1 inspect .26 .44 31 3.2 0     0   true prog tests 1 inspect
78.6  92.6 .12  .12  17   .082 0  
reducercommutativity/rangesum60.yml unknown 1 prog tests 1 inspect .27 .46 31 3.2 0     0   true prog tests 1 inspect
78.6  92.6 .15  .15  16   .082 0  
array-tiling/mlceu.yml error (0) prog tests 0 inspect .20 .34 31 2.8 0     0   unknown prog tests 0 inspect
0    0   .061 .061 9.0 0     0  
array-tiling/skippedu.yml error (0) prog tests 0 inspect .19 .33 31 2.8 0     0   unknown prog tests 0 inspect
0    0   .070 .071 9.0 0     0  
array-programs/copysome1-2.yml timeout prog tests 1 inspect 900    840    31 14000   .012 0   unknown prog tests 0 inspect
8.33 35.7 .40  .39  45   .078 0  
array-programs/copysome2-2.yml timeout prog tests 1 inspect 900    840    31 14000   .012 0   unknown prog tests 0 inspect
7.14 35.3 .36  .36  45   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 22 5 13000 12000 680 190000 .18 0   22 600 941 7.1 7.1 750 1.7 0  
Run set prtest.test-comp19_prop-coverage-error-call.ReachSafety-Arrays tbf-testsuite-validator-prtest.test-comp19_prop-coverage-error-call.ReachSafety-Arrays