Benchmark CPA/Tiger-MGP TBF Test-Suite Validator
Tool CPAchecker 1.8-svn 30541M Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:13:54 CET 2019-02-06 06:15:02 CET
Run set cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Loops
Options -benchmark -heap 10000M -tigertestcomp19 --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/cpa-tiger.2019-02-05_2113.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
loops/array-2.yml unknown 1 prog tests 1 inspect 3.0 1.3 270 27 .0041 0   true prog tests 1 inspect
66.7 86.7 .12  .14  16   .078 0  
loops/compact.yml timeout prog tests 0 inspect 900   900   2500 6000 .0041 0   unknown prog tests 0 inspect
0   0   .064 .065 9.1 0     0  
loops/count_up_down-2.yml unknown 1 prog tests 1 inspect 3.1 1.3 270 30 .0041 0   true prog tests 1 inspect
50.0 72.7 .12  .12  17   .078 0  
loops/eureka_01-1.yml unknown prog tests 0 inspect 5.6 3.5 300 62 .0041 0   unknown prog tests 0 inspect
0   0   .063 .064 9.0 0     0  
loops/for_bounded_loop1.yml unknown 1 prog tests 1 inspect 3.1 1.4 270 31 .0041 0   true prog tests 1 inspect
75.0 100   .12  .12  16   .078 0  
loops/insertion_sort-1.yml unknown prog tests 0 inspect 3.1 1.4 270 31 .0041 0   unknown prog tests 0 inspect
0   0   .068 .070 8.9 0     0  
loops/invert_string-1.yml unknown prog tests 0 inspect 3.1 1.4 270 30 .0041 0   unknown prog tests 0 inspect
0   0   .060 .060 9.0 0     0  
loops/linear_search.yml unknown prog tests 0 inspect 3.1 1.4 270 30 .0041 0   unknown prog tests 0 inspect
0   0   .059 .060 9.1 0     0  
loops/matrix-2.yml unknown 1 prog tests 1 inspect 3.3 1.4 270 30 .0041 0   true prog tests 1 inspect
66.7 88.9 .13  .15  16   .082 0  
loops/nec20.yml unknown 1 prog tests 1 inspect 3.0 1.3 270 26 .0041 0   true prog tests 1 inspect
41.7 62.5 .12  .12  17   .078 0  
loops/string-2.yml unknown 1 prog tests 1 inspect 4.3 2.0 290 41 .0041 0   true prog tests 1 inspect
69.2 86.2 .12  .18  16   .082 0  
loops/sum01-1.yml unknown 1 prog tests 1 inspect 4.7 2.0 280 37 .0041 0   true prog tests 1 inspect
70.0 90.0 .12  .11  16   .078 0  
loops/sum01_bug02.yml unknown 1 prog tests 1 inspect 4.0 1.7 280 34 .0041 0   true prog tests 1 inspect
70.0 90.9 .12  .12  16   .078 0  
loops/sum01_bug02_sum01_bug02_base.case.yml unknown 1 prog tests 1 inspect 3.5 1.5 280 29 .0041 0   true prog tests 1 inspect
70.0 90.0 .12  .12  17   .078 0  
loops/sum03-1.yml unknown 1 prog tests 1 inspect 4.6 2.0 290 39 .0041 0   true prog tests 1 inspect
87.5 100   .12  .12  16   .078 0  
loops/sum_array-1.yml unknown 1 prog tests 1 inspect 3.4 1.6 270 34 .0041 0   true prog tests 1 inspect
80.0 93.8 .12  .12  16   .078 0  
loops/terminator_01.yml unknown 1 prog tests 1 inspect 2.8 1.3 260 30 .0041 0   true prog tests 1 inspect
50.0 72.7 .11  .11  16   .078 0  
loops/terminator_02-1.yml unknown 1 prog tests 1 inspect 2.9 1.3 260 24 .0041 0   true prog tests 1 inspect
25.0 56.2 .12  .12  16   .078 0  
loops/terminator_03-1.yml unknown 1 prog tests 1 inspect 2.9 1.3 260 28 .0041 0   true prog tests 1 inspect
41.7 75.0 .12  .12  17   .078 0  
loops/trex01-1.yml unknown 1 prog tests 1 inspect 3.1 1.3 270 28 .0041 0   true prog tests 1 inspect
28.6 50.0 .12  .12  16   .082 0  
loops/trex02-2.yml unknown 1 prog tests 1 inspect 3.1 1.3 270 26 .0041 0   true prog tests 1 inspect
33.3 50.0 .11  .11  16   .078 0  
loops/trex03-1.yml unknown 1 prog tests 1 inspect 2.9 1.3 270 27 .0041 0   true prog tests 1 inspect
22.2 56.2 .11  .11  16   .078 0  
loops/vogal-2.yml unknown 1 prog tests 1 inspect 48   43   500 590 .0041 0   true prog tests 1 inspect
88.9 88.5 .12  .12  16   .078 0  
loop-acceleration/array_3-2.yml timeout prog tests 0 inspect 900   880   6500 13000 .0041 0   unknown prog tests 0 inspect
0   0   .062 .062 9.0 0     0  
loop-acceleration/diamond_1-2.yml unknown 1 prog tests 1 inspect 35   29   560 460 .0041 0   true prog tests 1 inspect
66.7 83.3 .11  .11  16   .078 0  
loop-acceleration/multivar_1-2.yml unknown 1 prog tests 1 inspect 2.9 1.2 270 28 .0041 0   true prog tests 1 inspect
50.0 72.7 .12  .12  17   .078 0  
loop-invgen/id_trans.yml unknown 1 prog tests 1 inspect 3.0 1.3 270 31 .0041 0   true prog tests 1 inspect
62.5 93.3 .12  .13  16   .078 0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 27 21 2000 1900 16000 21000 .11 0   27 1220 1660 2.8 3.0 400 1.6 0  
Run set cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Loops tbf-testsuite-validator-cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Loops