Benchmark | Symbiotic | TBF Test-Suite Validator | ||||||||||||||||||||||||
Tool | symbiotic 6.0.3-dev-fd3f777b | Tbf Test-suite Validator v1.2 | ||||||||||||||||||||||||
Limits | timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 | timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2 | ||||||||||||||||||||||||
Host | apollon* | |||||||||||||||||||||||||
OS | Linux 4.15.0-45-generic | |||||||||||||||||||||||||
System | CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB | |||||||||||||||||||||||||
Date of execution | 2019-02-06 07:07:32 CET | 2019-02-06 14:52:39 CET | ||||||||||||||||||||||||
Run set | symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Recursive | tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Recursive | ||||||||||||||||||||||||
Options | --test-comp --verifier klee-testcomp | --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/symbiotic.2019-02-06_0707.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip | ||||||||||||||||||||||||
sv-benchmarks/c/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
recursive/Ackermann02.yml | done | 1 | prog | tests | 1 | inspect | .58 | .58 | 19 | 7.6 | 0 | 0 | true | prog | tests | 1 | inspect | 62.5 | 82.3 | .12 | .12 | 17 | .078 | 0 | ||
recursive/Addition02.yml | done | 1 | prog | tests | 1 | inspect | .56 | .55 | 19 | 7.1 | 0 | 0 | true | prog | tests | 1 | inspect | 50.0 | 68.4 | .11 | .11 | 16 | .078 | 0 | ||
recursive/BallRajamani-SPIN2000-Fig1.yml | done | 1 | prog | tests | 1 | inspect | .48 | .47 | 19 | 6.6 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 100 | .11 | .11 | 16 | .078 | 0 | ||
recursive/EvenOdd03.yml | done | 1 | prog | tests | 1 | inspect | .56 | .55 | 19 | 7.6 | 0 | 0 | true | prog | tests | 1 | inspect | 28.6 | 47.6 | .13 | .13 | 17 | .078 | 0 | ||
recursive/Fibonacci04.yml | done | 1 | prog | tests | 1 | inspect | .68 | .68 | 19 | 9.0 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 91.7 | .11 | .13 | 16 | .078 | 0 | ||
recursive/Fibonacci05.yml | done | 1 | prog | tests | 1 | inspect | .93 | .93 | 19 | 13 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 91.7 | .12 | .13 | 16 | .078 | 0 | ||
recursive/McCarthy91-1.yml | done | 1 | prog | tests | 1 | inspect | .54 | .54 | 19 | 7.3 | 0 | 0 | true | prog | tests | 1 | inspect | 37.5 | 80.0 | .11 | .11 | 16 | .078 | 0 | ||
recursive-simple/id2_b3_o2.yml | done | 1 | prog | tests | 1 | inspect | .56 | .56 | 19 | 6.9 | 0 | 0 | true | prog | tests | 1 | inspect | 60.0 | 100 | .11 | .13 | 16 | .078 | 0 | ||
recursive-simple/id_b3_o2-2.yml | done | 1 | prog | tests | 1 | inspect | .53 | .52 | 19 | 6.2 | 0 | 0 | true | prog | tests | 1 | inspect | 66.7 | 100 | .12 | .12 | 16 | .078 | 0 | ||
recursive-simple/id_o10.yml | done | 1 | prog | tests | 1 | inspect | .48 | .48 | 19 | 5.3 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 100 | .11 | .11 | 16 | .078 | 0 | ||
recursive-simple/id_o100.yml | done | 1 | prog | tests | 1 | inspect | .48 | .47 | 18 | 5.3 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 100 | .19 | .23 | 16 | .078 | 0 | ||
recursive-simple/id_o1000.yml | done | 1 | prog | tests | 1 | inspect | .50 | .50 | 19 | 5.9 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 100 | .11 | .11 | 16 | .078 | 0 | ||
recursive-simple/id_o20.yml | done | 1 | prog | tests | 1 | inspect | .49 | .49 | 19 | 8.0 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 100 | .11 | .12 | 16 | .078 | 0 | ||
recursive-simple/id_o200.yml | done | 1 | prog | tests | 1 | inspect | .47 | .47 | 19 | 5.7 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 100 | .12 | .12 | 16 | .078 | 0 | ||
recursive-simple/id_o3.yml | done | 1 | prog | tests | 1 | inspect | .47 | .47 | 18 | 5.8 | 0 | 0 | true | prog | tests | 1 | inspect | 75.0 | 100 | .12 | .17 | 16 | .078 | 0 | ||
recursive-simple/sum_non_eq-3.yml | done | 1 | prog | tests | 1 | inspect | .49 | .48 | 16 | 5.7 | 0 | 0 | true | prog | tests | 1 | inspect | 50.0 | 90.0 | .11 | .11 | 16 | .078 | 0 | ||
sv-benchmarks/c/ | status | score | program | test-suite | TS size | inspect test-suite | cpu (s) | wall (s) | mem (MB) | energy (J) | blkio-w (MB) | blkio-r (MB) | status | program | test-suite | TS size | inspect test-suite | cov | branch cov (%) | line cov (%) | cpu (s) | wall (s) | mem (MB) | energy | blkio-w (MB) | blkio-r (MB) |
total | 16 | 16 | 8.8 | 8.7 | 300 | 110 | 0 | 0 | 16 | 1030 | 1450 | 1.9 | 2.1 | 260 | 1.2 | 0 | ||||||||||
Run set | symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Recursive | tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Recursive |