Task filter


Tracer-X 2020-12-14 20:56:36 CET tracerx.Test-Comp21_coverage-branches.ReachSafety-Heap

Add filter for:

TestCov 2020-12-17 15:38:45 CET testcov-validate-test-suites-tracerx.Test-Comp21_coverage-branches.ReachSafety-Heap

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkTracer-X TestCov
ToolTracer-X 1.2.0 TestCov v3.3
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 300 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 5.4.0-56-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33493 MB
Date of execution2020-12-14 20:56:36 CET 2020-12-17 15:38:45 CET
Run settracerx.Test-Comp21_coverage-branches.ReachSafety-Heap testcov-validate-test-suites-tracerx.Test-Comp21_coverage-branches.ReachSafety-Heap
Options
  • --memlimit 6GB
  • --timelimit-per-run 3
  • --cpu-cores 0
  • --verbose
  • --no-plots
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/tracerx.2020-12-14_20-56-36.files/${rundefinition_name}.${taskdef_name}/test-suite.zip
Propertiescoverage-branches

Statistics

Tracer-X 2020-12-14 20:56:36 CET tracerx.Test-Comp21_coverage-branches.ReachSafety-Heap
TestCov 2020-12-17 15:38:45 CET testcov-validate-test-suites-tracerx.Test-Comp21_coverage-branches.ReachSafety-Heap
Click here to select columns
status
score
cpu
(s)
wall
(s)
mem
(MB)
energy
(J)
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
total
143
86.0
18000
18000
140000
200000
143
8600
10000
16000
9600
    correct results
52
29.4
5400
5400
53000
58000
0
-
-
-
-
        correct true
0
-
-
-
-
-
0
-
-
-
-
        correct false
52
29.4
5400
5400
53000
58000
0
-
-
-
-
    incorrect results
0
-
-
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
-
-
-
0
-
-
-
-
Loading...

Generated by BenchExec 3.6