Task filter


TracerX-WP 2024-12-20 13:14:13 CET tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-24 09:30:42 CET testcov-validate-test-suites-clang-formatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-24 09:30:42 CET testcov-validate-test-suites-clang-unformatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-24 09:30:43 CET testcov-validate-test-suites-gcc-formatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-24 09:30:42 CET testcov-validate-test-suites-gcc-unformatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive

Add filter for:

Benchmark Setup

BenchmarkTracerX-WPTestCov
ToolTracerX-WP 1.2.0TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-20 13:14:13 CET2024-12-24 09:30:42 CET2024-12-24 09:30:43 CET2024-12-24 09:30:42 CET
Run settracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursivetestcov-validate-test-suites-clang-formatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursivetestcov-validate-test-suites-clang-unformatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursivetestcov-validate-test-suites-gcc-formatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursivetestcov-validate-test-suites-gcc-unformatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive
Options
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-branches

Statistics

TracerX-WP 2024-12-20 13:14:13 CET tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive
TestCov 2024-12-24 09:30:42 CET testcov-validate-test-suites-clang-formatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive
TestCov 2024-12-24 09:30:42 CET testcov-validate-test-suites-clang-unformatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive
TestCov 2024-12-24 09:30:43 CET testcov-validate-test-suites-gcc-formatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive
TestCov 2024-12-24 09:30:42 CET testcov-validate-test-suites-gcc-unformatted-tracerx-wp.Test-Comp25_coverage-branches.ReachSafety-Recursive
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
121
64.4 
58000
58000
190000
121
6070
420
460
8800
121
6070
420
450
8400
121
6440
410
450
8200
121
6440
420
450
7700
    correct results
4
3.00
150
150
4000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        correct false
4
3.00
150
150
4000
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
    incorrect results
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect true
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
        incorrect false
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-
0
-
-
-
-

Generated by BenchExec 3.29