Task filter


Sikraken 2024-12-19 12:19:23 CET sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow

Add filter for:

TestCov 2024-12-24 07:52:59 CET testcov-validate-test-suites-clang-formatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow

Add filter for:

TestCov 2024-12-24 07:52:59 CET testcov-validate-test-suites-clang-unformatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow

Add filter for:

TestCov 2024-12-24 07:52:59 CET testcov-validate-test-suites-gcc-formatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow

Add filter for:

TestCov 2024-12-24 07:52:59 CET testcov-validate-test-suites-gcc-unformatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkSikrakenTestCov
ToolSikraken 1.0.8TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-19 12:19:23 CET2024-12-24 07:52:59 CET
Run setsikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlowtestcov-validate-test-suites-clang-formatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlowtestcov-validate-test-suites-clang-unformatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlowtestcov-validate-test-suites-gcc-formatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlowtestcov-validate-test-suites-gcc-unformatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow
Options
  • release budget[900]
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/sikraken.2024-12-19_12-19-23.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/sikraken.2024-12-19_12-19-23.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/sikraken.2024-12-19_12-19-23.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/sikraken.2024-12-19_12-19-23.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-branches

Statistics

Sikraken 2024-12-19 12:19:23 CET sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow
TestCov 2024-12-24 07:52:59 CET testcov-validate-test-suites-clang-formatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow
TestCov 2024-12-24 07:52:59 CET testcov-validate-test-suites-clang-unformatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow
TestCov 2024-12-24 07:52:59 CET testcov-validate-test-suites-gcc-formatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow
TestCov 2024-12-24 07:52:59 CET testcov-validate-test-suites-gcc-unformatted-sikraken.Test-Comp25_coverage-branches.ReachSafety-ControlFlow
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
87
3.42
34000
32000
37000
87
272
67
74
4200
87
272
59
67
2700
87
342
76
85
4300
87
342
68
77
2800

Generated by BenchExec 3.29