Task filter


CPAchecker 2024-12-17 20:37:35 CET coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-formatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-unformatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-formatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-unformatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCoVeriTestTestCov
ToolCPAchecker 4.0TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-17 20:37:35 CET2024-12-23 23:57:55 CET
Run setcoveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLinestestcov-validate-test-suites-clang-formatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLinestestcov-validate-test-suites-clang-unformatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLinestestcov-validate-test-suites-gcc-formatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLinestestcov-validate-test-suites-gcc-unformatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines
Options
  • --benchmark
  • --heap 10000M
  • --testcomp25
  • --option log.consoleLevel=SEVERE
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-branches

Statistics

CPAchecker 2024-12-17 20:37:35 CET coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-formatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-unformatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-formatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-unformatted-coveritest.Test-Comp25_coverage-branches.ReachSafety-ProductLines
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
263
76.7
53000
44000
220000
263
170
170
12000
263
7670
130000
160000
46000
263
160
160
11000
263
7670
130000
150000
46000

Generated by BenchExec 3.29