Task filter


CPAchecker 2024-12-17 20:37:35 CET coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCoVeriTestTestCov
ToolCPAchecker 4.0TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-17 20:37:35 CET2024-12-23 23:57:55 CET
Run setcoveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursivetestcov-validate-test-suites-clang-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursivetestcov-validate-test-suites-clang-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursivetestcov-validate-test-suites-gcc-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursivetestcov-validate-test-suites-gcc-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
Options
  • --benchmark
  • --heap 10000M
  • --testcomp25
  • --option log.consoleLevel=SEVERE
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-error-call

Statistics

CPAchecker 2024-12-17 20:37:35 CET coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
21
7
15000
13000
130000
21
700
620
640
1700
21
700
610
630
1700
21
700
600
620
1600
21
700
600
620
1500

Generated by BenchExec 3.29