Task filter


CPAchecker 2024-12-17 20:37:35 CET coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized

Add filter for:

TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkCoVeriTestTestCov
ToolCPAchecker 4.0TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-17 20:37:35 CET2024-12-23 23:57:55 CET
Run setcoveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentializedtestcov-validate-test-suites-clang-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentializedtestcov-validate-test-suites-clang-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentializedtestcov-validate-test-suites-gcc-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentializedtestcov-validate-test-suites-gcc-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized
Options
  • --benchmark
  • --heap 10000M
  • --testcomp25
  • --option log.consoleLevel=SEVERE
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/coveritest.2024-12-17_20-37-35.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-error-call

Statistics

CPAchecker 2024-12-17 20:37:35 CET coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-clang-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-formatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized
TestCov 2024-12-23 23:57:55 CET testcov-validate-test-suites-gcc-unformatted-coveritest.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
106
61
46000
44000
60000
106
6100
480
550
9000
106
6100
460
530
9000
106
6100
430
500
8300
106
6100
420
490
8300

Generated by BenchExec 3.29