Task filter


PRTest 2024-12-19 03:25:41 CET prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkPRTestTestCov
ToolPRTest v2.3TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-19 03:25:41 CET2024-12-24 07:18:25 CET
Run setprtest.Test-Comp25_coverage-error-call.ReachSafety-ECAtestcov-validate-test-suites-clang-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECAtestcov-validate-test-suites-clang-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECAtestcov-validate-test-suites-gcc-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECAtestcov-validate-test-suites-gcc-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA
Options
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-error-call

Statistics

PRTest 2024-12-19 03:25:41 CET prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ECA
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
18
0
16000
16000
4300
18
.0
2500
2500
21000
18
.0
1700
1700
18000
18
.0
2700
2700
21000
18
.0
1700
1700
18000

Generated by BenchExec 3.29