Task filter


PRTest 2024-12-19 03:25:41 CET prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkPRTestTestCov
ToolPRTest v2.3TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-19 03:25:41 CET2024-12-24 07:18:25 CET
Run setprtest.Test-Comp25_coverage-error-call.ReachSafety-Recursivetestcov-validate-test-suites-clang-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursivetestcov-validate-test-suites-clang-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursivetestcov-validate-test-suites-gcc-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursivetestcov-validate-test-suites-gcc-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
Options
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-error-call

Statistics

PRTest 2024-12-19 03:25:41 CET prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-Recursive
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
21
3
8100
8100
550
21
300
20
23
1200
21
200
18
20
1000
21
300
19
21
1100
21
200
17
19
970

Generated by BenchExec 3.29