Task filter


PRTest 2024-12-19 03:25:41 CET prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines

Add filter for:

TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkPRTestTestCov
ToolPRTest v2.3TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-19 03:25:41 CET2024-12-24 07:18:25 CET
Run setprtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLinestestcov-validate-test-suites-clang-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLinestestcov-validate-test-suites-clang-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLinestestcov-validate-test-suites-gcc-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLinestestcov-validate-test-suites-gcc-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines
Options
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/prtest.2024-12-19_03-25-41.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-error-call

Statistics

PRTest 2024-12-19 03:25:41 CET prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-clang-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-formatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines
TestCov 2024-12-24 07:18:25 CET testcov-validate-test-suites-gcc-unformatted-prtest.Test-Comp25_coverage-error-call.ReachSafety-ProductLines
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
169
92
150000
150000
4500
169
88
89
7500
169
9200
290
330
14000
169
80
81
7200
169
9200
280
310
14000

Generated by BenchExec 3.29