Task filter


Rizzer 2024-12-23 13:14:27 CET rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-clang-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-clang-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-gcc-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-gcc-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkRizzerTestCov
ToolRizzer 0.1TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-23 13:14:27 CET2024-12-24 13:16:16 CET
Run setrizzer.Test-Comp25_coverage-error-call.ReachSafety-ECAtestcov-validate-test-suites-clang-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECAtestcov-validate-test-suites-clang-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECAtestcov-validate-test-suites-gcc-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECAtestcov-validate-test-suites-gcc-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA
Options
  • --max_seconds 865
  • --optimizer_max_seconds 30
  • --max_exec_milliseconds 500
  • --max_stdin_bytes 65536
  • --stdin_model stdin_replay_bytes_then_repeat_zero
  • --test_type testcomp
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/rizzer.2024-12-23_13-14-27.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/rizzer.2024-12-23_13-14-27.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/rizzer.2024-12-23_13-14-27.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/rizzer.2024-12-23_13-14-27.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-error-call

Statistics

Rizzer 2024-12-23 13:14:27 CET rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA
TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-clang-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA
TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-clang-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA
TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-gcc-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA
TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-gcc-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-ECA
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
18
7
14000
14000
50000
18
700
4900
5100
21000
18
800
4200
4400
18000
18
700
5100
5300
21000
18
700
4600
4800
18000

Generated by BenchExec 3.29