Task filter


Rizzer 2024-12-23 13:14:27 CET rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays

Add filter for:

TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-clang-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays

Add filter for:

TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-clang-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays

Add filter for:

TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-gcc-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays

Add filter for:

TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-gcc-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkRizzerTestCov
ToolRizzer 0.1TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-23 13:14:27 CET2024-12-24 13:16:16 CET
Run setrizzer.Test-Comp25_coverage-error-call.ReachSafety-Arraystestcov-validate-test-suites-clang-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arraystestcov-validate-test-suites-clang-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arraystestcov-validate-test-suites-gcc-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arraystestcov-validate-test-suites-gcc-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays
Options
  • --max_seconds 865
  • --optimizer_max_seconds 30
  • --max_exec_milliseconds 500
  • --max_stdin_bytes 65536
  • --stdin_model stdin_replay_bytes_then_repeat_zero
  • --test_type testcomp
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/rizzer.2024-12-23_13-14-27.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/rizzer.2024-12-23_13-14-27.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/rizzer.2024-12-23_13-14-27.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/rizzer.2024-12-23_13-14-27.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-error-call

Statistics

Rizzer 2024-12-23 13:14:27 CET rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays
TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-clang-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays
TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-clang-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays
TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-gcc-formatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays
TestCov 2024-12-24 13:16:16 CET testcov-validate-test-suites-gcc-unformatted-rizzer.Test-Comp25_coverage-error-call.ReachSafety-Arrays
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
100
82
73000
73000
200000
100
8200
350
370
21000
100
8200
350
370
21000
100
8200
340
360
21000
100
8200
340
360
21000

Generated by BenchExec 3.29