Task filter


Fizzer 2024-12-18 09:05:25 CET fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-clang-formatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-clang-unformatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-gcc-formatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-gcc-unformatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkFizzerTestCov
ToolFizzer 0.1TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-18 09:05:25 CET2024-12-24 04:37:51 CET
Run setfizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafetytestcov-validate-test-suites-clang-formatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafetytestcov-validate-test-suites-clang-unformatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafetytestcov-validate-test-suites-gcc-formatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafetytestcov-validate-test-suites-gcc-unformatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Options
  • --max_seconds 865
  • --optimizer_max_seconds 30
  • --max_exec_milliseconds 500
  • --max_exec_megabytes 13312
  • --max_stdin_bytes 65536
  • --max_trace_length 10000
  • --max_stack_size 25
  • --stdin_model stdin_replay_bytes_then_repeat_zero
  • --test_type testcomp
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/fizzer.2024-12-18_09-05-25.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/fizzer.2024-12-18_09-05-25.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/fizzer.2024-12-18_09-05-25.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/fizzer.2024-12-18_09-05-25.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-error-call

Statistics

Fizzer 2024-12-18 09:05:25 CET fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety
TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-clang-formatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety
TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-clang-unformatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety
TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-gcc-formatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety
TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-gcc-unformatted-fizzer.Test-Comp25_coverage-error-call.SoftwareSystems-DeviceDriversLinux64-ReachSafety
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
2
0
1800
1700
4500
2
.0
17
21
220
2
.0
16
19
190
2
.0
18
22
220
2
.0
15
19
200

Generated by BenchExec 3.29