Task filter


Fizzer 2024-12-18 09:05:25 CET fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety

Add filter for:

TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-clang-formatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety

Add filter for:

TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-clang-unformatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety

Add filter for:

TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-gcc-formatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety

Add filter for:

TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-gcc-unformatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkFizzerTestCov
ToolFizzer 0.1TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-18 09:05:25 CET2024-12-24 04:37:51 CET
Run setfizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafetytestcov-validate-test-suites-clang-formatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafetytestcov-validate-test-suites-clang-unformatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafetytestcov-validate-test-suites-gcc-formatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafetytestcov-validate-test-suites-gcc-unformatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety
Options
  • --max_seconds 865
  • --optimizer_max_seconds 30
  • --max_exec_milliseconds 500
  • --max_exec_megabytes 13312
  • --max_stdin_bytes 65536
  • --max_trace_length 10000
  • --max_stack_size 25
  • --stdin_model stdin_replay_bytes_then_repeat_zero
  • --test_type testcomp
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/fizzer.2024-12-18_09-05-25.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/fizzer.2024-12-18_09-05-25.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/fizzer.2024-12-18_09-05-25.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/fizzer.2024-12-18_09-05-25.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-branches

Statistics

Fizzer 2024-12-18 09:05:25 CET fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety
TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-clang-formatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety
TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-clang-unformatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety
TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-gcc-formatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety
TestCov 2024-12-24 04:37:51 CET testcov-validate-test-suites-gcc-unformatted-fizzer.Test-Comp25_coverage-branches.SoftwareSystems-BusyBox-MemSafety
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
75
23.5
65000
63000
310000
75
2340
1700
1800
16000
75
2340
1700
1800
15000
75
2180
1600
1700
16000
75
2180
1700
1700
16000

Generated by BenchExec 3.29