Task filter


WASP-C 2024-12-23 15:22:20 CET wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety

Add filter for:

TestCov 2024-12-24 13:18:39 CET testcov-validate-test-suites-clang-formatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety

Add filter for:

TestCov 2024-12-24 13:18:38 CET testcov-validate-test-suites-clang-unformatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety

Add filter for:

TestCov 2024-12-24 13:18:38 CET testcov-validate-test-suites-gcc-formatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety

Add filter for:

TestCov 2024-12-24 13:18:39 CET testcov-validate-test-suites-gcc-unformatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkWASP-CTestCov
ToolWASP-C TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-23 15:22:20 CET2024-12-24 13:18:39 CET2024-12-24 13:18:38 CET2024-12-24 13:18:39 CET
Run setwasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafetytestcov-validate-test-suites-clang-formatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafetytestcov-validate-test-suites-clang-unformatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafetytestcov-validate-test-suites-gcc-formatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafetytestcov-validate-test-suites-gcc-unformatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety
Options
  • --smt-assume
  • --policy breadth
  • --test-comp
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/wasp-c.2024-12-23_15-22-20.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/wasp-c.2024-12-23_15-22-20.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/wasp-c.2024-12-23_15-22-20.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/wasp-c.2024-12-23_15-22-20.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-branches

Statistics

WASP-C 2024-12-23 15:22:20 CET wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety
TestCov 2024-12-24 13:18:39 CET testcov-validate-test-suites-clang-formatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety
TestCov 2024-12-24 13:18:38 CET testcov-validate-test-suites-clang-unformatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety
TestCov 2024-12-24 13:18:38 CET testcov-validate-test-suites-gcc-formatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety
TestCov 2024-12-24 13:18:39 CET testcov-validate-test-suites-gcc-unformatted-wasp-c.Test-Comp25_coverage-branches.SoftwareSystems-OpenBSD-MemSafety
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
all results
5
0
58
58
450
5
2.2
2.2
360
5
.94
.99
110
5
2.2
2.2
360
5
.98
1.0
110

Generated by BenchExec 3.29