Task filter


ULTIMATE TestGen 2024-12-20 16:19:19 CET utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow

Add filter for:

TestCov 2024-12-24 10:05:48 CET testcov-validate-test-suites-clang-formatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow

Add filter for:

TestCov 2024-12-24 10:05:48 CET testcov-validate-test-suites-clang-unformatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow

Add filter for:

TestCov 2024-12-24 10:05:47 CET testcov-validate-test-suites-gcc-formatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow

Add filter for:

TestCov 2024-12-24 10:05:47 CET testcov-validate-test-suites-gcc-unformatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow

Add filter for:

Summary Table Quantile Plot Scatter Plot Info

Benchmark Setup

BenchmarkUTestGenTestCov
ToolULTIMATE TestGen 0.2.3-222e02f9TestCov 3.11
Limitstimelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Hostapollon*
OSLinux 6.8.0-51-generic
SystemCPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution2024-12-20 16:19:19 CET2024-12-24 10:05:48 CET2024-12-24 10:05:47 CET
Run setutestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlowtestcov-validate-test-suites-clang-formatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlowtestcov-validate-test-suites-clang-unformatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlowtestcov-validate-test-suites-gcc-formatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlowtestcov-validate-test-suites-gcc-unformatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow
Options
  • --traceabstraction.test.generation.mode Standard
  • --rcfgbuilder.reuse.mode.for.test.generation ReuseUNSATmatchPrefix
  • --full-output
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/utestgen.2024-12-20_16-19-19.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --compiler clang
  • --cov-tool llvm-cov
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/utestgen.2024-12-20_16-19-19.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --format
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/utestgen.2024-12-20_16-19-19.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
  • --memlimit 6GB
  • --timelimit-per-run 50
  • --verbose
  • --no-plots
  • --prep-cgroup
  • --disable-info-files
  • --reduction BY_ORDER
  • --reduction-output test-suite
  • --test-suite ../../results-verified/utestgen.2024-12-20_16-19-19.files/${rundefinition_name}/${taskdef_name}/test-suite.zip
Propertiescoverage-error-call

Statistics

ULTIMATE TestGen 2024-12-20 16:19:19 CET utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow
TestCov 2024-12-24 10:05:48 CET testcov-validate-test-suites-clang-formatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow
TestCov 2024-12-24 10:05:48 CET testcov-validate-test-suites-clang-unformatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow
TestCov 2024-12-24 10:05:47 CET testcov-validate-test-suites-gcc-formatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow
TestCov 2024-12-24 10:05:47 CET testcov-validate-test-suites-gcc-unformatted-utestgen.Test-Comp25_coverage-error-call.ReachSafety-ControlFlow
Click here to select columns
 
status
score
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
 
status
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
 
status
cov
(%)
cpu
(s)
wall
(s)
mem
(MB)
all results
5
2
3500
3000
6300
5
5.7
5.7
310
5
4.9
4.9
250
5
200
11
12
420
5
200
11
12
410

Generated by BenchExec 3.29