tracerx-wp.2024-12-20_13-14-13.results.Test-Comp25_coverage-error-call.ReachSafety-ECA.xml.bz2.fixed.xml.bz2 – BenchExec results

Benchmark Setup

Benchmark	TracerX-WP									TestCov
Tool	TracerX-WP 1.2.0									TestCov 3.11
Limits	timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4									timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Host	apollon*
OS	Linux 6.8.0-51-generic
System	CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution	2024-12-20 13:14:13 CET									2024-12-24 09:30:42 CET																				2024-12-24 09:30:43 CET										2024-12-24 09:30:42 CET
Run set	tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ECA									testcov-validate-test-suites-clang-formatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ECA										testcov-validate-test-suites-clang-unformatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ECA										testcov-validate-test-suites-gcc-formatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ECA										testcov-validate-test-suites-gcc-unformatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ECA
Options										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`
Properties	coverage-error-call

Statistics

all results

18

2

9100

9100

86000

18

200

6200

6700

25000

18

200

4700

5100

11000

18

200

6300

6700

25000

18

200

4700

5100

11000

correct results

2

2

970

970

21000

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

correct true

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

correct false

2

2

970

970

21000

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

incorrect results

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

incorrect true

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

incorrect false

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

Generated by BenchExec 3.29

BenchExec