tracerx-wp.2024-12-20_13-14-13.results.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized.xml.bz2.fixed.xml.bz2 – BenchExec results

Benchmark Setup

Benchmark	TracerX-WP									TestCov
Tool	TracerX-WP 1.2.0									TestCov 3.11
Limits	timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4									timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Host	apollon*
OS	Linux 6.8.0-51-generic
System	CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution	2024-12-20 13:14:13 CET									2024-12-24 09:30:42 CET																				2024-12-24 09:30:43 CET										2024-12-24 09:30:42 CET
Run set	tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized									testcov-validate-test-suites-clang-formatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized										testcov-validate-test-suites-clang-unformatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized										testcov-validate-test-suites-gcc-formatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized										testcov-validate-test-suites-gcc-unformatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-Sequentialized
Options										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`
Properties	coverage-error-call

Statistics

all results

106

50

7700

7700

300000

106

5000

3400

4000

9600

106

5000

3400

3900

9100

106

5000

3100

3700

9100

106

5000

3100

3700

8700

correct results

10

10

60

60

13000

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

correct true

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

correct false

10

10

60

60

13000

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

incorrect results

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

incorrect true

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

incorrect false

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

Generated by BenchExec 3.29

BenchExec