tracerx-wp.2024-12-20_13-14-13.results.Test-Comp25_coverage-error-call.ReachSafety-ProductLines.xml.bz2.fixed.xml.bz2 – BenchExec results

Benchmark Setup

Benchmark	TracerX-WP									TestCov
Tool	TracerX-WP 1.2.0									TestCov 3.11
Limits	timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4									timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Host	apollon*
OS	Linux 6.8.0-51-generic
System	CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution	2024-12-20 13:14:13 CET									2024-12-24 09:30:42 CET																				2024-12-24 09:30:43 CET										2024-12-24 09:30:42 CET
Run set	tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ProductLines									testcov-validate-test-suites-clang-formatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ProductLines										testcov-validate-test-suites-clang-unformatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ProductLines										testcov-validate-test-suites-gcc-formatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ProductLines										testcov-validate-test-suites-gcc-unformatted-tracerx-wp.Test-Comp25_coverage-error-call.ReachSafety-ProductLines
Options										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx-wp.2024-12-20_13-14-13.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`
Properties	coverage-error-call

Statistics

all results

169

120

220

220

6400

169

77

78

7500

169

12000

2400

2700

12000

169

72

74

7200

169

12000

2200

2600

11000

correct results

120

120

220

220

5600

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

correct true

0

-

-

-

-

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

correct false

120

120

220

220

5600

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

incorrect results

0

-

-

-

-

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

incorrect true

0

-

-

-

-

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

incorrect false

0

-

-

-

-

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

Generated by BenchExec 3.29

BenchExec