tracerx.2024-12-20_08-13-36.results.Test-Comp25_coverage-error-call.ReachSafety-ProductLines.xml.bz2.fixed.xml.bz2 – BenchExec results

Benchmark Setup

Benchmark	TracerX									TestCov
Tool	Tracer-X 1.2.0									TestCov 3.11
Limits	timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4									timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Host	apollon*
OS	Linux 6.8.0-51-generic
System	CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution	2024-12-20 08:13:36 CET									2024-12-24 09:13:13 CET
Run set	tracerx.Test-Comp25_coverage-error-call.ReachSafety-ProductLines									testcov-validate-test-suites-clang-formatted-tracerx.Test-Comp25_coverage-error-call.ReachSafety-ProductLines										testcov-validate-test-suites-clang-unformatted-tracerx.Test-Comp25_coverage-error-call.ReachSafety-ProductLines										testcov-validate-test-suites-gcc-formatted-tracerx.Test-Comp25_coverage-error-call.ReachSafety-ProductLines										testcov-validate-test-suites-gcc-unformatted-tracerx.Test-Comp25_coverage-error-call.ReachSafety-ProductLines
Options										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx.2024-12-20_08-13-36.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx.2024-12-20_08-13-36.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx.2024-12-20_08-13-36.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx.2024-12-20_08-13-36.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`
Properties	coverage-error-call

Statistics

all results

169

124

250

250

24000

169

76

78

7400

169

12400

1500

1700

12000

169

71

72

7200

169

12400

1400

1600

11000

correct results

124

124

240

240

24000

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

correct true

0

-

-

-

-

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

correct false

124

124

240

240

24000

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

incorrect results

0

-

-

-

-

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

incorrect true

0

-

-

-

-

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

incorrect false

0

-

-

-

-

0

-

-

-

0

-

-

-

-

0

-

-

-

0

-

-

-

-

Generated by BenchExec 3.29

BenchExec