tracerx.2024-12-20_08-13-36.results.Test-Comp25_coverage-error-call.ReachSafety-Recursive.xml.bz2.fixed.xml.bz2 – BenchExec results

Benchmark Setup

Benchmark	TracerX									TestCov
Tool	Tracer-X 1.2.0									TestCov 3.11
Limits	timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 4									timelimit: 600 s, memlimit: 7000 MB, CPU core limit: 2
Host	apollon*
OS	Linux 6.8.0-51-generic
System	CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3800 MHz, Turbo Boost: disabled; RAM: 33471 MB
Date of execution	2024-12-20 08:13:36 CET									2024-12-24 09:13:13 CET
Run set	tracerx.Test-Comp25_coverage-error-call.ReachSafety-Recursive									testcov-validate-test-suites-clang-formatted-tracerx.Test-Comp25_coverage-error-call.ReachSafety-Recursive										testcov-validate-test-suites-clang-unformatted-tracerx.Test-Comp25_coverage-error-call.ReachSafety-Recursive										testcov-validate-test-suites-gcc-formatted-tracerx.Test-Comp25_coverage-error-call.ReachSafety-Recursive										testcov-validate-test-suites-gcc-unformatted-tracerx.Test-Comp25_coverage-error-call.ReachSafety-Recursive
Options										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx.2024-12-20_08-13-36.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--compiler clang` `--cov-tool llvm-cov` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx.2024-12-20_08-13-36.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--format` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx.2024-12-20_08-13-36.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`										`--memlimit 6GB` `--timelimit-per-run 50` `--verbose` `--no-plots` `--prep-cgroup` `--disable-info-files` `--reduction BY_ORDER` `--reduction-output test-suite` `--test-suite ../../results-verified/tracerx.2024-12-20_08-13-36.files/${rundefinition_name}/${taskdef_name}/test-suite.zip`
Properties	coverage-error-call

Statistics

all results

21

11

620

620

16000

21

1100

730

900

1800

21

1000

740

910

1700

21

1100

710

890

1700

21

1000

710

880

1600

correct results

11

11

25

25

1100

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

correct true

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

correct false

11

11

25

25

1100

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

incorrect results

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

incorrect true

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

incorrect false

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

0

-

-

-

-

Generated by BenchExec 3.29

BenchExec