Benchmark Symbiotic TBF Test-Suite Validator
Tool symbiotic 6.0.3-dev-fd3f777b Tbf Test-suite Validator v1.2
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8 timelimit: 10800 s, memlimit: 7000 MB, CPU core limit: 2
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-06 07:07:32 CET 2019-02-06 14:52:39 CET
Run set symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-ECA tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-ECA
Options --test-comp --verifier klee-testcomp --verbose --sequence-file cov-seq.txt -r --stop-after-found-violation --test-suite ../../results-verified/symbiotic.2019-02-06_0707.logfiles/${rundefinition_name}.${inputfile_name}.files/test-suite.zip
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
eca-rers2012/Problem03_label09.yml done 1 prog tests 1 inspect 30   30   190 450 0      0      true prog tests 1 inspect
21.3  12.3  .46  .46  58   1.3  0  
eca-rers2012/Problem03_label13.yml done 1 prog tests 1 inspect 29   29   100 410 0      0      true prog tests 1 inspect
20.2  12.5  .44  .44  58   1.3  0  
eca-rers2012/Problem03_label26.yml done 1 prog tests 1 inspect 29   29   85 420 0      0      true prog tests 1 inspect
16.8  12.1  .46  .46  58   1.3  0  
eca-rers2012/Problem03_label27.yml done 1 prog tests 1 inspect 29   29   120 420 0      0      true prog tests 1 inspect
19.2  12.3  .45  .45  57   1.3  0  
eca-rers2012/Problem03_label28.yml done 1 prog tests 1 inspect 30   30   170 390 0      0      true prog tests 1 inspect
18.5  12.3  .44  .45  58   1.4  0  
eca-rers2012/Problem03_label31.yml done 1 prog tests 1 inspect 30   30   160 380 0      0      true prog tests 1 inspect
20.0  12.1  .43  .44  57   1.3  0  
eca-rers2012/Problem03_label35.yml done 1 prog tests 1 inspect 31   31   290 380 0      0      true prog tests 1 inspect
22.1  12.1  .49  .51  57   1.3  0  
eca-rers2012/Problem03_label37.yml done 1 prog tests 1 inspect 28   28   84 300 0      0      true prog tests 1 inspect
16.1  11.9  .45  .49  58   1.3  0  
eca-rers2012/Problem03_label39.yml done 1 prog tests 1 inspect 31   31   250 400 0      0      true prog tests 1 inspect
21.2  12.3  .46  .46  57   1.3  0  
eca-rers2012/Problem03_label43.yml done 1 prog tests 1 inspect 29   29   84 380 0      0      true prog tests 1 inspect
15.8  12.2  .45  .45  57   1.3  0  
eca-rers2012/Problem03_label45.yml done 1 prog tests 1 inspect 30   30   230 400 0      0      true prog tests 1 inspect
22.5  12.1  .48  .50  57   1.3  0  
eca-rers2012/Problem03_label50.yml done 1 prog tests 1 inspect 30   30   150 420 0      0      true prog tests 1 inspect
20.4  12.3  .45  .48  57   1.3  0  
eca-rers2012/Problem03_label52.yml done 1 prog tests 1 inspect 31   31   290 390 0      0      true prog tests 1 inspect
21.5  12.1  .45  .48  57   1.4  0  
eca-rers2012/Problem04_label04.yml done 1 prog tests 1 inspect 410   410   9300 3500 0      0      true prog tests 1 inspect
31.2  18.0  1.1   1.1   110   2.2  0  
eca-rers2012/Problem04_label06.yml done 1 prog tests 1 inspect 480   480   11000 3300 0      0      true prog tests 1 inspect
32.6  18.0  1.1   1.1   110   5.2  0  
eca-rers2012/Problem04_label09.yml done 1 prog tests 1 inspect 250   250   5600 2800 0      0      true prog tests 1 inspect
31.2  18.0  1.1   1.1   110   5.5  0  
eca-rers2012/Problem04_label13.yml done 1 prog tests 1 inspect 320   320   7000 2600 0      0      true prog tests 1 inspect
31.0  18.2  1.1   1.2   110   4.8  0  
eca-rers2012/Problem04_label15.yml done 1 prog tests 1 inspect 280   280   6400 3600 0      0      true prog tests 1 inspect
31.6  18.3  1.1   1.1   110   5.7  0  
eca-rers2012/Problem04_label18.yml done 1 prog tests 1 inspect 330   330   7400 3700 0      0      true prog tests 1 inspect
31.6  18.1  1.1   1.1   110   .86 0  
eca-rers2012/Problem04_label19.yml done 1 prog tests 1 inspect 860   860   15000 5600 0      7300      true prog tests 1 inspect
32.6  17.9  1.1   1.1   110   4.6  0  
eca-rers2012/Problem04_label26.yml done 1 prog tests 1 inspect 340   340   7500 3300 0      0      true prog tests 1 inspect
31.4  18.0  1.1   1.1   110   4.6  0  
eca-rers2012/Problem04_label31.yml done 1 prog tests 1 inspect 440   440   9800 3400 0      0      true prog tests 1 inspect
31.3  17.9  1.1   1.1   110   4.8  0  
eca-rers2012/Problem04_label32.yml done 1 prog tests 1 inspect 290   290   6400 3400 0      0      true prog tests 1 inspect
31.4  18.0  1.1   1.1   110   4.6  0  
eca-rers2012/Problem04_label35.yml done 1 prog tests 1 inspect 270   270   5700 2500 0      0      true prog tests 1 inspect
31.5  18.1  1.2   1.2   110   4.6  0  
eca-rers2012/Problem04_label38.yml done 1 prog tests 1 inspect 360   360   8100 3300 0      0      true prog tests 1 inspect
31.7  18.0  1.0   1.1   110   5.5  0  
eca-rers2012/Problem04_label39.yml done 1 prog tests 1 inspect 420   420   9700 3200 0      0      true prog tests 1 inspect
32.3  17.9  1.0   1.1   110   4.6  0  
eca-rers2012/Problem04_label45.yml done 1 prog tests 1 inspect 300   300   6900 3800 0      0      true prog tests 1 inspect
31.1  18.0  1.0   1.0   110   4.6  0  
eca-rers2012/Problem04_label52.yml done 1 prog tests 1 inspect 450   450   10000 3700 0      0      true prog tests 1 inspect
32.7  18.0  1.1   1.1   110   4.9  0  
eca-rers2012/Problem04_label55.yml done 1 prog tests 1 inspect 390   390   8600 2800 0      0      true prog tests 1 inspect
30.5  18.1  1.1   1.1   110   4.6  0  
eca-rers2012/Problem05_label00.yml timeout (verification) prog tests 0 inspect 900   900   15000 6300 .041  .0041 error (0) prog tests 0 inspect
0    0    .059 .059 9.0 0    0  
eca-rers2012/Problem05_label01.yml timeout (verification) prog tests 0 inspect 900   900   15000 6500 .033  .0082 error (0) prog tests 0 inspect
0    0    .057 .058 8.9 0    0  
eca-rers2012/Problem05_label11.yml done 1 prog tests 1 inspect 630   630   14000 4800 0      0      true prog tests 1 inspect
20.4  16.0  2.1   2.1   180   10    0  
eca-rers2012/Problem05_label13.yml timeout (verification) prog tests 0 inspect 900   900   15000 7100 .029  .0082 error (0) prog tests 0 inspect
0    0    .061 .062 9.0 0    0  
eca-rers2012/Problem05_label15.yml done 1 prog tests 1 inspect 730   730   15000 6400 0      4500      true prog tests 1 inspect
20.7  16.0  2.1   2.1   180   11    0  
eca-rers2012/Problem05_label18.yml timeout (verification) prog tests 0 inspect 900   900   15000 5900 .041  .0082 error (0) prog tests 0 inspect
0    0    .059 .060 8.8 0    0  
eca-rers2012/Problem05_label24.yml timeout (verification) prog tests 0 inspect 900   900   15000 6300 .037  .0041 error (0) prog tests 0 inspect
0    0    .056 .057 8.9 0    0  
eca-rers2012/Problem05_label26.yml done 1 prog tests 1 inspect 890   890   15000 8200 0      7300      true prog tests 1 inspect
21.1  16.0  2.1   2.1   180   11    0  
eca-rers2012/Problem05_label30.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 900   900   15000 6800 .020  .0041 error (0) prog tests 0 inspect
0    0    .059 .059 9.0 0    0  
eca-rers2012/Problem05_label32.yml timeout (verification) prog tests 0 inspect 900   900   15000 6400 .020  .0041 error (0) prog tests 0 inspect
0    0    .057 .058 8.9 0    0  
eca-rers2012/Problem05_label33.yml timeout (verification) prog tests 0 inspect 900   900   15000 5900 .033  .0041 error (0) prog tests 0 inspect
0    0    .059 .060 9.0 0    0  
eca-rers2012/Problem05_label36.yml timeout (verification) prog tests 0 inspect 900   900   15000 4800 .033  .0041 error (0) prog tests 0 inspect
0    0    .058 .058 8.9 0    0  
eca-rers2012/Problem05_label37.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 900   900   15000 6400 .020  .012  error (0) prog tests 0 inspect
0    0    .059 .060 8.9 0    0  
eca-rers2012/Problem05_label38.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 880   880   15000 7000 .029  .0082 error (0) prog tests 0 inspect
0    0    .064 .065 8.9 0    0  
eca-rers2012/Problem05_label39.yml timeout (verification) prog tests 0 inspect 900   900   15000 6300 .025  .0082 error (0) prog tests 0 inspect
0    0    .063 .064 8.9 0    0  
eca-rers2012/Problem05_label40.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 900   900   15000 6300 .025  .0082 error (0) prog tests 0 inspect
0    0    .059 .060 8.9 0    0  
eca-rers2012/Problem05_label41.yml timeout (verification) prog tests 0 inspect 900   900   15000 6300 .025  .0082 error (0) prog tests 0 inspect
0    0    .088 .090 8.9 0    0  
eca-rers2012/Problem05_label44.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 890   890   15000 6700 .037  .012  error (0) prog tests 0 inspect
0    0    .060 .061 9.0 0    0  
eca-rers2012/Problem05_label47.yml timeout (verification) prog tests 0 inspect 900   900   15000 5900 .029  .0041 error (0) prog tests 0 inspect
0    0    .056 .057 8.9 0    0  
eca-rers2012/Problem05_label48.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 880   880   15000 8700 .029  .0041 error (0) prog tests 0 inspect
0    0    .080 .081 9.0 0    0  
eca-rers2012/Problem05_label51.yml timeout (verification-finished) prog tests 0 inspect 900   900   15000 6900 .053  6800      error (0) prog tests 0 inspect
0    0    .064 .064 9.0 0    0  
eca-rers2012/Problem05_label55.yml timeout (verification) prog tests 0 inspect 900   900   15000 5900 .029  .0041 error (0) prog tests 0 inspect
0    0    .071 .071 9.0 0    0  
eca-rers2012/Problem05_label57.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 890   890   15000 7500 .033  .012  error (0) prog tests 0 inspect
0    0    .083 .084 9.0 0    0  
eca-rers2012/Problem05_label58.yml timeout (verification) prog tests 0 inspect 900   900   15000 6800 .037  .0041 error (0) prog tests 0 inspect
0    0    .061 .062 9.0 0    0  
eca-rers2012/Problem06_label00.yml done 1 prog tests 1 inspect 190   190   2400 2600 0      0      true prog tests 1 inspect
15.9  10.7  1.9   1.9   180   8.8  0  
eca-rers2012/Problem06_label01.yml done 1 prog tests 1 inspect 320   320   7100 3500 0      0      true prog tests 1 inspect
18.1  10.7  1.9   1.9   180   3.3  0  
eca-rers2012/Problem06_label02.yml done 1 prog tests 1 inspect 270   270   5600 2800 0      0      true prog tests 1 inspect
16.7  10.8  2.0   2.0   180   8.9  0  
eca-rers2012/Problem06_label04.yml done 1 prog tests 1 inspect 160   160   780 1900 0      0      true prog tests 1 inspect
16.5  10.8  2.0   2.0   180   8.5  0  
eca-rers2012/Problem06_label05.yml done 1 prog tests 1 inspect 250   250   5100 3400 0      0      true prog tests 1 inspect
16.7  10.9  2.0   2.0   180   2.5  0  
eca-rers2012/Problem06_label09.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 610   610   15000 4500 .033  .0041 error (0) prog tests 0 inspect
0    0    .072 .072 8.9 0    0  
eca-rers2012/Problem06_label10.yml done 1 prog tests 1 inspect 290   290   6400 3800 0      0      true prog tests 1 inspect
14.9  10.9  2.0   2.0   180   9.9  0  
eca-rers2012/Problem06_label11.yml done 1 prog tests 1 inspect 330   330   7700 3800 0      0      true prog tests 1 inspect
15.5  10.7  1.9   1.9   180   9.6  0  
eca-rers2012/Problem06_label12.yml done 1 prog tests 1 inspect 310   310   7000 3200 0      0      true prog tests 1 inspect
16.1  10.7  1.9   1.9   180   8.5  0  
eca-rers2012/Problem06_label15.yml done 1 prog tests 1 inspect 200   200   2700 2400 0      0      true prog tests 1 inspect
16.7  10.9  1.9   1.9   180   8.5  0  
eca-rers2012/Problem06_label20.yml done 1 prog tests 1 inspect 160   160   960 2400 0      0      true prog tests 1 inspect
14.5  10.9  1.9   1.9   180   9.1  0  
eca-rers2012/Problem06_label21.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 600   600   15000 5400 .029  .0041 error (0) prog tests 0 inspect
0    0    .060 .060 8.9 0    0  
eca-rers2012/Problem06_label24.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 610   610   15000 3400 .029  0      error (0) prog tests 0 inspect
0    0    .058 .059 9.0 0    0  
eca-rers2012/Problem06_label27.yml done 1 prog tests 1 inspect 170   170   1500 2600 0      0      true prog tests 1 inspect
15.0  10.9  1.9   1.9   180   11    0  
eca-rers2012/Problem06_label29.yml out of memory (killed (signal 9, verification)) prog tests 0 inspect 600   600   15000 4600 .029  .0041 error (0) prog tests 0 inspect
0    0    .060 .061 9.0 0    0  
eca-rers2012/Problem06_label33.yml done 1 prog tests 1 inspect 530   530   14000 5400 0      0      true prog tests 1 inspect
12.8  10.9  1.9   1.9   180   10    0  
eca-rers2012/Problem06_label36.yml done 1 prog tests 1 inspect 210   210   3300 2400 0      0      true prog tests 1 inspect
14.1  10.7  2.0   2.0   180   10    0  
eca-rers2012/Problem06_label37.yml done 1 prog tests 1 inspect 260   260   5200 3200 0      0      true prog tests 1 inspect
14.7  10.8  1.9   1.9   180   10    0  
eca-rers2012/Problem06_label38.yml done 1 prog tests 1 inspect 190   190   2500 2600 0      0      true prog tests 1 inspect
14.4  10.8  2.0   2.0   180   9.8  0  
eca-rers2012/Problem06_label44.yml done 1 prog tests 1 inspect 580   580   15000 5400 0      3000      true prog tests 1 inspect
17.2  10.7  1.9   1.9   180   9.0  0  
eca-rers2012/Problem06_label47.yml done 1 prog tests 1 inspect 220   220   3700 2600 0      0      true prog tests 1 inspect
13.5  11.0  1.9   1.9   180   12    0  
eca-rers2012/Problem06_label48.yml done 1 prog tests 1 inspect 180   180   2200 2100 0      0      true prog tests 1 inspect
18.2  10.8  1.8   1.8   180   8.5  0  
eca-rers2012/Problem06_label56.yml done 1 prog tests 1 inspect 360   360   8700 3500 0      0      true prog tests 1 inspect
13.1  11.0  2.0   2.0   180   8.5  0  
eca-rers2012/Problem06_label58.yml done 1 prog tests 1 inspect 400   400   11000 3600 0      0      true prog tests 1 inspect
18.2  10.9  1.8   1.8   180   8.5  0  
eca-rers2012/Problem06_label59.yml done 1 prog tests 1 inspect 150   150   450 2500 0      0      true prog tests 1 inspect
17.2  10.8  1.9   1.9   180   10    0  
eca-rers2012/Problem07_label03.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6100 0      0      error (0) prog tests 0 inspect
0    0    .060 .061 8.9 0    0  
eca-rers2012/Problem07_label05.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 4900 0      0      error (0) prog tests 0 inspect
0    0    .056 .056 9.0 0    0  
eca-rers2012/Problem07_label06.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5300 0      0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-rers2012/Problem07_label07.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 6900 0      0      error (0) prog tests 0 inspect
0    0    .058 .059 9.0 0    0  
eca-rers2012/Problem07_label09.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 6000 0      0      error (0) prog tests 0 inspect
0    0    .063 .064 8.9 0    0  
eca-rers2012/Problem07_label11.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5100 0      0      error (0) prog tests 0 inspect
0    0    .062 .063 8.9 0    0  
eca-rers2012/Problem07_label15.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 5600 0      0      error (0) prog tests 0 inspect
0    0    .062 .063 9.0 0    0  
eca-rers2012/Problem07_label18.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6300 0      0      error (0) prog tests 0 inspect
0    0    .059 .059 8.9 0    0  
eca-rers2012/Problem07_label19.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 5400 0      0      error (0) prog tests 0 inspect
0    0    .056 .057 8.9 0    0  
eca-rers2012/Problem07_label20.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 6300 0      0      error (0) prog tests 0 inspect
0    0    .057 .058 9.0 0    0  
eca-rers2012/Problem07_label23.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6700 0      0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-rers2012/Problem07_label30.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6300 0      0      error (0) prog tests 0 inspect
0    0    .056 .058 8.9 0    0  
eca-rers2012/Problem07_label31.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5800 0      0      error (0) prog tests 0 inspect
0    0    .062 .11  9.0 0    0  
eca-rers2012/Problem07_label35.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 5800 0      0      error (0) prog tests 0 inspect
0    0    .057 .058 8.9 0    0  
eca-rers2012/Problem07_label36.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 4400 0      0      error (0) prog tests 0 inspect
0    0    .060 .061 8.9 0    0  
eca-rers2012/Problem07_label37.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 5600 0      0      error (0) prog tests 0 inspect
0    0    .060 .060 8.9 0    0  
eca-rers2012/Problem07_label39.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 5200 0      0      error (0) prog tests 0 inspect
0    0    .056 .057 8.9 0    0  
eca-rers2012/Problem07_label40.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5700 0      0      error (0) prog tests 0 inspect
0    0    .061 .061 9.0 0    0  
eca-rers2012/Problem07_label42.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5500 0      0      error (0) prog tests 0 inspect
0    0    .057 .058 9.0 0    0  
eca-rers2012/Problem07_label44.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5700 0      0      error (0) prog tests 0 inspect
0    0    .061 .062 9.0 0    0  
eca-rers2012/Problem07_label46.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6500 0      0      error (0) prog tests 0 inspect
0    0    .057 .059 8.9 0    0  
eca-rers2012/Problem07_label47.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5600 0      0      error (0) prog tests 0 inspect
0    0    .059 .085 9.0 0    0  
eca-rers2012/Problem07_label48.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5500 0      0      error (0) prog tests 0 inspect
0    0    .056 .056 9.0 0    0  
eca-rers2012/Problem07_label58.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5500 0      0      error (0) prog tests 0 inspect
0    0    .060 .061 8.9 0    0  
eca-rers2012/Problem08_label01.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .041  0      error (0) prog tests 0 inspect
0    0    .064 .065 9.0 0    0  
eca-rers2012/Problem08_label02.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .045  0      error (0) prog tests 0 inspect
0    0    .058 .059 9.0 0    0  
eca-rers2012/Problem08_label04.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .037  0      error (0) prog tests 0 inspect
0    0    .063 .063 8.8 0    0  
eca-rers2012/Problem08_label05.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .045  0      error (0) prog tests 0 inspect
0    0    .058 .064 8.9 0    0  
eca-rers2012/Problem08_label06.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .045  0      error (0) prog tests 0 inspect
0    0    .086 .087 9.0 0    0  
eca-rers2012/Problem08_label07.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .045  0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-rers2012/Problem08_label10.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .041  0      error (0) prog tests 0 inspect
0    0    .062 .063 8.9 0    0  
eca-rers2012/Problem08_label13.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .037  0      error (0) prog tests 0 inspect
0    0    .058 .058 9.0 0    0  
eca-rers2012/Problem08_label15.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .041  0      error (0) prog tests 0 inspect
0    0    .060 .061 9.0 0    0  
eca-rers2012/Problem08_label24.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .045  0      error (0) prog tests 0 inspect
0    0    .088 .089 8.9 0    0  
eca-rers2012/Problem08_label25.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .045  0      error (0) prog tests 0 inspect
0    0    .060 .061 8.9 0    0  
eca-rers2012/Problem08_label26.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .041  0      error (0) prog tests 0 inspect
0    0    .062 .090 9.0 0    0  
eca-rers2012/Problem08_label28.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .041  0      error (0) prog tests 0 inspect
0    0    .069 .070 9.0 0    0  
eca-rers2012/Problem08_label29.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .037  0      error (0) prog tests 0 inspect
0    0    .059 .059 9.0 0    0  
eca-rers2012/Problem08_label34.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .045  0      error (0) prog tests 0 inspect
0    0    .056 .066 8.8 0    0  
eca-rers2012/Problem08_label37.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .045  0      error (0) prog tests 0 inspect
0    0    .058 .058 8.8 0    0  
eca-rers2012/Problem08_label43.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .045  0      error (0) prog tests 0 inspect
0    0    .062 .062 9.0 0    0  
eca-rers2012/Problem08_label46.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .045  0      error (0) prog tests 0 inspect
0    0    .067 .068 9.0 0    0  
eca-rers2012/Problem08_label48.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .041  0      error (0) prog tests 0 inspect
0    0    .087 .088 9.0 0    0  
eca-rers2012/Problem08_label49.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .037  0      error (0) prog tests 0 inspect
0    0    .058 .061 8.9 0    0  
eca-rers2012/Problem08_label50.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .045  0      error (0) prog tests 0 inspect
0    0    .059 .060 8.9 0    0  
eca-rers2012/Problem08_label51.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .045  0      error (0) prog tests 0 inspect
0    0    .056 .057 8.9 0    0  
eca-rers2012/Problem08_label55.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .045  0      error (0) prog tests 0 inspect
0    0    .070 .071 9.0 0    0  
eca-rers2012/Problem08_label59.yml timeout (before-instr) prog tests 0 inspect 900   900   610 10000 .045  0      error (0) prog tests 0 inspect
0    0    .057 .058 8.9 0    0  
eca-rers2012/Problem09_label02.yml timeout (before-instr) prog tests 0 inspect 900   900   650 13000 .012  0      error (0) prog tests 0 inspect
0    0    .057 .058 9.0 0    0  
eca-rers2012/Problem09_label03.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .061 .062 9.0 0    0  
eca-rers2012/Problem09_label06.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .059 .060 9.0 0    0  
eca-rers2012/Problem09_label08.yml timeout (before-instr) prog tests 0 inspect 900   900   650 10000 .012  0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-rers2012/Problem09_label10.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .075 .076 9.0 0    0  
eca-rers2012/Problem09_label11.yml timeout (before-instr) prog tests 0 inspect 900   900   650 13000 .012  0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-rers2012/Problem09_label15.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .059 .061 8.9 0    0  
eca-rers2012/Problem09_label19.yml timeout (before-instr) prog tests 0 inspect 900   900   650 11000 .012  0      error (0) prog tests 0 inspect
0    0    .058 .059 9.0 0    0  
eca-rers2012/Problem09_label20.yml timeout (before-instr) prog tests 0 inspect 900   900   650 13000 .012  0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-rers2012/Problem09_label32.yml timeout (before-instr) prog tests 0 inspect 900   900   650 9400 .012  0      error (0) prog tests 0 inspect
0    0    .058 .058 8.9 0    0  
eca-rers2012/Problem09_label34.yml timeout (before-instr) prog tests 0 inspect 900   900   650 14000 .012  0      error (0) prog tests 0 inspect
0    0    .061 .075 8.9 0    0  
eca-rers2012/Problem09_label35.yml timeout (before-instr) prog tests 0 inspect 900   900   650 11000 .012  0      error (0) prog tests 0 inspect
0    0    .092 .093 9.0 0    0  
eca-rers2012/Problem09_label36.yml timeout (before-instr) prog tests 0 inspect 900   900   650 11000 .012  0      error (0) prog tests 0 inspect
0    0    .058 .059 8.9 0    0  
eca-rers2012/Problem09_label38.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .060 .061 9.0 0    0  
eca-rers2012/Problem09_label41.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .056 .057 8.8 0    0  
eca-rers2012/Problem09_label44.yml timeout (before-instr) prog tests 0 inspect 900   900   650 13000 .012  0      error (0) prog tests 0 inspect
0    0    .070 .072 9.0 0    0  
eca-rers2012/Problem09_label46.yml timeout (before-instr) prog tests 0 inspect 900   900   650 14000 .012  0      error (0) prog tests 0 inspect
0    0    .058 .058 9.0 0    0  
eca-rers2012/Problem09_label47.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .086 .087 9.0 0    0  
eca-rers2012/Problem09_label51.yml timeout (before-instr) prog tests 0 inspect 900   900   650 13000 .012  0      error (0) prog tests 0 inspect
0    0    .058 .067 8.9 0    0  
eca-rers2012/Problem09_label53.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .057 .058 9.0 0    0  
eca-rers2012/Problem09_label54.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .059 .059 8.9 0    0  
eca-rers2012/Problem09_label56.yml timeout (before-instr) prog tests 0 inspect 900   900   650 11000 .0041 0      error (0) prog tests 0 inspect
0    0    .057 .058 8.8 0    0  
eca-rers2012/Problem09_label57.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .058 .059 9.0 0    0  
eca-rers2012/Problem09_label59.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .057 .069 8.9 0    0  
eca-rers2012/Problem10_label12.yml done 1 prog tests 1 inspect 5.4 5.4 27 74 0      0      true prog tests 1 inspect
23.4  33.6  .22  .22  30   .48 0  
eca-rers2012/Problem10_label15.yml done 1 prog tests 1 inspect 5.6 5.6 34 71 0      0      true prog tests 1 inspect
22.7  31.7  .23  .27  30   .14 0  
eca-rers2012/Problem10_label24.yml done 1 prog tests 1 inspect 5.5 5.5 33 78 0      0      true prog tests 1 inspect
26.4  34.5  .22  .22  30   .48 0  
eca-rers2012/Problem10_label26.yml done 1 prog tests 1 inspect 5.8 5.8 42 88 0      0      true prog tests 1 inspect
24.3  34.7  .22  .22  30   .48 0  
eca-rers2012/Problem10_label28.yml done 1 prog tests 1 inspect 5.6 5.6 33 74 0      0      true prog tests 1 inspect
22.8  30.5  .25  .25  30   .48 0  
eca-rers2012/Problem10_label29.yml done 1 prog tests 1 inspect 5.4 5.4 28 69 0      0      true prog tests 1 inspect
22.3  33.6  .22  .22  30   .48 0  
eca-rers2012/Problem10_label41.yml done 1 prog tests 1 inspect 5.3 5.3 24 65 0      0      true prog tests 1 inspect
20.2  32.9  .22  .23  30   .48 0  
eca-rers2012/Problem10_label42.yml done 1 prog tests 1 inspect 5.2 5.2 22 74 0      0      true prog tests 1 inspect
14.9  28.0  .23  .23  30   .48 0  
eca-rers2012/Problem10_label46.yml done 1 prog tests 1 inspect 5.0 5.0 21 72 0      0      true prog tests 1 inspect
7.95 19.6  .22  .22  30   .48 0  
eca-rers2012/Problem10_label47.yml done 1 prog tests 1 inspect 5.4 5.4 29 67 0      0      true prog tests 1 inspect
25.3  33.8  .23  .25  30   .48 0  
eca-rers2012/Problem10_label48.yml done 1 prog tests 1 inspect 5.5 5.5 30 70 0      0      true prog tests 1 inspect
24.4  34.5  .22  .23  30   .48 0  
eca-rers2012/Problem10_label50.yml done 1 prog tests 1 inspect 5.6 5.6 35 66 0      0      true prog tests 1 inspect
25.4  35.4  .23  .24  30   .48 0  
eca-rers2012/Problem10_label55.yml done 1 prog tests 1 inspect 5.4 5.4 28 75 0      0      true prog tests 1 inspect
25.6  34.7  .22  .22  30   .48 0  
eca-rers2012/Problem10_label57.yml done 1 prog tests 1 inspect 5.4 5.4 29 69 0      0      true prog tests 1 inspect
22.5  31.9  .23  .25  30   .48 0  
eca-rers2012/Problem10_label58.yml done 1 prog tests 1 inspect 5.6 5.6 33 77 0      0      true prog tests 1 inspect
26.3  34.0  .22  .22  30   .48 0  
eca-rers2012/Problem11_label00.yml done 1 prog tests 1 inspect 12   12   54 150 0      0      true prog tests 1 inspect
17.6  23.1  .34  .34  44   .81 0  
eca-rers2012/Problem11_label08.yml done 1 prog tests 1 inspect 11   11   31 170 0      0      true prog tests 1 inspect
16.1  19.1  .33  .33  44   .81 0  
eca-rers2012/Problem11_label14.yml done 1 prog tests 1 inspect 11   11   26 180 0      0      true prog tests 1 inspect
16.1  19.6  .32  .33  44   .81 0  
eca-rers2012/Problem11_label15.yml done 1 prog tests 1 inspect 11   11   28 140 0      0      true prog tests 1 inspect
12.9  17.9  .32  .32  44   .81 0  
eca-rers2012/Problem11_label20.yml done 1 prog tests 1 inspect 12   11   48 180 0      0      true prog tests 1 inspect
18.5  22.1  .33  .33  44   .81 0  
eca-rers2012/Problem11_label29.yml done 1 prog tests 1 inspect 11   11   38 150 0      0      true prog tests 1 inspect
15.8  23.5  .34  .35  44   .81 0  
eca-rers2012/Problem11_label31.yml done 1 prog tests 1 inspect 11   11   44 140 0      0      true prog tests 1 inspect
17.3  23.1  .33  .34  44   .81 0  
eca-rers2012/Problem11_label34.yml done 1 prog tests 1 inspect 11   11   43 160 0      0      true prog tests 1 inspect
17.0  23.1  .35  .35  44   .81 0  
eca-rers2012/Problem11_label36.yml done 1 prog tests 1 inspect 11   11   26 160 0      0      true prog tests 1 inspect
10.6  15.8  .33  .33  44   .81 0  
eca-rers2012/Problem11_label39.yml done 1 prog tests 1 inspect 12   12   93 160 0      0      true prog tests 1 inspect
18.4  21.1  .33  .34  44   .81 0  
eca-rers2012/Problem11_label42.yml done 1 prog tests 1 inspect 11   11   29 140 0      0      true prog tests 1 inspect
17.9  22.2  .33  .33  44   .81 0  
eca-rers2012/Problem11_label43.yml done 1 prog tests 1 inspect 11   11   25 170 0      0      true prog tests 1 inspect
12.7  17.6  .32  .32  44   .81 0  
eca-rers2012/Problem11_label49.yml done 1 prog tests 1 inspect 11   11   26 160 0      0      true prog tests 1 inspect
12.7  22.7  .33  .33  44   .81 0  
eca-rers2012/Problem11_label51.yml done 1 prog tests 1 inspect 11   11   32 150 0      0      true prog tests 1 inspect
17.9  24.6  .35  .35  44   .81 0  
eca-rers2012/Problem11_label58.yml done 1 prog tests 1 inspect 11   11   31 130 0      0      true prog tests 1 inspect
13.5  17.1  .33  .38  44   .22 0  
eca-rers2012/Problem12_label00.yml done 1 prog tests 1 inspect 45   45   70 570 0      0      true prog tests 1 inspect
18.1  16.8  1.1   1.1   99   1.5  0  
eca-rers2012/Problem12_label03.yml done 1 prog tests 1 inspect 90   90   2400 1000 0      0      true prog tests 1 inspect
18.7  18.5  1.0   1.0   99   1.5  0  
eca-rers2012/Problem12_label06.yml done 1 prog tests 1 inspect 46   46   120 560 0      0      true prog tests 1 inspect
20.9  18.1  .99  .99  99   3.9  0  
eca-rers2012/Problem12_label07.yml done 1 prog tests 1 inspect 48   48   200 630 0      0      true prog tests 1 inspect
12.7  13.5  1.0   1.0   99   4.4  0  
eca-rers2012/Problem12_label08.yml done 1 prog tests 1 inspect 46   46   100 690 0      0      true prog tests 1 inspect
12.1  18.6  1.0   1.0   99   3.9  0  
eca-rers2012/Problem12_label10.yml done 1 prog tests 1 inspect 52   52   470 750 0      0      true prog tests 1 inspect
12.8  14.7  1.0   1.0   99   3.9  0  
eca-rers2012/Problem12_label13.yml done 1 prog tests 1 inspect 55   55   720 670 0      0      true prog tests 1 inspect
17.2  18.6  1.0   1.0   99   3.9  0  
eca-rers2012/Problem12_label19.yml done 1 prog tests 1 inspect 45   45   70 630 0      0      true prog tests 1 inspect
15.0  16.8  1.0   1.0   99   3.9  0  
eca-rers2012/Problem12_label20.yml done 1 prog tests 1 inspect 390   390   14000 3700 0      0      true prog tests 1 inspect
15.9  17.7  1.0   1.0   99   4.9  0  
eca-rers2012/Problem12_label21.yml done 1 prog tests 1 inspect 46   46   89 590 0      0      true prog tests 1 inspect
20.1  18.1  1.0   1.1   99   4.9  0  
eca-rers2012/Problem12_label25.yml done 1 prog tests 1 inspect 83   83   2100 960 0      0      true prog tests 1 inspect
16.1  18.8  1.0   1.0   99   4.9  0  
eca-rers2012/Problem12_label28.yml done 1 prog tests 1 inspect 48   48   260 620 0      0      true prog tests 1 inspect
21.5  18.3  1.1   1.1   99   3.9  0  
eca-rers2012/Problem12_label30.yml done 1 prog tests 1 inspect 48   48   200 700 0      0      true prog tests 1 inspect
18.6  16.8  1.0   1.0   99   4.2  0  
eca-rers2012/Problem12_label34.yml done 1 prog tests 1 inspect 46   46   75 660 0      0      true prog tests 1 inspect
17.3  16.7  1.1   1.1   99   4.8  0  
eca-rers2012/Problem12_label35.yml done 1 prog tests 1 inspect 56   56   740 750 0      0      true prog tests 1 inspect
12.0  16.9  1.1   1.1   100   4.9  0  
eca-rers2012/Problem12_label37.yml done 1 prog tests 1 inspect 54   54   610 690 0      0      true prog tests 1 inspect
15.7  18.8  1.0   1.0   99   3.9  0  
eca-rers2012/Problem12_label38.yml done 1 prog tests 1 inspect 53   53   580 790 0      0      true prog tests 1 inspect
18.7  16.8  1.0   1.0   99   1.5  0  
eca-rers2012/Problem12_label39.yml done 1 prog tests 1 inspect 47   47   130 640 0      0      true prog tests 1 inspect
20.6  18.2  1.1   1.1   99   2.6  0  
eca-rers2012/Problem12_label40.yml done 1 prog tests 1 inspect 46   46   70 600 0      0      true prog tests 1 inspect
12.5  16.7  1.0   1.0   99   3.9  0  
eca-rers2012/Problem12_label42.yml done 1 prog tests 1 inspect 52   52   500 760 0      0      true prog tests 1 inspect
17.9  16.8  1.1   1.1   99   5.3  0  
eca-rers2012/Problem12_label48.yml done 1 prog tests 1 inspect 46   46   70 560 0      0      true prog tests 1 inspect
13.7  16.8  1.0   1.0   100   3.9  0  
eca-rers2012/Problem12_label50.yml done 1 prog tests 1 inspect 50   50   380 730 0      0      true prog tests 1 inspect
15.8  18.5  1.1   1.1   99   3.9  0  
eca-rers2012/Problem12_label51.yml done 1 prog tests 1 inspect 47   47   140 690 0      0      true prog tests 1 inspect
20.1  16.9  1.0   1.0   99   3.9  0  
eca-rers2012/Problem12_label52.yml done 1 prog tests 1 inspect 58   58   870 690 0      0      true prog tests 1 inspect
18.5  18.6  1.0   1.0   99   3.9  0  
eca-rers2012/Problem12_label55.yml done 1 prog tests 1 inspect 47   47   170 690 0      0      true prog tests 1 inspect
12.2  15.4  1.0   1.0   99   3.9  0  
eca-rers2012/Problem13_label04.yml done 1 prog tests 1 inspect 64   64   190 830 0      0      true prog tests 1 inspect
12.1  15.3  1.3   1.3   120   4.6  0  
eca-rers2012/Problem13_label06.yml done 1 prog tests 1 inspect 69   69   630 960 0      0      true prog tests 1 inspect
15.0  14.5  1.4   1.4   120   4.7  0  
eca-rers2012/Problem13_label07.yml done 1 prog tests 1 inspect 62   62   92 830 0      0      true prog tests 1 inspect
13.0  16.7  1.2   1.2   120   5.1  0  
eca-rers2012/Problem13_label11.yml done 1 prog tests 1 inspect 72   72   870 860 0      0      true prog tests 1 inspect
14.5  16.7  1.3   1.3   120   5.4  0  
eca-rers2012/Problem13_label12.yml done 1 prog tests 1 inspect 65   65   310 800 0      0      true prog tests 1 inspect
14.9  16.9  1.3   1.3   120   4.6  0  
eca-rers2012/Problem13_label16.yml done 1 prog tests 1 inspect 64   64   240 920 0      0      true prog tests 1 inspect
15.8  16.7  1.2   1.2   120   5.7  0  
eca-rers2012/Problem13_label19.yml done 1 prog tests 1 inspect 66   66   450 900 0      0      true prog tests 1 inspect
13.8  14.4  1.2   1.2   120   4.6  0  
eca-rers2012/Problem13_label21.yml done 1 prog tests 1 inspect 63   63   130 880 0      0      true prog tests 1 inspect
13.7  16.8  1.3   1.3   120   4.8  0  
eca-rers2012/Problem13_label23.yml done 1 prog tests 1 inspect 65   65   330 680 0      0      true prog tests 1 inspect
16.2  16.8  1.3   1.3   120   6.3  0  
eca-rers2012/Problem13_label24.yml done 1 prog tests 1 inspect 62   62   110 940 0      0      true prog tests 1 inspect
19.3  17.0  1.3   1.3   120   4.7  0  
eca-rers2012/Problem13_label25.yml done 1 prog tests 1 inspect 62   62   100 870 0      0      true prog tests 1 inspect
17.6  16.9  1.3   1.3   120   4.6  0  
eca-rers2012/Problem13_label28.yml done 1 prog tests 1 inspect 62   62   92 770 0      0      true prog tests 1 inspect
13.4  16.6  1.2   1.2   120   4.6  0  
eca-rers2012/Problem13_label29.yml done 1 prog tests 1 inspect 65   65   390 830 0      0      true prog tests 1 inspect
17.1  16.6  1.3   1.3   120   5.0  0  
eca-rers2012/Problem13_label30.yml done 1 prog tests 1 inspect 63   63   210 750 0      0      true prog tests 1 inspect
14.8  16.8  1.3   1.3   120   4.6  0  
eca-rers2012/Problem13_label32.yml done 1 prog tests 1 inspect 65   65   310 930 0      0      true prog tests 1 inspect
22.2  16.9  1.2   1.2   120   4.8  0  
eca-rers2012/Problem13_label35.yml done 1 prog tests 1 inspect 91   91   1900 1100 0      0      true prog tests 1 inspect
11.8  11.7  1.2   1.2   120   4.6  0  
eca-rers2012/Problem13_label36.yml done 1 prog tests 1 inspect 63   63   160 760 0      0      true prog tests 1 inspect
15.9  16.8  1.2   1.2   120   4.6  0  
eca-rers2012/Problem13_label40.yml done 1 prog tests 1 inspect 62   62   97 930 0      0      true prog tests 1 inspect
11.8  13.0  1.2   1.2   120   6.3  0  
eca-rers2012/Problem13_label43.yml done 1 prog tests 1 inspect 63   63   160 930 0      0      true prog tests 1 inspect
11.7  14.4  1.3   1.3   120   .86 0  
eca-rers2012/Problem13_label44.yml done 1 prog tests 1 inspect 62   62   92 840 0      0      true prog tests 1 inspect
11.5  16.7  1.3   1.3   120   4.6  0  
eca-rers2012/Problem13_label45.yml done 1 prog tests 1 inspect 62   62   110 840 0      0      true prog tests 1 inspect
13.8  16.9  1.3   1.3   120   4.6  0  
eca-rers2012/Problem13_label48.yml done 1 prog tests 1 inspect 66   66   460 890 0      0      true prog tests 1 inspect
19.0  16.0  1.3   1.3   120   4.6  0  
eca-rers2012/Problem13_label51.yml done 1 prog tests 1 inspect 77   77   1200 1200 0      0      true prog tests 1 inspect
16.6  16.8  1.4   1.4   120   4.6  0  
eca-rers2012/Problem13_label54.yml done 1 prog tests 1 inspect 75   75   1100 890 0      0      true prog tests 1 inspect
15.2  16.7  1.3   1.3   120   4.8  0  
eca-rers2012/Problem13_label58.yml done 1 prog tests 1 inspect 64   64   240 870 0      0      true prog tests 1 inspect
16.6  16.7  1.3   1.3   120   2.0  0  
eca-rers2012/Problem15_label00.yml done 1 prog tests 1 inspect 18   18   34 270 0      0      true prog tests 1 inspect
19.8  21.4  .49  .49  64   1.4  0  
eca-rers2012/Problem15_label02.yml done 1 prog tests 1 inspect 18   18   34 240 0      0      true prog tests 1 inspect
16.8  20.1  .49  .49  63   1.3  0  
eca-rers2012/Problem15_label03.yml done 1 prog tests 1 inspect 18   18   34 220 0      0      true prog tests 1 inspect
21.5  21.3  .48  .48  63   1.3  0  
eca-rers2012/Problem15_label07.yml done 1 prog tests 1 inspect 18   18   43 280 0      0      true prog tests 1 inspect
20.3  20.6  .48  .48  64   1.3  0  
eca-rers2012/Problem15_label09.yml done 1 prog tests 1 inspect 18   18   40 270 0      0      true prog tests 1 inspect
25.2  21.8  .50  .54  63   1.3  0  
eca-rers2012/Problem15_label14.yml done 1 prog tests 1 inspect 18   18   34 240 0      0      true prog tests 1 inspect
21.3  21.2  .52  .52  63   1.3  0  
eca-rers2012/Problem15_label15.yml done 1 prog tests 1 inspect 18   18   33 260 0      0      true prog tests 1 inspect
16.2  20.3  .50  .50  63   1.3  0  
eca-rers2012/Problem15_label22.yml done 1 prog tests 1 inspect 18   18   34 230 0      0      true prog tests 1 inspect
15.8  20.3  .50  .50  63   1.3  0  
eca-rers2012/Problem15_label23.yml done 1 prog tests 1 inspect 18   18   35 220 0      0      true prog tests 1 inspect
24.7  21.9  .50  .52  64   1.6  0  
eca-rers2012/Problem15_label25.yml done 1 prog tests 1 inspect 18   18   38 250 0      0      true prog tests 1 inspect
26.3  22.6  .53  .53  64   1.3  0  
eca-rers2012/Problem15_label29.yml done 1 prog tests 1 inspect 18   18   35 250 0      0      true prog tests 1 inspect
18.3  20.4  .50  .50  64   1.3  0  
eca-rers2012/Problem15_label30.yml done 1 prog tests 1 inspect 18   18   34 270 0      0      true prog tests 1 inspect
19.3  21.3  .49  .51  64   1.3  0  
eca-rers2012/Problem15_label33.yml done 1 prog tests 1 inspect 18   18   34 250 0      0      true prog tests 1 inspect
21.0  21.3  .51  .51  64   1.3  0  
eca-rers2012/Problem15_label34.yml done 1 prog tests 1 inspect 18   18   42 240 0      0      true prog tests 1 inspect
20.1  21.2  .51  .53  64   1.3  0  
eca-rers2012/Problem15_label37.yml done 1 prog tests 1 inspect 18   18   34 230 0      0      true prog tests 1 inspect
22.5  20.4  .48  .48  63   1.3  0  
eca-rers2012/Problem15_label38.yml done 1 prog tests 1 inspect 19   19   47 260 0      0      true prog tests 1 inspect
25.0  20.5  .48  .48  64   1.3  0  
eca-rers2012/Problem15_label39.yml done 1 prog tests 1 inspect 18   18   39 230 0      0      true prog tests 1 inspect
19.9  20.7  .48  .48  63   1.3  0  
eca-rers2012/Problem15_label40.yml done 1 prog tests 1 inspect 18   18   34 220 0      0      true prog tests 1 inspect
17.1  20.2  .50  .50  63   1.6  0  
eca-rers2012/Problem15_label41.yml done 1 prog tests 1 inspect 18   18   34 270 0      0      true prog tests 1 inspect
20.5  21.4  .49  .49  63   1.3  0  
eca-rers2012/Problem15_label45.yml done 1 prog tests 1 inspect 18   18   41 230 0      0      true prog tests 1 inspect
21.8  20.7  .52  .56  63   .31 0  
eca-rers2012/Problem15_label47.yml done 1 prog tests 1 inspect 18   18   38 240 0      0      true prog tests 1 inspect
19.4  21.6  .50  .50  63   1.3  0  
eca-rers2012/Problem15_label48.yml done 1 prog tests 1 inspect 18   18   34 260 0      0      true prog tests 1 inspect
16.3  20.2  .49  .49  63   1.3  0  
eca-rers2012/Problem15_label50.yml done 1 prog tests 1 inspect 18   18   35 290 0      0      true prog tests 1 inspect
20.0  21.3  .49  .49  63   1.5  0  
eca-rers2012/Problem15_label51.yml done 1 prog tests 1 inspect 18   18   34 270 0      0      true prog tests 1 inspect
20.0  21.3  .50  .50  63   1.3  0  
eca-rers2012/Problem16_label00.yml done 1 prog tests 1 inspect 17   17   77 230 0      0      true prog tests 1 inspect
29.9  24.3  .43  .43  52   1.1  0  
eca-rers2012/Problem16_label01.yml done 1 prog tests 1 inspect 17   17   69 230 0      0      true prog tests 1 inspect
29.5  24.3  .44  .47  51   1.1  0  
eca-rers2012/Problem16_label03.yml done 1 prog tests 1 inspect 17   17   95 220 0      0      true prog tests 1 inspect
31.6  24.7  .42  .42  52   1.1  0  
eca-rers2012/Problem16_label04.yml done 1 prog tests 1 inspect 17   17   65 220 0      0      true prog tests 1 inspect
30.6  25.7  .41  .41  52   1.1  0  
eca-rers2012/Problem16_label05.yml done 1 prog tests 1 inspect 18   18   120 240 0      0      true prog tests 1 inspect
31.9  24.6  .42  .42  51   1.1  0  
eca-rers2012/Problem16_label06.yml done 1 prog tests 1 inspect 17   17   90 230 0      0      true prog tests 1 inspect
32.8  26.1  .44  .44  52   1.3  0  
eca-rers2012/Problem16_label08.yml done 1 prog tests 1 inspect 18   18   110 240 0      0      true prog tests 1 inspect
32.8  26.7  .42  .42  52   1.2  0  
eca-rers2012/Problem16_label14.yml done 1 prog tests 1 inspect 17   17   97 270 0      0      true prog tests 1 inspect
31.1  24.6  .43  .45  52   .49 0  
eca-rers2012/Problem16_label15.yml done 1 prog tests 1 inspect 17   17   67 210 0      0      true prog tests 1 inspect
29.0  24.2  .43  .43  52   1.1  0  
eca-rers2012/Problem16_label18.yml done 1 prog tests 1 inspect 18   18   110 220 0      0      true prog tests 1 inspect
31.8  24.7  .41  .41  51   1.1  0  
eca-rers2012/Problem16_label20.yml done 1 prog tests 1 inspect 17   17   68 220 0      0      true prog tests 1 inspect
29.1  24.2  .46  .50  51   1.1  0  
eca-rers2012/Problem16_label22.yml done 1 prog tests 1 inspect 17   17   86 240 0      0      true prog tests 1 inspect
33.1  26.9  .41  .41  52   1.1  0  
eca-rers2012/Problem16_label27.yml done 1 prog tests 1 inspect 17   17   81 220 0      0      true prog tests 1 inspect
31.9  26.1  .43  .45  51   1.1  0  
eca-rers2012/Problem16_label30.yml done 1 prog tests 1 inspect 17   17   86 220 0      0      true prog tests 1 inspect
31.4  24.5  .43  .44  51   1.1  0  
eca-rers2012/Problem16_label31.yml done 1 prog tests 1 inspect 18   18   110 230 0      0      true prog tests 1 inspect
33.1  24.8  .42  .42  52   1.1  0  
eca-rers2012/Problem16_label33.yml done 1 prog tests 1 inspect 16   16   64 220 0      0      true prog tests 1 inspect
29.4  24.2  .40  .40  52   1.1  0  
eca-rers2012/Problem16_label37.yml done 1 prog tests 1 inspect 17   17   71 230 0      0      true prog tests 1 inspect
29.4  24.2  .41  .42  52   1.1  0  
eca-rers2012/Problem16_label38.yml done 1 prog tests 1 inspect 17   17   88 230 0      0      true prog tests 1 inspect
32.3  26.1  .42  .43  51   1.3  0  
eca-rers2012/Problem16_label41.yml done 1 prog tests 1 inspect 17   17   67 220 0      0      true prog tests 1 inspect
28.7  24.3  .42  .42  52   1.3  0  
eca-rers2012/Problem16_label43.yml done 1 prog tests 1 inspect 17   17   80 230 0      0      true prog tests 1 inspect
31.6  26.0  .44  .44  52   1.1  0  
eca-rers2012/Problem16_label44.yml done 1 prog tests 1 inspect 16   16   61 200 0      0      true prog tests 1 inspect
28.7  24.1  .43  .43  51   1.1  0  
eca-rers2012/Problem16_label46.yml done 1 prog tests 1 inspect 17   17   100 230 0      0      true prog tests 1 inspect
31.9  26.6  .43  .43  52   1.1  0  
eca-rers2012/Problem16_label51.yml done 1 prog tests 1 inspect 17   17   80 250 0      0      true prog tests 1 inspect
31.7  24.5  .43  .43  51   1.1  0  
eca-rers2012/Problem16_label52.yml done 1 prog tests 1 inspect 16   16   63 190 0      0      true prog tests 1 inspect
28.6  24.0  .46  .46  52   1.1  0  
eca-rers2012/Problem16_label54.yml done 1 prog tests 1 inspect 17   17   66 210 0      0      true prog tests 1 inspect
29.1  24.3  .45  .45  51   1.1  0  
eca-rers2012/Problem17_label04.yml done 1 prog tests 1 inspect 29   29   50 470 0      0      true prog tests 1 inspect
8.37 9.24 .73  .73  81   2.5  0  
eca-rers2012/Problem17_label07.yml done 1 prog tests 1 inspect 32   32   250 410 0      0      true prog tests 1 inspect
22.8  20.2  .70  .70  80   2.3  0  
eca-rers2012/Problem17_label09.yml done 1 prog tests 1 inspect 29   29   50 400 0      0      true prog tests 1 inspect
19.6  18.6  .75  .75  81   2.4  0  
eca-rers2012/Problem17_label13.yml done 1 prog tests 1 inspect 29   29   50 360 0      0      true prog tests 1 inspect
17.7  18.0  .72  .73  80   3.1  0  
eca-rers2012/Problem17_label16.yml done 1 prog tests 1 inspect 29   29   69 370 0      0      true prog tests 1 inspect
19.7  20.3  .71  .76  80   2.3  0  
eca-rers2012/Problem17_label20.yml done 1 prog tests 1 inspect 31   31   190 430 0      0      true prog tests 1 inspect
21.5  20.2  .72  .72  80   2.3  0  
eca-rers2012/Problem17_label23.yml done 1 prog tests 1 inspect 29   29   50 400 0      0      true prog tests 1 inspect
11.3  11.7  .73  .73  81   3.1  0  
eca-rers2012/Problem17_label25.yml done 1 prog tests 1 inspect 29   29   58 370 0      0      true prog tests 1 inspect
21.3  18.7  .73  .79  80   2.3  0  
eca-rers2012/Problem17_label26.yml done 1 prog tests 1 inspect 29   29   49 470 0      0      true prog tests 1 inspect
17.1  18.1  .75  .75  80   2.4  0  
eca-rers2012/Problem17_label30.yml done 1 prog tests 1 inspect 29   29   50 400 0      0      true prog tests 1 inspect
19.0  20.2  .71  .71  80   2.9  0  
eca-rers2012/Problem17_label31.yml done 1 prog tests 1 inspect 29   29   49 390 0      0      true prog tests 1 inspect
18.8  18.6  .75  .79  81   2.6  0  
eca-rers2012/Problem17_label33.yml done 1 prog tests 1 inspect 30   30   120 450 0      0      true prog tests 1 inspect
14.8  15.6  .73  .73  80   2.5  0  
eca-rers2012/Problem17_label34.yml done 1 prog tests 1 inspect 29   29   64 450 0      0      true prog tests 1 inspect
12.2  13.4  .70  .70  81   2.5  0  
eca-rers2012/Problem17_label35.yml done 1 prog tests 1 inspect 29   29   74 390 0      0      true prog tests 1 inspect
20.4  18.7  .71  .71  80   2.3  0  
eca-rers2012/Problem17_label37.yml done 1 prog tests 1 inspect 30   30   110 350 0      0      true prog tests 1 inspect
14.2  15.6  .71  .71  80   3.1  0  
eca-rers2012/Problem17_label40.yml done 1 prog tests 1 inspect 29   29   50 420 0      0      true prog tests 1 inspect
19.0  18.7  .72  .72  80   2.3  0  
eca-rers2012/Problem17_label46.yml done 1 prog tests 1 inspect 29   29   53 400 0      0      true prog tests 1 inspect
20.3  18.6  .74  .76  80   2.4  0  
eca-rers2012/Problem17_label49.yml done 1 prog tests 1 inspect 30   30   92 370 0      0      true prog tests 1 inspect
13.7  15.6  .76  .76  81   2.6  0  
eca-rers2012/Problem17_label50.yml done 1 prog tests 1 inspect 29   29   67 440 0      0      true prog tests 1 inspect
19.8  18.6  .75  .75  80   2.3  0  
eca-rers2012/Problem17_label52.yml done 1 prog tests 1 inspect 30   30   100 400 0      0      true prog tests 1 inspect
21.6  18.8  .72  .72  80   2.3  0  
eca-rers2012/Problem17_label53.yml done 1 prog tests 1 inspect 29   29   50 350 0      0      true prog tests 1 inspect
18.9  18.5  .71  .72  80   2.3  0  
eca-rers2012/Problem17_label54.yml done 1 prog tests 1 inspect 29   29   57 460 0      0      true prog tests 1 inspect
20.7  18.5  .72  .72  80   2.5  0  
eca-rers2012/Problem17_label55.yml done 1 prog tests 1 inspect 29   29   50 430 0      0      true prog tests 1 inspect
20.1  18.5  .72  .77  80   2.3  0  
eca-rers2012/Problem17_label57.yml done 1 prog tests 1 inspect 30   30   90 450 0      0      true prog tests 1 inspect
16.4  17.0  .71  .71  81   2.3  0  
eca-rers2012/Problem18_label00.yml done 1 prog tests 1 inspect 35   35   170 500 0      0      true prog tests 1 inspect
19.4  17.0  .83  .83  75   3.0  0  
eca-rers2012/Problem18_label01.yml done 1 prog tests 1 inspect 33   33   67 430 0      0      true prog tests 1 inspect
19.0  16.5  .76  .76  76   3.3  0  
eca-rers2012/Problem18_label03.yml done 1 prog tests 1 inspect 34   34   100 430 0      0      true prog tests 1 inspect
18.3  18.0  .75  .75  76   2.7  0  
eca-rers2012/Problem18_label06.yml done 1 prog tests 1 inspect 34   34   120 480 0      0      true prog tests 1 inspect
21.4  16.4  .81  .81  75   2.7  0  
eca-rers2012/Problem18_label08.yml done 1 prog tests 1 inspect 34   34   78 420 0      0      true prog tests 1 inspect
19.3  17.4  .78  .78  76   2.7  0  
eca-rers2012/Problem18_label09.yml done 1 prog tests 1 inspect 37   37   240 470 0      0      true prog tests 1 inspect
16.8  16.1  .80  .80  76   3.2  0  
eca-rers2012/Problem18_label10.yml done 1 prog tests 1 inspect 35   35   160 430 0      0      true prog tests 1 inspect
19.0  16.7  .76  .76  75   2.9  0  
eca-rers2012/Problem18_label12.yml done 1 prog tests 1 inspect 33   33   76 490 0      0      true prog tests 1 inspect
15.4  16.1  .76  .76  75   2.7  0  
eca-rers2012/Problem18_label19.yml done 1 prog tests 1 inspect 35   35   150 470 0      0      true prog tests 1 inspect
16.5  16.1  .78  .79  76   3.2  0  
eca-rers2012/Problem18_label20.yml done 1 prog tests 1 inspect 41   41   440 540 0      0      true prog tests 1 inspect
22.2  21.1  .73  .73  76   3.2  0  
eca-rers2012/Problem18_label25.yml done 1 prog tests 1 inspect 35   35   170 530 0      0      true prog tests 1 inspect
20.3  17.5  .78  .81  76   2.7  0  
eca-rers2012/Problem18_label27.yml done 1 prog tests 1 inspect 33   33   68 430 0      0      true prog tests 1 inspect
15.6  16.0  .78  .79  75   2.9  0  
eca-rers2012/Problem18_label31.yml done 1 prog tests 1 inspect 43   43   540 640 0      0      true prog tests 1 inspect
15.8  16.0  .80  .80  76   2.7  0  
eca-rers2012/Problem18_label32.yml done 1 prog tests 1 inspect 34   34   97 440 0      0      true prog tests 1 inspect
23.7  19.2  .76  .78  76   2.7  0  
eca-rers2012/Problem18_label33.yml done 1 prog tests 1 inspect 35   35   130 430 0      0      true prog tests 1 inspect
20.8  17.6  .74  .75  76   .99 0  
eca-rers2012/Problem18_label34.yml done 1 prog tests 1 inspect 34   34   110 540 0      0      true prog tests 1 inspect
18.0  16.0  .75  .77  76   2.7  0  
eca-rers2012/Problem18_label35.yml done 1 prog tests 1 inspect 40   40   400 470 0      0      true prog tests 1 inspect
15.0  16.1  .77  .78  76   2.7  0  
eca-rers2012/Problem18_label36.yml done 1 prog tests 1 inspect 34   34   120 510 0      0      true prog tests 1 inspect
20.5  16.5  .76  .81  75   2.7  0  
eca-rers2012/Problem18_label38.yml done 1 prog tests 1 inspect 34   34   86 460 0      0      true prog tests 1 inspect
15.9  16.1  .77  .77  75   2.7  0  
eca-rers2012/Problem18_label39.yml done 1 prog tests 1 inspect 35   35   170 460 0      0      true prog tests 1 inspect
13.3  16.0  .76  .77  75   2.7  0  
eca-rers2012/Problem18_label45.yml done 1 prog tests 1 inspect 35   35   190 530 0      0      true prog tests 1 inspect
17.0  16.0  .77  .81  76   3.0  0  
eca-rers2012/Problem18_label49.yml done 1 prog tests 1 inspect 34   34   130 490 0      0      true prog tests 1 inspect
20.7  17.4  .77  .81  76   3.6  0  
eca-rers2012/Problem18_label52.yml done 1 prog tests 1 inspect 33   33   75 430 0      0      true prog tests 1 inspect
15.4  16.1  .78  .78  76   3.5  0  
eca-rers2012/Problem18_label55.yml done 1 prog tests 1 inspect 35   35   130 450 0      0      true prog tests 1 inspect
16.3  16.1  .75  .75  75   1.6  0  
eca-rers2012/Problem18_label57.yml done 1 prog tests 1 inspect 37   37   270 510 0      0      true prog tests 1 inspect
17.1  16.0  .76  .76  76   2.7  0  
eca-rers2012/Problem19_label10.yml done 1 prog tests 1 inspect 110   110   910 1300 0      0      true prog tests 1 inspect
19.5  16.2  1.9   1.9   160   9.2  0  
eca-rers2012/Problem19_label11.yml done 1 prog tests 1 inspect 90   90   230 1200 0      0      true prog tests 1 inspect
15.9  16.1  1.8   1.8   160   7.3  0  
eca-rers2012/Problem19_label14.yml done 1 prog tests 1 inspect 99   99   590 1500 0      0      true prog tests 1 inspect
18.0  16.2  1.9   1.9   160   5.7  0  
eca-rers2012/Problem19_label17.yml done 1 prog tests 1 inspect 99   99   610 1500 0      0      true prog tests 1 inspect
17.4  16.2  2.0   2.0   160   8.0  0  
eca-rers2012/Problem19_label18.yml done 1 prog tests 1 inspect 95   95   460 1300 0      0      true prog tests 1 inspect
17.9  13.8  1.8   1.8   160   7.3  0  
eca-rers2012/Problem19_label19.yml done 1 prog tests 1 inspect 94   94   420 1200 0      0      true prog tests 1 inspect
17.7  16.1  1.9   1.9   160   7.3  0  
eca-rers2012/Problem19_label21.yml done 1 prog tests 1 inspect 100   100   810 1300 0      0      true prog tests 1 inspect
18.5  16.2  1.9   1.9   160   8.6  0  
eca-rers2012/Problem19_label22.yml done 1 prog tests 1 inspect 97   97   520 1300 0      0      true prog tests 1 inspect
17.4  13.8  1.9   1.9   160   8.0  0  
eca-rers2012/Problem19_label26.yml done 1 prog tests 1 inspect 88   88   180 1300 0      0      true prog tests 1 inspect
15.4  16.1  1.9   1.9   160   11    0  
eca-rers2012/Problem19_label27.yml done 1 prog tests 1 inspect 93   93   380 1300 0      0      true prog tests 1 inspect
18.3  16.5  1.9   1.9   160   11    0  
eca-rers2012/Problem19_label28.yml done 1 prog tests 1 inspect 90   90   250 1200 0      0      true prog tests 1 inspect
16.4  15.4  1.9   1.9   160   7.5  0  
eca-rers2012/Problem19_label29.yml done 1 prog tests 1 inspect 92   92   340 1400 0      0      true prog tests 1 inspect
16.9  15.4  1.9   1.9   160   5.4  0  
eca-rers2012/Problem19_label31.yml done 1 prog tests 1 inspect 94   94   410 1400 0      0      true prog tests 1 inspect
17.3  16.1  2.0   2.0   160   8.5  0  
eca-rers2012/Problem19_label32.yml done 1 prog tests 1 inspect 97   97   510 1500 0      0      true prog tests 1 inspect
17.6  16.1  1.8   1.8   160   7.3  0  
eca-rers2012/Problem19_label41.yml done 1 prog tests 1 inspect 100   100   730 1500 0      0      true prog tests 1 inspect
17.5  16.2  2.0   2.0   160   8.3  0  
eca-rers2012/Problem19_label42.yml done 1 prog tests 1 inspect 110   110   990 1300 0      0      true prog tests 1 inspect
18.4  16.2  2.0   2.1   160   7.2  0  
eca-rers2012/Problem19_label43.yml done 1 prog tests 1 inspect 96   96   490 1400 0      0      true prog tests 1 inspect
19.2  16.1  2.0   2.0   160   7.4  0  
eca-rers2012/Problem19_label47.yml done 1 prog tests 1 inspect 97   97   510 1300 0      0      true prog tests 1 inspect
17.2  16.2  1.9   1.9   160   8.5  0  
eca-rers2012/Problem19_label50.yml done 1 prog tests 1 inspect 98   98   570 1300 0      0      true prog tests 1 inspect
17.7  15.4  1.8   1.8   160   7.3  0  
eca-rers2012/Problem19_label51.yml done 1 prog tests 1 inspect 90   90   240 1200 0      0      true prog tests 1 inspect
16.0  16.1  2.0   2.0   160   2.3  0  
eca-rers2012/Problem19_label53.yml done 1 prog tests 1 inspect 100   100   750 1300 0      0      true prog tests 1 inspect
19.7  16.5  1.9   1.9   160   2.7  0  
eca-rers2012/Problem19_label55.yml done 1 prog tests 1 inspect 110   110   920 1500 0      0      true prog tests 1 inspect
19.8  16.9  2.0   2.0   160   7.7  0  
eca-rers2012/Problem19_label58.yml done 1 prog tests 1 inspect 97   97   560 1300 0      0      true prog tests 1 inspect
18.3  16.2  1.8   1.8   160   9.2  0  
eca-rers2012/Problem19_label59.yml done 1 prog tests 1 inspect 88   88   170 1200 0      0      true prog tests 1 inspect
15.3  16.1  2.0   2.0   160   7.4  0  
eca-programs/Problem101_label00.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6200 0      0      error (0) prog tests 0 inspect
0    0    .083 .084 9.0 0    0  
eca-programs/Problem101_label01.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5900 0      0      error (0) prog tests 0 inspect
0    0    .060 .060 8.9 0    0  
eca-programs/Problem101_label02.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 5400 0      0      error (0) prog tests 0 inspect
0    0    .058 .059 9.0 0    0  
eca-programs/Problem101_label03.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5500 0      0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-programs/Problem101_label04.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6100 0      0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-programs/Problem101_label05.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5100 0      0      error (0) prog tests 0 inspect
0    0    .058 .058 8.8 0    0  
eca-programs/Problem101_label06.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5400 0      0      error (0) prog tests 0 inspect
0    0    .059 .060 8.9 0    0  
eca-programs/Problem101_label07.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5300 0      0      error (0) prog tests 0 inspect
0    0    .062 .074 9.0 0    0  
eca-programs/Problem101_label08.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5200 0      0      error (0) prog tests 0 inspect
0    0    .058 .058 9.0 0    0  
eca-programs/Problem101_label09.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 5700 0      0      error (0) prog tests 0 inspect
0    0    .061 .11  9.0 0    0  
eca-programs/Problem101_label10.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6700 0      0      error (0) prog tests 0 inspect
0    0    .059 .060 9.0 0    0  
eca-programs/Problem101_label11.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6000 0      0      error (0) prog tests 0 inspect
0    0    .060 .061 8.9 0    0  
eca-programs/Problem101_label12.yml error(returned 1, slicing) prog tests 0 inspect 430   420   320 5200 0      0      error (0) prog tests 0 inspect
0    0    .060 .061 9.0 0    0  
eca-programs/Problem101_label13.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5200 0      0      error (0) prog tests 0 inspect
0    0    .058 .058 9.0 0    0  
eca-programs/Problem101_label14.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5700 0      0      error (0) prog tests 0 inspect
0    0    .057 .058 8.8 0    0  
eca-programs/Problem101_label15.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 6200 0      0      error (0) prog tests 0 inspect
0    0    .056 .056 9.0 0    0  
eca-programs/Problem101_label16.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5900 0      0      error (0) prog tests 0 inspect
0    0    .062 .10  9.0 0    0  
eca-programs/Problem101_label17.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 4900 0      0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-programs/Problem101_label18.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5300 0      0      error (0) prog tests 0 inspect
0    0    .056 .057 8.9 0    0  
eca-programs/Problem101_label19.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5700 0      0      error (0) prog tests 0 inspect
0    0    .085 .086 9.0 0    0  
eca-programs/Problem101_label20.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 5500 0      0      error (0) prog tests 0 inspect
0    0    .055 .056 9.0 0    0  
eca-programs/Problem101_label21.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5400 0      0      error (0) prog tests 0 inspect
0    0    .059 .060 9.0 0    0  
eca-programs/Problem101_label22.yml error(returned 1, slicing) prog tests 0 inspect 420   420   320 5500 0      0      error (0) prog tests 0 inspect
0    0    .064 .065 9.0 0    0  
eca-programs/Problem101_label23.yml error(returned 1, slicing) prog tests 0 inspect 430   430   320 5700 0      0      error (0) prog tests 0 inspect
0    0    .064 .065 9.0 0    0  
eca-programs/Problem102_label01.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .045  0      error (0) prog tests 0 inspect
0    0    .060 .061 9.0 0    0  
eca-programs/Problem102_label02.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .045  0      error (0) prog tests 0 inspect
0    0    .060 .061 9.0 0    0  
eca-programs/Problem102_label04.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .045  0      error (0) prog tests 0 inspect
0    0    .094 .095 9.0 0    0  
eca-programs/Problem102_label05.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .041  0      error (0) prog tests 0 inspect
0    0    .057 .058 8.9 0    0  
eca-programs/Problem102_label06.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .033  0      error (0) prog tests 0 inspect
0    0    .057 .058 8.9 0    0  
eca-programs/Problem102_label07.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .037  0      error (0) prog tests 0 inspect
0    0    .058 .058 8.9 0    0  
eca-programs/Problem102_label10.yml timeout (before-instr) prog tests 0 inspect 900   900   610 9400 .045  0      error (0) prog tests 0 inspect
0    0    .056 .056 9.0 0    0  
eca-programs/Problem102_label13.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .049  0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-programs/Problem102_label15.yml timeout (before-instr) prog tests 0 inspect 900   900   610 14000 .049  0      error (0) prog tests 0 inspect
0    0    .057 .066 9.0 0    0  
eca-programs/Problem102_label24.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .045  0      error (0) prog tests 0 inspect
0    0    .063 .064 8.9 0    0  
eca-programs/Problem102_label25.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .045  0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-programs/Problem102_label26.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .045  0      error (0) prog tests 0 inspect
0    0    .092 .093 8.9 0    0  
eca-programs/Problem102_label28.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .045  0      error (0) prog tests 0 inspect
0    0    .056 .056 9.0 0    0  
eca-programs/Problem102_label29.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .041  0      error (0) prog tests 0 inspect
0    0    .056 .057 9.0 0    0  
eca-programs/Problem102_label34.yml timeout (before-instr) prog tests 0 inspect 900   900   610 14000 .025  0      error (0) prog tests 0 inspect
0    0    .062 .063 8.9 0    0  
eca-programs/Problem102_label37.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .041  0      error (0) prog tests 0 inspect
0    0    .057 .057 9.0 0    0  
eca-programs/Problem102_label43.yml timeout (before-instr) prog tests 0 inspect 900   900   610 12000 .041  0      error (0) prog tests 0 inspect
0    0    .057 .057 9.0 0    0  
eca-programs/Problem102_label46.yml timeout (before-instr) prog tests 0 inspect 900   900   610 10000 .041  0      error (0) prog tests 0 inspect
0    0    .057 .058 9.0 0    0  
eca-programs/Problem102_label48.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .045  0      error (0) prog tests 0 inspect
0    0    .057 .057 8.9 0    0  
eca-programs/Problem102_label49.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .037  0      error (0) prog tests 0 inspect
0    0    .060 .061 9.0 0    0  
eca-programs/Problem102_label50.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .045  0      error (0) prog tests 0 inspect
0    0    .059 .059 9.0 0    0  
eca-programs/Problem102_label51.yml timeout (before-instr) prog tests 0 inspect 900   900   610 13000 .045  0      error (0) prog tests 0 inspect
0    0    .060 .060 9.0 0    0  
eca-programs/Problem102_label55.yml timeout (before-instr) prog tests 0 inspect 900   900   610 14000 .041  0      error (0) prog tests 0 inspect
0    0    .062 .063 9.0 0    0  
eca-programs/Problem102_label59.yml timeout (before-instr) prog tests 0 inspect 900   900   610 11000 .045  0      error (0) prog tests 0 inspect
0    0    .060 .070 9.0 0    0  
eca-programs/Problem103_label32.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .062 .063 9.0 0    0  
eca-programs/Problem103_label35.yml timeout (before-instr) prog tests 0 inspect 900   900   650 13000 .012  0      error (0) prog tests 0 inspect
0    0    .057 .058 9.0 0    0  
eca-programs/Problem103_label41.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .056 .056 8.9 0    0  
eca-programs/Problem103_label44.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .062 .062 8.9 0    0  
eca-programs/Problem103_label46.yml timeout (before-instr) prog tests 0 inspect 900   900   650 13000 .012  0      error (0) prog tests 0 inspect
0    0    .059 .069 8.8 0    0  
eca-programs/Problem103_label47.yml timeout (before-instr) prog tests 0 inspect 900   900   650 14000 .012  0      error (0) prog tests 0 inspect
0    0    .057 .058 9.0 0    0  
eca-programs/Problem103_label51.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .059 .060 9.0 0    0  
eca-programs/Problem103_label53.yml timeout (before-instr) prog tests 0 inspect 900   900   650 12000 .012  0      error (0) prog tests 0 inspect
0    0    .061 .061 8.9 0    0  
eca-programs/Problem103_label54.yml timeout (before-instr) prog tests 0 inspect 900   900   650 11000 .012  0      error (0) prog tests 0 inspect
0    0    .056 .056 9.0 0    0  
eca-programs/Problem103_label56.yml timeout (before-instr) prog tests 0 inspect 900   900   650 11000 .012  0      error (0) prog tests 0 inspect
0    0    .068 .069 8.9 0    0  
eca-programs/Problem103_label57.yml timeout (before-instr) prog tests 0 inspect 900   900   650 11000 .012  0      error (0) prog tests 0 inspect
0    0    .060 .061 9.0 0    0  
eca-programs/Problem103_label59.yml timeout (before-instr) prog tests 0 inspect 900   900   650 11000 .0041 0      error (0) prog tests 0 inspect
0    0    .059 .060 8.9 0    0  
sv-benchmarks/c/ status score program test-suite TS size inspect test-suite cpu (s) wall (s) mem (MB) energy (J) blkio-w (MB) blkio-r (MB) status program test-suite TS size inspect test-suite cov branch cov (%) line cov (%) cpu (s) wall (s) mem (MB) energy blkio-w (MB) blkio-r (MB)
total 412 255 140000 140000 790000 1700000 3.2 29000 412 5080 4700 250 250 25000 900 0  
Run set symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-ECA tbf-testsuite-validator-symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-ECA