Benchmark CPA/CoVeriTest CPA/Tiger-MGP ESBMC-bkind ESBMC-falsif FairFuzz KLEE PRtest Symbiotic VeriFuzz
Tool CPAchecker 1.8-svn 30375 CPAchecker 1.8-svn 30541M ESBMC version 6.0.0 64-bit x86_64 linux FairFuzz TC-0.0.2 KLEE 2.0.0-pre-test-comp tbf v0.3.0-testcomp19 symbiotic 6.0.3-dev-fd3f777b VeriFuzz 1.0.1
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-05 21:13:54 CET 2019-02-05 21:13:25 CET 2019-02-05 21:11:17 CET 2019-02-08 09:39:09 CET 2019-02-05 21:09:47 CET 2019-02-06 06:02:44 CET 2019-02-06 07:07:32 CET 2019-02-06 07:17:17 CET
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Arrays esbmc-kind.test-comp19_prop-coverage-branches.ReachSafety-Arrays esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Arrays fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Arrays klee.test-comp19_prop-coverage-branches.ReachSafety-Arrays prtest.test-comp19_prop-coverage-branches.ReachSafety-Arrays symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Arrays verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Arrays
Options -benchmark -heap 10000M -testcomp19 -benchmark -heap 10000M -tigertestcomp19 -s kinduction -s falsi --stats -i random --write-xml --svcomp-nondets --test-comp --verifier klee-testcomp --testcomp
../sv-benchmarks/c/ status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J)
array-examples/sanfoundry_10_ground.yml timeout .0556 900 1400 13000 timeout .0556 900   5000 13000 unknown .0  .025 5.7 .17  unknown .0  .041 5.7 .085 timeout .944 900    53 11000   timeout .944  900    10000 9800    timeout .0556 900    31 13000   done .833 850    2900 10000   timeout .944 900   150 12000
array-examples/sanfoundry_24-1.yml done .917  24 1300 310 unknown .917  6.3 470 60 unknown .0  .023 5.7 .097 unknown .0  .024 5.6 .12  timeout .75  900    98 13000   timeout .917  900    5900 10000    timeout .917  900    30 13000   done .917 890    10000 10000   timeout .917 900   150 12000
array-examples/standard_copy1_ground-1.yml timeout .125  900 2600 11000 timeout .0    900   5900 11000 unknown .0  .024 5.7 .13  unknown .0  .028 5.8 .19  timeout .875 900    28 10000   done .875  2.0  110 26    timeout .125  900    31 12000   done .875 3.8  380 48   timeout .875 900   150 12000
array-examples/standard_copy1_ground-2.yml timeout .125  900 2700 12000 timeout .0    900   7300 12000 unknown .0  .026 5.7 .17  unknown .0  .040 5.7 .14  timeout 1.0   900    70 11000   timeout (false(unreach-call)) .75   900    240 8600    timeout .125  900    31 13000   done .75  840    420 7400   timeout .875 900   150 12000
array-examples/standard_copy2_ground-1.yml timeout .1    900 3000 10000 timeout .0    900   7400 10000 unknown .0  .042 5.7 .17  unknown .0  .026 5.7 .15  timeout 1.0   900    60 14000   timeout (false(unreach-call)) .8    900    250 9700    timeout .1    900    31 12000   done .8   840    530 7100   timeout .9   900   150 11000
array-examples/standard_copy2_ground-2.yml timeout .1    900 2500 12000 timeout .0    900   7300 11000 unknown .0  .021 5.6 .082 unknown .0  .025 5.7 .10  timeout .9   900    23 9900   done .9    2.5  110 32    timeout .1    900    31 13000   done .9   4.4  440 54   timeout .9   900   150 12000
array-examples/standard_copy3_ground-1.yml timeout .0833 900 3100 12000 timeout .0833 900   8100 11000 unknown .0  .028 5.7 .17  unknown .0  .027 5.7 .12  timeout .917 900    23 14000   done .917  2.9  110 38    timeout .0833 900    31 14000   done .917 5.0  500 63   timeout .917 900   150 12000
array-examples/standard_copy3_ground-2.yml timeout .0833 900 3100 13000 timeout .0833 900   7900 11000 unknown .0  .025 5.7 .081 unknown .0  .048 5.7 .099 timeout 1.0   900    76 12000   timeout (false(unreach-call)) .833  900    250 9500    timeout .0833 900    31 13000   done .833 840    580 7300   timeout .917 900   150 11000
array-examples/standard_copy4_ground-1.yml timeout .0714 900 3700 11000 timeout .0    900   7000 11000 unknown .0  .025 5.7 .13  unknown .0  .020 5.6 .24  timeout .929 900    23 12000   done .929  3.3  120 46    timeout .0714 900    31 13000   done .929 5.6  560 77   timeout .929 900   150 11000
array-examples/standard_copy4_ground-2.yml timeout .0714 900 3300 12000 timeout .0    900   8600 11000 unknown .0  .023 5.7 .17  unknown .0  .052 5.5 .13  timeout 1.0   900    69 11000   timeout (false(unreach-call)) .857  900    250 9400    timeout .0714 900    30 14000   done .857 840    640 8100   timeout .929 900   150 11000
array-examples/standard_copy5_ground-1.yml timeout .0625 900 3400 13000 timeout .0    900   8200 14000 unknown .0  .045 5.7 .12  unknown .0  .024 5.7 .12  timeout .938 900    26 12000   done .938  3.8  120 50    timeout .0625 900    31 12000   done .938 6.0  620 77   timeout .938 900   150 14000
array-examples/standard_copy5_ground-2.yml timeout .0625 900 3200 12000 timeout .0625 900   7000 12000 unknown .0  .024 5.7 .11  unknown .0  .044 5.7 .10  timeout 1.0   900    65 11000   timeout (false(unreach-call)) .875  900    260 11000    timeout .0625 900    31 14000   done .875 840    700 7500   timeout .938 900   150 11000
array-examples/standard_copy6_ground-1.yml timeout .0556 900 3600 12000 timeout .0556 900   7000 12000 unknown .0  .023 5.7 .15  unknown .0  .050 5.6 .10  timeout 1.0   900    68 11000   timeout (false(unreach-call)) .889  900    260 7900    timeout .0556 900    31 12000   done .889 840    760 7700   timeout .944 900   160 11000
array-examples/standard_copy6_ground-2.yml timeout .0556 900 4200 12000 timeout .0    900   8600 10000 unknown .0  .026 5.7 .14  unknown .0  .026 5.6 .11  timeout .944 900    23 10000   done .944  4.2  120 51    timeout .0556 900    31 15000   done .944 6.5  680 100   timeout .944 900   150 9600
array-examples/standard_copy7_ground-1.yml timeout .05   900 3600 11000 timeout .05   900   8900 11000 unknown .0  .018 5.7 .22  unknown .0  .024 5.6 .12  timeout 1.0   900    83 11000   timeout (false(unreach-call)) .9    900    270 9300    timeout .05   900    31 13000   done .9   840    820 8300   timeout .95  900   150 12000
array-examples/standard_copy7_ground-2.yml timeout .05   900 4000 13000 timeout .0    900   7500 13000 unknown .0  .024 5.7 .12  unknown .0  .024 5.6 .13  timeout .95  900    24 13000   done .95   4.7  130 60    timeout .05   900    31 13000   done .95  7.3  740 100   timeout .95  900   150 14000
array-examples/standard_copy8_ground-1.yml timeout .0455 900 4600 13000 timeout .0    900   7900 11000 unknown .0  .025 5.7 .062 unknown .0  .028 5.6 .19  timeout .955 900    26 12000   done .955  5.1  130 76    timeout .0455 900    31 13000   done .955 7.9  800 130   timeout .955 900   150 10000
array-examples/standard_copy8_ground-2.yml timeout .0455 900 4700 10000 timeout .0455 900   9500 11000 unknown .0  .024 5.7 .13  unknown .0  .030 5.7 .091 timeout 1.0   900    63 14000   timeout (false(unreach-call)) .909  900    270 11000    timeout .0455 900    31 14000   done .909 840    880 7200   timeout .955 900   150 12000
array-examples/standard_copy9_ground-1.yml timeout .0417 900 5700 11000 timeout .0    900   11000 13000 unknown .0  .024 5.7 .10  unknown .0  .023 5.6 .11  timeout 1.0   900    57 9900   timeout (false(unreach-call)) .917  900    270 9200    timeout .0417 900    31 13000   done .917 840    940 8300   timeout .958 900   160 12000
array-examples/standard_copy9_ground-2.yml timeout .0417 900 4600 11000 timeout .0    900   11000 11000 unknown .0  .022 5.6 .12  unknown .0  .025 5.8 .16  timeout .958 900    29 12000   done .958  5.6  140 94    timeout .0417 900    30 12000   done .958 8.5  850 110   timeout .958 900   150 11000
array-examples/standard_copyInitSum_ground.yml timeout .9    900 2000 9800 timeout .9    900   5800 11000 unknown .0  .030 5.6 .17  unknown .0  .032 5.7 .15  done .9   49    11 290   done .9    2.0  56 30    timeout .9    900    31 12000   done .9   2.5  310 30   timeout .9   900   150 9800
array-examples/standard_find_ground-1.yml timeout .1    900 2400 12000 timeout .0    900   6600 11000 unknown .0  .048 5.7 .072 unknown .0  .025 5.7 .12  timeout .9   900    70 11000   timeout .9    900    1600 11000    timeout .1    900    30 13000   done .8   860    3600 10000   timeout .9   900   150 14000
array-examples/standard_partition_ground-1.yml timeout .214  900 3700 11000 timeout .0714 900   6200 11000 unknown .0  .018 5.7 .037 unknown .0  .031 5.6 .14  couldn't run: all seeds time out or crash .0   1.4  10 15   out of memory .143  8.3  15000 110    timeout .214  900    31 14000   out of memory (killed (signal 9, verification)) .0   45    15000 510   timeout .929 900   160 12000
array-examples/standard_sentinel-2.yml timeout .1    900 4000 13000 timeout .0    900   9600 10000 unknown .0  .025 5.7 .13  unknown .0  .050 5.6 .091 done .8   710    29 10000   unknown .8    .93 170 12    timeout .1    900    31 15000   done .3   2.9  320 46   timeout .8   900   4400 12000
array-examples/standard_sentinel.i.v+cfa-reducer.yml timeout .1    900 2400 13000 timeout .0    900   6800 13000 unknown .0  .021 5.7 .16  unknown .0  .032 5.7 .13  done .8   720    28 8600   unknown .8    .95 170 11    timeout .1    900    31 13000   done .5   3.4  350 38   timeout .8   900   3000 11000
array-examples/standard_strcpy_ground-1.yml timeout .1    900 2700 12000 timeout .0    900   7200 13000 unknown .0  .037 5.7 .099 unknown .0  .024 5.7 .030 timeout .8   900    63 12000   timeout .8    900    5400 12000    timeout .1    900    31 13000   done .8   860    5300 10000   timeout .8   900   160 12000
array-examples/standard_strcpy_original-2.yml timeout .0833 900 2200 11000 timeout .0    900   6000 11000 unknown .0  .023 5.7 .11  unknown .0  .024 5.7 .077 timeout .75  900    63 12000   timeout .75   900    2000 12000    timeout .0833 900    31 13000   done .75  870    5800 10000   timeout .75  900   150 13000
array-examples/standard_two_index_01.yml timeout .125  900 8500 9600 timeout .0    900   4900 11000 unknown .0  .023 5.6 .15  unknown .0  .027 5.7 .088 done .875 420    15 6100   done .875  .32 27 3.8  timeout .875  900    31 13000   done .875 .64 51 7.4 timeout .875 900   150 14000
array-examples/standard_two_index_02.yml timeout .125  900 2800 11000 timeout .0    900   5800 12000 unknown .0  .024 5.7 .14  unknown .0  .029 5.7 .18  timeout .875 900    24 11000   done .875  1.5  110 21    timeout .125  900    30 12000   done .875 3.1  300 35   timeout .875 900   150 12000
array-examples/standard_two_index_03.yml timeout .125  900 8300 8400 timeout .0    900   5200 11000 unknown .0  .026 5.7 .11  unknown .0  .025 5.7 .061 done .875 410    14 5200   done .875  .24 28 3.2  timeout .875  900    31 12000   done .875 .55 40 6.8 timeout .875 900   150 13000
array-examples/standard_two_index_04.yml timeout .125  900 2500 11000 timeout .0    900   6100 11000 unknown .0  .025 5.7 .11  unknown .0  .035 5.6 .13  timeout .875 900    24 11000   done .875  1.2  110 20    timeout .125  900    31 13000   done .875 2.6  260 33   timeout .875 900   150 9700
array-examples/standard_two_index_05.yml timeout .125  900 3000 9500 timeout .0    900   5900 11000 unknown .0  .022 5.7 .14  unknown .0  .027 5.7 .096 timeout .875 900    23 12000   done .875  1.1  110 16    timeout .125  900    31 12000   done .875 2.6  260 33   timeout .875 900   150 14000
array-examples/standard_two_index_06.yml timeout .125  900 5900 8900 timeout .0    900   5200 12000 unknown .0  .030 5.7 .19  unknown .0  .019 5.7 .15  done .875 420    15 5300   done .875  .22 27 2.4  timeout .875  900    31 15000   done .875 .51 38 7.2 timeout .875 900   150 13000
array-examples/standard_two_index_07.yml timeout .125  900 2900 13000 timeout .0    900   5800 11000 unknown .0  .019 5.7 .11  unknown .0  .021 5.7 .069 timeout .875 900    25 11000   done .875  1.1  110 14    timeout .125  900    31 12000   done .875 2.5  250 28   timeout .875 900   150 14000
array-examples/standard_two_index_08.yml timeout .125  900 2400 12000 timeout .0    900   6000 13000 unknown .0  .027 5.6 .11  unknown .0  .026 5.7 .11  timeout .875 900    25 11000   done .875  1.0  110 15    timeout .125  900    31 14000   done .875 2.5  240 29   timeout .875 900   150 12000
array-examples/standard_two_index_09.yml timeout .125  900 3000 11000 timeout .0    900   6100 12000 unknown .0  .027 5.7 .12  unknown .0  .040 5.7 .082 timeout .875 900    26 11000   done .875  1.0  110 13    timeout .125  900    31 13000   done .875 2.4  240 32   timeout .875 900   150 12000
array-industry-pattern/array_monotonic.yml timeout .3    900 3000 11000 timeout .0    900   7000 12000 unknown .0  .025 5.7 .29  unknown .0  .026 5.7 .11  done .9   860    35 13000   timeout .3    900    14000 7000    timeout .2    900    30 15000   out of memory (killed (signal 9, verification)) .0   14    15000 180   timeout .9   900   150 12000
array-industry-pattern/array_mul_init.yml timeout .214  900 2000 13000 timeout .0    900   5700 13000 unknown .0  .028 5.7 .19  unknown .0  .025 5.7 .096 timeout .857 900    160 11000   out of memory .286  8.3  15000 99    timeout .0    900    31 12000   out of memory (killed (signal 9, verification)) .0   10    15000 130   timeout .857 900   1600 12000
array-industry-pattern/array_of_struct_break.yml timeout .0    900 4300 5900 timeout .0    900   3800 6000 unknown .0  .020 5.7 .16  unknown .0  .040 5.7 .068 done .9   34    12 110   done .9    2.4  21 42    timeout .9    900    31 11000   done .9   1.4  170 22   timeout .9   900   150 14000
array-industry-pattern/array_of_struct_ptr_mul_init.yml timeout .0    900 6400 12000 timeout .0    900   5700 10000 unknown .0  .032 5.7 .099 unknown .0  .023 5.7 .079 timeout .857 900    83 12000   out of memory .357  9.5  15000 120    timeout .0    900    32 12000   out of memory (killed (signal 9, verification)) .0   13    15000 180   timeout .857 900   510 12000
array-industry-pattern/array_of_struct_single_elem_init.yml timeout .0    900 8000 11000 timeout .0    900   7300 9200 unknown .0  .026 5.7 .076 unknown .0  .026 5.7 .087 timeout .917 900    67 13000   timeout .25   900    11000 6700    timeout .25   900    34 13000   out of memory (killed (signal 9, verification)) .0   28    15000 160   timeout .917 900   150 13000
array-industry-pattern/array_ptr_single_elem_init-2.yml timeout .5    900 3500 14000 timeout .214  900   5500 11000 unknown .0  .047 5.7 .097 unknown .0  .031 5.7 .079 couldn't run: all seeds time out or crash .0   1.3  12 16   timeout .5    900    11000 6600    timeout .5    900    35 13000   done .714 1.7  180 21   timeout .857 900   150 13000
array-industry-pattern/array_shadowinit.yml timeout .875  900 2800 9600 unknown .875  3.5 280 29 unknown .0  .023 5.6 .091 unknown .0  .029 5.7 .11  false(unreach-call) .875 42    22 150   false(valid-deref) .875  .13 21 1.6  done .125  .28 30 3.0 done .875 840    1200 14000   timeout .875 900   160 11000
array-industry-pattern/array_single_elem_init.yml timeout .5    900 3500 12000 timeout .214  900   5400 11000 unknown .0  .021 5.7 .095 unknown .0  .023 5.7 .14  timeout .929 900    69 13000   timeout .5    900    11000 7000    timeout .5    900    35 13000   out of memory (killed (signal 9, verification)) .0   15    15000 200   timeout .929 900   160 12000
reducercommutativity/avg.yml segmentation fault .8    200 6900 2200 segmentation fault .7    170   6900 1900 unknown .0  .023 5.6 .15  unknown .0  .023 5.7 .16  false(unreach-call) .8   20    20 43   false(valid-deref) .8    .14 21 1.5  done .1    .28 30 3.0 done .8   840    990 8800   timeout .8   900   150 12000
reducercommutativity/avg05-1.yml timeout .8    900 3200 8000 timeout .8    900   2300 8900 unknown .0  .022 5.7 .12  unknown .0  .023 5.7 .083 done .8   30    18 90   done .8    .12 21 1.3  timeout .8    900    31 14000   done .8   .35 18 4.4 timeout .8   900   150 11000
reducercommutativity/avg10-2.yml timeout .8    900 2900 9100 unknown .8    620   740 8300 unknown .0  .024 5.7 .13  unknown .0  .027 5.8 .18  done .8   33    17 84   done .8    .13 21 1.2  timeout .8    900    31 14000   done .8   .36 18 4.1 timeout .8   900   150 10000
reducercommutativity/avg20-2.yml timeout .8    900 4100 12000 unknown .8    680   1800 6200 unknown .0  .022 5.7 .14  unknown .0  .023 5.7 .13  done .8   35    14 110   done .8    .14 21 .91 timeout .8    900    31 12000   done .8   .37 19 4.2 timeout .8   900   150 11000
reducercommutativity/avg40-2.yml timeout .8    900 7500 11000 out of memory .8    320   15000 4000 unknown .0  .027 5.6 .092 unknown .0  .024 5.7 .11  done .8   40    13 110   done .8    .13 21 1.3  timeout .8    900    31 13000   done .8   .37 19 4.9 timeout .8   900   160 11000
reducercommutativity/avg60-1.yml timeout .8    900 9700 7500 out of memory .8    330   15000 4300 unknown .0  .027 5.7 .11  unknown .0  .027 5.7 .14  done .8   45    13 130   done .8    .12 21 1.5  timeout .8    900    31 14000   done .8   .35 19 4.8 timeout .8   900   150 11000
reducercommutativity/max.yml timeout .8    900 1000 10000 timeout .7    900   400 12000 unknown .0  .044 5.5 .098 unknown .0  .024 5.7 .098 false(unreach-call) .8   22    19 62   false(valid-deref) .8    .16 21 1.5  done .1    .25 31 3.3 done .8   840    950 11000   timeout .8   900   150 11000
reducercommutativity/max05-1.yml timeout .8    900 2600 7900 unknown .8    59   1900 610 unknown .0  .022 5.7 .15  unknown .0  .020 5.7 .20  done .8   30    16 78   done .8    .56 22 7.4  timeout .8    900    31 14000   done .8   4.8  27 66   timeout .8   900   150 14000
reducercommutativity/max10-1.yml timeout .8    900 2900 6000 timeout .8    900   1400 7400 unknown .0  .035 5.7 .14  unknown .0  .023 5.7 .13  done .8   22    15 110   done .8    50    110 770    timeout .8    900    31 14000   done .8   220    51 3000   timeout .8   900   150 13000
reducercommutativity/max20-1.yml timeout .8    900 1100 5100 timeout .8    900   1200 6400 unknown .0  .023 5.7 .21  unknown .0  .023 5.7 .096 done .8   35    14 120   timeout .8    900    1700 8200    timeout .8    900    31 13000   timeout (verification) .0   900    120 13000   timeout .8   900   150 12000
reducercommutativity/max40-1.yml timeout .8    900 1400 5500 timeout .8    900   4100 6900 unknown .0  .023 5.5 .11  unknown .0  .025 5.7 .10  done .8   37    13 110   timeout .8    900    1700 7900    timeout .8    900    31 13000   timeout (verification) .0   900    150 12000   timeout .8   900   150 13000
reducercommutativity/max60-2.yml timeout .8    900 5100 7200 out of memory .8    830   15000 11000 unknown .0  .022 5.7 .098 unknown .0  .045 5.7 .071 done .8   44    12 140   timeout .8    900    1800 9000    timeout .8    900    31 13000   timeout (verification) .0   900    230 11000   timeout .8   900   150 11000
reducercommutativity/rangesum.yml timeout .875  900 4700 10000 unknown .875  57   520 620 unknown .0  .025 5.8 .13  unknown .0  .023 5.7 .085 false(unreach-call) .938 730    60 11000   false(valid-deref) .875  .22 40 3.9  done .0625 .25 31 3.3 done .938 840    200 9600   timeout .938 900   210 13000
reducercommutativity/rangesum05.yml timeout .786  900 2100 8500 unknown .786  210   710 2100 unknown .0  .030 5.6 .083 unknown .0  .029 5.7 .11  false(unreach-call) .857 10    16 30   false(unreach-call) .857  .13 21 1.5  done .0    .25 31 3.3 done .857 .66 64 8.9 error .857 890   150 12000
reducercommutativity/rangesum10.yml timeout .786  900 3000 7500 timeout .786  930   1900 9300 unknown .0  .024 5.6 .096 unknown .0  .037 5.7 .062 false(unreach-call) .857 11    15 33   false(unreach-call) .857  .14 22 1.2  done .0    .25 31 4.0 done .857 .66 62 10   error .857 890   150 12000
reducercommutativity/rangesum20.yml timeout .786  900 4500 7300 unknown .786  730   1000 7800 unknown .0  .026 5.6 .12  unknown .0  .021 5.6 .074 false(unreach-call) .857 13    15 46   false(unreach-call) .857  .20 36 2.3  done .0    .26 31 2.9 done .857 1.5  65 18   error .857 870   150 13000
reducercommutativity/rangesum40.yml timeout .786  900 5200 9700 unknown .786  850   2300 11000 unknown .0  .023 5.6 .12  unknown .0  .024 5.6 .096 false(unreach-call) .857 14    12 46   false(unreach-call) .857  .20 41 2.6  done .0    .24 31 3.8 done .857 6.9  71 88   error .857 890   150 11000
reducercommutativity/rangesum60.yml timeout .786  900 5300 9900 timeout .786  900   3600 12000 unknown .0  .021 5.6 .11  unknown .0  .040 5.7 .12  false(unreach-call) .857 12    12 73   false(unreach-call) .857  .25 48 2.6  done .0    .26 31 2.9 done .857 50    86 580   error .857 890   150 12000
reducercommutativity/sep.yml timeout .75   900 4600 14000 unknown .75   470   620 6500 unknown .0  .030 5.7 .15  unknown .0  .024 5.6 .14  false(unreach-call) .833 31    20 110   false(valid-deref) .833  .15 21 1.4  done .0833 .25 30 3.1 done .75  840    950 12000   timeout .833 900   150 13000
reducercommutativity/sep05-1.yml timeout .833  900 5400 8400 unknown .833  23   540 260 unknown .0  .025 5.7 .11  unknown .0  .026 5.7 .077 done .75  31    15 95   done .833  .14 21 1.4  timeout .833  900    31 12000   done .75  .38 18 4.9 timeout .833 900   150 11000
reducercommutativity/sep10-2.yml timeout .833  900 5700 5600 unknown .833  130   990 1300 unknown .0  .026 5.7 .13  unknown .0  .050 5.6 .14  done .75  28    15 90   done .833  .58 26 7.5  timeout .833  900    31 13000   done .75  .37 18 5.0 timeout .833 900   150 14000
reducercommutativity/sep20-1.yml timeout .833  900 5700 7400 out of memory .833  310   15000 3400 unknown .0  .021 5.7 .16  unknown .0  .023 5.7 .12  done .75  25    13 110   timeout .833  900    6400 6100    timeout .833  900    31 13000   done .75  .37 18 4.6 timeout .833 900   150 14000
reducercommutativity/sep40-1.yml timeout .833  900 5800 10000 timeout .833  900   4000 11000 unknown .0  .023 5.8 .063 unknown .0  .040 5.5 .082 done .75  42    14 120   timeout .833  900    11000 10000    timeout .833  900    31 15000   done .75  .37 19 4.4 timeout .833 900   150 12000
reducercommutativity/sep60-2.yml timeout .833  900 2700 13000 timeout .833  900   4400 12000 unknown .0  .043 5.7 .092 unknown .0  .029 5.7 .069 done .75  38    12 140   timeout .833  900    11000 13000    timeout .833  900    31 13000   done .75  .41 19 4.3 timeout .833 900   150 11000
reducercommutativity/sum.yml timeout .8    900 2400 10000 timeout .7    900   750 11000 unknown .0  .026 5.7 .13  unknown .0  .040 5.5 .11  false(unreach-call) .8   27    20 120   false(valid-deref) .8    .15 20 1.4  done .1    .25 31 2.9 done .8   840    960 11000   timeout .8   900   150 11000
reducercommutativity/sum05-2.yml timeout .8    900 2400 11000 timeout .8    900   3100 12000 unknown .0  .027 5.7 .20  unknown .0  .020 5.7 .13  done .8   31    16 100   done .8    .13 21 2.4  timeout .8    900    31 14000   done .8   .38 19 6.3 timeout .8   900   150 11000
reducercommutativity/sum10-1.yml timeout .8    900 4000 11000 timeout .8    900   3400 7500 unknown .0  .022 5.7 .068 unknown .0  .039 5.7 .080 done .8   30    16 96   done .8    .13 20 1.3  timeout .8    900    31 13000   done .8   .35 18 3.9 timeout .8   900   150 13000
reducercommutativity/sum20-2.yml timeout .8    900 4900 8000 timeout .8    900   3000 6800 unknown .0  .024 5.7 .092 unknown .0  .024 5.7 .15  done .8   25    14 130   done .8    .13 21 1.1  timeout .8    900    31 13000   done .8   .37 19 4.9 timeout .8   900   150 11000
reducercommutativity/sum40-2.yml timeout .8    900 10000 13000 timeout .8    900   3200 5100 unknown .0  .021 5.6 .19  unknown .0  .023 5.6 .081 done .8   39    13 110   done .8    .12 21 1.2  timeout .8    900    31 14000   done .8   .35 18 4.5 timeout .8   900   150 12000
reducercommutativity/sum60-2.yml timeout .8    900 11000 11000 timeout .8    900   6600 7100 unknown .0  .021 5.7 .064 unknown .0  .028 5.7 .18  done .8   33    12 140   done .8    .12 21 1.2  timeout .8    900    31 14000   done .8   .36 19 5.1 timeout .8   900   150 11000
array-tiling/mbpr2.yml timeout .8    900 5200 12000 true .8    3.9 280 35 unknown .0  .026 5.7 .16  unknown .0  .049 6.0 .090 false(unreach-call) .8   33    21 160   false(valid-deref) .75   .14 21 1.1  done .05   .25 30 3.1 done .8   840    92 11000   timeout .8   900   150 12000
array-tiling/mbpr3.yml timeout .792  900 4400 10000 true .792  7.2 300 75 unknown .0  .027 5.7 .078 unknown .0  .035 5.7 .069 false(unreach-call) .792 42    22 190   done .125  .15 21 1.2  done .0417 .26 31 2.9 done .792 840    89 10000   timeout .792 900   150 12000
array-tiling/mbpr4.yml timeout .786  900 5200 9200 true .786  6.3 300 55 unknown .0  .030 5.7 .19  unknown .0  .024 5.7 .10  false(unreach-call) .786 25    21 120   false(valid-deref) .75   .15 21 1.7  done .0357 .25 31 3.5 done .786 840    90 13000   timeout .786 900   150 11000
array-tiling/mbpr5.yml timeout .781  900 5200 13000 true .781  10   310 110 unknown .0  .024 5.9 .016 unknown .0  .025 5.7 .13  false(unreach-call) .781 67    24 380   done .0938 .16 21 1.2  done .0313 .26 31 3.0 done .781 840    90 9900   timeout .781 900   160 11000
array-tiling/mlceu.yml timeout .833  900 5100 11000 timeout .667  900   610 13000 unknown .0  .023 5.7 .17  unknown .0  .023 5.7 .12  done .75  29    13 130   done .833  .16 21 1.2  done .0    .20 31 2.3 done .75  850    2100 11000   timeout .75  900   150 12000
array-tiling/nr2.yml timeout .889  900 5400 9900 unknown .889  4.2 290 42 unknown .0  .023 5.7 .10  unknown .0  .023 5.7 .11  false(unreach-call) .889 49    21 320   false(valid-deref) .833  .15 21 1.4  done .0556 .26 30 4.6 done .889 840    92 13000   timeout .889 900   150 12000
array-tiling/nr3.yml timeout .889  900 3100 10000 unknown .889  6.5 290 80 unknown .0  .029 5.7 .17  unknown .0  .037 5.6 .082 false(unreach-call) .889 63    23 230   done .167  .14 21 1.4  done .0556 .26 30 5.0 done .889 840    89 11000   timeout .889 900   150 12000
array-tiling/nr4.yml timeout .889  900 4600 10000 unknown .889  5.2 280 52 unknown .0  .023 5.7 .18  unknown .0  .027 5.7 .070 false(unreach-call) .889 34    20 160   false(valid-deref) .833  .14 21 1.3  done .0556 .24 30 3.2 done .889 840    92 11000   timeout .889 900   150 11000
array-tiling/nr5.yml timeout .889  900 3500 12000 unknown .889  8.0 300 82 unknown .0  .019 5.7 .12  unknown .0  .031 5.7 .18  false(unreach-call) .889 38    26 180   done .167  .15 21 1.3  done .0556 .25 31 2.8 done .889 840    83 12000   timeout .889 900   150 13000
array-tiling/pnr2.yml timeout .938  900 2700 13000 unknown .938  3.8 280 37 unknown .0  .024 5.7 .13  unknown .0  .038 5.7 .11  timeout .875 900    45 12000   timeout .875  900    11000 9100    done .0    .21 30 2.3 done .75  840    92 10000   timeout .875 900   160 11000
array-tiling/pnr3.yml timeout .944  900 3100 12000 unknown .944  5.3 290 62 unknown .0  .024 5.7 .084 unknown .0  .023 5.7 .15  timeout .889 900    38 10000   done .278  .12 21 1.3  done .0    .23 31 2.3 done .722 840    88 11000   timeout .889 900   150 11000
array-tiling/pnr4.yml timeout .95   900 5100 13000 unknown .95   4.5 290 44 unknown .0  .023 5.7 .11  unknown .0  .035 5.7 .090 timeout .9   900    29 12000   timeout .9    900    11000 7800    done .0    .21 31 2.5 done .7   840    89 11000   error .9   880   150 12000
array-tiling/pnr5.yml timeout .955  900 2800 9200 unknown .955  6.2 300 66 unknown .0  .022 5.7 .14  unknown .0  .046 5.6 .15  timeout .909 900    46 9900   done .227  .13 21 1.3  done .0    .19 30 2.7 done .682 840    85 12000   error .909 880   150 11000
array-tiling/poly1.yml timeout .9    900 5100 8500 timeout .8    900   570 13000 unknown .0  .028 5.7 .14  unknown .0  .024 5.7 .074 done .8   20    17 69   done .9    .14 21 1.3  done .0    .19 31 2.8 done .8   850    2100 12000   timeout .8   900   150 10000
array-tiling/poly2.yml timeout .917  900 4500 7900 unknown .917  4.7 320 48 unknown .0  .027 5.7 .12  unknown .0  .023 5.7 .13  done .833 16    16 50   done .917  .13 21 1.0  done .0    .23 31 2.2 done .833 840    1100 12000   timeout .833 900   150 14000
array-tiling/pr2.yml timeout .667  900 2200 10000 unknown .667  4.0 280 38 unknown .0  .028 5.8 .16  unknown .0  .047 5.7 .075 false(unreach-call) .667 63    22 420   false(valid-deref) .611  .16 21 1.1  done .0556 .25 31 2.9 done .667 840    1600 10000   timeout .667 900   150 12000
array-tiling/pr3.yml timeout .65   900 4200 11000 unknown .65   4.8 280 53 unknown .0  .022 5.7 .14  unknown .0  .022 5.7 .11  false(unreach-call) .65  22    22 160   done .15   .12 21 2.7  done .05   .24 31 2.9 done .65  840    1400 9400   timeout .65  900   150 11000
array-tiling/pr4.yml timeout .636  900 3400 13000 unknown .636  4.4 290 44 unknown .0  .028 5.7 .13  unknown .0  .036 5.7 .13  false(unreach-call) .636 11    23 120   false(valid-deref) .591  .13 21 1.4  done .0455 .24 30 2.7 done .636 840    1700 8000   timeout .636 900   150 10000
array-tiling/pr5.yml timeout .625  900 980 13000 unknown .625  6.7 300 76 unknown .0  .030 5.6 .10  unknown .0  .028 5.6 .15  false(unreach-call) .625 15    19 84   done .125  .13 21 1.4  done .0417 .26 31 2.9 done .625 840    1400 9700   timeout .625 900   150 11000
array-tiling/revcpyswp2.yml done .938  24 810 220 unknown .938  5.2 300 47 unknown .0  .048 5.7 .077 unknown .0  .024 5.7 .15  done .875 680    27 8700   done .938  .16 21 1.5  done .0    .21 31 2.2 done .875 840    820 13000   error .938 890   150 13000
array-tiling/rew.yml timeout .917  900 4700 10000 unknown .917  3.5 270 36 unknown .0  .022 5.7 .12  unknown .0  .044 5.7 .087 done .833 58    15 200   done .917  .13 21 2.5  done .0    .21 31 2.5 done .833 850    2100 12000   timeout .833 900   150 13000
array-tiling/rewnif.yml timeout .917  900 5600 12000 unknown .917  3.8 270 51 unknown .0  .024 5.7 .13  unknown .0  .045 5.7 .097 done .833 55    17 180   done .917  .13 21 1.2  done .0    .20 31 2.6 done .833 850    2100 11000   timeout .833 900   150 12000
array-tiling/rewnifrev.yml out of memory .917  100 15000 1100 out of memory .0    79   15000 1000 unknown .0  .023 5.6 .13  unknown .0  .023 5.7 .095 done .833 24    15 140   done .917  .45 21 5.8  done .0    .21 31 2.3 done .833 840    110 13000   timeout .833 900   150 12000
array-tiling/rewnifrev2.yml out of memory .9    98 15000 1300 unknown .9    3.3 270 32 unknown .0  .025 5.6 .13  unknown .0  .023 5.7 .074 done .8   14    17 70   done .9    .45 21 5.1  done .0    .21 30 2.8 done .8   850    110 12000   timeout .8   900   150 11000
array-tiling/rewrev.yml out of memory .917  97 15000 1300 out of memory .0    81   15000 950 unknown .0  .047 5.7 .085 unknown .0  .027 5.6 .10  done .833 49    15 140   done .917  .42 21 5.2  done .0    .21 30 2.7 done .833 850    120 12000   timeout .833 900   150 11000
array-tiling/skipped.yml timeout .944  900 5100 12000 unknown .944  4.7 280 44 unknown .0  .027 5.8 .11  unknown .0  .029 5.7 .074 timeout .889 900    38 11000   timeout .889  900    11000 8500    done .0    .20 31 2.6 done .833 880    9900 10000   timeout .944 900   150 13000
array-tiling/skippedu.yml done 1.0    25 960 200 unknown 1.0    4.4 280 43 unknown .0  .024 5.8 .16  unknown .0  .029 5.7 .18  timeout .944 900    35 12000   timeout (false(unreach-call)) .944  900    11000 12000    done .0    .21 31 2.5 done .833 880    9600 12000   timeout 1.0   900   150 14000
array-tiling/tcpy.yml timeout .929  900 5000 13000 unknown .929  4.8 290 46 unknown .0  .029 5.8 .15  unknown .0  .034 5.7 .16  done .857 700    26 11000   done .857  .30 21 3.6  done .0    .21 31 2.2 done .857 840    190 9000   timeout .929 900   150 12000
array-programs/copysome1-1.yml timeout .0833 900 3400 12000 timeout .0    930   3400 13000 unknown .0  .046 5.6 .096 unknown .0  .027 5.7 .12  couldn't run: all seeds time out or crash .0   3.1  19 44   done .917  5.6  360 76    timeout .0833 900    30 13000   done .917 16    850 170   timeout .917 900   150 12000
array-programs/copysome1-2.yml timeout .0833 900 3900 10000 timeout .0    900   6900 11000 unknown .0  .028 5.8 .10  unknown .0  .052 5.5 .18  couldn't run: all seeds time out or crash .0   3.1  17 37   false(unreach-call) 1.0    5.8  400 89    timeout .0833 900    30 13000   done 1.0   19    940 160   timeout 1.0   900   150 12000
array-programs/copysome2-1.yml timeout .0714 900 4100 11000 timeout .0    900   7200 13000 unknown .0  .024 5.7 .19  unknown .0  .024 5.7 .092 couldn't run: all seeds time out or crash .0   3.1  18 42   unknown .929  7.7  530 140    timeout .0714 900    31 13000   done .929 35    1300 230   timeout .929 900   4200 14000
array-programs/copysome2-2.yml timeout .0714 900 4200 11000 timeout .0    900   7300 13000 unknown .0  .039 5.7 .27  unknown .0  .020 5.7 .056 couldn't run: all seeds time out or crash .0   3.1  19 35   false(unreach-call) 1.0    7.8  610 100    timeout .0714 900    31 11000   done 1.0   39    1500 250   timeout .929 900   4200 11000
array-crafted/bAnd1.yml timeout .8    900 3600 10000 timeout .8    900   3200 11000 unknown .0  .027 5.7 .13  unknown .0  .030 5.6 .18  done .8   44    12 170   done .8    .16 21 1.3  timeout .8    900    31 12000   done .8   .37 20 4.7 timeout .8   900   150 12000
array-crafted/bAnd2.yml timeout .1    900 5600 13000 timeout .0    900   6300 12000 unknown .0  .024 5.7 .074 unknown .0  .026 5.6 .13  done .8   170    11 1100   done .8    .51 25 6.2  timeout .8    900    30 12000   done .8   .56 39 8.9 timeout .8   900   150 12000
array-crafted/bAnd3.yml timeout .1    900 9100 9000 timeout .0    900   6400 11000 unknown .0  .022 5.7 .11  unknown .0  .022 5.7 .054 done .8   420    15 5600   done .8    38    84 460    timeout .8    900    31 12000   done .8   17    940 220   timeout .8   900   150 13000
array-crafted/bAnd4.yml timeout .1    900 2400 12000 timeout .0    900   6500 10000 unknown .0  .036 5.7 .095 unknown .0  .023 5.7 .088 timeout .8   900    24 12000   timeout .8    900    150 8900    timeout .1    900    31 14000   unknown .0   3.7  310 45   timeout .8   900   150 11000
array-crafted/bAnd5.yml timeout .833  900 1900 11000 timeout .833  900   910 13000 unknown .0  .025 5.6 .18  unknown .0  .028 5.7 .073 false(unreach-call) .833 710    46 9100   false(valid-deref) .833  .15 21 1.8  done .0833 .26 31 3.3 done .833 840    430 10000   timeout .833 900   160 15000
array-crafted/bor1.yml timeout .8    900 3800 12000 timeout .8    900   3300 8300 unknown .0  .028 5.7 .17  unknown .0  .023 5.7 .16  done .8   45    12 160   done .8    .15 21 1.2  timeout .8    900    31 13000   done .8   .36 19 5.1 timeout .8   900   150 12000
array-crafted/bor2.yml timeout .1    900 6000 11000 timeout .0    900   6300 9800 unknown .0  .023 5.7 .043 unknown .0  .022 5.7 .13  done .8   170    10 1000   done .8    .52 25 6.7  timeout .8    900    31 12000   done .8   .49 39 6.1 timeout .8   900   150 13000
array-crafted/bor3.yml timeout .1    900 9000 9200 timeout .0    900   6400 12000 unknown .0  .031 5.7 .10  unknown .0  .037 5.7 .090 done .8   420    15 6100   done .8    39    84 570    timeout .8    900    31 12000   done .8   7.7  1300 100   timeout .8   900   150 12000
array-crafted/bor4.yml timeout .1    900 2500 10000 timeout .0    900   6500 13000 unknown .0  .025 5.6 .14  unknown .0  .029 5.7 .12  timeout .8   900    25 12000   timeout .8    900    150 11000    timeout .1    900    31 13000   unknown .0   3.7  310 56   timeout .8   900   150 12000
array-crafted/bor5.yml timeout .833  900 5100 10000 unknown .833  5.0 300 47 unknown .0  .021 5.7 .11  unknown .0  .021 5.7 .13  false(unreach-call) .833 740    44 11000   false(valid-deref) .833  .15 21 1.4  done .0833 .25 31 2.9 done .833 840    400 9500   timeout .833 900   150 12000
array-crafted/mapavg1.yml timeout .8    900 3800 11000 out of memory .8    330   15000 4200 unknown .0  .024 5.7 .12  unknown .0  .023 5.7 .15  done .8   41    12 190   done .8    .14 21 1.2  timeout .8    900    31 14000   done .8   .37 19 4.5 timeout .8   900   150 11000
array-crafted/mapavg2.yml timeout .1    900 5800 12000 timeout .0    900   5100 13000 unknown .0  .029 5.7 .17  unknown .0  .037 5.7 .092 done .8   170    11 1200   done .8    .45 25 6.8  timeout .8    900    31 13000   done .8   .86 38 12   timeout .8   900   150 13000
array-crafted/mapavg3.yml timeout .1    900 5900 9200 timeout .0    900   5200 11000 unknown .0  .025 5.7 .085 unknown .0  .027 5.6 .12  done .8   410    15 5000   done .8    27    84 390    timeout .8    900    31 13000   done .8   56    1300 770   timeout .8   900   150 12000
array-crafted/mapavg4.yml timeout .1    900 2500 11000 timeout .0    900   5300 13000 unknown .0  .028 5.7 .18  unknown .0  .023 5.7 .11  timeout .8   900    25 13000   unknown .0    79    160 580    timeout .1    900    31 14000   done .8   840    470 7700   timeout .8   900   150 12000
array-crafted/mapavg5.yml timeout .833  900 5100 9100 unknown .75   470   500 5000 unknown .0  .051 5.7 .14  unknown .0  .048 5.5 .11  false(unreach-call) .833 720    42 8700   false(valid-deref) .833  .15 21 1.7  done .0833 .26 31 3.3 timeout (verification) .0   900    71 12000   error .0   3.6 150 42
array-crafted/mapsum1.yml timeout .8    900 3100 10000 timeout .8    900   3900 9700 unknown .0  .022 5.7 .076 unknown .0  .029 5.7 .12  done .8   50    11 180   done .8    .13 21 1.4  timeout .8    900    31 13000   done .8   .37 19 5.0 timeout .8   900   150 11000
array-crafted/mapsum2.yml timeout .1    900 5900 12000 timeout .0    900   6300 11000 unknown .0  .027 5.7 .16  unknown .0  .039 5.6 .086 done .8   170    11 1100   done .8    .45 25 6.6  timeout .8    900    31 14000   done .8   .85 39 12   timeout .8   900   150 11000
array-crafted/mapsum3.yml timeout .1    900 8400 7300 timeout .0    930   37 11000 unknown .0  .025 5.7 .098 unknown .0  .024 5.7 .063 done .8   420    14 5900   done .8    27    84 470    timeout .8    900    31 13000   done .8   56    1300 810   timeout .8   900   150 13000
array-crafted/mapsum4.yml timeout .1    900 2600 8900 timeout .0    900   6500 13000 unknown .0  .029 5.7 .12  unknown .0  .027 5.7 .040 timeout .8   900    24 12000   unknown .0    79    160 720    timeout .1    900    31 14000   done .8   840    470 7800   timeout .8   900   150 12000
array-crafted/mapsum5.yml timeout .833  900 5300 11000 unknown .833  240   770 2800 unknown .0  .028 5.7 .12  unknown .0  .021 5.7 .14  false(unreach-call) .833 710    50 8600   timeout (false(valid-deref)) .833  900    570 11000    done .0833 .24 31 3.1 timeout (verification) .0   900    140 12000   timeout .833 900   150 11000
array-crafted/xor1.yml timeout .8    900 3800 12000 timeout .8    900   3000 7500 unknown .0  .025 5.7 .068 unknown .0  .025 5.7 .095 done .8   41    11 200   done .8    1.3  33 17    timeout .8    900    31 13000   done .8   .37 19 5.1 timeout .8   900   150 10000
array-crafted/xor2.yml timeout .1    900 5800 11000 timeout .0    900   6300 12000 unknown .0  .024 5.7 .12  unknown .0  .024 5.7 .15  done .8   170    10 1200   done .8    470    310 4000    timeout .8    900    31 12000   done .8   .50 39 6.7 timeout .8   900   150 12000
array-crafted/xor3.yml timeout .1    900 6700 8400 timeout .0    900   6400 12000 unknown .0  .023 5.7 .094 unknown .0  .050 5.5 .092 done .8   410    15 6100   unknown .0    39    95 600    timeout .8    900    31 12000   done .8   9.1  1300 120   timeout .8   900   150 13000
array-crafted/xor4.yml timeout .1    900 2500 12000 timeout .0    900   6500 12000 unknown .0  .022 5.6 .15  unknown .0  .027 5.7 .087 timeout .8   900    28 13000   timeout .8    900    150 8500    timeout .1    900    30 15000   unknown .0   3.8  310 50   timeout .8   900   150 13000
array-crafted/xor5.yml timeout .833  900 5500 12000 unknown .833  5.2 290 52 unknown .0  .027 5.7 .14  unknown .0  .022 5.7 .13  false(unreach-call) .833 690    40 9800   false(valid-deref) .833  .33 25 3.8  done .0833 .25 31 2.9 done .833 860    130 11000   error .0   3.7 150 37
array-crafted/zero_sum1.yml timeout .9    900 2000 6100 timeout .8    900   950 7700 unknown .0  .024 5.7 .10  unknown .0  .029 5.7 .19  done .9   300    22 4500   done .9    .17 21 1.4  timeout .0    900    31 13000   done .9   840    1700 13000   timeout .9   900   150 12000
array-crafted/zero_sum2.yml exception .929  29 930 250 unknown .929  7.2 360 86 unknown .0  .023 5.6 .13  unknown .0  .027 5.7 .11  done .929 210    20 2400   done .929  .16 21 1.4  timeout .0    900    31 14000   done .929 840    1600 12000   timeout .929 900   150 11000
array-crafted/zero_sum3.yml exception .944  33 1100 330 unknown .944  12   400 140 unknown .0  .022 5.7 .25  unknown .0  .026 5.7 .13  done .944 320    25 3800   done .944  .19 21 1.5  timeout .0    900    31 13000   done .944 840    1400 9700   timeout .944 900   150 15000
array-crafted/zero_sum4.yml exception .955  37 1200 360 unknown .955  15   460 160 unknown .0  .030 5.7 .11  unknown .0  .029 5.7 .18  done .955 240    22 3100   done .955  .17 21 1.8  timeout .0    900    31 11000   done .955 840    1300 13000   timeout .955 900   150 11000
array-crafted/zero_sum5.yml exception .962  42 1200 400 unknown .962  22   550 270 unknown .0  .044 5.7 .10  unknown .0  .024 5.7 .067 done .962 280    24 3500   done .962  .18 21 2.0  timeout .0    900    30 13000   done .962 840    1100 13000   timeout .962 900   150 12000
array-crafted/zero_sum_const1.yml timeout .917  900 950 14000 timeout .75   900   610 13000 unknown .0  .021 5.7 .080 unknown .0  .025 5.7 .11  done .833 36    17 89   done .917  .13 21 1.3  done .0    .20 31 2.4 done .833 850    1100 12000   timeout .833 900   150 11000
array-crafted/zero_sum_const2.yml exception .938  28 870 320 unknown .938  8.8 320 110 unknown .0  .025 5.7 .083 unknown .0  .023 5.6 .21  done .875 30    18 78   done .938  .13 21 1.8  done .0    .23 31 2.8 done .875 850    1000 11000   timeout .938 900   150 12000
array-crafted/zero_sum_const3.yml exception .95   29 680 280 unknown .95   9.7 330 120 unknown .0  .043 5.6 .096 unknown .0  .022 5.6 .14  done .9   19    17 130   done .95   .13 21 1.5  done .0    .21 31 2.6 done .9   850    990 10000   timeout .9   900   150 11000
array-crafted/zero_sum_const4.yml exception .958  31 910 360 unknown .958  15   360 180 unknown .0  .025 5.7 .11  unknown .0  .040 5.8 .065 done .917 19    15 64   done .958  .13 21 1.8  done .0    .20 31 2.2 done .917 850    980 12000   timeout .917 900   150 12000
array-crafted/zero_sum_const5.yml exception .964  35 890 380 unknown .964  18   400 190 unknown .0  .043 5.6 .090 unknown .0  .022 5.5 .094 done .929 18    15 66   done .964  .14 21 1.4  done .0    .21 31 2.8 done .929 850    1000 10000   timeout .964 900   150 11000
array-crafted/zero_sum_const_m2.yml timeout .938  900 1500 9900 timeout .812  900   1500 9800 unknown .0  .031 5.7 .076 unknown .0  .027 5.6 .19  done .875 35    17 93   done .938  .13 21 1.4  done .0    .20 31 2.6 done .875 850    1000 13000   timeout .938 900   150 13000
array-crafted/zero_sum_const_m3.yml exception .95   48 1200 640 unknown .95   28   710 400 unknown .0  .045 5.7 .087 unknown .0  .026 5.7 .14  done .9   36    16 110   done .95   .16 21 1.5  done .0    .21 31 2.4 done .9   850    990 11000   timeout .9   900   150 12000
array-crafted/zero_sum_const_m4.yml timeout .958  900 3300 9800 unknown .958  300   1400 4000 unknown .0  .028 5.7 .18  unknown .0  .036 5.5 .074 done .917 27    16 140   done .958  .14 21 2.0  done .0    .20 30 2.4 done .917 850    1000 13000   timeout .958 900   150 13000
array-crafted/zero_sum_const_m5.yml timeout .964  900 1500 12000 timeout .964  900   970 12000 unknown .0  .023 5.6 .12  unknown .0  .029 5.6 .19  done .929 18    16 80   done .964  .15 21 1.4  done .0    .24 31 2.2 done .929 850    1000 12000   timeout .929 900   160 12000
array-crafted/zero_sum_m2.yml timeout .929  900 4900 9700 unknown .857  730   4200 8600 unknown .0  .022 5.9 .054 unknown .0  .025 5.7 .10  done .929 310    20 3900   done .929  .16 22 1.4  timeout .0    900    31 12000   done .929 840    1500 11000   timeout .929 900   150 12000
array-crafted/zero_sum_m3.yml timeout .944  910 1800 9300 timeout .889  900   1100 7800 unknown .0  .025 5.8 .091 unknown .0  .034 5.7 .13  done .944 250    22 3500   done .944  .15 21 1.7  timeout .0    900    31 11000   done .944 840    1500 12000   timeout .944 900   150 10000
array-crafted/zero_sum_m4.yml timeout .955  900 2200 11000 timeout .909  900   2000 9900 unknown .0  .029 5.6 .18  unknown .0  .051 5.5 .092 done .955 320    21 3900   done .955  .17 21 1.5  timeout .0    900    31 13000   done .955 840    1600 11000   timeout .955 900   150 12000
array-crafted/zero_sum_m5.yml timeout .962  900 10000 12000 timeout .962  900   9500 9100 unknown .0  .020 5.7 .12  unknown .0  .025 5.7 .12  done .962 260    23 3500   done .962  .18 21 2.1  timeout .0    900    30 14000   done .962 840    1600 13000   timeout .962 900   150 12000
array-multidimensional/add-2-n-u.yml timeout .0    900 6500 11000 timeout .0    900   6100 12000 unknown .0  .026 5.7 .087 unknown .0  .026 5.7 .10  couldn't run: all seeds time out or crash .0   .17 11 1.8 unknown .0    56    3400 860    done .0    .23 31 2.8 done .0   96    9100 1100   out of memory .0   15   15000 200
array-multidimensional/add-3-n-u.yml timeout .0    900 6400 11000 timeout .0    900   6200 13000 unknown .0  .027 5.7 .15  unknown .0  .021 5.6 .13  couldn't run: all seeds time out or crash .0   .17 10 1.9 out of memory .0    5.5  15000 60    done .0    .25 30 2.9 out of memory (killed (signal 9, verification)) .0   150    15000 2100   timeout .0   900   1600 14000
array-multidimensional/copy-2-u.yml timeout .143  900 6100 11000 timeout .143  900   6700 11000 unknown .0  .028 5.7 .12  unknown .0  .031 5.7 .078 couldn't run: all seeds time out or crash .0   3.1  18 44   unknown .929  25    890 320    timeout .214  900    30 13000   done .929 38    3800 540   timeout .929 900   300 12000
array-multidimensional/copy-3-n-u.yml timeout .0    900 6400 11000 timeout .0    900   6700 13000 unknown .0  .052 5.7 .10  unknown .0  .027 5.7 .072 couldn't run: all seeds time out or crash .0   .16 11 1.6 false(valid-deref) .0    1.9  2200 21    done .0    .26 31 2.8 out of memory (killed (signal 9, verification)) .0   160    15000 1900   timeout .0   900   1600 12000
array-multidimensional/copy-partial-2-n-u.yml timeout .0    900 6200 12000 timeout .0    900   6700 12000 unknown .0  .037 5.6 .11  unknown .0  .023 5.7 .12  couldn't run: all seeds time out or crash .0   .15 10 1.6 unknown .0    19    1300 230    done .0    .23 30 2.8 done .0   40    4000 470   timeout .0   900   1600 14000
array-multidimensional/copy-partial-3-u.yml timeout .0    900 6300 11000 timeout .0    900   6100 11000 unknown .0  .021 5.7 .17  unknown .0  .022 5.7 .14  couldn't run: all seeds time out or crash .0   .18 10 1.4 false(valid-deref) .0    .12 22 1.5  done .0    .26 30 3.6 out of memory (killed (signal 9, verification)) .0   180    15000 2800   timeout .0   900   1600 10000
array-multidimensional/diff-2-n-u.yml timeout .0    900 6200 11000 timeout .0    900   6100 11000 unknown .0  .021 5.7 .10  unknown .0  .021 5.7 .095 couldn't run: all seeds time out or crash .0   .17 11 1.8 unknown .0    79    5000 1100    done .0    .26 31 3.0 done .0   160    13000 2200   timeout .0   900   1600 13000
array-multidimensional/diff-3-n-u.yml timeout .0    900 6600 11000 timeout .0    900   6100 11000 unknown .0  .021 5.7 .15  unknown .0  .024 5.8 .076 couldn't run: all seeds time out or crash .0   .18 10 1.9 out of memory .0    5.6  15000 55    done .0    .26 31 3.4 out of memory (killed (signal 9, verification)) .0   160    15000 2300   timeout .0   900   1600 11000
array-multidimensional/init-2-n-u.yml timeout .9    900 6500 11000 timeout .9    900   5700 12000 unknown .0  .024 5.7 .072 unknown .0  .022 5.7 .12  done .9   95    13 1200   done .9    19    73 330    timeout .9    900    30 13000   done .9   18    2400 250   timeout .9   900   150 12000
array-multidimensional/init-3-u.yml timeout .0    900 6500 11000 timeout .0    900   6600 10000 unknown .0  .023 5.6 .088 unknown .0  .052 5.6 .14  couldn't run: all seeds time out or crash .0   .16 11 1.7 false(valid-deref) .0    .14 21 1.3  done .0    .25 31 2.8 out of memory (killed (signal 9, verification)) .0   250    15000 3900   timeout .0   900   1600 11000
array-multidimensional/init-4-n-u.yml timeout .0    900 6700 11000 timeout .0    900   6500 11000 unknown .0  .023 5.7 .25  unknown .0  .022 5.7 .13  couldn't run: all seeds time out or crash .0   .16 10 2.1 timeout .0    900    5600 14000    done .0    .25 31 3.0 out of memory (killed (signal 9, verification)) .0   290    15000 3800   timeout .0   900   1600 12000
array-multidimensional/init-non-constant-2-n-u.yml timeout .9    900 4700 10000 unknown .9    5.4 290 49 unknown .0  .027 5.7 .19  unknown .0  .022 5.7 .12  timeout .9   900    10 13000   timeout .9    900    11000 13000    timeout .6    900    31 11000   done .9   850    4300 11000   timeout .9   900   150 12000
array-multidimensional/init-non-constant-3-u.yml timeout .0    900 6500 12000 timeout .0    900   6600 11000 unknown .0  .031 5.8 .16  unknown .0  .023 5.7 .097 couldn't run: all seeds time out or crash .0   .16 11 2.0 false(valid-deref) .0    .11 22 1.6  done .0    .25 31 3.7 out of memory (killed (signal 9, verification)) .0   140    15000 2200   timeout .0   900   1600 12000
array-multidimensional/max-2-u.yml timeout .0    900 6200 12000 timeout .0    900   6200 11000 unknown .0  .023 5.7 .13  unknown .0  .024 5.7 .11  couldn't run: all seeds time out or crash .0   .18 10 1.8 timeout .0    900    3200 8300    done .0    .25 31 3.0 unknown .0   35    3300 460   timeout .0   900   1600 11000
array-multidimensional/max-3-n-u.yml timeout .0    900 6300 12000 timeout .0    900   6100 12000 unknown .0  .052 5.6 .18  unknown .0  .024 5.7 .13  couldn't run: all seeds time out or crash .0   .16 11 1.8 out of memory .0    5.6  15000 68    done .0    .24 30 3.5 out of memory (killed (signal 9, verification)) .0   170    15000 2200   timeout .0   900   1600 11000
array-multidimensional/min-2-u.yml timeout .0    900 6300 11000 timeout .0    900   6200 11000 unknown .0  .047 5.6 .10  unknown .0  .023 5.7 .074 couldn't run: all seeds time out or crash .0   .15 11 2.2 timeout .0    900    3000 8600    done .0    .25 31 2.8 unknown .0   36    3300 510   timeout .0   900   1600 12000
array-multidimensional/min-3-n-u.yml timeout .0    900 6300 11000 timeout .0    900   6100 12000 unknown .0  .025 5.7 .13  unknown .0  .025 5.7 .087 couldn't run: all seeds time out or crash .0   .17 11 2.1 out of memory .0    5.5  15000 72    done .0    .24 31 3.2 out of memory (killed (signal 9, verification)) .0   170    15000 2100   timeout .0   900   1600 11000
array-multidimensional/rev-2-n-u.yml timeout .0    900 6200 11000 timeout .0    900   6000 11000 unknown .0  .024 5.6 .13  unknown .0  .034 5.7 .12  couldn't run: all seeds time out or crash .0   .16 10 1.8 unknown .0    43    1300 610    done .0    .28 31 2.8 done .0   57    5700 740   timeout .0   900   1600 11000
array-multidimensional/rev-3-u.yml timeout .0    900 3100 11000 timeout .0    900   6700 11000 unknown .0  .026 5.7 .11  unknown .0  .023 5.7 .079 couldn't run: all seeds time out or crash .0   .19 11 1.9 false(valid-deref) .0    .14 21 1.2  done .0    .24 31 3.0 out of memory (killed (signal 9, verification)) .0   170    15000 2100   timeout .0   900   1600 12000
array-multidimensional/transpose-u.yml timeout .143  900 6500 11000 timeout .0    900   6600 12000 unknown .0  .030 5.5 .099 unknown .0  .023 5.7 .078 couldn't run: all seeds time out or crash .0   3.1  18 43   unknown .929  25    880 340    timeout .214  900    30 12000   done .929 39    3900 430   timeout .929 900   300 11000
../sv-benchmarks/c/ status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J)
total 169 84.7 140000 740000 1600000 169 75.9  110000 740000 1300000 169 .0  4.6 960 21 169 .0  4.9 960 19 169 124   57000 4300 730000 169 120   34000 300000 360000 169 42.0 90000 5200 1300000 169 116 69000 420000 870000 169 130 150000 80000 2000000
Run set coveritest.test-comp19_prop-coverage-branches.ReachSafety-Arrays cpa-tiger.test-comp19_prop-coverage-branches.ReachSafety-Arrays esbmc-kind.test-comp19_prop-coverage-branches.ReachSafety-Arrays esbmc-falsi.test-comp19_prop-coverage-branches.ReachSafety-Arrays fairfuzz.test-comp19_prop-coverage-branches.ReachSafety-Arrays klee.test-comp19_prop-coverage-branches.ReachSafety-Arrays prtest.test-comp19_prop-coverage-branches.ReachSafety-Arrays symbiotic.test-comp19_prop-coverage-branches.ReachSafety-Arrays verifuzz.test-comp19_prop-coverage-branches.ReachSafety-Arrays