Benchmark CPA/CoVeriTest CPA/Tiger-MGP ESBMC-bkind ESBMC-falsif FairFuzz KLEE PRtest Symbiotic VeriFuzz
Tool CPAchecker 1.8-svn 30375 CPAchecker 1.8-svn 30541M ESBMC version 6.0.0 64-bit x86_64 linux FairFuzz TC-0.0.2 KLEE 2.0.0-pre-test-comp tbf v0.3.0-testcomp19 symbiotic 6.0.3-dev-fd3f777b VeriFuzz 1.0.1
Limits timelimit: 900 s, memlimit: 15000 MB, CPU core limit: 8
Host apollon*
OS Linux 4.15.0-45-generic
System CPU: Intel Xeon E3-1230 v5 @ 3.40 GHz, cores: 8, frequency: 3.8 GHz, Turbo Boost: disabled; RAM: 33546 MB
Date of execution 2019-02-05 21:05:56 CET 2019-02-05 21:13:54 CET 2019-02-05 21:13:25 CET 2019-02-05 21:11:17 CET 2019-02-08 09:39:09 CET 2019-02-05 21:09:47 CET 2019-02-06 06:02:44 CET 2019-02-06 07:07:32 CET 2019-02-06 07:17:17 CET
Run set coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized esbmc-kind.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized esbmc-falsi.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized klee.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized prtest.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized
Options -benchmark -heap 10000M -testcomp19 -benchmark -heap 10000M -tigertestcomp19 -s kinduction -s falsi --stats -i random --write-xml --svcomp-nondets --test-comp --verifier klee-testcomp --testcomp
../sv-benchmarks/c/seq-mthreaded/ status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J)
pals_STARTPALS_ActiveStandby.1.ufo.BOUNDED-10.pals.yml done 1 29 1100 220 unknown 1 5.0 300 44 false(unreach-call) .13 29 1.7 false(unreach-call) .12 29 1.5 couldn't run: all seeds time out or crash 3.2 10 49 false(unreach-call) 1 .16 21 2.2 timeout 900 31 14000 done 1 1.8 25 26 done 1 5.2 180 59
pals_STARTPALS_ActiveStandby.1.ufo.UNBOUNDED.pals.yml done 1 25 870 190 unknown 1 4.9 310 44 false(unreach-call) .13 29 1.5 false(unreach-call) .12 29 1.7 couldn't run: all seeds time out or crash 3.2 11 41 false(unreach-call) 1 .18 21 2.1 timeout 900 31 12000 done 1 1.8 26 23 done 1 5.3 170 57
pals_STARTPALS_ActiveStandby.4_1.ufo.BOUNDED-10.pals.yml done 1 26 870 230 unknown 1 6.7 330 64 false(unreach-call) .20 29 4.5 false(unreach-call) .20 29 3.4 couldn't run: all seeds time out or crash 3.2 10 38 false(unreach-call) 1 .18 22 2.5 timeout 900 31 14000 done 1 1.8 25 22 done 1 5.0 170 51
pals_STARTPALS_ActiveStandby.4_1.ufo.UNBOUNDED.pals.yml done 1 25 890 200 unknown 1 6.2 320 53 false(unreach-call) .21 29 2.8 false(unreach-call) .19 29 2.5 couldn't run: all seeds time out or crash 3.2 10 37 false(unreach-call) 1 .30 23 3.3 timeout 900 31 12000 done 1 1.8 26 22 done 1 5.7 170 62
pals_STARTPALS_ActiveStandby.4_2.ufo.BOUNDED-10.pals.yml done 1 26 890 210 unknown 1 6.8 330 55 false(unreach-call) .20 29 2.8 false(unreach-call) .19 29 2.5 couldn't run: all seeds time out or crash 3.2 10 46 false(unreach-call) 1 .23 25 2.5 timeout 900 30 13000 done 1 1.8 25 27 done 1 4.9 170 50
pals_STARTPALS_ActiveStandby.4_2.ufo.UNBOUNDED.pals.yml done 1 31 1100 230 unknown 1 6.6 330 62 false(unreach-call) .20 29 2.3 false(unreach-call) .20 29 2.3 couldn't run: all seeds time out or crash 3.2 10 45 false(unreach-call) 1 .17 21 2.0 timeout 900 31 11000 done 1 1.8 26 22 done 1 5.1 170 49
pals_STARTPALS_ActiveStandby.5.ufo.BOUNDED-10.pals.yml done 1 130 2200 1500 unknown 1 89   550 1100 false(unreach-call) .51 29 6.3 false(unreach-call) .34 29 3.8 couldn't run: all seeds time out or crash 3.2 10 37 false(unreach-call) 1 .84 41 9.3 timeout 900 31 14000 done 1 8.3 260 100 done 1 14   170 150
pals_STARTPALS_ActiveStandby.5.ufo.UNBOUNDED.pals.yml done 1 42 1100 410 unknown 1 22   410 240 false(unreach-call) .48 29 6.1 false(unreach-call) .32 29 4.3 couldn't run: all seeds time out or crash 3.2 10 42 false(unreach-call) 1 8.8  170 120   timeout 900 31 11000 done 1 8.1 250 110 done 1 14   170 210
pals_STARTPALS_Triplicated.1.ufo.BOUNDED-10.pals.yml done 1 39 1200 340 unknown 1 24   860 240 false(unreach-call) .47 29 5.3 false(unreach-call) .29 29 3.6 couldn't run: all seeds time out or crash 3.2 11 37 false(unreach-call) 1 .37 40 4.3 timeout 900 31 13000 done 1 1.8 26 23 done 1 5.6 170 52
pals_STARTPALS_Triplicated.1.ufo.UNBOUNDED.pals.yml done 1 39 1300 350 unknown 1 23   880 250 false(unreach-call) .44 29 5.0 false(unreach-call) .30 29 3.2 couldn't run: all seeds time out or crash 3.2 11 38 false(unreach-call) 1 .37 39 4.6 timeout 900 30 12000 done 1 1.8 26 29 done 1 5.6 170 59
pals_STARTPALS_Triplicated.2.ufo.BOUNDED-10.pals.yml done 1 43 1400 370 unknown 1 25   780 220 false(unreach-call) .40 29 5.3 false(unreach-call) .27 29 2.9 couldn't run: all seeds time out or crash 3.2 11 43 false(unreach-call) 1 1.1  67 15   timeout 900 31 11000 done 1 2.0 26 26 done 1 15   170 180
pals_STARTPALS_Triplicated.2.ufo.UNBOUNDED.pals.yml done 1 40 1400 420 unknown 1 24   900 250 false(unreach-call) .40 29 4.9 false(unreach-call) .26 29 3.5 couldn't run: all seeds time out or crash 3.2 10 45 false(unreach-call) 1 .54 48 6.7 timeout 900 31 13000 done 1 2.0 26 25 done 1 12   170 130
pals_floodmax.3.1.ufo.BOUNDED-6.pals.yml done 1 27 1000 300 unknown 1 5.8 300 62 false(unreach-call) .51 30 5.6 false(unreach-call) .26 29 2.9 couldn't run: all seeds time out or crash 3.2 11 42 false(unreach-call) 1 .89 38 11   timeout 900 30 12000 done 2.5 27 32 done 1 4.7 170 43
pals_floodmax.3.1.ufo.UNBOUNDED.pals.yml done 1 26 1000 290 unknown 1 5.6 300 52 false(unreach-call) .51 30 7.1 false(unreach-call) .24 29 2.9 couldn't run: all seeds time out or crash 3.2 10 44 false(unreach-call) 1 .87 38 10   timeout 900 31 12000 done 2.4 27 32 done 1 4.8 170 50
pals_floodmax.3.2.ufo.BOUNDED-6.pals.yml done 1 25 810 240 unknown 1 4.5 280 44 false(unreach-call) .21 29 2.1 false(unreach-call) .17 29 2.1 couldn't run: all seeds time out or crash 3.2 10 44 false(unreach-call) 1 .60 33 6.9 timeout 900 31 11000 done 4.6 22 59 done 1 4.9 170 53
pals_floodmax.3.2.ufo.UNBOUNDED.pals.yml done 1 26 790 230 unknown 1 4.7 290 42 false(unreach-call) .20 29 2.1 false(unreach-call) .19 29 2.0 couldn't run: all seeds time out or crash 3.2 11 45 false(unreach-call) 1 .35 28 3.8 timeout 900 31 14000 done 6.4 22 89 done 1 4.8 170 47
pals_floodmax.3.3.ufo.BOUNDED-6.pals.yml done 1 27 1100 270 unknown 1 6.1 310 64 false(unreach-call) .54 30 8.0 false(unreach-call) .26 29 3.2 couldn't run: all seeds time out or crash 3.2 11 45 false(unreach-call) 1 .61 33 9.1 timeout 900 31 13000 done 5.0 23 73 done 1 4.9 170 57
pals_floodmax.3.3.ufo.UNBOUNDED.pals.yml done 1 27 1300 250 unknown 1 6.1 300 61 false(unreach-call) .52 30 6.1 false(unreach-call) .26 29 3.4 couldn't run: all seeds time out or crash 3.2 10 41 false(unreach-call) 1 .36 29 4.1 timeout 900 30 13000 done 4.3 23 58 done 1 5.0 170 47
pals_floodmax.3.4.ufo.BOUNDED-6.pals.yml done 1 28 920 300 unknown 1 7.7 320 81 false(unreach-call) .53 30 6.7 false(unreach-call) .26 29 4.3 couldn't run: all seeds time out or crash 3.2 10 42 false(unreach-call) 1 .68 33 8.9 timeout 900 31 13000 done 29   27 390 done 1 5.2 170 48
pals_floodmax.3.4.ufo.UNBOUNDED.pals.yml done 1 26 1100 290 unknown 1 6.5 300 71 false(unreach-call) .55 30 6.6 false(unreach-call) .26 29 3.8 couldn't run: all seeds time out or crash 3.2 11 41 false(unreach-call) 1 1.1  34 15   timeout 900 31 13000 done 29   27 410 done 1 4.9 170 52
pals_floodmax.3_overflow.ufo.UNBOUNDED.pals.yml timeout 900 1500 8800 timeout 900   800 6100 timeout 900    3600 9600   timeout 900    2700 9200   couldn't run: all seeds time out or crash 3.2 11 40 false(unreach-call) 1 1.6  33 20   timeout 900 31 11000 done 200   110 3100 done 1 4.8 170 49
pals_floodmax.4.1.ufo.BOUNDED-8.pals.yml done 1 62 890 550 unknown 1 40   430 290 false(unreach-call) 1.5  49 18   false(unreach-call) .74 45 8.8 couldn't run: all seeds time out or crash 3.2 11 45 timeout 900    3100 8800   timeout 900 31 14000 done 79   1700 960 done 1 5.5 190 58
pals_floodmax.4.1.ufo.UNBOUNDED.pals.yml done 1 32 900 380 unknown 1 10   380 88 false(unreach-call) 1.5  50 18   false(unreach-call) .76 46 9.8 couldn't run: all seeds time out or crash 3.2 11 45 timeout 900    3300 8900   timeout 900 31 12000 done 90   1800 1100 done 1 5.6 190 52
pals_floodmax.4.2.ufo.BOUNDED-8.pals.yml done 1 30 840 340 unknown 1 10   340 95 false(unreach-call) 1.2  52 19   false(unreach-call) .58 47 7.9 couldn't run: all seeds time out or crash 3.2 12 47 timeout 900    3100 9300   timeout 900 31 12000 done 21   160 280 done 1 5.7 190 64
pals_floodmax.4.2.ufo.UNBOUNDED.pals.yml done 1 30 910 330 unknown 1 9.0 370 85 false(unreach-call) 1.3  53 17   false(unreach-call) .56 47 7.7 couldn't run: all seeds time out or crash 3.2 12 52 false(unreach-call) 1 .27 30 3.1 timeout 900 31 11000 done 20   160 320 done 1 5.6 190 60
pals_floodmax.4.3.ufo.BOUNDED-8.pals.yml done 1 36 860 360 unknown 1 15   390 120 false(unreach-call) 1.6  53 22   false(unreach-call) .81 48 9.8 couldn't run: all seeds time out or crash 3.2 12 41 timeout 900    3100 8300   timeout 900 31 13000 done 35   280 440 done 1 5.5 190 54
pals_floodmax.4.3.ufo.UNBOUNDED.pals.yml done 1 42 940 450 unknown 1 21   500 190 false(unreach-call) 1.6  52 22   false(unreach-call) .81 49 13   couldn't run: all seeds time out or crash 3.2 12 42 false(unreach-call) 1 .29 30 3.4 timeout 900 31 12000 done 34   270 450 done 1 5.6 190 58
pals_floodmax.4.4.ufo.BOUNDED-8.pals.yml done 1 58 780 500 unknown 1 38   440 280 false(unreach-call) 1.9  53 23   false(unreach-call) 1.1  49 15   couldn't run: all seeds time out or crash 3.2 12 43 timeout 900    3100 11000   timeout 900 31 12000 done 91   650 1100 done 1 27   190 310
pals_floodmax.4.4.ufo.UNBOUNDED.pals.yml done 1 85 850 700 unknown 1 63   530 460 false(unreach-call) 2.0  53 29   false(unreach-call) 1.1  49 14   couldn't run: all seeds time out or crash 3.3 12 42 false(unreach-call) 1 .26 31 3.8 timeout 900 31 13000 done 120   700 1500 done 1 31   190 430
pals_floodmax.4_overflow.ufo.UNBOUNDED.pals.yml timeout 900 1600 8700 timeout 900   1200 5800 timeout 900    780 13000   timeout 900    580 11000   couldn't run: all seeds time out or crash 3.2 12 42 timeout 900    3100 9700   timeout 900 31 12000 timeout (verification) 900   1300 11000 done 1 5.5 190 65
pals_floodmax.5.1.ufo.BOUNDED-10.pals.yml done 1 160 1300 1100 unknown 1 130   710 1100 false(unreach-call) 6.4  150 69   false(unreach-call) 3.4  150 53   couldn't run: all seeds time out or crash 3.2 12 44 timeout 900    15000 5600   timeout 900 34 13000 out of memory (killed (signal 9, verification)) 290   15000 3700 done 1 8.7 210 110
pals_floodmax.5.1.ufo.UNBOUNDED.pals.yml done 1 190 1200 1500 unknown 1 170   740 1100 false(unreach-call) 6.4  150 66   false(unreach-call) 3.4  150 49   couldn't run: all seeds time out or crash 3.2 12 49 false(unreach-call) 1 19    940 180   timeout 900 34 13000 out of memory (killed (signal 9, verification)) 290   15000 3700 done 1 8.8 220 99
pals_floodmax.5.2.ufo.BOUNDED-10.pals.yml done 1 41 880 440 unknown 1 20   440 180 false(unreach-call) 5.6  160 77   false(unreach-call) 2.8  160 31   couldn't run: all seeds time out or crash 3.4 21 41 timeout 900    15000 6300   timeout 900 35 12000 out of memory (killed (signal 9, verification)) 76   15000 1000 done 1 8.8 220 97
pals_floodmax.5.2.ufo.UNBOUNDED.pals.yml done 1 39 1100 400 unknown 1 18   450 160 false(unreach-call) 5.7  160 66   false(unreach-call) 2.8  160 33   couldn't run: all seeds time out or crash 3.4 21 48 false(unreach-call) 1 160    5700 1500   timeout 900 35 12000 out of memory (killed (signal 9, verification)) 77   15000 1100 done 1 8.9 230 87
pals_floodmax.5.3.ufo.BOUNDED-10.pals.yml done 1 70 1100 620 unknown 1 50   560 480 false(unreach-call) 7.0  160 87   false(unreach-call) 3.6  160 52   couldn't run: all seeds time out or crash 3.4 21 43 false(unreach-call) 1 180    6000 1300   timeout 900 35 13000 out of memory (killed (signal 9, verification)) 75   15000 900 done 1 8.8 230 96
pals_floodmax.5.3.ufo.UNBOUNDED.pals.yml done 1 160 1200 1200 unknown 1 140   680 1300 false(unreach-call) 7.1  160 89   false(unreach-call) 3.6  160 47   couldn't run: all seeds time out or crash 3.4 21 48 false(unreach-call) 1 160    5600 1300   timeout 900 34 11000 out of memory (killed (signal 9, verification)) 77   15000 980 done 1 8.9 220 97
pals_floodmax.5.4.ufo.BOUNDED-10.pals.yml timeout 900 1500 5300 timeout 900   950 5700 false(unreach-call) 7.0  160 76   false(unreach-call) 3.6  160 43   couldn't run: all seeds time out or crash 3.4 20 44 timeout 900    15000 5400   timeout 900 35 10000 out of memory (killed (signal 9, verification)) 75   15000 950 done 1 300   230 4300
pals_floodmax.5.4.ufo.UNBOUNDED.pals.yml timeout 900 1500 5700 timeout 900   1100 5900 false(unreach-call) 7.2  160 81   false(unreach-call) 3.7  160 44   couldn't run: all seeds time out or crash 3.4 21 44 timeout 900    15000 5300   timeout 900 35 12000 out of memory (killed (signal 9, verification)) 77   15000 980 done 1 420   220 5900
pals_floodmax.5_overflow.ufo.UNBOUNDED.pals.yml timeout 900 1700 5800 timeout 900   1000 8200 timeout 900    220 12000   timeout 900    220 11000   couldn't run: all seeds time out or crash 3.4 21 49 timeout 900    15000 4200   timeout 900 35 11000 out of memory (killed (signal 9, verification)) 77   15000 1000 done 1 9.0 230 90
pals_lcr-var-start-time.3.1.ufo.BOUNDED-6.pals.yml done 1 35 1100 330 unknown 1 15   340 150 false(unreach-call) .38 28 4.8 false(unreach-call) .25 28 3.0 couldn't run: all seeds time out or crash 3.2 11 43 false(unreach-call) 1 .20 21 2.5 timeout 900 31 12000 done 1 1.6 20 24 done 1 4.5 170 44
pals_lcr-var-start-time.3.1.ufo.UNBOUNDED.pals.yml done 1 30 850 250 unknown 1 9.7 380 110 false(unreach-call) .38 28 4.8 false(unreach-call) .27 28 4.1 couldn't run: all seeds time out or crash 3.2 11 41 false(unreach-call) 1 .20 20 2.2 timeout 900 31 12000 done 1 1.6 20 22 done 1 27   160 380
pals_lcr-var-start-time.3.2.ufo.BOUNDED-6.pals.yml timeout 900 2000 14000 timeout 900   1000 12000 false(unreach-call) .37 27 4.8 false(unreach-call) .27 27 2.6 couldn't run: all seeds time out or crash 3.2 10 43 false(unreach-call) 1 .17 21 1.6 timeout 900 31 12000 done 1 1.4 20 20 done 1 4.3 170 44
pals_lcr-var-start-time.3.2.ufo.UNBOUNDED.pals.yml done 1 41 1100 420 unknown 1 21   440 250 false(unreach-call) .41 27 5.3 false(unreach-call) .29 27 3.8 couldn't run: all seeds time out or crash 3.2 10 43 false(unreach-call) 1 .17 21 1.8 timeout 900 30 14000 done 1 1.5 20 21 done 1 4.6 160 54
pals_lcr-var-start-time.4.1.ufo.BOUNDED-8.pals.yml timeout 900 4800 11000 timeout 900   480 10000 false(unreach-call) .69 28 7.9 false(unreach-call) .45 28 6.1 couldn't run: all seeds time out or crash 3.2 11 44 false(unreach-call) 1 .42 23 5.7 timeout 900 31 13000 done 1 2.4 22 29 done 1 6.8 170 75
pals_lcr-var-start-time.4.1.ufo.UNBOUNDED.pals.yml timeout 900 2000 11000 timeout 900   970 13000 false(unreach-call) .70 28 10   false(unreach-call) .47 28 6.9 couldn't run: all seeds time out or crash 3.2 10 47 false(unreach-call) 1 .50 23 6.1 timeout 900 31 11000 done 1 2.5 23 36 done 1 4.8 170 43
pals_lcr-var-start-time.4.2.ufo.BOUNDED-8.pals.yml timeout 900 2100 9800 timeout 900   760 9400 false(unreach-call) .97 29 15   false(unreach-call) .73 28 8.9 couldn't run: all seeds time out or crash 3.2 10 42 false(unreach-call) 1 .23 23 2.3 timeout 900 30 13000 done 1 1.9 21 29 done 1 4.6 170 49
pals_lcr-var-start-time.4.2.ufo.UNBOUNDED.pals.yml timeout 900 2000 12000 timeout 900   860 13000 false(unreach-call) .76 28 10   false(unreach-call) .47 28 5.8 couldn't run: all seeds time out or crash 3.2 11 37 false(unreach-call) 1 .37 23 4.4 timeout 900 31 12000 done 1 2.0 21 26 done 1 4.7 170 47
pals_lcr-var-start-time.5.1.ufo.BOUNDED-10.pals.yml timeout 900 4900 11000 timeout 930   740 13000 false(unreach-call) 1.5  32 18   false(unreach-call) 1.1  31 16   couldn't run: all seeds time out or crash 3.2 11 47 false(unreach-call) 1 .98 32 12   timeout 900 30 12000 done 1 4.6 28 63 done 1 5.0 170 49
pals_lcr-var-start-time.5.1.ufo.UNBOUNDED.pals.yml timeout 900 3200 14000 timeout 900   500 13000 false(unreach-call) 1.6  33 21   false(unreach-call) 1.3  32 17   couldn't run: all seeds time out or crash 3.2 10 42 false(unreach-call) 1 1.9  33 45   timeout 900 31 11000 done 1 4.8 29 61 done 1 4.9 170 47
pals_lcr-var-start-time.5.2.ufo.BOUNDED-10.pals.yml timeout 900 4500 12000 timeout 900   710 14000 false(unreach-call) 1.4  31 18   false(unreach-call) 1.0  30 13   couldn't run: all seeds time out or crash 3.2 10 42 false(unreach-call) 1 .46 29 8.5 timeout 900 31 13000 done 1 2.8 24 40 done 1 4.9 170 47
pals_lcr-var-start-time.5.2.ufo.UNBOUNDED.pals.yml timeout 900 1600 14000 timeout 900   930 12000 false(unreach-call) 1.5  32 19   false(unreach-call) 1.2  31 14   couldn't run: all seeds time out or crash 3.2 10 40 false(unreach-call) 1 .48 29 5.4 timeout 900 30 12000 done 1 2.9 24 47 done 1 4.7 180 54
pals_lcr-var-start-time.6.1.ufo.BOUNDED-12.pals.yml timeout 900 1300 14000 timeout 900   1100 11000 false(unreach-call) 3.8  40 57   false(unreach-call) 3.2  38 47   couldn't run: all seeds time out or crash 3.2 10 50 false(unreach-call) 1 4.1  70 65   timeout 900 31 10000 done 1 10   49 130 done 1 4.9 180 48
pals_lcr-var-start-time.6.1.ufo.UNBOUNDED.pals.yml timeout 900 1200 12000 timeout 900   750 14000 false(unreach-call) 3.3  41 49   false(unreach-call) 2.6  38 34   couldn't run: all seeds time out or crash 3.2 10 46 false(unreach-call) 1 11    76 130   timeout 900 31 12000 done 1 11   52 170 done 1 5.2 180 53
pals_lcr-var-start-time.6.2.ufo.BOUNDED-12.pals.yml timeout 900 2900 11000 timeout 900   2400 12000 false(unreach-call) 4.5  39 52   false(unreach-call) 3.9  37 53   couldn't run: all seeds time out or crash 3.2 10 48 false(unreach-call) 1 .65 47 8.0 timeout 900 31 13000 done 1 4.6 32 67 done 1 4.7 180 48
pals_lcr-var-start-time.6.2.ufo.UNBOUNDED.pals.yml timeout 900 1400 12000 timeout 900   1000 12000 false(unreach-call) 3.7  40 54   false(unreach-call) 3.1  38 46   couldn't run: all seeds time out or crash 3.2 11 51 false(unreach-call) 1 4.7  72 62   timeout 900 31 12000 done 1 4.7 32 69 done 1 5.0 180 47
pals_lcr.3.1.ufo.BOUNDED-6.pals.yml done 1 26 850 230 unknown 1 6.2 300 55 false(unreach-call) .29 27 3.4 false(unreach-call) .18 27 2.3 couldn't run: all seeds time out or crash 3.2 11 49 false(unreach-call) 1 .23 21 2.0 timeout 900 31 9300 done 1 1.5 20 21 done 1 4.2 160 40
pals_lcr.3.1.ufo.UNBOUNDED.pals.yml done 1 230 4000 2800 unknown 1 170   750 2100 false(unreach-call) .30 27 3.4 false(unreach-call) .20 27 2.5 couldn't run: all seeds time out or crash 3.2 10 44 false(unreach-call) 1 .18 21 2.4 timeout 900 31 12000 done 1 1.4 20 22 done 1 4.2 160 39
pals_lcr.3_overflow.ufo.UNBOUNDED.pals.yml timeout 900 1800 12000 timeout 900   950 9300 timeout 900    1200 11000   timeout 900    820 11000   couldn't run: all seeds time out or crash 3.2 11 41 false(unreach-call) 1 .48 21 6.1 timeout 900 31 12000 done 1 2.0 26 28 done 1 4.4 170 44
pals_lcr.4.1.ufo.BOUNDED-8.pals.yml timeout 900 1800 9300 timeout 900   1000 9400 false(unreach-call) .54 28 7.2 false(unreach-call) .35 28 4.9 couldn't run: all seeds time out or crash 3.2 10 46 false(unreach-call) 1 .37 21 4.3 timeout 900 31 12000 done 1 2.7 20 36 done 1 8.8 170 110
pals_lcr.4.1.ufo.UNBOUNDED.pals.yml timeout 900 2000 12000 timeout 900   1300 13000 false(unreach-call) .52 28 6.7 false(unreach-call) .33 28 3.7 couldn't run: all seeds time out or crash 3.2 10 48 false(unreach-call) 1 .51 21 5.6 timeout 900 31 12000 done 1 2.7 21 36 done 1 15   170 180
pals_lcr.4_overflow.ufo.UNBOUNDED.pals.yml timeout 900 2900 6600 timeout 900   1000 6700 timeout 900    740 13000   timeout 900    520 11000   couldn't run: all seeds time out or crash 3.2 11 39 false(unreach-call) 1 .91 21 11   timeout 900 31 12000 done 1 5.0 37 64 done 1 4.2 170 45
pals_lcr.5.1.ufo.BOUNDED-10.pals.yml timeout 900 3600 11000 timeout 900   1900 12000 false(unreach-call) .93 29 13   false(unreach-call) .63 28 8.3 couldn't run: all seeds time out or crash 3.2 11 36 false(unreach-call) 1 .90 23 12   timeout 900 31 12000 done 1 6.8 24 100 done 1 370   170 4700
pals_lcr.5.1.ufo.UNBOUNDED.pals.yml timeout 900 3900 10000 timeout 900   990 8000 false(unreach-call) .91 30 12   false(unreach-call) .61 29 8.6 couldn't run: all seeds time out or crash 3.2 11 41 false(unreach-call) 1 1.8  24 22   timeout 900 31 11000 done 1 6.5 24 97 done 1 27   170 350
pals_lcr.5_overflow.ufo.UNBOUNDED.pals.yml timeout 900 4400 8500 timeout 900   870 9500 timeout 900    490 13000   timeout 900    340 11000   couldn't run: all seeds time out or crash 3.2 11 41 false(unreach-call) 1 2.4  25 37   timeout 900 30 13000 done 1 16   64 220 done 1 4.5 170 44
pals_lcr.6.1.ufo.BOUNDED-12.pals.yml timeout 900 2500 11000 timeout 900   600 11000 false(unreach-call) 1.6  35 20   false(unreach-call) 1.2  34 15   couldn't run: all seeds time out or crash 3.2 12 46 false(unreach-call) 1 .95 26 13   timeout 900 31 13000 done 1 19   35 260 done 1 180   180 2400
pals_lcr.6.1.ufo.UNBOUNDED.pals.yml timeout 900 1800 10000 timeout 900   600 11000 false(unreach-call) 1.6  36 22   false(unreach-call) 1.2  34 16   couldn't run: all seeds time out or crash 3.2 12 46 false(unreach-call) 1 1.4  25 18   timeout 900 31 13000 done 1 20   35 260 done 1 5.4 180 66
pals_lcr.6_overflow.ufo.UNBOUNDED.pals.yml timeout 900 2400 10000 timeout 900   540 12000 timeout 900    340 11000   timeout 900    260 11000   couldn't run: all seeds time out or crash 3.2 12 41 false(unreach-call) 1 9.2  39 130   timeout 900 31 12000 done 1 49   130 650 done 1 4.9 180 48
pals_lcr.7.1.ufo.BOUNDED-14.pals.yml timeout 900 1100 11000 timeout 900   610 14000 false(unreach-call) 3.6  43 48   false(unreach-call) 2.9  40 37   couldn't run: all seeds time out or crash 3.2 13 40 false(unreach-call) 1 8.2  43 100   timeout 900 31 14000 done 1 55   74 710 done 1 110   180 1500
pals_lcr.7.1.ufo.UNBOUNDED.pals.yml timeout 900 1200 13000 timeout 900   470 13000 false(unreach-call) 3.5  44 42   false(unreach-call) 2.9  41 39   couldn't run: all seeds time out or crash 3.2 12 38 false(unreach-call) 1 7.4  41 100   timeout 900 31 13000 done 1 55   71 740 done 1 4.8 190 48
pals_lcr.7_overflow.ufo.UNBOUNDED.pals.yml timeout 900 1800 12000 timeout 900   600 13000 timeout 900    250 12000   timeout 900    190 13000   couldn't run: all seeds time out or crash 3.2 12 49 false(unreach-call) 1 39    96 480   timeout 900 31 14000 done 1 180   300 2700 done 1 4.6 180 42
pals_lcr.8.1.ufo.BOUNDED-16.pals.yml timeout 900 1300 11000 timeout 900   600 12000 false(unreach-call) 9.4  53 120   false(unreach-call) 8.5  49 120   couldn't run: all seeds time out or crash 3.3 14 43 false(unreach-call) 1 3.3  32 44   timeout 900 31 14000 done 1 160   190 2500 done 1 570   190 7200
pals_lcr.8.1.ufo.UNBOUNDED.pals.yml timeout 900 1100 11000 timeout 900   720 13000 false(unreach-call) 9.4  54 140   false(unreach-call) 8.5  50 100   couldn't run: all seeds time out or crash 3.2 14 46 false(unreach-call) 1 14    56 190   timeout 900 31 12000 done 1 170   190 2500 done 1 5.0 190 50
pals_lcr.8_overflow.ufo.UNBOUNDED.pals.yml timeout 900 1100 14000 timeout 900   760 11000 timeout 900    200 13000   timeout 900    170 12000   couldn't run: all seeds time out or crash 3.2 13 49 false(unreach-call) 1 190    340 2300   timeout 900 31 13000 done 1 670   790 11000 done 1 4.7 190 48
pals_opt-floodmax.3.1.ufo.BOUNDED-6.pals.yml done 1 26 890 270 unknown 1 5.8 300 53 false(unreach-call) .54 30 7.0 false(unreach-call) .27 29 3.3 couldn't run: all seeds time out or crash 3.2 11 38 false(unreach-call) 1 .63 64 7.9 timeout 900 31 13000 done 2.6 27 32 done 1 4.9 170 49
pals_opt-floodmax.3.1.ufo.UNBOUNDED.pals.yml done 1 27 1000 280 unknown 1 5.9 300 55 false(unreach-call) .61 30 7.8 false(unreach-call) .28 29 3.1 couldn't run: all seeds time out or crash 3.2 10 41 false(unreach-call) 1 20    170 250   timeout 900 31 12000 done 2.6 27 37 done 1 5.1 170 58
pals_opt-floodmax.3.2.ufo.BOUNDED-6.pals.yml done 1 25 890 260 unknown 1 5.2 300 57 false(unreach-call) .21 29 2.1 false(unreach-call) .20 29 2.0 couldn't run: all seeds time out or crash 3.2 10 43 false(unreach-call) 1 .60 60 7.5 timeout 900 30 11000 done 5.1 23 63 done 1 4.8 170 47
pals_opt-floodmax.3.2.ufo.UNBOUNDED.pals.yml done 1 26 1300 260 unknown 1 4.8 290 42 false(unreach-call) .22 29 2.3 false(unreach-call) .18 29 2.2 couldn't run: all seeds time out or crash 3.2 11 43 false(unreach-call) 1 .64 65 7.5 timeout 900 31 14000 done 5.0 23 69 done 1 4.8 170 48
pals_opt-floodmax.3.3.ufo.BOUNDED-6.pals.yml done 1 27 1200 280 unknown 1 5.9 310 63 false(unreach-call) .55 30 7.4 false(unreach-call) .27 29 3.3 couldn't run: all seeds time out or crash 3.2 11 50 false(unreach-call) 1 .61 60 7.3 timeout 900 30 13000 done 4.5 24 61 done 1 5.0 170 49
pals_opt-floodmax.3.3.ufo.UNBOUNDED.pals.yml done 1 27 1100 290 unknown 1 6.3 310 56 false(unreach-call) .55 30 6.8 false(unreach-call) .27 29 3.6 couldn't run: all seeds time out or crash 3.2 10 45 false(unreach-call) 1 .74 70 9.5 timeout 900 31 12000 done 3.7 23 56 done 1 4.6 180 48
pals_opt-floodmax.3.4.ufo.BOUNDED-6.pals.yml done 1 29 1000 290 unknown 1 7.5 320 75 false(unreach-call) .56 30 8.2 false(unreach-call) .28 29 2.5 couldn't run: all seeds time out or crash 3.2 10 37 false(unreach-call) 1 .66 62 8.4 timeout 900 31 11000 done 27   27 360 done 1 4.9 170 50
pals_opt-floodmax.3.4.ufo.UNBOUNDED.pals.yml done 1 28 990 300 unknown 1 6.6 310 66 false(unreach-call) .56 30 7.9 false(unreach-call) .27 29 3.6 couldn't run: all seeds time out or crash 3.2 11 44 false(unreach-call) 1 5.6  130 77   timeout 900 31 14000 done 26   27 350 done 1 5.0 180 48
pals_opt-floodmax.3_overflow.ufo.UNBOUNDED.pals.yml timeout 900 2000 9200 timeout 900   1300 10000 timeout 900    3400 10000   timeout 900    2700 11000   couldn't run: all seeds time out or crash 3.2 10 47 false(unreach-call) 1 9.6  130 110   timeout 900 31 14000 done 200   110 2900 done 1 4.7 180 52
pals_opt-floodmax.4.1.ufo.BOUNDED-8.pals.yml done 1 33 810 350 unknown 1 12   500 120 false(unreach-call) 1.6  53 20   false(unreach-call) .83 48 9.9 couldn't run: all seeds time out or crash 3.2 10 47 false(unreach-call) 1 290    11000 1700   timeout 900 31 12000 done 87   1800 1400 done 1 5.6 180 63
pals_opt-floodmax.4.1.ufo.UNBOUNDED.pals.yml done 1 44 810 480 unknown 1 24   420 180 false(unreach-call) 1.6  51 20   false(unreach-call) .85 48 9.7 couldn't run: all seeds time out or crash 3.2 11 41 false(unreach-call) 1 280    11000 1800   timeout 900 31 13000 done 97   1900 1400 done 1 5.7 190 51
pals_opt-floodmax.4.2.ufo.BOUNDED-8.pals.yml done 1 30 740 320 unknown 1 10   360 98 false(unreach-call) 1.3  55 16   false(unreach-call) .60 49 8.3 couldn't run: all seeds time out or crash 3.2 13 40 false(unreach-call) 1 280    11000 1800   timeout 900 31 11000 done 22   170 290 done 1 5.7 200 53
pals_opt-floodmax.4.2.ufo.UNBOUNDED.pals.yml done 1 32 870 330 unknown 1 12   350 100 false(unreach-call) 1.3  55 18   false(unreach-call) .61 49 8.2 couldn't run: all seeds time out or crash 3.2 13 48 false(unreach-call) 1 280    11000 1900   timeout 900 31 12000 done 24   170 310 done 1 5.9 200 61
pals_opt-floodmax.4.3.ufo.BOUNDED-8.pals.yml done 1 40 970 440 unknown 1 18   410 170 false(unreach-call) 1.8  55 20   false(unreach-call) .91 51 9.9 couldn't run: all seeds time out or crash 3.2 12 46 false(unreach-call) 1 290    11000 1500   timeout 900 31 12000 done 34   270 430 done 1 5.7 190 64
pals_opt-floodmax.4.3.ufo.UNBOUNDED.pals.yml done 1 32 950 370 unknown 1 12   490 120 false(unreach-call) 1.7  55 25   false(unreach-call) .89 51 13   couldn't run: all seeds time out or crash 3.3 12 42 false(unreach-call) 1 280    11000 2200   timeout 900 32 12000 done 32   270 410 done 1 5.6 190 58
pals_opt-floodmax.4.4.ufo.BOUNDED-8.pals.yml done 1 99 970 730 unknown 1 76   580 710 false(unreach-call) 1.8  55 21   false(unreach-call) .88 51 12   couldn't run: all seeds time out or crash 3.3 12 45 false(unreach-call) 1 320    11000 1900   timeout 900 31 13000 done 98   670 1200 done 1 22   190 280
pals_opt-floodmax.4.4.ufo.UNBOUNDED.pals.yml done 1 150 1100 1500 unknown 1 140   500 1100 false(unreach-call) 1.7  54 24   false(unreach-call) .89 51 11   couldn't run: all seeds time out or crash 3.3 13 44 timeout 900    13000 5900   timeout 900 31 12000 done 120   710 1400 done 1 26   200 310
pals_opt-floodmax.4_overflow.ufo.UNBOUNDED.pals.yml timeout 900 1600 7100 timeout 900   1100 7600 timeout 900    810 11000   timeout 900    640 11000   couldn't run: all seeds time out or crash 3.2 13 41 false(unreach-call) 1 290    11000 1700   timeout 900 31 12000 timeout (verification) 900   1400 12000 done 1 5.6 190 57
pals_opt-floodmax.5.1.ufo.BOUNDED-10.pals.yml done 1 620 1600 4600 unknown 1 610   1100 4000 false(unreach-call) 7.0  150 83   false(unreach-call) 3.6  150 42   couldn't run: all seeds time out or crash 3.2 12 46 timeout 900    15000 6200   timeout 900 34 14000 out of memory (killed (signal 9, verification)) 290   15000 3800 done 1 8.9 220 110
pals_opt-floodmax.5.1.ufo.UNBOUNDED.pals.yml done 1 380 1600 3200 unknown 1 360   1000 2500 false(unreach-call) 6.9  150 82   false(unreach-call) 3.7  150 44   couldn't run: all seeds time out or crash 3.3 13 48 timeout 900    15000 6500   timeout 900 34 12000 out of memory (killed (signal 9, verification)) 290   15000 3500 done 1 9.2 220 100
pals_opt-floodmax.5.2.ufo.BOUNDED-10.pals.yml done 1 82 1100 670 unknown 1 62   490 450 false(unreach-call) 6.1  160 73   false(unreach-call) 3.0  160 33   couldn't run: all seeds time out or crash 3.4 21 46 timeout 900    14000 5300   timeout 900 35 14000 out of memory (killed (signal 9, verification)) 76   15000 980 done 1 8.9 220 110
pals_opt-floodmax.5.2.ufo.UNBOUNDED.pals.yml done 1 110 1100 930 unknown 1 92   530 680 false(unreach-call) 6.0  160 73   false(unreach-call) 3.0  160 41   couldn't run: all seeds time out or crash 3.4 21 53 timeout 900    14000 5500   timeout 900 35 10000 out of memory (killed (signal 9, verification)) 73   15000 940 done 1 9.4 230 100
pals_opt-floodmax.5.3.ufo.BOUNDED-10.pals.yml done 1 71 1400 630 unknown 1 50   550 480 false(unreach-call) 7.5  160 100   false(unreach-call) 3.9  160 41   couldn't run: all seeds time out or crash 3.4 21 47 timeout 900    14000 5100   timeout 900 35 11000 out of memory (killed (signal 9, verification)) 73   15000 840 done 1 9.2 230 110
pals_opt-floodmax.5.3.ufo.UNBOUNDED.pals.yml done 1 260 1500 2000 unknown 1 230   800 2100 false(unreach-call) 7.6  160 110   false(unreach-call) 3.9  160 45   couldn't run: all seeds time out or crash 3.4 21 44 timeout 900    14000 6200   timeout 900 35 11000 out of memory (killed (signal 9, verification)) 73   15000 860 done 1 9.2 250 98
pals_opt-floodmax.5.4.ufo.BOUNDED-10.pals.yml timeout 900 1800 5800 timeout 900   1200 6100 false(unreach-call) 7.9  160 95   false(unreach-call) 4.3  160 53   couldn't run: all seeds time out or crash 3.4 21 40 timeout 900    14000 5800   timeout 900 35 12000 out of memory (killed (signal 9, verification)) 73   15000 880 done 1 380   230 4700
pals_opt-floodmax.5.4.ufo.UNBOUNDED.pals.yml timeout 900 1500 5800 timeout 900   1000 5600 false(unreach-call) 7.9  160 99   false(unreach-call) 4.2  160 52   couldn't run: all seeds time out or crash 3.4 21 42 timeout 900    14000 5500   timeout 900 35 11000 out of memory (killed (signal 9, verification)) 73   15000 920 done 1 210   240 3000
pals_opt-floodmax.5_overflow.ufo.UNBOUNDED.pals.yml timeout 900 1400 6000 timeout 900   970 4400 timeout 900    230 13000   timeout 900    220 11000   couldn't run: all seeds time out or crash 3.4 21 51 timeout 900    14000 6300   timeout 900 35 13000 out of memory (killed (signal 9, verification)) 73   15000 900 done 1 9.4 250 120
../sv-benchmarks/c/seq-mthreaded/ status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J) status score cpu (s) mem (MB) energy (J)
total 100 61 39000 150000 440000 100 61 38000 65000 430000 100 11000 17000 150000 100 11000 14000 130000 100 320 1200 4400 100 79 22000 340000 160000 100 90000 3100 1200000 100 46 7100 290000 95000 100 100 3200 19000 42000
Run set coveritest.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized cpa-tiger.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized esbmc-kind.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized esbmc-falsi.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized fairfuzz.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized klee.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized prtest.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized symbiotic.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized verifuzz.test-comp19_prop-coverage-error-call.ReachSafety-Sequentialized