blob: 67186bf924adfa56948a47d51d7e55e44fc66851 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
|
** Vericert-Fun
| benchmark | lut_flip_flop | slice | regs | luts | ramfifo | iopin | dsps | power | delay | cycles |
|----------------+---------------+-------+------+------+---------+-------+------+-------+-------+---------|
| 2mm | 668 | 926 | 2678 | 1976 | 4 | 0 | 24 | 0.172 | 4.689 | 469176 |
| 3mm | 707 | 981 | 2761 | 2219 | 8 | 0 | 21 | 0.16 | 4.489 | 606222 |
| adi | 1704 | 2063 | 5778 | 4510 | 6 | 0 | 54 | 0.211 | 4.913 | 1831462 |
| atas | 357 | 419 | 1298 | 908 | 4 | 0 | 6 | 0.137 | 4.338 | 103216 |
| bicg | 441 | 565 | 1699 | 1216 | 4 | 0 | 9 | 0.141 | 4.287 | 132467 |
| cholesky | 722 | 916 | 2895 | 2020 | 8 | 0 | 12 | 0.157 | 4.567 | 2576630 |
| covariance | 397 | 497 | 1458 | 1101 | 4 | 0 | 6 | 0.139 | 4.27 | 342097 |
| doitgen | 472 | 594 | 1957 | 1267 | 4 | 0 | 6 | 0.136 | 4.205 | 387887 |
| durbin | 514 | 480 | 1457 | 1055 | 1 | 0 | 12 | 0.145 | 9.403 | 23872 |
| fdtd-2d | 778 | 863 | 2590 | 1864 | 4 | 0 | 9 | 0.146 | 4.322 | 958412 |
| floyd-warshall | 449 | 550 | 1794 | 1239 | 8 | 0 | 3 | 0.137 | 4.043 | 5414366 |
| gemm | 483 | 765 | 2008 | 1459 | 4 | 0 | 18 | 0.152 | 4.291 | 408625 |
| gemver | 477 | 800 | 2030 | 1470 | 4 | 0 | 21 | 0.161 | 4.641 | 194848 |
| gesummv | 508 | 654 | 2018 | 1285 | 4 | 0 | 15 | 0.143 | 4.606 | 118387 |
| heat-3d | 1061 | 1213 | 3273 | 2027 | 4 | 0 | 3 | 0.135 | 4.299 | 594771 |
| jacobi-1d | 272 | 322 | 1183 | 527 | 1 | 0 | 0 | 0.124 | 4.163 | 20057 |
| jacobi-2d | 490 | 592 | 1908 | 1215 | 4 | 0 | 6 | 0.139 | 4.142 | 399000 |
| lu | 701 | 979 | 2718 | 1930 | 8 | 0 | 9 | 0.158 | 4.709 | 2894707 |
| ludcmp | 991 | 1348 | 3506 | 2834 | 8 | 0 | 15 | 0.176 | 4.728 | 2643295 |
| mvt | 552 | 721 | 2307 | 1505 | 4 | 0 | 9 | 0.146 | 4.285 | 150634 |
| nussinov | 521 | 693 | 1967 | 1564 | 8 | 0 | 0 | 0.135 | 4.468 | 956551 |
| seidel-2d | 416 | 519 | 1642 | 937 | 4 | 0 | 3 | 0.134 | 4.147 | 951158 |
| symm | 706 | 837 | 2467 | 1819 | 4 | 0 | 21 | 0.159 | 4.684 | 281242 |
| syr2k | 546 | 822 | 2362 | 1589 | 8 | 0 | 18 | 0.155 | 4.465 | 528008 |
| syrk | 410 | 673 | 1847 | 1192 | 4 | 0 | 12 | 0.143 | 4.485 | 339786 |
| trisolv | 225 | 347 | 1091 | 591 | 4 | 0 | 3 | 0.132 | 4.199 | 36870 |
| trmm | 474 | 593 | 1739 | 1193 | 2 | 0 | 6 | 0.137 | 4.291 | 166619 |
|----------------+---------------+-------+------+------+---------+-------+------+-------+-------+---------|
| median | 508 | 693 | 2008 | 1459 | 4 | 0 | 9 | 0.143 | 4.338 | 399000 |
#+TBLFM: @>$<<..@>$>=vmedian(@2$$#..@II$$#)
** Vericert
| benchmark | lut_flip_flop | slice | regs | luts | ramfifo | iopin | dsps | power | delay | cycles |
|----------------+---------------+-------+-------+------+---------+-------+------+-------+-------+---------|
| 2mm | 808 | 1546 | 3866 | 2750 | 4 | 0 | 24 | 0.169 | 4.797 | 467612 |
| 3mm | 858 | 1489 | 3976 | 3010 | 8 | 0 | 21 | 0.163 | 4.577 | 604582 |
| adi | 1990 | 3497 | 10185 | 5405 | 4 | 0 | 54 | 0.209 | 4.683 | 1831462 |
| atas | 346 | 480 | 1471 | 1007 | 4 | 0 | 6 | 0.135 | 4.258 | 101619 |
| bicg | 560 | 787 | 2515 | 1777 | 4 | 0 | 9 | 0.144 | 4.363 | 130791 |
| cholesky | 719 | 1391 | 3666 | 2394 | 8 | 0 | 12 | 0.156 | 4.739 | 2575070 |
| covariance | 388 | 600 | 1711 | 1217 | 4 | 0 | 6 | 0.136 | 4.351 | 340795 |
| doitgen | 535 | 801 | 2392 | 1606 | 4 | 0 | 6 | 0.14 | 4.321 | 386783 |
| durbin | 656 | 666 | 2097 | 1495 | 1 | 0 | 12 | 0.148 | 4.698 | 23833 |
| fdtd-2d | 750 | 1028 | 3179 | 1949 | 4 | 0 | 9 | 0.145 | 4.513 | 958412 |
| floyd-warshall | 634 | 811 | 2645 | 2016 | 8 | 0 | 3 | 0.143 | 4.289 | 5414366 |
| gemm | 587 | 954 | 2809 | 2020 | 4 | 0 | 18 | 0.161 | 4.447 | 406775 |
| gemver | 469 | 898 | 2696 | 1665 | 4 | 0 | 21 | 0.156 | 4.703 | 193048 |
| gesummv | 614 | 867 | 2842 | 1897 | 4 | 0 | 15 | 0.148 | 4.384 | 116557 |
| heat-3d | 1051 | 1117 | 3232 | 2015 | 4 | 0 | 3 | 0.135 | 4.668 | 592771 |
| jacobi-1d | 255 | 385 | 1272 | 534 | 1 | 0 | 0 | 0.126 | 4.038 | 19997 |
| jacobi-2d | 481 | 648 | 1997 | 1263 | 4 | 0 | 6 | 0.137 | 4.285 | 397200 |
| lu | 729 | 1314 | 3499 | 2300 | 8 | 0 | 9 | 0.154 | 4.554 | 2893147 |
| ludcmp | 1039 | 2007 | 5011 | 3272 | 8 | 0 | 15 | 0.172 | 4.94 | 2641695 |
| mvt | 812 | 1498 | 3892 | 2575 | 4 | 0 | 9 | 0.157 | 4.411 | 148874 |
| nussinov | 516 | 668 | 1930 | 1541 | 8 | 0 | 0 | 0.136 | 4.433 | 956491 |
| seidel-2d | 393 | 526 | 1725 | 926 | 4 | 0 | 3 | 0.131 | 4.184 | 942338 |
| symm | 805 | 1077 | 3179 | 2470 | 4 | 0 | 21 | 0.162 | 4.733 | 279832 |
| syr2k | 630 | 1166 | 3182 | 2145 | 8 | 0 | 18 | 0.158 | 5.012 | 525908 |
| syrk | 449 | 738 | 2278 | 1531 | 4 | 0 | 12 | 0.14 | 9.467 | 338286 |
| trisolv | 205 | 362 | 1177 | 590 | 4 | 0 | 3 | 0.128 | 4.185 | 36050 |
| trmm | 500 | 703 | 2170 | 1499 | 2 | 0 | 6 | 0.14 | 4.449 | 165829 |
|----------------+---------------+-------+-------+------+---------+-------+------+-------+-------+---------|
| median | 614 | 867 | 2696 | 1897 | 4 | 0 | 9 | 0.145 | 4.449 | 397200 |
#+TBLFM: @>$<<..@>$>=vmedian(@2$$#..@II$$#)
** Bambu
| benchmark | lut_flip_flop | slice | regs | luts | ramfifo | iopin | dsps | power | delay | cycles |
|----------------+---------------+-------+------+------+---------+-------+------+-------+-------+--------|
| 2mm | 1220 | 949 | 1986 | 2868 | 5 | 0 | 6 | 0.151 | 8.676 | 82724 |
| 3mm | 1293 | 1061 | 2209 | 3244 | 8 | 0 | 6 | 0.161 | 9.383 | 126860 |
| adi | 1057 | 866 | 1775 | 2770 | 4 | 0 | 9 | 0.152 | 9.584 | 218309 |
| atas | 456 | 370 | 806 | 1119 | 6 | 0 | 3 | 0.146 | 7.608 | 22628 |
| bicg | 614 | 533 | 1285 | 1397 | 8 | 0 | 9 | 0.142 | 7.78 | 30060 |
| cholesky | 1357 | 910 | 2071 | 3080 | 8 | 0 | 3 | 0.148 | 9.509 | 432503 |
| covariance | 594 | 536 | 1193 | 1508 | 5 | 0 | 6 | 0.144 | 8.417 | 91654 |
| doitgen | 792 | 632 | 1410 | 1862 | 4 | 0 | 6 | 0.139 | 8.409 | 85427 |
| durbin | 566 | 412 | 921 | 1414 | 3 | 0 | 6 | 0.15 | 9.202 | 7454 |
| fdtd-2d | 856 | 680 | 1525 | 2195 | 7 | 0 | 3 | 0.143 | 8.552 | 101407 |
| floyd-warshall | 529 | 350 | 859 | 1123 | 8 | 0 | 3 | 0.143 | 7.855 | 998008 |
| gemm | 803 | 651 | 1568 | 1882 | 5 | 0 | 6 | 0.138 | 7.924 | 88052 |
| gemver | 516 | 501 | 1030 | 1587 | 11 | 0 | 9 | 0.162 | 8.615 | 39318 |
| gesummv | 583 | 461 | 1069 | 1265 | 6 | 0 | 9 | 0.137 | 7.84 | 24736 |
| heat-3d | 818 | 680 | 1439 | 2151 | 4 | 0 | 3 | 0.145 | 9.172 | 50107 |
| jacobi-1d | 325 | 225 | 617 | 646 | 2 | 0 | 0 | 0.131 | 8.183 | 4717 |
| jacobi-2d | 715 | 525 | 1157 | 1562 | 4 | 0 | 3 | 0.133 | 8.083 | 73516 |
| lu | 1249 | 885 | 1990 | 2914 | 8 | 0 | 3 | 0.15 | 9.778 | 503642 |
| ludcmp | 1728 | 1222 | 2363 | 4177 | 11 | 0 | 3 | 0.164 | 9.881 | 458706 |
| mvt | 689 | 594 | 1442 | 1616 | 8 | 0 | 6 | 0.145 | 8.79 | 36958 |
| nussinov | 662 | 455 | 1049 | 1509 | 9 | 0 | 0 | 0.142 | 9.187 | 236267 |
| seidel-2d | 521 | 405 | 954 | 1133 | 4 | 0 | 3 | 0.143 | 8.638 | 172996 |
| symm | 894 | 663 | 1617 | 1949 | 5 | 0 | 6 | 0.138 | 8.335 | 50392 |
| syr2k | 825 | 636 | 1582 | 1829 | 6 | 0 | 9 | 0.138 | 7.783 | 76378 |
| syrk | 788 | 605 | 1372 | 1754 | 4 | 0 | 6 | 0.136 | 7.754 | 68228 |
| trisolv | 345 | 284 | 698 | 844 | 6 | 0 | 3 | 0.143 | 7.151 | 9468 |
| trmm | 628 | 488 | 1113 | 1460 | 3 | 0 | 3 | 0.135 | 8.396 | 42642 |
|----------------+---------------+-------+------+------+---------+-------+------+-------+-------+--------|
| median | 715 | 594 | 1372 | 1616 | 6 | 0 | 6 | 0.143 | 8.417 | 76378 |
#+TBLFM: @>$<<..@>$>=vmedian(@2$$#..@II$$#)
** Time
| benchmark | vericert | vericert-fun |
|----------------+-----------+--------------|
| 2mm | 3.125391 | 3.065243 |
| 3mm | 2.324715 | 2.286203 |
| adi | 4.099243 | 4.300572 |
| atas | 2.513413 | 2.600878 |
| bicg | 2.440026 | 2.428246 |
| cholesky | 2.967234 | 2.861272 |
| covariance | 1.922089 | 1.893513 |
| doitgen | 2.326549 | 2.270553 |
| durbin | 1.632376 | 3.27253 |
| fdtd-2d | 4.987489 | 4.776408 |
| floyd-warshall | 2.962262 | 2.792358 |
| gemm | 2.592613 | 2.513042 |
| gemver | 2.680363 | 2.66969 |
| gesummv | 2.634895 | 2.811787 |
| heat-3d | 6.020816 | 5.563586 |
| jacobi-1d | 2.091957 | 2.163186 |
| jacobi-2d | 2.864215 | 2.781176 |
| lu | 2.675417 | 2.76797 |
| ludcmp | 2.879216 | 2.757324 |
| mvt | 2.021429 | 1.986902 |
| nussinov | 1.953448 | 1.968995 |
| seidel-2d | 2.638452 | 2.639596 |
| symm | 3.15331 | 3.136389 |
| syr2k | 4.4341 | 3.965945 |
| syrk | 6.05352 | 2.880577 |
| trisolv | 2.22831 | 2.28662 |
| trmm | 2.060691 | 1.996977 |
|----------------+-----------+--------------|
| mean | 2.9734644 | 2.8680570 |
| median | 2.638452 | 2.757324 |
| speedup | 1.0450537 | |
|----------------+-----------+--------------|
#+TBLFM: @>>>$2..@>>>$3=vmean(@2$$#..@II$$#)::@>>$2..@>>$3=vmedian(@2$$#..@II$$#)::@>$2=@>>$3/@>>$2
** Size
| benchmark | vericert | vericert-fun |
|----------------+------------+--------------|
| 2mm | 1.629083 | 0.975764 |
| 3mm | 1.403393 | 0.924599 |
| adi | 4.038106 | 2.382217 |
| atas | 1.297297 | 1.132432 |
| bicg | 1.476548 | 1.060038 |
| cholesky | 1.528571 | 1.006593 |
| covariance | 1.119403 | 0.927239 |
| doitgen | 1.267405 | 0.939873 |
| durbin | 1.616505 | 1.165049 |
| fdtd-2d | 1.511765 | 1.269118 |
| floyd-warshall | 2.317143 | 1.571429 |
| gemm | 1.465438 | 1.175115 |
| gemver | 1.792415 | 1.596806 |
| gesummv | 1.880694 | 1.418655 |
| heat-3d | 1.642647 | 1.783824 |
| jacobi-1d | 1.711111 | 1.431111 |
| jacobi-2d | 1.234286 | 1.127619 |
| lu | 1.484746 | 1.106215 |
| ludcmp | 1.64239 | 1.10311 |
| mvt | 2.521886 | 1.213805 |
| nussinov | 1.468132 | 1.523077 |
| seidel-2d | 1.298765 | 1.281481 |
| symm | 1.624434 | 1.262443 |
| syr2k | 1.833333 | 1.292453 |
| syrk | 1.219835 | 1.112397 |
| trisolv | 1.274648 | 1.221831 |
| trmm | 1.440574 | 1.215164 |
|----------------+------------+--------------|
| average | 1.6570575 | 1.2673873 |
| median | 1.511765 | 1.213805 |
| diff | 0.80290587 | |
|----------------+------------+--------------|
#+TBLFM: @>>>$2..@>>>$3=vmean(@2$$#..@II$$#)::@>>$2..@>>$3=vmedian(@2$$#..@II$$#)::@>$2=@>>$3/@>>$2
|
