diff options
Diffstat (limited to 'eval.tex')
| -rw-r--r-- | eval.tex | 2 |
1 files changed, 1 insertions, 1 deletions
@@ -53,7 +53,7 @@ We see that 918 (13.7\%), 167 (2.5\%), 83 (1.2\%) and 26 (0.4\%) test-cases fail Despite i++ having the lowest failure rate, it has the highest time-out rate (540 test-cases), because of its remarkably long compilation time. % We remark that although the Intel HLS Compiler had the smallest number of confirmed test-case failures, it had the most time-outs (which could be masking additional failures) Note that the absolute numbers here do not necessarily correspond to the number of bugs in the tools, because a single bug in a language feature that appears frequently in our test suite could cause many programs to crash or fail. -Hence, we reduce many of the failing test-cases in an effort to identify unique bugs; these are summarised in the table below. +Hence, we reduce many of the failing test-cases in an effort to identify unique bugs; these are summarised in the table below.\footnote{Link to detailed bug reports available from PC Chair.} \begin{table}[h] \centering |