From b16f3242909e90bdb547ab1500d46f5e38527981 Mon Sep 17 00:00:00 2001 From: John Wickerson Date: Fri, 29 Jan 2021 16:20:10 +0000 Subject: Update on Overleaf. --- eval.tex | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) (limited to 'eval.tex') diff --git a/eval.tex b/eval.tex index 46b58a0..e17d955 100644 --- a/eval.tex +++ b/eval.tex @@ -53,7 +53,7 @@ We see that 918 (13.7\%), 167 (2.5\%), 83 (1.2\%) and 26 (0.4\%) test-cases fail Despite i++ having the lowest failure rate, it has the highest time-out rate (540 test-cases), because of its remarkably long compilation time. % We remark that although the Intel HLS Compiler had the smallest number of confirmed test-case failures, it had the most time-outs (which could be masking additional failures) Note that the absolute numbers here do not necessarily correspond to the number of bugs in the tools, because a single bug in a language feature that appears frequently in our test suite could cause many programs to crash or fail. -Hence, we reduce many of the failing test-cases in an effort to identify unique bugs; these are summarised in the table below. +Hence, we reduce many of the failing test-cases in an effort to identify unique bugs; these are summarised in the table below.\footnote{Link to detailed bug reports available from PC Chair.} \begin{table}[h] \centering -- cgit