summaryrefslogtreecommitdiffstats
diff options
context:
space:
mode:
authorYann Herklotz <git@yannherklotz.com>2020-09-15 11:13:03 +0100
committerYann Herklotz <git@yannherklotz.com>2020-09-15 11:13:03 +0100
commit5000737a898c4083c9b7c844ffc3abf964fc5bdb (patch)
tree14a4c9e7bdd03ac4bc71d5af85e261fc3a32c611
parentb4b05be981d7ea3043ddcce6766dfa0f260bc532 (diff)
downloadfccm21_esrhls-5000737a898c4083c9b7c844ffc3abf964fc5bdb.tar.gz
fccm21_esrhls-5000737a898c4083c9b7c844ffc3abf964fc5bdb.zip
Update intro
-rw-r--r--intro.tex2
1 files changed, 1 insertions, 1 deletions
diff --git a/intro.tex b/intro.tex
index 44d0b1c..990a241 100644
--- a/intro.tex
+++ b/intro.tex
@@ -64,7 +64,7 @@ This paper reports on our campaign to test HLS tools by fuzzing.
\item We give these programs to three widely used HLS tools: Xilinx Vivado HLS~\cite{xilinx20_vivad_high_synth}, LegUp HLS~\cite{canis13_legup} and the Intel HLS Compiler, which is also known as i++~\cite{intel20_sdk_openc_applic}. When we find a program that causes an HLS tool to crash, or to generate hardware that produces a different result from GCC, we reduce it to a minimal example with the help of the \creduce{} tool~\cite{creduce}.
- \item Our testing campaign revealed that all three tools could be made to crash while compiling or to generate wrong RTL. In total, we found 6 bugs across the three tools.
+ \item Our testing campaign revealed that all three tools could be made to crash while compiling or to generate wrong RTL. In total, 6700 test cases were run through each tool out of which 272 test cases failed in at least one of the tools. Test case reduction was then performed on some of these failing test cases to obtain at least 6 unique failing test cases.
\item To investigate whether HLS tools are getting more or less reliable over time, we also tested three different versions of Vivado HLS (2018.3, 2019.1, and 2019.2). We found that in general there about half as many failures in versions 2019.1 and 2019.2 compared to 2018.3. However, there were also test-cases that only failed in versions 2019.1 and 2019.2, meaning bugs were probably introduced due to the addition of new features.
\end{itemize}