summaryrefslogtreecommitdiffstats
path: root/main.tex
diff options
context:
space:
mode:
authorYann Herklotz <git@yannherklotz.com>2021-01-18 16:18:54 +0000
committerYann Herklotz <git@yannherklotz.com>2021-01-18 16:18:54 +0000
commit24d259e150e844ec842a6df77c4b7f3a9ec9bfa0 (patch)
tree2d07539a5d78abbf9059f9462c28d46fa8228314 /main.tex
parentdc0eb6c626a4068a9d28da5caafce7c39c3fd6ea (diff)
downloadfccm21_esrhls-24d259e150e844ec842a6df77c4b7f3a9ec9bfa0.tar.gz
fccm21_esrhls-24d259e150e844ec842a6df77c4b7f3a9ec9bfa0.zip
Reduction in sections
Diffstat (limited to 'main.tex')
-rw-r--r--main.tex4
1 files changed, 2 insertions, 2 deletions
diff --git a/main.tex b/main.tex
index 50ef7e2..2761aad 100644
--- a/main.tex
+++ b/main.tex
@@ -23,7 +23,7 @@
%\usepackage{balance}
\newcommand\totaltestcases{6700}
-\newcommand\totaltestcasefailures{272}
+\newcommand\totaltestcasefailures{1178}
\newcommand\numuniquebugs{8}
\newcommand\vivadotestcases{3645}
@@ -58,7 +58,7 @@ Email: \{zewei.du19, yann.herklotz15, n.ramanathan14, j.wickerson\}@imperial.ac.
High-level synthesis (HLS) is becoming an increasingly important part of the computing landscape, even in safety-critical domains where correctness is key.
As such, HLS tools are increasingly relied upon. But are they trustworthy?
-We have subjected three widely used HLS tools -- LegUp, Xilinx Vivado HLS, the Intel HLS Compiler and Bambu -- to a rigorous fuzzing campaign using thousands of random, valid C programs that we generated using a modified version of the Csmith tool. For each C program, we compiled it to a hardware design using the HLS tool under test and checked whether that hardware design generates the same output as an executable generated by the GCC compiler. When discrepancies arose between GCC and the HLS tool under test, we reduced the C program to a minimal example in order to zero in on the potential bug. Our testing campaign has revealed that all three HLS tools can be made either to crash or to generate wrong code when given valid C programs, and thereby underlines the need for these increasingly trusted tools to be more rigorously engineered.
+We have subjected four widely used HLS tools -- LegUp, Xilinx Vivado HLS, the Intel HLS Compiler and Bambu -- to a rigorous fuzzing campaign using thousands of random, valid C programs that we generated using a modified version of the Csmith tool. For each C program, we compiled it to a hardware design using the HLS tool under test and checked whether that hardware design generates the same output as an executable generated by the GCC compiler. When discrepancies arose between GCC and the HLS tool under test, we reduced the C program to a minimal example in order to zero in on the potential bug. Our testing campaign has revealed that all four HLS tools can be made either to crash or to generate wrong code when given valid C programs, and thereby underlines the need for these increasingly trusted tools to be more rigorously engineered.
Out of \totaltestcases{} test cases, we found \totaltestcasefailures{} programs that failed in at least one tool, out of which we were able to discern at least \numuniquebugs{} unique bugs.
\end{abstract}