1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
|
%\documentclass[hyphens,prologue,x11names,rgb,sigconf,anonymous,review]{acmart}
\documentclass[conference]{IEEEtran}
\usepackage[english]{babel}
\usepackage{graphicx}
\usepackage{siunitx}
\usepackage{minted}
\setminted{baselinestretch=1, numbersep=5pt, xleftmargin=9pt, linenos}
\usepackage{amsthm}
\usepackage{pgfplots}
\usepackage{tikz}
%\usepackage{subcaption}
\usepackage{booktabs}
\usepackage{multirow}
\usepackage{multicol}
\usepackage{hyperref}
%\usepackage{balance}
\newif\ifCOMMENTS
\COMMENTStrue
\newcommand{\Comment}[3]{\ifCOMMENTS\textcolor{#1}{{\bf [[#2:} #3{\bf ]]}}\fi}
\newcommand\JW[1]{\Comment{red!75!black}{JW}{#1}}
\newcommand\YH[1]{\Comment{green!50!blue}{YH}{#1}}
\newcommand\NR[1]{\Comment{yellow!50!black}{NR}{#1}}
\newcommand\ZD[1]{\Comment{blue!50!black}{NR}{#1}}
\newcommand{\code}[1]{\texttt{#1}}
\newcommand\creduce{C-Reduce}
\begin{document}
\title{Fuzzing High-Level Synthesis Tools}
\newif\ifBLIND
\BLINDfalse
\ifBLIND
\author{Blind review}
\else
\author{%
\IEEEauthorblockN{Zewei Du}
\IEEEauthorblockA{Imperial College London, UK \\
Email: zewei.du19@imperial.ac.uk}
\and
\IEEEauthorblockN{Yann Herklotz}
\IEEEauthorblockA{Imperial College London, UK \\
Email: yann.herklotz15@imperial.ac.uk}
\and
\IEEEauthorblockN{Nadesh Ramanathan}
\IEEEauthorblockA{Imperial College London, UK \\
Email: n.ramanathan14@imperial.ac.uk}
\and
\IEEEauthorblockN{John Wickerson}
\IEEEauthorblockA{Imperial College London, UK \\
Email: j.wickerson@imperial.ac.uk}}
\fi
\maketitle
\begin{abstract}
High-level synthesis (HLS) is becoming an increasingly important part of the computing landscape, even in safety-critical domains where correctness is key.
As such, HLS tools are increasingly relied upon. In this paper, we investigate whether they are trustworthy.
We have subjected three widely used HLS tools -- LegUp, Xilinx Vivado HLS, and the Intel HLS Compiler -- to a rigorous fuzzing campaign using thousands of random, valid C programs that we generated using a modified version of the Csmith tool. For each C program, we compiled it to a hardware design using the HLS tool under test and checked whether that hardware design generates the same output as an executable generated by the GCC compiler. When discrepancies arose between GCC and the HLS tool under test, we reduced the C program to a minimal example in order to zero in on the potential bug. Our testing campaign has revealed that all three HLS tools can be made either to crash or to generate wrong code when given valid C programs, and thereby underlines the need for these increasingly trusted tools to be more rigorously engineered.
Out of 6700 test cases, we found 272 programs that failed in at least one tool, out of which we were able to identify at least 6 unique bugs.
\end{abstract}
\input{intro}
\input{related}
\input{method}
% \input{testing-system-new}
\input{eval}
\input{conclusion}
%\begin{acks}
%For final version of paper.
%\end{acks}
\bigskip
\bibliographystyle{IEEEtran}
\bibliography{conference.bib}
\end{document}
\endinput
%%% Local Variables:
%%% mode: latex
%%% TeX-master: t
%%% End:
|
