Coarse Grained FPGA Overlay for Rapid Just-In-Time Accelerator Compilation
Name:
Coarse_Grained_FPGA_Overlay_for_Rapid_Just-In-Time_Accelerator_Compilation.pdf
Size:
1.571Mb
Format:
PDF
Description:
Publisher's version
Type
ArticleDate
2021-09-30Online Publication Date
2021Print Publication Date
2022-06-01Submitted Date
2020-10Permanent link to this record
http://hdl.handle.net/10754/672090
Metadata
Show full item recordAbstract
Coarse-grained FPGA overlays built around the runtime programmable DSP blocks in modern FPGAs can achieve high throughput and improved scalability compared to traditional overlays built without detailed consideration of FPGA architecture. These overlays can be mapped to using higher level compilers, achieving fast compilation, software-like programmability and run-time management, and high-level design abstraction. OpenCL allows programs running on a host computer to launch accelerator kernels which can be compiled at run-time for a specific architecture, thus enabling portability. However, prohibitive hardware compilation times in traditional design flows mean that the tools cannot effectively use just-in-time (JIT) compilation or runtime performance scaling on FPGAs. We present an architecture-optimised FPGA overlay that exploits the capabilities of DSP blocks to maximise throughput and an associated design methodology for runtime compilation of dataflow graphs expressed as OpenCL kernels onto the overlays. The methodology benefits from the high level of abstraction afforded by using the OpenCL programming model, while the mapping to the overlay significantly reduces compilation and load times. Key characteristics of this work include highly performant DSP-optimized functional units that scale to large overlays on modern devices and the ability to perform automatic resource-aware kernel replication up to the size of the overlay for performance scaling. We demonstrate place and route times orders of magnitude better than traditional HLS flows, even when running on an embedded processor in the Xilinx Zynq.Citation
Jain, A. K., Maskell, D. L., & Fahmy, S. A. (2021). Coarse Grained FPGA Overlay for Rapid Just-In-Time Accelerator Compilation. IEEE Transactions on Parallel and Distributed Systems, 1–1. doi:10.1109/tpds.2021.3116859Publisher
IEEEAdditional Links
https://ieeexplore.ieee.org/document/9555373/https://ieeexplore.ieee.org/document/9555373/
https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9555373
ae974a485f413a2113503eed53cd6c53
10.1109/TPDS.2021.3116859
Scopus Count
Except where otherwise noted, this item's license is described as This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.