LLM Inference Accelerator
Jan. 2025 – Apr. 2025Waterloo, ON
I-BERT inference on a PYNQ FPGA, with a focus on hardware compute units and throughput.
- SystemVerilog
- FPGA
- Vivado
- RTL Design
Overview
- Wrote and optimized RTL implementations of systolic arrays, matrix multipliers, softmax, and layer normalization for synthesis on FPGA.
- Developed a suite of throughput-optimized, pipelined compute units in SystemVerilog for the PYNQ FPGA.