The emerging role of SRAM-centric chips in AI inference
kept by eddie
SRAM-centric chips outperform GPUs on memory-bound AI inference workloads, particularly decode, by placing memory near compute for faster bandwidth.