Reading up on Pallas
1 deep · digging since sep 25
- 700 TPS on Kimi K3: A Case for TPU Megakernels
Inferact's TPU‑v7 megakernel for Kimi K3 achieves over 700 tokens per second with speculative decoding, nearly double the GB200 baseline at batch size 1.