inferact.ai
700 TPS on Kimi K3: A Case for TPU Megakernels
Inferact's TPU‑v7 megakernel for Kimi K3 achieves over 700 tokens per second with speculative decoding, nearly double the GB200 baseline at batch size 1.
One line. Many voicesSeek and you shall find
inferact.ai
Inferact's TPU‑v7 megakernel for Kimi K3 achieves over 700 tokens per second with speculative decoding, nearly double the GB200 baseline at batch size 1.