Reading up on TPU

: HN commenters analyze Gemini 3.5 Flash's likely parameter count (~250-300B total, 10-16B active) and debate whether frontier models are actually much smaller than rumored.

This online book teaches LLM scaling through roofline analysis, TPU/GPU hardware, Transformer math, and parallelism techniques to estimate training and inference costs.

Anthropic redesigned its performance engineering take-home test three times because Claude models kept solving it, eventually adopting unconventional puzzles to stay ahead.