Reading up on LLaMA 3
2 deep · digging since may 06
- LLMs are becoming commodities
LLMs are rapidly converging in performance, making model choice less important and pushing differentiation toward application, cost, and user experience rather than raw model quality.
- How To Scale Your Model
This online book teaches LLM scaling through roofline analysis, TPU/GPU hardware, Transformer math, and parallelism techniques to estimate training and inference costs.