Reading up on JAX
3 deep · digging since may 06
- Lean Verified Transformers — Lean Verified Transformers
This post shows how to use Lean to write AI-generated proofs verifying equivariance and invariance properties of Transformer neural networks.
- ZeroModels
ZeroModels provides 100+ pretrained transformer models in pure Keras 3 that run on JAX, PyTorch, or TensorFlow without requiring transformers or torch at runtime.
- How To Scale Your Model
This online book teaches LLM scaling through roofline analysis, TPU/GPU hardware, Transformer math, and parallelism techniques to estimate training and inference costs.