ZeroModels

kept by eddie sep 11

ZeroModels provides 100+ pretrained transformer models in pure Keras 3 that run on JAX, PyTorch, or TensorFlow without requiring transformers or torch at runtime.

Software is slow because of bad design, not slow languages
Software slowness is primarily due to inefficient design rather than slow programming languages, and rewriting in faster languages like Rust or C rarely yields significant speedups for most programs.
also on TensorFlow, PyTorch
How To Scale Your Model
This online book teaches LLM scaling through roofline analysis, TPU/GPU hardware, Transformer math, and parallelism techniques to estimate training and inference costs.
also on JAX, #machine-learning, #developer-tools
Lean Verified Transformers — Lean Verified Transformers
This post shows how to use Lean to write AI-generated proofs verifying equivariance and invariance properties of Transformer neural networks.
also on JAX, #machine-learning
The Jeff Dean Facts
This piece preserves a collection of humorous 'Jeff Dean Facts' memes that exaggerate his programming abilities, originally from a now-removed Quora post.
also on TensorFlow
LLMs are complicated now – Ian’s Blog
Modern LLMs have grown complex with many attention variants and mixture-of-experts, echoing the messy evolution of recommendation systems.
also on PyTorch, #open-source, #developer-tools