Reading up on FlexAttention
1 deep · digging since jun 22
- LLMs are complicated now – Ian’s Blog
Modern LLMs have grown complex with many attention variants and mixture-of-experts, echoing the messy evolution of recommendation systems.
Short for Read Later. Save links from any browser or phone. Click to save, read to clear. The full tour
One topic. Every takeSeek and you shall find