Reading up on transformer-architecture
1 deep · digging since oct 23
- You could have invented transformers from memory
Explains how to independently derive the transformer architecture by reasoning about memory and attention mechanisms, making it accessible to learners.