Reading up on attention-mechanism
1 deep · digging since oct 23
- You could have invented transformers from memory
Explains how to independently derive the transformer architecture by reasoning about memory and attention mechanisms, making it accessible to learners.