Reading up on Maarten Grootendorst
1 deep · digging since may 06
- Multi-token-prediction in Gemma 4
Google released Multi-Token Prediction drafters for Gemma 4 that use speculative decoding to achieve up to 3x faster inference without output quality loss.