Reading up on GuppyLM

1 deep · digging since apr 12

Show HN: I built a tiny LLM to demystify how language models work
GuppyLM is an 8.7M-parameter model trained from scratch in five minutes that simulates a fish named Guppy to illustrate the mechanics of LLMs.