Reading up on FineWeb
2 deep · digging since apr 28
- Rethinking the Data Moat
The piece contends that AI progress is driven chiefly by algorithmic advances and smarter data curation, not merely more data or human expert labels, citing Greenblatt and Bi.
- Show HN: How LLMs Work – Interactive visual guide based on Karpathy's lecture
An interactive visual guide explains how LLMs are built from internet text to conversational assistants, based on Karpathy's lecture.