Show HN: How LLMs Work – Interactive visual guide based on Karpathy's lecture

kept by eddie apr 28

An interactive visual guide explains how LLMs are built from internet text to conversational assistants, based on Karpathy's lecture.

Rethinking the Data Moat
The piece contends that AI progress is driven chiefly by algorithmic advances and smarter data curation, not merely more data or human expert labels, citing Greenblatt and Bi.
also on FineWeb, #ai
Can a URL in a prompt change an LLM's output?
LLM output is influenced by URLs in prompts only when the URL's content was memorized during training; JavaScript-rendered sites often remain invisible to training crawlers, creating a growing data gap.
also on Common Crawl, #ai
Microgpt | Hacker News
Andrej Karpathy's microgpt is a 200-line pure Python file that implements the full algorithmic core of a GPT, including training and inference, with all other complexity framed as mere efficiency.
also on Andrej Karpathy, #education, #ai
Zen and the Art of Machine Learning Research
Success in machine learning research hinges on temperament—persistence, equanimity, and beginner's mind—more than on raw talent or intelligence, akin to Zen practice.
also on Andrej Karpathy, #education