Autoresearch on an old research idea | Blog

kept by eddie mar 24

Using Karpathy's Autoresearch loop with Claude Code, the author reduced mean rank by 54% on an old research project, primarily through bug fixes and hyperparameter tuning.

'The Karpathy Loop': 700 experiments, 2 days, and a glimpse of where AI is heading
Andrej Karpathy's 'autoresearch' AI agent ran 700 experiments in 2 days, discovering 20 optimizations that sped up language model training by 11%.
also on autoresearch, Andrej Karpathy, #ai-research, #ai-agents
A new software engineering paradigm – Blog
Using formal verification, AI agents can generate code and machine‑checked proofs, removing the need for human code review and overcoming the AI‑generated‑code bottleneck.
also on autoresearch, Andrej Karpathy, #developer-tools
Zen and the Art of Machine Learning Research
Success in machine learning research hinges on temperament—persistence, equanimity, and beginner's mind—more than on raw talent or intelligence, akin to Zen practice.
also on Andrej Karpathy, #machine-learning, #ai-research
Microgpt | Hacker News
Andrej Karpathy's microgpt is a 200-line pure Python file that implements the full algorithmic core of a GPT, including training and inference, with all other complexity framed as mere efficiency.
also on Andrej Karpathy, #machine-learning, #open-source, #developer-tools