Zen and the Art of Machine Learning Research

kept by eddie jun 16

Success in machine learning research hinges on temperament—persistence, equanimity, and beginner's mind—more than on raw talent or intelligence, akin to Zen practice.

About Those "Hackquisitions"...
Big tech's early 'hackquisitions'—talent deals without full acquisitions—have largely failed, with key hires departing quickly and internal chaos ensuing.
also on Noam Shazeer
Microgpt | Hacker News
Andrej Karpathy's microgpt is a 200-line pure Python file that implements the full algorithmic core of a GPT, including training and inference, with all other complexity framed as mere efficiency.
also on Andrej Karpathy, #education, #machine-learning
Autoresearch on an old research idea | Blog
Using Karpathy's Autoresearch loop with Claude Code, the author reduced mean rank by 54% on an old research project, primarily through bug fixes and hyperparameter tuning.
also on Andrej Karpathy, #machine-learning, #ai-research