dynomight.net
Why didn't we get GPT-2 in 2005?
GPT-2 wasn't created in 2005 because insufficient compute investment and unclear payoff prevented the feedback loop that later drove rapid LLM advances.
One line. Many voicesSeek and you shall find
dynomight.net
GPT-2 wasn't created in 2005 because insufficient compute investment and unclear payoff prevented the feedback loop that later drove rapid LLM advances.