How did ‘large’ language models get that way? The role of Transformers and Pretraining in GPT - LessWrong 2.0 viewer
kept by eddie
The transformer architecture and pretraining enabled enormous scaling of language models, making 'large language models' a fitting description.