Back to projects

GPT-2 from Scratch

A GPT-2 language model implemented from scratch in PyTorch, trained to generate Shakespeare-style text.

GPT-2 from Scratch

A from-scratch implementation of the GPT-2 architecture in PyTorch, trained on Shakespeare to demonstrate autoregressive text generation.