Building an LLM From Scratch

A research quest to build a GPT-style Transformer from the ground up using PyTorch. Trained on 223k characters of poetry, this project explores self-attention, tokenization, and backpropagation to generate creative text.