Learn & Build

Workshops

Hands-on video workshops with interactive Jupyter notebooks. Sign in to watch and code along.

Build Your Own GPT Model

Lecture 1: Micrograd & Backpropagation
Part 1 of 3

Lecture 1: Micrograd & Backpropagation

Build an autograd engine from scratch. Covers derivatives, computation graphs, the chain rule, and training a multi-layer perceptron with gradient descent.

February 15, 2026

Watch workshop
Lecture 2: Bigram Language Model
Part 2 of 3

Lecture 2: Bigram Language Model

Build a character-level language model. Covers bigram statistics, maximum likelihood estimation, softmax, and training a neural network to predict the next character.

February 22, 2026

Watch workshop
Lecture 3: Word Embeddings & MLPs
Part 3 of 3

Lecture 3: Word Embeddings & MLPs

Build a GPT model from scratch using character-level bigram, trigram, and multi-layer perceptron models. Covers word embeddings, softmax, cross-entropy loss, backpropagation, and hyperparameter tuning.

March 1, 2026

Watch workshop