Let's build GPT: from scratch, in code, spelled out.

Name: Let's build GPT: from scratch, in code, spelled out.
Uploaded: 2023-01-17T16:33:27Z
Channel: Andrej Karpathy
Description: We build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3. We talk about connec

7.6M views · 3 years ago · 1:56:20

Andrej Karpathy

Educational creator

Jan 17, 2023 · 7.6M views

We build a Generatively Pretrained Transformer (GPT), following the paper "Attention is All You Need" and OpenAI's GPT-2 / GPT-3. We talk about connec