Let's reproduce GPT-2 (124M)

Name: Let's reproduce GPT-2 (124M)
Uploaded: 2024-06-09T23:31:35Z
Channel: Andrej Karpathy
Description: We reproduce the GPT-2 (124M) from scratch. This video covers the whole process: First we build the GPT-2 network, then we optimize its training to be

1.1M views · 2 years ago · 4:01:26

Andrej Karpathy

Educational creator

Jun 9, 2024 · 1.1M views

We reproduce the GPT-2 (124M) from scratch. This video covers the whole process: First we build the GPT-2 network, then we optimize its training to be