Building makemore Part 3: Activations & Gradients, BatchNorm

Name: Building makemore Part 3: Activations & Gradients, BatchNorm
Uploaded: 2022-10-04T16:41:03Z
Channel: Andrej Karpathy
Description: We dive into some of the internals of MLPs with multiple layers and scrutinize the statistics of the forward pass activations, backward pass gradients

531.1K views · 3 years ago · 1:55:58

Andrej Karpathy

Educational creator

Oct 4, 2022 · 531.1K views

We dive into some of the internals of MLPs with multiple layers and scrutinize the statistics of the forward pass activations, backward pass gradients