Tag: batch normalization

• Batch Normalization

  Batch normalization is a method of reparametrizing any layer, input or hidden, in a deep neural network. Batch Normalization, or BN, resolves the vanishing gradient problem by ensuring that activations remain in the non-saturated regions of non-linear functions. This is achieved by forcing the inputs to have zero mean and unit variance. It resolves the…

  Anu Bhatia

  November 28, 2025

  ai notes

  ai compendium, ai notes, batch normalization, deep learning, gradient descent