Layer Norm
Easy · Solved in PyTorch · Machine learning coding practice
Problem
Layer Normalization (LayerNorm Ba et al., 2016) is a technique to stabilize the hidden states of neural networks. Unlike Batch Normalization, which normalizes across the batch, LayerNorm normalizes the inputs across the features for each specific training example.
Topics: normalization, deep-neural-networks, statistics
The full statement, worked examples, hints and the test suite are available once you sign in. You can then solve Layer Norm in the browser and run it against the tests.