What is Layer Normalization in Deep Learning?

There are a lot of explanations elsewhere, here I’d like to share some example questions in an interview setting.

What is layer normalization in deep learning?

Source : The illustration of layer normalization (left) and batch/power normalization (right). The entries colored in blue show the components used for calculating the statistics.