How to Decide Neural Network Architecture?

There are a lot of explanations elsewhere, here I’d like to share some example questions in an interview setting.

When building a neural network model, how do you decide what should be the architecture of your model?

Source: The mostly complete chart of Neural Networks, explained

Here are some tips for readers’ reference: