Why does Overfitting happen?

Related questions

1. What is optimizers in neural network?
2. What is l2 regularization?
3. What is optimization equation?
4. Why is the vanishing gradient a problem?
5. What is decay in deep learning?
6. What happens when learning rate is too high?
7. What is Hyperparameter in deep learning?
8. What does an optimizer do?
9. What does weight decay mean?
10. What is the batch size?

Tags

1. #specifically
2. #overfitting
3. #algorithm
4. #intuitively
5. #model
6. #learning
7. #variance
8. #occurs
9. #statistical
10. #shows
11. #noise
12. #machine
13. #captures