What is weight decay in neural networks?

Related questions

1. What is stochastic learning?
2. Is number of epochs a Hyperparameter?
3. What is optimization equation?
4. What is optimizers in neural network?
5. Why Overfitting is a problem?
6. What is inverted dropout?
7. What is Hyperparameter in deep learning?
8. What is Overfitting CNN?
9. How do I know if my learning rate is too high?
10. What is the batch size?

Tags

1. #descent
2. #large
3. #factor
4. #where
5. #decay
6. #common
7. #quadratic
8. #growing
9. #gradient
10. #slightly
11. #weights
12. #prevents
13. #regularization
14. #multiplied
15. #after
16. #weight
17. #update
18. #networks
19. #neural
20. #training