What is weight decay deep learning?

Related questions

1. What is decay in deep learning?
2. What happens when learning rate is too high?
3. What is Hyperparameter in deep learning?
4. What is the problem of overfitting?
5. What does batch size mean in keras?
6. What is dropout in CNN?
7. Is number of epochs a Hyperparameter?
8. What is the role of Hyperparameters in deep learning?
9. What is the batch size?
10. Why is the vanishing gradient a problem?

Tags

1. #slightly
2. #prevents
3. #decay
4. #weights
5. #summary
6. #where
7. #neural
8. #weight
9. #networks
10. #training
11. #factor
12. #quadratic
13. #growing
14. #common
15. #large
16. #gradient
17. #multiplied
18. #descent
19. #update
20. #after
21. #regularization