What is decay in deep learning?

Related questions

1. What does Optimizer mean?
2. What is the role of Hyperparameters in deep learning?
3. What does weight decay mean?
4. What does batch size mean in keras?
5. What does an optimizer do?
6. Why does Overfitting happen?
7. What is optimization equation?
8. What is the batch size?
9. What is l2 regularization?
10. What is Overfitting CNN?

Tags

1. #learning
2. #range
3. #neural
4. #using
5. #descent
6. #configurable
7. #trained
8. #between
9. #small
10. #stochastic
11. #value
12. #training
13. #specifically
14. #gradient
15. #hyperparameter
16. #networks
17. #positive
18. #algorithm
19. #often