What is the difference between sigmoid and ReLU?

Related questions

1. What is conv 2d?
2. How do you choose batch size and epochs?
3. What is the purpose of convolution layer?
4. Does cross validation prevent Overfitting?
5. What does changing batch size do?
6. What is batch size in keras?
7. Why does Softmax use EXP?
8. What causes Overfitting?
9. Which is major benefit of reducing batch size?
10. What is flatten in TensorFlow?

Tags

1. #neural
2. #designing
3. #activations
4. #weights
5. #operations
6. #point
7. #computationally
8. #during
9. #adjusted
10. #sigmoid
11. #mathematical
12. #gradient
13. #simpler
14. #consider
15. #region
16. #because
17. #which
18. #involves
19. #descent
20. #expensive