Why do gradients vanish?

Related questions

1. Is Gradient the same as slope?
2. What is the physical significance of gradient?
3. What is the annealing process?
4. What materials can be annealed?
5. What controls the magnitude of a step taken during gradient descent?
6. How do you interpret a gradient?
7. What is gradient descent in linear regression?
8. Why do we need gradient?
9. What is vanilla gradient descent?
10. Can cost function be negative?

Tags

1. #exploding
2. #backpropagation
3. #larger
4. #derivatives
5. #methods
6. #learning
7. #vanishing
8. #activation
9. #values
10. #training
11. #gradient
12. #found
13. #related
14. #based
15. #machine
16. #neural
17. #encountering
18. #functions
19. #difficulty
20. #problem
21. #whose
22. #networks
23. #risks
24. #artificial