What is asynchronous stochastic gradient descent?

Related questions

1. How does stochastic gradient descent work?
2. Is gradient descent a convex function?
3. Is gradient descent greedy?
4. What is meant by genetic algorithm?
5. What is cost function gradient descent?
6. Is gradient descent a loss function?
7. What is mini batch gradient descent?
8. Does gradient descent always converge?
9. Can stochastic gradient descent be parallelized?
10. What is stochastic gradient descent used for?

Tags

1. #asynchronous
2. #stochastic
3. #descent
4. #parallelization
5. #improve
6. #speed
7. #furthermore
8. #machine
9. #widely
10. #larger
11. #training
12. #algorithm
13. #order
14. #learning
15. #train
16. #optimization
17. #leverage
18. #scale
19. #gradient
20. #studied