Why Overfitting is a problem?

Related questions

1. What is weight decay in neural networks?
2. What is the batch size?
3. What is decay in deep learning?
4. What is Overfitting CNN?
5. What does batch size mean in keras?
6. Is bigger batch size better?
7. What is optimizers in neural network?
8. What happens when learning rate is too high?
9. Is number of epochs a Hyperparameter?
10. What does Optimizer mean?

Tags

1. #overfitting
2. #generalizability
3. #between
4. #reduces
5. #rather
6. #error
7. #original
8. #relationships
9. #variables
10. #condition
11. #dataset
12. #describe
13. #random
14. #begins
15. #model
16. #statistical
17. #where
18. #complex
19. #problem
20. #outside
21. #occurs
22. #regression