What is robots txt in SEO?

Related questions

1. Where is my robots txt file?
2. What is Sitemap in robots txt?
3. What is Ahrefs bot?
4. What are search bots?
5. What should be in robots txt?
6. Do I need a sitemap?
7. How long does it take for robots txt to take effect?
8. Does Yoast create a sitemap?
9. What does a Googlebot do?
10. What is Bingbot htm?

Tags

1. #which
2. #standard
3. #slash
4. #robots
5. #exclusion
6. #disallow
7. #visit
8. #crawl
9. #robot
10. #search
11. #tells
12. #after
13. #pages
14. #known
15. #often
16. #engines
17. #protocol