What is robots.txt?
In this video we define what is robots.txt
Video transcript
What is robots.txt?
The Robots Exclusion Protocol (or Standard) is a text file, accessible at the root of a website, that tells search engine crawlers which areas of a website should be ignored.
SEO Glossary of Terms
The best way to learn SEO is to understand the most common terms and concepts. Check out these terms next:
Want to boost your SEO?
Instantly turn your blog posts into videos for SEO and social media
Learn more ->