What is robots.txt?

In this video we define what is robots.txt

Video transcript

What is robots.txt?

The Robots Exclusion Protocol (or Standard) is a text file, accessible at the root of a website, that tells search engine crawlers which areas of a website should be ignored.

SEO Glossary of Terms

The best way to learn SEO is to understand the most common terms and concepts. Check out these terms next:

Want to boost your SEO?

Instantly turn your blog posts into videos for SEO and social media

Film iconLearn more ->