Robots.txt Generator

Robots.txt is a file that tells search engine crawlers which pages or sections of your site should or should not be crawled and indexed.

Select your user agents, add allow and disallow paths, add your sitemap URL, and click Generate. Copy the output to your website root.

Yes, completely free with no limits.

All generation happens in your browser. No data is transmitted to servers.

Place it at the root of your domain, accessible at yourdomain.com/robots.txt. It must be at the root level to be recognized by crawlers.