Robots.txt Generator

Generate a robots.txt file for your website to control how search engine crawlers access your pages.

How to Use

1. Set rules for allowed and disallowed paths
2. Specify which bots the rules apply to
3. Add your sitemap URL
4. Generate and download the robots.txt file

Common Rules

• Allow all: User-agent: * / Allow: /
• Block all: User-agent: * / Disallow: /
• Block specific folders: Disallow: /admin/
• Include sitemap: Sitemap: https://example.com/sitemap.xml