Robots.txt Generator

Generate professional robots.txt file for your website

Allow/Disallow Rules

robots.txt Code

# robots.txt generated by SEO Tools
# www.robotstxt.org

User-agent: *
Disallow:

What is robots.txt?

robots.txt tells search engines which pages to crawl or ignore. Place this file in your website's root directory (e.g., yourdomain.com/robots.txt).