Robots.txt Generator

Controlling Search Engine Crawlers

A robots.txt file at your site root tells crawlers which paths they may or may not fetch. Use it to keep admin areas, carts, and duplicate pages out of the crawl, and to point bots to your sitemap. Remember it's a directive, not a security boundary — sensitive pages should also be protected server-side. This tool builds a valid file instantly in your browser.