robots.txt Generator
Pick the user agents and rules you want.
Loading tool…
Build a robots.txt without remembering the syntax. Choose 'allow all', 'block all', or add granular rules per user agent (Googlebot, Bingbot, GPTBot, others). Add disallow paths, allow exceptions, and a sitemap URL.
We validate the output as you build, so what you copy actually works.