AI Bot Robots.txt Policy Builder
A robots.txt snippet for AI bots.
Runs in your browser. Nothing is uploaded — your input is processed on this device and discarded when you close the tab.
AI Bot Robots.txt Policy Builder
How to use this tool
- Enter bot names, one per line, and choose Allow or Disallow.
- Press Generate to see the snippet.
- Use Load sample, Copy result or Clear as needed.
Worked example
GPTBot and ClaudeBot with Disallow give one block per bot, each disallowing the site root.
What this tool does not do / Limits
This only writes a text snippet. It does not publish it, enforce it, or connect to any bot, crawler or platform, and bots may or may not respect it.
Frequently asked questions
Does this block a bot for certain?
No. Robots.txt is a request that well-behaved bots follow; it is not access control.
Where do I use the snippet?
In your own robots.txt file, merged with your existing rules by you.
Related tools
Structured Data Generator
Generate JSON-LD for Article, Product, FAQPage, LocalBusiness and more, with live validation against required properties.
LiveRobots.txt and Sitemap Toolkit
A robots.txt rule builder with a URL tester and templates, plus an XML sitemap generator with validation.
LiveOn-Page SEO and Redirect Checker
Enter a URL and get the full redirect chain, status, title and meta checks, heading outline, link counts and a prioritised fix list.
Live