AI & LLM · ACR registry
anthropic-ai — robots.txt guide
Legacy Anthropic crawler user-agent.
- robots.txt User-agent
- anthropic-ai
- Company
- Anthropic
- Official documentation
- https://www.anthropic.com/claude-bot
How to allow anthropic-ai in robots.txt
Add an explicit allow rule (recommended when you use specific bot blocks elsewhere):
User-agent: anthropic-ai Allow: /
How to block anthropic-ai in robots.txt
Block this crawler from your entire site:
User-agent: anthropic-ai Disallow: /
Free-check your live policy
Don't guess — run the free AI Bot Checker against all 241 ACR crawlers including anthropic-ai.
Or open the shareable checker page.
Related AI bots
Part of the AI Crawler Registry (ACR) · Best GEO tools 2026