What is ClaudeBot? How to allow or block ClaudeBot in robots.txt. Part of the ACR registry. Free-check your site against all 241 crawlers.

Features Pricing Free Tools Help Developers Success Stories Sign in Get started

AI & LLM · ACR registry

ClaudeBot — robots.txt guide

Anthropic crawler for Claude model training and improvement.

robots.txt User-agent
ClaudeBot
Company
Anthropic
Official documentation
https://www.anthropic.com/claude-bot

How to allow ClaudeBot in robots.txt

Add an explicit allow rule (recommended when you use specific bot blocks elsewhere):

User-agent: ClaudeBot
Allow: /

How to block ClaudeBot in robots.txt

Block this crawler from your entire site:

User-agent: ClaudeBot
Disallow: /

Free-check your live policy

Don't guess — run the free AI Bot Checker against all 241 ACR crawlers including ClaudeBot.

Or open the shareable checker page.

Related AI bots

Part of the AI Crawler Registry (ACR) · Best GEO tools 2026

Free AI Visibility Scan