What is GoogleBot? How to allow or block Googlebot in robots.txt. Part of the ACR registry. Free-check your site against all 241 crawlers.

Features Pricing Free Tools Help Developers Success Stories Sign in Get started

Search Engine · ACR registry

GoogleBot — robots.txt guide

Google Search indexing crawler.

robots.txt User-agent
Googlebot
Company
Google

How to allow Googlebot in robots.txt

Add an explicit allow rule (recommended when you use specific bot blocks elsewhere):

User-agent: Googlebot
Allow: /

How to block Googlebot in robots.txt

Block this crawler from your entire site:

User-agent: Googlebot
Disallow: /

Free-check your live policy

Don't guess — run the free AI Bot Checker against all 241 ACR crawlers including Googlebot.

Or open the shareable checker page.

Related AI bots

Part of the AI Crawler Registry (ACR) · Best GEO tools 2026

Free AI Visibility Scan