What is Bytespider? How to allow or block Bytespider in robots.txt. Part of the ACR registry. Free-check your site against all 241 crawlers.

Features Pricing Free Tools Help Developers Success Stories Sign in Get started

AI & LLM · ACR registry

Bytespider — robots.txt guide

ByteDance/TikTok AI training crawler.

robots.txt User-agent
Bytespider
Company
ByteDance

How to allow Bytespider in robots.txt

Add an explicit allow rule (recommended when you use specific bot blocks elsewhere):

User-agent: Bytespider
Allow: /

How to block Bytespider in robots.txt

Block this crawler from your entire site:

User-agent: Bytespider
Disallow: /

Free-check your live policy

Don't guess — run the free AI Bot Checker against all 241 ACR crawlers including Bytespider.

Or open the shareable checker page.

Related AI bots

Part of the AI Crawler Registry (ACR) · Best GEO tools 2026

Free AI Visibility Scan