Glossary
ClaudeBot
ClaudeBot is Anthropic's training crawler. Claude-User and Claude-SearchBot are the fetch agents used for on-demand retrieval and search. The Fix Report's Technical Access pillar reads robots.txt for each token on the scoring roster. Allowing or blocking training is a separate decision from allowing live fetch. Start with a free homepage score; crawler allow-block ships in the Fix Report.
Why ClaudeBot matters for a Fix Report
Technical Access in the Fix Report scores ClaudeBot as training and Claude-User / Claude-SearchBot as fetch. A single Anthropic rule that only names ClaudeBot does not decide whether Claude can retrieve a page for a live answer. The report shows each token.
FAQ
Frequently Asked Questions
Is ClaudeBot the same as Claude-User?
No. ClaudeBot is Anthropic's training crawler. Claude-User and Claude-SearchBot are fetch agents. The Fix Report's Technical Access table scores them as separate robots.txt tokens.
Related terms
Related Fix Report checks
Deep-dive posts
See ClaudeBot in the Fix Report crawler table
Start with a free homepage score. The $19 Fix Report's Technical Access table scores ClaudeBot separately from Claude-User and Claude-SearchBot.
Get a free homepage score