Free AI Crawlability Checker
Can ChatGPT, Claude, Perplexity, and Gemini actually read your site? We fetch your live robots.txt and test 14 AI crawlers against it — plus llms.txt and sitemap checks. No signup.
Frequently asked questions
Which AI crawlers does this check?
All the crawlers that matter for AI visibility: GPTBot, OAI-SearchBot and ChatGPT-User (OpenAI), ClaudeBot, Claude-SearchBot and Claude-User (Anthropic), PerplexityBot and Perplexity-User, Google-Extended (Gemini training), Bingbot (Copilot), CCBot (Common Crawl), Amazonbot, Applebot-Extended, and meta-externalagent.
Why does blocking AI crawlers hurt my visibility?
AI engines can only recommend and cite content their crawlers can read. Blocking GPTBot or PerplexityBot means ChatGPT search and Perplexity can't index your pages — competitors get cited for the buyer questions you should own.
What's the difference between search, assistant, and training crawlers?
Search crawlers (OAI-SearchBot, PerplexityBot) build the live indexes AI answers cite. Assistant crawlers (ChatGPT-User, Claude-User) fetch pages when a user asks. Training crawlers (GPTBot, CCBot, Google-Extended) feed model training. Blocking search and assistant bots hurts visibility immediately; blocking training bots reduces long-term brand knowledge in models.
Does Google-Extended affect my Google rankings?
No. Google-Extended only controls Gemini model training. Blocking it does not affect Google Search crawling, indexing, or ranking — that's still Googlebot.
Crawlable is step one. Next: find out if AI engines actually mention you.
Check your AI visibility
Get started withAEObot
Scan your brand in seconds and see exactly where you stand in AI search.